The scoreboard
for AI memory.
Bench'd runs memory systems through reproducible benchmark protocols — measuring recall, temporal correctness, failure traces, and how efficiently past experience improves future performance.
Every run is cryptographically signed and publicly verifiable. Spend attestation by ProofMeter (Patent Pending).
LlamaIndex Memory
gbrain
Letta
Independently run, cryptographically signed receipts.
Benchmark Index
Systems indexed across open-source projects, managed memory layers, and agent frameworks.
| # | System | Verified |
|---|---|---|
| 1 | LangMem | 60.0 |
| 2 | LlamaIndex Memory | 59.0 |
| 3 | LLM Baseline (GPT-4o-mini) | 57.6 |
| 4 | LangChain Memory | 34.0 |
| 5 | Mem0 OSS | 32.4 |
| # | System | Verified |
|---|---|---|
| -- | Hindsight | 89.0Self-reported. Not independently run by Bench'd. |
| -- | Mastra | 84.2Self-reported. Not independently run by Bench'd. |
| -- | Supermemory | 81.6Self-reported. Not independently run by Bench'd. |
| -- | Zep | 71.2Self-reported. Not independently run by Bench'd. |
| -- | MemPalace | Pending |
Benchmark Coverage
Official Bench'd runs by benchmark. Listed and self-reported systems excluded.
| System | LongMemEval | LoCoMo | PersonaMem |
|---|---|---|---|
| gbrain | |||
| Letta | |||
| Graphiti | |||
| LangMem | |||
| LlamaIndex Memory | |||
| LLM Baseline (GPT-4o-mini) | |||
| AutoGPT Memory | |||
| CrewAI Memory |
Scoring Model
Exact match, regex, ID retrieval. Pure math. Does not change.
Synthesis and open-ended recall. Contextual. May shift with judge updates.
Latest Signed Receipts
View receiptsOpen Methodology
Claim your system
Connect your official endpoint and verify your results against the public harness.
Claim profileStay in the loop
New benchmark results, methodology updates, and memory system rankings. No spam.
Unsubscribe anytime. We respect your inbox.
All scores are independently run when marked Community-Verified, Vendor-Verified, or Partner-Audited. Listed and Self-Reported systems are clearly labeled. Spend attestation by ProofMeter (Patent Pending).