mem0-local 0.0 on LongMemEvalllamaindex-memory 0.0 on LongMemEvalllm-baseline 0.0 on LongMemEvalLetta 88.4 on LongMemEvalLetta 87.1 on PersonaMemMem0 85.3 on LongMemEvalMem0 82.9 on LoCoMoZep 83.6 on LongMemEval4 systems independently scored36 systems indexedmem0-local 0.0 on LongMemEvalllamaindex-memory 0.0 on LongMemEvalllm-baseline 0.0 on LongMemEvalLetta 88.4 on LongMemEvalLetta 87.1 on PersonaMemMem0 85.3 on LongMemEvalMem0 82.9 on LoCoMoZep 83.6 on LongMemEval4 systems independently scored36 systems indexed

Run: run_langchain_lme_001

VERIFIED
SystemLangChain Memory
BenchmarkLongMemEval
Harnessv0.9.4
Verified Overall72.1%
Nuance Overall65.6%
DateApr 29, 2026
run_manifest.jsonjson
{
  "version": "1.0.0",
  "runId": "run_langchain_lme_001",
  "systemId": "sys_langchain_memory",
  "systemName": "LangChain Memory",
  "benchmarkId": "bench_longmemeval",
  "benchmarkName": "LongMemEval",
  "benchmarkVersion": "1.0",
  "harnessVersion": "0.9.4",
  "judgeModel": "claude-sonnet-4-20250514",
  "judgeTemperature": 0,
  "startedAt": "2026-04-29T02:00:00Z",
  "completedAt": "2026-04-29T04:18:39Z",
  "scores": {
    "verified": {
      "recall": 76.9,
      "temporal": 67.3,
      "reasoning": 70.2,
      "overall": 72.1
    },
    "nuance": {
      "recall": 70.4,
      "temporal": 60.8,
      "reasoning": 63.7,
      "overall": 65.6
    }
  },
  "questionCount": 240,
  "passCount": 167,
  "failCount": 73,
  "merkleRoot": "c9d0e1f2a3b4c5d6e7f8a9b0c1d2e3f4a5b6c7d8e9f0a1b2c3d4e5f6a7b8c9d0"
}

Command Palette

Search for a command to run...