langchain-memory 0.0 on LongMemEvalcognee 0.0 on LongMemEvalmem0-local 0.0 on LongMemEvalllamaindex-memory 0.0 on LongMemEvalllm-baseline 0.0 on LongMemEvalverifiedstate 0.0 on LongMemEvallangchain-memory 0.0 on LongMemEvalLetta 88.4 on LongMemEval3 systems independently scored36 systems indexedlangchain-memory 0.0 on LongMemEvalcognee 0.0 on LongMemEvalmem0-local 0.0 on LongMemEvalllamaindex-memory 0.0 on LongMemEvalllm-baseline 0.0 on LongMemEvalverifiedstate 0.0 on LongMemEvallangchain-memory 0.0 on LongMemEvalLetta 88.4 on LongMemEval3 systems independently scored36 systems indexed

Run: run_letta_lme_001

VERIFIED
SystemLetta
BenchmarkLongMemEval
Harnessv0.9.4
Verified Overall88.4%
Nuance Overall82.1%
DateMay 8, 2026
run_manifest.jsonjson
{
  "version": "1.0.0",
  "runId": "run_letta_lme_001",
  "systemId": "sys_letta",
  "systemName": "Letta",
  "benchmarkId": "bench_longmemeval",
  "benchmarkName": "LongMemEval",
  "benchmarkVersion": "1.0",
  "harnessVersion": "0.9.4",
  "judgeModel": "claude-sonnet-4-20250514",
  "judgeTemperature": 0,
  "startedAt": "2026-05-08T01:00:00Z",
  "completedAt": "2026-05-08T03:47:13Z",
  "scores": {
    "verified": {
      "recall": 88.7,
      "temporal": 85.1,
      "reasoning": 89.4,
      "overall": 88.4
    },
    "nuance": {
      "recall": 82.3,
      "temporal": 78.9,
      "reasoning": 83.6,
      "overall": 82.1
    }
  },
  "questionCount": 240,
  "passCount": 209,
  "failCount": 31,
  "merkleRoot": "c9d8e7f6a5b4c3d2e1f0a9b8c7d6e5f4a3b2c1d0e9f8a7b6c5d4e3f2a1b0c9d8"
}

Command Palette

Search for a command to run...