mem0-local 0.0 on LongMemEvalllamaindex-memory 0.0 on LongMemEvalllm-baseline 0.0 on LongMemEvalLetta 88.4 on LongMemEvalLetta 87.1 on PersonaMemMem0 85.3 on LongMemEvalMem0 82.9 on LoCoMoZep 83.6 on LongMemEval4 systems independently scored36 systems indexedmem0-local 0.0 on LongMemEvalllamaindex-memory 0.0 on LongMemEvalllm-baseline 0.0 on LongMemEvalLetta 88.4 on LongMemEvalLetta 87.1 on PersonaMemMem0 85.3 on LongMemEvalMem0 82.9 on LoCoMoZep 83.6 on LongMemEval4 systems independently scored36 systems indexed

Run: run_mastra_lcm_001

VERIFIED
SystemMastra
BenchmarkLoCoMo
Harnessv0.9.4
Verified Overall82.4%
Nuance Overall75.9%
DateMay 4, 2026
run_manifest.jsonjson
{
  "version": "1.0.0",
  "runId": "run_mastra_lcm_001",
  "systemId": "sys_mastra",
  "systemName": "Mastra",
  "benchmarkId": "bench_locomo",
  "benchmarkName": "LoCoMo",
  "benchmarkVersion": "1.0",
  "harnessVersion": "0.9.4",
  "judgeModel": "claude-sonnet-4-20250514",
  "judgeTemperature": 0,
  "startedAt": "2026-05-04T09:00:00Z",
  "completedAt": "2026-05-04T10:44:31Z",
  "scores": {
    "verified": {
      "recall": 84.9,
      "temporal": 79.6,
      "reasoning": 81.3,
      "overall": 82.4
    },
    "nuance": {
      "recall": 78.2,
      "temporal": 73.1,
      "reasoning": 74.8,
      "overall": 75.9
    }
  },
  "questionCount": 180,
  "passCount": 144,
  "failCount": 36,
  "merkleRoot": "3c4d5e6f7a8b9c0d1e2f3a4b5c6d7e8f9a0b1c2d3e4f5a6b7c8d9e0f1a2b3c4d"
}

Command Palette

Search for a command to run...