llamaindex-memory 0.0 on LoCoMollm-baseline 0.0 on LoCoMomem0-local 0.0 on LongMemEvalmem0-local 0.0 on LongMemEvalllamaindex-memory 0.0 on LongMemEvalllm-baseline 0.0 on LongMemEvallangchain-memory 0.0 on LongMemEvalcognee 0.0 on LongMemEval13 systems independently scored64 systems indexedllamaindex-memory 0.0 on LoCoMollm-baseline 0.0 on LoCoMomem0-local 0.0 on LongMemEvalmem0-local 0.0 on LongMemEvalllamaindex-memory 0.0 on LongMemEvalllm-baseline 0.0 on LongMemEvallangchain-memory 0.0 on LongMemEvalcognee 0.0 on LongMemEval13 systems independently scored64 systems indexed

Run: run_97dc7ee145d9

VERIFIED
Systemllm-baseline
BenchmarkLoCoMo
Harnessv0.1.0
Verified Overall0%
Nuance Overall50.370370370370374%
DateMay 12, 2026
run_manifest.jsonjson
{
  "version": "1.0.0",
  "runId": "run_97dc7ee145d9",
  "systemId": "sys_llm-baseline",
  "systemName": "llm-baseline",
  "benchmarkId": "bench_locomo-v1",
  "benchmarkName": "LoCoMo",
  "benchmarkVersion": "1.0",
  "harnessVersion": "0.1.0",
  "judgeModel": "openai/gpt-4o-mini",
  "judgeTemperature": 0,
  "startedAt": "2026-05-12T03:45:13.984686+00:00",
  "completedAt": "2026-05-12T03:49:02.727672+00:00",
  "scores": {
    "verified": {
      "recall": 0,
      "temporal": 0,
      "reasoning": 0,
      "overall": 0
    },
    "nuance": {
      "recall": 44.44444444444444,
      "temporal": 30,
      "reasoning": 76.66666666666667,
      "overall": 50.370370370370374
    }
  },
  "questionCount": 49,
  "passCount": 30,
  "failCount": 19,
  "merkleRoot": "9616139de45d8e11dc44d77da9ca7eaffed71494f09f7a0e48282e75b76de767"
}

Command Palette

Search for a command to run...