Thin Signal Profile picture
https://t.co/Vzy3NXCMqd | https://t.co/vGv3u7z9Bf
Apr 7 6 tweets 3 min read
🧵 MemPalace claims to be "the highest-scoring AI memory system ever benchmarked" I cloned it. Installed it. Ran the benchmarks. Read every line of code. Here's what's actually inside. A thread. Image 1/ The headline claim: 96.6% on LongMemEval, beating Mem0 (~85%), Zep (~85%), Mastra (94.87%)

Problem: MemPalace reports retrieval Recall@5. The others report end-to-end QA accuracy.

Those numbers measure completely different things. You can't put them in the same table. Image