{"repo":"EngTurtle/hermes-memconflict","free":true,"listed":false,"github":"https://github.com/EngTurtle/hermes-memconflict","clone":"git clone https://github.com/EngTurtle/hermes-memconflict.git","description":"Comparison of self-hostable memory providers for the Hermes agent on the MemConflict benchmark","language":"Python","stars":25,"topics":[],"license":"MIT","category":"self-hosted-apps","readme_excerpt":"MemConflict memory-provider benchmark This project compares self-hostable long-term memory providers for the Hermes agent on the MemConflict benchmark. The benchmark measures how well each provider retrieves and uses the memory item that is temporally valid, factually correct, and contextually applicable, in the case where a user's stored facts conflict across multi-session dialogues. Every provider runs the same harness contract. The harness uses MemConflict Step4 4.jsonl (30 personas, 3,750 questions). Each provider emits Model Answer and Retrieved Memories per question. One shared, provider-agnostic scorer judges the output. The headline metric is macro answer accuracy, answer accuracy averaged evenly across the benchmark's conflict categories. The results are also published as an interactive site at . The site has a benchmark report and a conversation browser for the MemConflict dialogues. Documentation Document What it covers --- --- Benchmark report Interactive version of the benchmark matrix: providers, configurations, and results Conversation browser MemConflict dialogues as chat transcripts, with conflict annotations and questions docs/BENCHMARK MATRIX.md Providers, every configuration and feature flag, measured results docs/DECISIONS.md Why the benchmark is built this way, including decisions that were reversed docs/TROUBLESHOOTING.md Symptom, cause, fix, and what did not work benchmark/docker/README.md Container stack, per-provider env var reference, run commands C","default_branch":null,"files":null,"tree":[],"storefront":"/r/EngTurtle","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/EngTurtle/hermes-memconflict/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}