{"repo":"MarsPain/reward_harness","free":true,"listed":false,"github":"https://github.com/MarsPain/reward_harness","clone":"git clone https://github.com/MarsPain/reward_harness.git","description":"Reward model engineering harness for evolutionary rubric search, deployable RM artifacts, online scoring, and RL experiment lineage.","language":"Python","stars":15,"topics":["automation","reward-modeling","rl","rubric","harness-engineering","harness-framework"],"license":null,"category":"workflow-automation","readme_excerpt":"Reward Harness Legacy name : auto search rubric / autosr — autosr remains supported as a legacy compatibility shim. English 中文 Reward Harness is a Harness engineering project for reward model optimization. It started from the rubric-search idea in Chasing the Tail: Effective Rubric-based Reward Modeling for Large Language Model Post-Training, then grew into a broader system for searching, versioning, serving, tracing, and prototyping closed-loop reward model workflows. This repository keeps iterative as a baseline and uses evolutionary as the default search mode. It now covers the path from automated rubric search to deployable RM artifacts, an RM server for online scoring, and RL experiment registry/lineage tooling that lets external trainers consume the reward service while preserving traceability. Project Status Reward Harness is intentionally paused at the current personal open-source boundary. Stages A-D are the implemented and tested core: long-running rubric search, reproducible run records, deployable RM artifacts, RM server scoring, and RL training manifest/lineage management. Later stages require real RL/RM training resources that this project does not currently assume. Stage E is therefore provided as prototype design documentation rather than active implementation work: docs/design-docs/03-stage-e-classifier-rm.md. It captures the intended next step: using RL training samples to build denoised score/preference datasets and hand them to an external classifier RM tr","default_branch":null,"files":null,"tree":[],"storefront":"/r/MarsPain","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/MarsPain/reward_harness/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}