{"repo":"ranausmanai/tinyforge","free":true,"listed":false,"github":"https://github.com/ranausmanai/tinyforge","clone":"git clone https://github.com/ranausmanai/tinyforge.git","description":"A tiny model that teaches itself to code better. On your laptop. No cloud. No teacher model. No human feedback.","language":"Python","stars":68,"topics":["ai","code-generation","local-llm","machine-learning","python","reinforcement-learning","self-improving"],"license":null,"category":"machine-learning","readme_excerpt":"🔥 tinyforge A tiny model that teaches itself to get better — at anything with a test. On your laptop. 6GB RAM. No cloud. No teacher model. No human feedback. We discovered that a 0.8B parameter model can meaningfully improve itself by learning from its own failures — using only 6GB of RAM on a MacBook Air. We proved it on code. The technique works anywhere you can automatically verify the output. 🧠 What this actually does The model tries to solve coding problems. It fails. It sees exactly what failed (which test, what input, what it expected vs what it got). It tries again. When it finds a better solution, we extract the weak-to-strong pair and train the model on it. This is self-play for code. The \"game\" is passing tests. 📊 Key Results All results are on fresh holdout slices the model never saw during training. 🔧 The repair training effect Fresh HumanEval slice 40-47: Setup Public Tests Hidden HumanEval+ :--- ---: ---: Base model, single-pass 16/50 2/8 Repair-trained, single-pass 28/50 4/8 Base model + evolutionary search 42/50 5/8 Repair-trained + evolutionary search 44/50 6/8 📈 Single-pass improved 75% (16 → 28) just from training on 13 self-generated repair pairs. 🔄 The feedback loop effect Fresh HumanEval slice 56-63 (overnight run): Setup Public Tests Hidden HumanEval+ :--- ---: ---: Base adapter + feedback loop 42/58 4/8 Repair-trained + feedback loop 47/58 5/8 💡 The trained model doesn't just write better code — it becomes a better participant in the repair loo","default_branch":null,"files":null,"tree":[],"storefront":"/r/ranausmanai","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ranausmanai/tinyforge/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}