{"repo":"callstackincubator/evals","free":true,"listed":false,"github":"https://github.com/callstackincubator/evals","clone":"git clone https://github.com/callstackincubator/evals.git","description":"A benchmark suite for evaluating how coding models solve real React Native tasks.","language":"TypeScript","stars":110,"topics":["agents","ai","evals","react-native"],"license":"MIT","category":"mobile-apps","readme_excerpt":"A benchmark suite for evaluating how coding models solve real React Native tasks. Available Evals Groups map to top-level folders under evals/ . The current suite contains 134 evals. Group Path Evals Status ----------------- ------------------------- ----: ------ animation evals/animation 13 Active async-state evals/async-state 13 Active expo-router evals/expo-router 11 Active expo-sdk evals/expo-sdk 25 Active expo-ui evals/expo-ui 7 Active lists evals/lists 18 Active navigation evals/navigation 13 Active react-native-apis evals/react-native-apis 9 Active skia evals/skia 25 Active Want a group that is not listed here? Open an issue to request it. Contributions are also welcome. Getting Started OpenCode runs in Docker for solver and judge calls. Credentials reach containers via copied /.local/share/opencode/auth.json , passthrough env vars ( OPENAI , CLOUDFLARE , and others), and an optional repo-level opencode.json . See docs/opencode-docker.md for the full mount and secrets reference. For debugging OpenCode runs, pass --agent-logs to stream agent/session events, or --verbose for per-call session heartbeats and phase traces ( --verbose also enables agent logs). Both flags work on run.ts and judge.ts . For full command reference and workflows, see docs and CONTRIBUTING.md. Whitepaper Methodology and scoring details are documented in the benchmark methodology whitepaper. The benchmark evaluates model-generated React Native implementations using requirement-based assessment. Eac","default_branch":null,"files":null,"tree":[],"storefront":"/r/callstackincubator","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/callstackincubator/evals/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}