{"repo":"devnen/qwen3.6-windows-server","free":true,"listed":false,"github":"https://github.com/devnen/qwen3.6-windows-server","clone":"git clone https://github.com/devnen/qwen3.6-windows-server.git","description":"One-click Qwen3.6-27B inference on Windows. 158 tok/s on RTX 5090, 72 tok/s on RTX 3090. Native, no WSL, no Docker, no telemetry.","language":"Python","stars":227,"topics":["llm-inference","local-llm","offline-ai","privacy","qwen","qwen3","rtx-3090","textual-tui","vllm","windows"],"license":null,"category":"machine-learning","readme_excerpt":"qwen3.6-windows-server One-click Qwen3.6-27B inference on Windows. Unzip, double-click, you're serving on http://127.0.0.1:5001/v1 . No WSL, no Docker, no conda, no pip, no admin. Everything runs on your machine. No telemetry. No analytics. No phone-home. --- What this is A small portable Windows app that gives you an OpenAI-compatible API serving Qwen3.6-27B locally, with config presets that I actually measured myself. The launcher is a Textual TUI: arrow keys, Enter to start a snapshot, Esc to stop. Press e to add, edit, duplicate, or delete your own snapshot configs from inside the TUI, no hand-editing files. That's the whole UX. It is the matching launcher for the devnen/vllm-windows patched wheel, but you don't need to know or care about that. The wheel ships inside the launcher zip. What you get On a single RTX 3090 (24 GB), running Lorbus AutoRound INT4: Every snapshot below has the tool-calling fix baked in (PR #35687 + #40861 + qwen3.5-enhanced.jinja + preserve thinking=false ), so any one of them works with any OpenAI-compatible client, Claude Code, Cline, Cursor, Codex, OpenCode, KiloCode, LM Studio, etc. Just point it at the listed port. Snapshot Decode tok/s Prompt class Context Use it when ----------------------- -------------- ------------------- --------- ------------- start 72tps 72 short ( 200 tok) 32 k Short-prompt / chat baseline. MTP n=3. start speed 64.5 long (100 KB) 90 k Default for long prompts. MTP n=6, see note below. start 127k 53.4 long (100 KB) 1","default_branch":null,"files":null,"tree":[],"storefront":"/r/devnen","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/devnen/qwen3.6-windows-server/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}