{"repo":"sammcj/ingest","free":true,"listed":false,"github":"https://github.com/sammcj/ingest","clone":"git clone https://github.com/sammcj/ingest.git","description":"Parse files (e.g. code repos) and websites to clipboard or a file for ingestions by AI / LLMs","language":"Go","stars":385,"topics":["ai","codegen","ingest","llama","llm","ollama"],"license":"MIT","category":"ai-agents","readme_excerpt":"Ingest Ingest parses directories of plain text files, such as source code, into a single markdown file suitable for ingestion by AI/LLMs. --- Ingest can also pass the prompt directly to any OpenAI compatible API for processing. And ingest web URLs. Features - Traverse directory structures and generate a tree view - Include/exclude files based on glob patterns - Compress code using Tree-sitter to extract key structural information while omitting implementation details - Parse output directly to any OpenAI compatible API for processing - Generate and include git diffs and logs - Count tokens using a bundled offline tokeniser (default) or optionally use the Anthropic API (API key required, but no charge for counting) - Customisable output templates - Copy output to clipboard (when available) - Export to file or print to console - Optional JSON output - Optionally save output to a file in /ingest - Shell completions for Bash, Zsh, and Fish - Web crawling to ingest web pages as Markdown - PDF to markdown conversion and ingestion Ingest Intro (\"Podcast\" Episode): Installation go install (recommended) Make sure you have Go installed on your system, then run: curl I don't recommend this method as it's not as easy to update, but you can use the following command: Manual install 1. Download the latest release from the releases page 2. Move the binary to a directory in your PATH, e.g. mv ingest /usr/local/bin/ingest Usage Basic usage: ingest will default to the current working directory","default_branch":null,"files":null,"tree":[],"storefront":"/r/sammcj","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/sammcj/ingest/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}