{"repo":"jimmc414/onefilellm","free":true,"listed":false,"github":"https://github.com/jimmc414/onefilellm","clone":"git clone https://github.com/jimmc414/onefilellm.git","description":"Specify a github or local repo, github pull request, arXiv or Sci-Hub paper, Youtube transcript or documentation URL on the web and scrape into a text file and clipboard for easier LLM ingestion","language":"Python","stars":2009,"topics":["arxiv","github","llm","tiktoken","youtube-transcript-api","doi","ipynb","pdf","pmid","sci-hub"],"license":"MIT","category":"ai-agents","readme_excerpt":"OneFileLLM Content Aggregator for LLMs - Aggregate and structure multi-source data into a single XML file for LLM context. Description OneFileLLM is a command-line tool that automates data aggregation from various sources (local files, GitHub repos, web pages, PDFs, YouTube transcripts, etc.) and combines them into a single, structured XML output that's automatically copied to your clipboard for use with Large Language Models. Installation Pip install OneFileLLM is also available as a pip package. You can install it directly and use both the CLI and Python API without cloning the repository: Command-Line Interface (CLI) This project can also be installed as a command-line tool, which allows you to run onefilellm directly from your terminal. CLI Installation To install the CLI, run the following command in the project's root directory: This will install the package in \"editable\" mode, meaning any changes you make to the source code will be immediately available to the command-line tool. CLI Usage Once installed, you can use the onefilellm command instead of python onefilellm.py . Synopsis: onefilellm [OPTIONS] [INPUT SOURCES...] Example: All other command-line arguments and options work the same as the script-based approach. For GitHub API access (recommended): Python API After installing via pip, OneFileLLM can be invoked directly from Python code. Command Help bash python onefilellm.py research paper.pdf config.yaml src/ python onefilellm.py .py requirements.txt docs/ README","default_branch":null,"files":null,"tree":[],"storefront":"/r/jimmc414","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/jimmc414/onefilellm/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}