{"repo":"aryn-ai/sycamore","free":true,"listed":false,"github":"https://github.com/aryn-ai/sycamore","clone":"git clone https://github.com/aryn-ai/sycamore.git","description":"🍁 Sycamore is an LLM-powered search and analytics platform for unstructured data.","language":"Python","stars":604,"topics":["ai","dataprep","etl","information-retrieval","llm","ml","nlp","opensearch","search","semantic-search"],"license":"Apache-2.0","category":"machine-learning","readme_excerpt":"Sycamore is an open source, AI-powered document processing engine for ETL, RAG, LLM-based applications, and analytics on unstructured data. Sycamore can partition and enrich a wide range of document types including reports, presentations, transcripts, manuals, and more. It can analyze and chunk complex documents such as PDFs and images with embedded tables, figures, graphs, and other infographics. Check out an example notebook. For processing documents, Sycamore leverages Aryn DocParse (formerly known as the Aryn Partitioning Service), a serverless, GPU-powered API for segmenting and labeling documents, doing OCR, extracting tables and images, and more. It leverages Aryn's state-of-the-art, open source deep learning DETR AI model trained on 80k+ enterprise documents, and it can lead to 6x more accurate data chunking and 2x improved recall on hybrid search or RAG when compared to alternate systems. You can sign-up for free here, or choose to run the Aryn Partitioner locally. Aryn DocParse takes documents and returns the partitioned output in JSON, and you can use Sycamore for additional data extraction, enrichment, transforms, cleaning, and loading into downstream databases. You can choose the LLMs to use with these transforms. Sycamore reliably loads your vector databases and hybrid search engines, including as OpenSearch, ElasticSearch, Pinecone, DuckDB, Qdrant and Weaviate, with higher quality data. The Sycamore framework is built around a scalable and robust abstraction fo","default_branch":null,"files":null,"tree":[],"storefront":"/r/aryn-ai","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/aryn-ai/sycamore/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}