{"repo":"facebookresearch/fairseq2","free":true,"listed":false,"github":"https://github.com/facebookresearch/fairseq2","clone":"git clone https://github.com/facebookresearch/fairseq2.git","description":"FAIR Sequence Modeling Toolkit 2","language":"Python","stars":1144,"topics":["artificial-intelligence","deep-learning","machine-learning","python","pytorch"],"license":"MIT","category":"machine-learning","readme_excerpt":"fairseq2: FAIR Sequence Modeling Toolkit 2 Documentation: Stable, Nightly Install: Linux, macOS, Windows, From Source Contribute: Guidelines fairseq2 is a sequence modeling toolkit that allows researchers to train custom models for content generation tasks. Some of the Recent FAIR Research Based on fairseq2 Omnilingual ASR: Open-Source Multilingual Speech Recognition for 1600+ Languages Bridging Offline and Online Reinforcement Learning for LLMs R.I.P.: Better Models by Survival of the Fittest Prompts Learning to reason for factuality Diverse Preference Optimization Large Concept Models: Language Modeling in a Sentence Representation Space Seamless: Multilingual Expressive and Streaming Speech Translation How is fairseq2 different from the original fairseq? fairseq2 is a start-from-scratch project that can be considered a reboot of the original fairseq to provide a clean, modular API. Notably, it differs from its predecessor in its design philosophy, moving from a monolithic framework to an extensible, much less intrusive architecture allowing researchers to independently own their project code base. As fairseq2 is a complete new project rather than an incremental update to the original fairseq, we intentionally avoided labeling it as fairseq version 2, reflecting its distinct and separate identity. Features First-party recipes for language model instruction finetuning and preference optimization Multi-GPU, multi-node training using DDP, FSDP, and tensor parallelism. Supports","default_branch":null,"files":null,"tree":[],"storefront":"/r/facebookresearch","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/facebookresearch/fairseq2/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}