{"repo":"guillaume-be/rust-bert","free":true,"listed":false,"github":"https://github.com/guillaume-be/rust-bert","clone":"git clone https://github.com/guillaume-be/rust-bert.git","description":"Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)","language":"Rust","stars":3077,"topics":["deep-learning","nlp","transformer","bert","rust-lang","rust","machine-learning","ner","sentiment-analysis","question-answering"],"license":"Apache-2.0","category":"machine-learning","readme_excerpt":"rust-bert Rust-native state-of-the-art Natural Language Processing models and pipelines. Port of Hugging Face's Transformers library, using tch-rs or onnxruntime bindings and pre-processing from rust-tokenizers. Supports multi-threaded tokenization and GPU inference. This repository exposes the model base architecture, task-specific heads (see below) and ready-to-use pipelines. Benchmarks are available at the end of this document. Get started with tasks including question answering, named entity recognition, translation, summarization, text generation, conversational agents and more in just a few lines of code: Output: The tasks currently supported include: - Translation - Summarization - Multi-turn dialogue - Zero-shot classification - Sentiment Analysis - Named Entity Recognition - Part of Speech tagging - Question-Answering - Language Generation - Masked Language Model - Sentence Embeddings - Keywords extraction Expand to display the supported models/tasks matrix Sequence classification Token classification Question answering Text Generation Summarization Translation Masked LM Sentence Embeddings :------------: :---------------------------: :------------------------: :----------------------: :-------------------: :-----------------: :---------------: :-------------: :-----------------------: DistilBERT ✅ ✅ ✅ ✅ ✅ MobileBERT ✅ ✅ ✅ ✅ DeBERTa ✅ ✅ ✅ ✅ DeBERTa (v2) ✅ ✅ ✅ ✅ FNet ✅ ✅ ✅ ✅ BERT ✅ ✅ ✅ ✅ ✅ RoBERTa ✅ ✅ ✅ ✅ ✅ GPT ✅ GPT2 ✅ GPT-Neo ✅ GPT-J ✅ BART ✅ ✅ ✅ Marian ✅ MBart ✅ ✅ ","default_branch":null,"files":null,"tree":[],"storefront":"/r/guillaume-be","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/guillaume-be/rust-bert/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}