{"repo":"Picovoice/speech-to-text-benchmark","free":true,"listed":false,"github":"https://github.com/Picovoice/speech-to-text-benchmark","clone":"git clone https://github.com/Picovoice/speech-to-text-benchmark.git","description":"speech to text benchmark framework","language":"Python","stars":697,"topics":["speech-recognition","speech-to-text","deepspeech","voice-recognition","offline","privacy","deep-learning","deep-neural-networks","google-speech-to-text","aws-transcribe"],"license":"Apache-2.0","category":"machine-learning","readme_excerpt":"Speech-to-Text Benchmark Made in Vancouver, Canada by Picovoice This repo is a minimalist and extensible framework for benchmarking different speech-to-text engines. Table of Contents - Data - Metrics - Engines - Usage - Results Data - LibriSpeech - TED-LIUM - Common Voice - Multilingual LibriSpeech - VoxPopuli - Fleurs (Download instructions) Metrics Word Error Rate Word error rate (WER) is the ratio of edit distance between words in a reference transcript and the words in the output of the speech-to-text engine to the number of words in the reference transcript. Punctuation Error Rate Punctuation Error Rate (PER) is the ratio of punctuation-specific errors between a reference transcript and the output of a speech-to-text engine to the number of punctuation-related operations in the reference transcript (more details in Section 3 of Meister et al.). We report PER results for periods (.) and question marks (?). Core-Hour The Core-Hour metric is used to evaluate the computational efficiency of the speech-to-text engine, indicating the number of CPU hours required to process one hour of audio. A speech-to-text engine with lower Core-Hour is more computationally efficient. We omit this metric for cloud-based engines. Word Emission Latency Word emission latency is used to evaluate the responsiveness of streaming speech-to-text engines. It measures the average delay from the point a word has finished being spoken to when its transcription is emitted by the engine. We measure this ","default_branch":null,"files":null,"tree":[],"storefront":"/r/Picovoice","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Picovoice/speech-to-text-benchmark/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}