{"repo":"alephpi/Texo","free":true,"listed":false,"github":"https://github.com/alephpi/Texo","clone":"git clone https://github.com/alephpi/Texo.git","description":"A minimalist SOTA LaTeX OCR model with only 20M parameters, running in browser. Full training pipeline available for self-reproduction. | 超轻量SOTA LaTeX公式识别模型，仅20M参数量，可在浏览器中运行。训练全流程代码开源，以便自学复现。","language":"Python","stars":883,"topics":["computer-vision","deep-learning","distillation-model","hydra","latex-ocr","machine-learning","python","pytorch","pytorch-lightning","transformers"],"license":"AGPL-3.0","category":"machine-learning","readme_excerpt":"Texo is pronounced as /ˈtɛːkoʊ/ A minimalist free and open-source SOTA LaTeX OCR model which contains only 20M parameters. Try it online Technical report: arXiv, HAL Features - Free and open-source. - Fast and lightweight inference. - Trainable on consumer's-level GPU. - Well organized code as a tutorial. - Running in browser! Prelude Despite a growing number of STEM and AI learners with their note-taking needs today, a free, fast, more accessible yet precise LaTeX OCR tool is still absent. Lying exactly in the comfort zone of machine learning due to the closed vocabulary and less generalization requirements, such classical pattern recognition task can be considered as solved thanks to recent deep learning progress(TrOCR, GOT-2.0, UniMERNet, PPFormulaNet). So here comes the Texo, which tackles this problem in the scope of a personal project. It is also a comprehensive practice to combine the knowledge and experiences I learned so far from school and online, as well as a tentative contribution to my beloved open source community. Performance Texo is a distilled version of PPFormulaNet-S and finetuned on UniMERNet-1M, hence it should preserve the most part of the performance compared to PPFormulaNet-S. Here is the evaluation results on the UniMERNet-Test dataset. Model Params Metric SPE CPE SCE HWE :-------------------------------: :--------------: ------------- ------ ------ ------ ------ UniMERNet-T &dagger; 107M BLEU 0.909 0.902 0.566 0.883 Edit distance 0.066 0.075 0.239 0.","default_branch":null,"files":null,"tree":[],"storefront":"/r/alephpi","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/alephpi/Texo/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}