{"repo":"dqbd/tiktokenizer","free":true,"listed":false,"github":"https://github.com/dqbd/tiktokenizer","clone":"git clone https://github.com/dqbd/tiktokenizer.git","description":"Online playground for OpenAPI tokenizers","language":"TypeScript","stars":1672,"topics":["chatgpt","nextjs","openai","t3-stack","tiktoken","tokenizer"],"license":"MIT","category":"ai-agents","readme_excerpt":"Tiktokenizer Online playground for openai/tiktoken , calculating the correct number of tokens for a given prompt. Special thanks to Diagram for sponsorship and guidance. https://user-images.githubusercontent.com/1443449/222598119-0a5a536e-6785-44ad-ba28-e26e04f15163.mp4 Acknowledgments - T3 Stack - shadcn/ui - openai/tiktoken","default_branch":null,"files":null,"tree":[],"storefront":"/r/dqbd","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/dqbd/tiktokenizer/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}