matteoteodori.llm-tokenizer

LLM Tokenizer

Total downloads

10,529

7d gain

1,443

Rolling weekly delta

Rating

5.00 / 5

1 review

Version

2.2.1

Latest published

Activity

Extension trends

Manifest

Metadata

Namespace: matteoteodori
Name: llm-tokenizer
License: MIT
Homepage: https://github.com/matteo-teodori/llm-tokenizer#readme
Repository: https://github.com/matteo-teodori/llm-tokenizer.git
Reviews: 1

Taxonomy

Categories

Machine Learning Other

Description

Count tokens for 93 AI models directly in your editor — exact wherever a model's tokenizer is published (GPT-5.6 and earlier, Llama, Gemini, DeepSeek, Qwen, Mistral and more), clearly labelled estimates where it is not (Claude, Grok, GPT-6 and a few others).

Archive

Release history

14 latest releases