openai/tiktoken
Daily GitHub growth and open-source AI ranking profile for openai/tiktoken.
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
openai/tiktoken has 19044 GitHub stars, 1585 forks, 10 stars gained in the last 24 hours, 61 stars gained in the last 7 days.
Repository ranking signals
- Total GitHub stars: 19044
- Forks: 1585
- Stars gained in 24 hours: 10
- Stars gained in 7 days: 61
- Primary language: Python
- AI category: Model Development
- Subcategory: Dataset engineering
- Keywords: Tokenizer
- Top contributors: hauntsaninja, ngoldbaum, l0rinc
- Last repository update: 2026-08-20
Why this page matters
AI Rank monitors openai/tiktoken as part of a daily open-source AI leaderboard. The page is useful for tracking GitHub momentum, category placement, language, contributors, and recent repository activity without manually checking each project.