openai/tiktoken
Daily GitHub growth and open-source AI ranking profile for openai/tiktoken.
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
openai/tiktoken has 18659 GitHub stars, 1524 forks, 9 stars gained in the last 24 hours, 59 stars gained in the last 7 days.
Repository ranking signals
- Total GitHub stars: 18659
- Forks: 1524
- Stars gained in 24 hours: 9
- Stars gained in 7 days: 59
- Primary language: Python
- AI category: Model Development
- Subcategory: Dataset engineering
- Keywords: Tokenizer
- Top contributors: hauntsaninja, ngoldbaum, l0rinc
- Last repository update: 2026-07-03
Why this page matters
AI Rank monitors openai/tiktoken as part of a daily open-source AI leaderboard. The page is useful for tracking GitHub momentum, category placement, language, contributors, and recent repository activity without manually checking each project.