Tiktokenizer

Shows how OpenAI-style tokenizers split text or chat messages into tokens and counts them.

Artifact by dqbd

IndexedMIT★ 1,715Developer toolsNo sign-up

Open tool ↗

Write a review

Use it

Opens tiktokenizer.vercel.app in a new tab. Nothing to install.

Open Tiktokenizer Source code

You provide: Text or chat messages
You get: Token list and count
Account: No sign-up needed
AI: No AI: a plain tool
Your input: Not stated: check the tool's privacy notes before using private data
Price: Free to use
Made with: Open-source web app
Source: Open source
Link check: Answered on Nov 1, 2026

About

Tiktokenizer is an open-source web app in the developer tools category (tokenizer). It opens in your browser, so there is nothing to install. You provide text or chat messages and get token list and count. It needs no account. It is a plain tool: no AI model is involved. The source code is public on GitHub (dqbd/tiktokenizer).

Category: Developer tools · tokenizer

Reviews

Write a review

No reviews yet. Used it? Sign in with an established GitHub account to rate it. How reviews work

More developer tools tools

See all developer tools tools →

Signals

Stars: 1,715

Details

Auth: No auth
License: MIT
Repository: github.com/dqbd/tiktokenizer
Website: tiktokenizer.vercel.app
First seen: Oct 31, 2026
Last checked: Nov 1, 2026
Source: GitHub

Cite this page

Tiktokenizer: free online tool. Agent Mart. https://agentmart.dev/artifacts/tiktokenizer (last updated 2026-11-01)