conv.

All stories
TechQuiet · 30h

Token-space font tool lets users visualize LLM tokenization in real time

A new web tool generates custom fonts where each character width equals one LLM token, supporting multiple models and chat platforms.

newest coverage 1d agosummary written 17h ago5 pieces112 likes & upvotes36 comments Hacker NewsMastodonNewswires

What to know

  • The tool generates fonts where character width equals LLM token width, making token boundaries visible in Discord and Slack.
  • Supports 15+ tokenizers and models including OpenAI, DeepSeek, Claude, Llama, Qwen, and Gemini, with user upload options.
  • Works as a Discord Vencord theme or Slack userscript with no custom build required; processing stays local in the browser.
  • Includes compatibility notes for known limitations: Claude boundaries are approximated, some tokenizer versions have normalization errors.

“We strongly recommend entering a specific em's ID so only its messages use the token font.”

Tool documentation · ampdot.mesh.host

ampdot Tool creator

Token-space font tool lets users visualize LLM tokenization in real time
twitter.com

How it unfolded 2 developments, newest first · click a bar or a number to jump articlesposts

Peak 2 pieces in one hour at Sep 25, 8 PM; 5 pieces over 47 hours (2 articles · 3 posts) Sep 25, 8 PM — 2 pieces · 1 article · 1 post — Hacker News 1, Newswires 1Sep 25, 9 PM — quietSep 25, 10 PM — quietSep 25, 11 PM — quietYesterday, 12 AM — quietYesterday, 1 AM — quietYesterday, 2 AM — quietYesterday, 3 AM — quietYesterday, 4 AM — 1 piece · 1 post — Mastodon 1Yesterday, 5 AM — quietYesterday, 6 AM — quietYesterday, 7 AM — quietYesterday, 8 AM — quietYesterday, 9 AM — quietYesterday, 10 AM — quietYesterday, 11 AM — quietYesterday, 12 PM — 2 pieces · 1 article · 1 post — Hacker News 1, Newswires 1Yesterday, 1 PM — quietYesterday, 2 PM — quietYesterday, 3 PM — quietYesterday, 4 PM — quietYesterday, 5 PM — quietYesterday, 6 PM — quietYesterday, 7 PM — quietYesterday, 8 PM — quietYesterday, 9 PM — quietYesterday, 10 PM — quietYesterday, 11 PM — quietToday, 12 AM — quietToday, 1 AM — quietToday, 2 AM — quietToday, 3 AM — quietToday, 4 AM — quietToday, 5 AM — quietToday, 6 AM — quietToday, 7 AM — quietToday, 8 AM — quietToday, 9 AM — quietToday, 10 AM — quietToday, 11 AM — quietToday, 12 PM — quietToday, 1 PM — quietToday, 2 PM — quietToday, 3 PM — quietToday, 4 PM — quietToday, 5 PM — quietToday, 6 PM — quiet ◂ 1 earlier2
yesterday8 AM4 PMtoday8 AMnow · 7:03 PM ET
  1. 2

    Early shares on social platforms

    The tool gained initial visibility on Hacker News and Mastodon as users discovered and shared the token visualization project.

  2. 1

    Token-space font generator launches

    A tool enabling users to generate custom fonts where each character width equals one LLM token became available. The generator supports multiple base fonts and tokenizers including DeepSeek V4.1, OpenAI models, Claude, Llama 3, and others, with integrations for Discord via Vencord theme and Slack via userscript.

    1. 1 outlet Font where each token is equal-width

      first by HN Frontpage, 1d ago

    2. 1 outlet Generate fonts where every LLM token is the same width

      first by HN Frontpage, 1d ago