💬

AI for words and text

From how text gets into a model, to why models answer the same question differently, to AI that reads your documents, to translation and proofreading. Put language models to work and see what they do well and where they slip.

Some need a login. A few, like Papago, Bareun, and Kkomantle, are built mainly for Korean.

1

How text gets into a model

Language models read text as pieces called tokens. Compare how many pieces the same sentence becomes in different models.

Tiktokenizer (Token Splitting Explorer)

A tool for seeing how a language model splits text into tokens. Type something and it immediately shows the token count, the colour-coded token pieces and the numeric ID of each token. You can also see the special markers that wrap a conversation before it reaches the model.

The Tokenizer Playground

A page that colors in how your sentence is split into tokens inside an AI model. You can pick and compare the tokenizers of 13 models including GPT-4, Claude, Llama 3, Gemma, Mistral, BERT, and T5.

2

Compare models

Ask several models the same question and read the answers side by side. Try a small model that runs entirely in your browser too.

LM Arena (Compare AI Models)

A site for comparing how several AI models answer the same question. From "Battle Mode" at the top of the screen you send a prompt and get responses from multiple models to weigh against each other, and the site also publishes a model leaderboard. The site shows its name on screen as "Arena".

Ai2 Playground (Try Open Models)

A place to chat directly with the Olmo models released by the Allen Institute for AI (Ai2). The model in use is shown on screen; at the time of capture it was Olmo 3.1 32B Instruct. You can also enable tool calling and add your own tools.

WebLLM Chat (An LLM Running in Your Browser)

A chat service that runs a language model directly inside your browser. Unlike other chatbots, your conversation is processed on your own computer instead of being sent to a server. The interface supports Korean.

3

Ask about your own material

Give it a PDF, a video, or a document and have it answer from that. Click the citations to check the answers really match the source.

ChatPDF (Chat with Your PDFs)

A service where you upload a PDF and then ask questions about its contents. Answers include citations, so you can see which part of the PDF they came from. Besides PDFs it accepts Word, PowerPoint, Markdown, and text files.

Lilys AI (Video and Document Summaries)

A Korean-made service that summarizes YouTube videos, PDFs, web pages, and audio. Beyond summaries it can explain the content in simpler terms or let you keep asking questions about the material. For videos it shows a timestamped transcript alongside a Korean translation.

4

Translation and proofreading

Run the same sentence through two translators and compare, then see what an AI spell checker changes and how.

Papago (Naver Translator)

Naver's translation service, centered on Korean and covering English, Japanese, Chinese, and other languages. Alongside text translation it has separate tabs for image, document, voice, and website translation. Results come with pronunciation playback and a way to rate the translation.

DeepL Translator

A translation service focused on rendering longer text naturally, stated to support more than 100 languages. Besides text translation it offers file and voice translation modes, plus DeepL Write for polishing the wording. It includes controls for formal or informal tone and a glossary for consistent terminology.

Bareun (Korean Spell Checker)

A Korean-made service that uses AI to correct spelling, spacing, and grammar in Korean text. Built by BAIKAL.AI, the same site also offers morphological analysis and a tokenizer. Proper nouns and technical terms can be registered in a user dictionary so the checker takes them into account.

5

Play with word meanings

Get a feel, through games, for how AI measures how close two words are in meaning.

Kkomantle (Korean Word-Similarity Guessing Game)

A Korean word game where you try to guess the day's answer word. Type a word and it reports how close the meaning is to the answer on a scale from -100 to +100, adding a rank if the word is in the top 1,000. Playing it gives you a feel for word embeddings, which compare words by meaning rather than spelling.