OURBIT

Ourbit AI Dictionary

Generative AI

Token

Plain-language meaning

A unit of text or other input represented internally by a model; text tokens may be words, parts of words or punctuation.

Why it matters

Token limits affect how much material a model can process and generate.

Practical example

A long word may be split into several tokens before processing.

Common misunderstanding

Equating one token with one word in every language.

Related concepts

Context window · Large language model (LLM)

Learn and practise

Open the related Ourbit Academy lesson →

Explore relevant AI tools →

References

Reviewed 2026-10-02.

Ask Ourbit

Find public explanations and links, with page-aware routing. Do not enter patient details here; Medical work requires its own protected service.

Ask a question to find explanations and public source links.