Tag
language
4 entries tagged language.
Computing & AI
AI & Language Models
- Tokens and EmbeddingsLLMs do not normally read text one character or one word at a time. A tokenizer converts text into integer token IDs representing chunks such as whole short words, word pieces, punctuation, or byte-level patterns.
- What an LLM Actually PredictsAn autoregressive large language model is trained around an almost embarrassingly simple objective: given previous tokens, assign probabilities to the next token.
History & Society
Modern World History
- Empires, Languages, and the States They Leave BehindWhy do people in distant countries use related languages, while neighboring communities sometimes use entirely different ones? Political maps and language maps preserve different layers of history. Empires matter enormously, but they neither erase every older culture nor explain every connection.
Philosophy
Philosophers
- Ludwig WittgensteinLudwig Wittgenstein (1889–1951) is unusual because his early and later work seem almost like two different philosophical projects — and the later project attacks the temptation to build theories much like the earlier one.