Tag
language
3 entries tagged language.
Computing & AI
AI & Language Models
- Tokens and EmbeddingsLLMs do not normally read text one character or one word at a time. A tokenizer converts text into integer token IDs representing chunks such as whole short words, word pieces, punctuation, or bytelevel patterns.
- What an LLM Actually PredictsAn autoregressive large language model is trained around an almost embarrassingly simple objective: given previous tokens, assign probabilities to the next token.
Philosophy
Philosophers
- Ludwig WittgensteinLudwig Wittgenstein (1889–1951) is unusual because his early and later work seem almost like two different philosophical projects — and the later project attacks the temptation to build theories much like the earlier one.