attention

Computing & AI

AI & Language Models

• Transformer AttentionAttention lets each token build a new representation by selectively combining information from other tokens in the context.