Tag

#attention

Every story tagged attention, newest first.

Microchip with gold circuit paths sits in a white ceramic bowl against a gray background

How a transformer model actually works

Attention is not the model reading your text like a person. It is a weighted lookup that lets every word pull context from every other word at once.

Ahmad J · May 13, 2026 · 4 min read

Wooden typeset compartments filled with metal printing type arranged on a workbench in a studio with windows

Article · aiDeep read

What a context window actually is

A context window is not memory. It is the fixed amount of text a model can look at in a single pass, and everything outside it simply does not exist to the model.

Ahmad J · May 11, 2026 · 4 min read