MQA (shapes)
Attention by shapes · 10 of 11
The idea
Section titled “The idea”Head 1 keeps K and V. Heads 2…H only project Q and borrow that drawer. Cache size drops by about the head count.
Where the story continues
Section titled “Where the story continues”The film-backed teaching deck — drawers shrinking by H — lives on MQA. This page is the matrix-flow view of the same idea.
Live diagram
Section titled “Live diagram”Next: GQA (shapes)