Attention Detective
attention • qkv • softmax
🕵️ Attention Detective
Type a sentence → click a word → beams show who it “cares” about.
✍️ Write your own sentence
Try pronouns: “it / she / he / they”
📍 Positional Encoding
strength0.70
⚡ Live Beams Stage
Heads:
Thetrophydoesn'tfitinthebrownsuitcasebecauseitistoosmall.
👁️ Grammar Eye
🧠 Meaning Eye
🧭 Distance Eye
🎲 Chaos Eye
🧩 Q / K / V (kid version)
Query = “I am asking!” • Key = “Do I match?” • Value = “Bring this info!”
Click a word to see its Q, and everyone’s K & V.
🧾 Detective Report
Hover heads & words. Click a word: beams show who it “looks at”.
Click any word to get “best friend” per head.
What is Softmax? 🎚️
Softmax is like sharing candy fairly. Big score gets more candy, but everyone gets some.
What is Positional Encoding? 📍
Words need seat numbers. Same word in a different seat can mean a different thing.