Query-Key-Value Interaction

Break down of the attention mechanism: a "Query" vector scans "Key" vectors to calculate relevance scores, determining how much information to retrieve from "Values".

Attention Mechanism: Query matching Key

Score: 0.00
Watch "it" (Query) scan other words (Keys) to find "animal".