Scaled Dot-Product

Scaled dot-product scores

Each row is a token asking how much it should read from every position — softmax turns scores into weights.