self-attention
Short definition from Wiktionary
Noun
- A form of attention (machine learning method) where input sequence is compared with itself, i.e. the keys and queries are the same.
- Conscious attention to one's own physiological and emotional state and behavior.
We haven’t written up self-attention yet: Simple and Standard meanings, examples and a quiz.