DictionaryAI

self-attention

Short definition from Wiktionary

Noun

  1. A form of attention (machine learning method) where input sequence is compared with itself, i.e. the keys and queries are the same.
  2. Conscious attention to one's own physiological and emotional state and behavior.

We haven’t written up self-attention yet: Simple and Standard meanings, examples and a quiz.