DictionaryAI

lexical analysis

Short definition from Wiktionary

Noun

  1. The conversion of a stream of characters to a stream of meaningful tokens; normally to simplify parsing.

We haven’t written up lexical analysis yet: Simple and Standard meanings, examples and a quiz.