online learning

Short definition from Wiktionary

Noun

1. 1
   The training of a neural network using stochastic gradient descent with a mini-batch size of one; only one input is used for training at a time.