online learning

(machine learning) The training of a neural network using stochastic gradient descent with a mini-batch size of one; only one input is used for training at a time.