pytorch_learn/06_training pipeline.md

Training Pipeline

a training pipeline generally consists of 3 steps:

1. Design model (input, output size, forward pass (layers))
2. Construct loss and optimizer
3. Training loop
   • forward pass: compute prediction
   • backward pass: gradient computation
   • update parameters

(iterate step 3)