# Training Pipeline

a training pipeline generally consists of 3 steps:
1. Design model (input, output size, forward pass (layers))
2. Construct loss and optimizer
3. Training loop
    - forward pass: compute prediction
    - backward pass: gradient computation
    - update parameters

(iterate step 3)