11 lines
303 B
Markdown
11 lines
303 B
Markdown
# Training Pipeline
|
|
|
|
a training pipeline generally consists of 3 steps:
|
|
1. Design model (input, output size, forward pass (layers))
|
|
2. Construct loss and optimizer
|
|
3. Training loop
|
|
- forward pass: compute prediction
|
|
- backward pass: gradient computation
|
|
- update parameters
|
|
|
|
(iterate step 3) |