Why it matters
Incremental training saves compute. Understanding shapes efficient ML ops.
Advertisement
The architecture
Continue from checkpoint.
New data + rehearsal of old.
Advertisement
How it works end to end
Rehearsal: mix in old data.
Regularization: elastic weight consolidation.
Evaluation: on old + new tasks.