Why You Forget Me?

Explanation on Catastrophic Forgetting

Start from Naive Regularization

L2-norm Regularization

Want Something that Performs Better?

Introduction to Elastic Weight Consolidation (EWC)

Maybe More Efficiency?

Introduction to Online EWC

A Step Further from EWC

Masking

What's Next?

Direction towards Future