Welcome to the Machine Intelligence and Neural Technologies (MINT) Lab at Vanderbilt University! We are an undergradate team under Dr. Kolouri, focusing on the catastrophic forgetting phenomenon in the area of continual learning.

But wait. What is catastrophic forgetting? Check out our first project that thoroughly explains this term using relatively simple examples.

Under Dr. Kolouri’s guidance, we have surveyed existing methods to solve the catastrophic forgetting, including Elastic Weight Consolidation (EWC), Synapsis intelligence (SI), etc. Check out our project page, which contains a series of explanations, examples, and experiments on those methods.

In the future, we will continue to expand our survey list and explore selective forgetting, a technique to make previously trained synapsis plastic again. For now, we are researching the masking technique, such that we fix the weights of a certain number of neurons in the model to maintain the model performance. Check this post if you are interested in masking.

Before we continue, we want to truly appreciate Dr. Kolouri for leading us into the area of continual learning and offering a tremendous amount of help during this project. It would be impossible for us to finish the project and the website without Dr. Kolouri.