Online Learning & Continual Training

Online Learning & Continual Training#

TikTok's recommendation model sees roughly a billion user interactions every day. If that model were retrained once a month, it would be making predictions about what you want to watch right now based on what people were clicking on thirty days ago. That gap, between the world the model learned from and the world it's currently predicting in, is where performance quietly dies.