Training classifier on multiple images

Maybe you could train your model with a multitemporal scene that contains all types of classes and their variability, and apply the model to the other images later.