Well one observation about chrysophytes vs say dinos or cyano, is it takes longer to rebound after being vacuumed out. It would not all be back tomorrow if you vacuumed it out today. It would take a few days to weeks.
Edit: Of course I'm making observations in my own tank. The kingdoms these organisms populate are huge and diverse so I shouldn't really make blanket statements about their potential behavior. Too late!