I never used to clean mine until there was crazy chunky stuff that settled on the bottom. Eventually i couldnt mix a batch without tons of flakes blowing around, at which point i would swirl the container and just dump it all out. Ive actually had so much buildup on the sides that i had to hammer it from the outside to get it all to come off.
Now i just fill my bin with scripps, no more mixing for me.