When it gets to that point, I say just skip the clean unless it's really noisy and play the record. I know that there can be residues or whatever that can very subtly affect the sound, but I don't buy that they have long term effects. You can always clean later when you're motivated!