Now keep in mind, I do not know the scale of these things but they definitely happen. Especially if you fiddle with it (like overclocking for instance).
So then comes the question - you could have this and full performance or you could not have this and the same performance so why do it?
TL;DR wear and tear fucks up everything everywhere and makes shit less efficient. CPUs are not an exception.