I have the same problem. It's the material combined with perspiration (sweaty hands) that becomes greasy and damaged over the years.
I've got the MX Master and I've noticed that the material is identical on this one, which is a real shame, because it's not at all suitable for people who sweat easily from their hands!