Hi gus,
thx for the reply.
The issue is on the knob caps themselves, and only the lined ones. Swapping to another pot didn't help, some caps seem to be a bit damaged inside which explains the play on the axle. Inside the lined caps the white plastic has three a bit higher holding lines, of which one is scrubbed out pretty much. On a second pot cap I removed for taking a look inside, even a little piece of on of theses holding lines broke out.
I attached some images, so you get a better idea what I mean.