I think you highlight the problem
People that are ill are ill and then for every one of them there are another 500 using medical labels that give others the impression that they have a problem .
sometimes If you upset somebody by mistake and they will say You are causing me anxiety and making me depressed
Most of the time this would be a load of waffle as all you have done is P$$ed them off !
Most of the ones I have met are not using the labels, they have the problem.
Out of hundreds met I can think of just a handful who may have been simply telling people they have a problem.
Many disabilities - like CFS - are invisible. People tend to judge based on what they see.
You can also have two people exactly same disability one can do a lot and one can do little. Each having limitations but not being the same.