What to do when you have an image (as in reputation) you don't care for?

Long story short I have an image I don't like but from another point of view I fit it perfectly. It's not really a negative perception but I just don't like I'm being shoved into a stereotype. It's even more infuriating when I try to do my best to not fit into that stereotype. But people still see me as said stereotype.

So what should one do when they have an image they don't care for? Should they try their hardest to change it? Or maybe something else?