I did, math is a step by step learning system, you keep learning new things that requires you to know the previous things you learned really well. I worked my way to calculus in college and it was quite interesting even though I'm not able to do the math again it helps me understand the world better
I just tell myself it's my executive dysfunction but.. I think it's just too much for Everybody