What's the point of cookies? Like, on websites and apps.

I always reject them, but mostly because I never really understood what their purpose was.

Is it to track my info and send me a bunch of emails I don't want? Do websites even need cookies? Why do they use them?