Saw this and a reply from perplexity in their blog essentially said "cos the user asked us to find the information, we do it on behalf of the user and therefore robots.txt doesn't apply"
It is different to how Google crawls and makes a database of info, but... Not sure how I feel. It's a greenfield out there.
High inflation and then a over saturation degrees(no longer a differentiator), people who've been told go to uni and you'll get a better job are left with debt and no better job. In a lot of cases where they don't use their degrees.
Then it goes up each year with inflation.. Even if you're not paying it (since you don't meet the threshold)
Definitely more thought is needed before just 'going to uni'. Eg should you get a trade or study on the job.
"Snake? Snake? Snaaaaaaaaaaaaake!"