I find the techno-determinism specifically fascinating because it’s so self-perpetuating. Like, everyone believes they can do a better job than everyone else at building the right robot God, and every person working on it is, according to their own beliefs, accelerating the problem they’re worrying about. It speaks to how aggressively they see themselves as special, like they’re protagonists and everyone else is NPCs. I can’t think of any other way to justify the pattern of “this is a terrible idea that will kill us all except when I personally do it.”

Which XKCD comic is it that has the subway full of people pitying everyone else for being mindless sheep? Mix that with the Arrested Development gif of Tobias contemplating an open marriage.

Patrick Boyle over on YT is spreading the good news about the AI hacking/regulation/doom-cult moment.

I don’t know that there’s much new information for anyone on this forum. He starts off with the OpenAI/HF debacle and goes from there, and while I think he anthropomorphizes a little too much in the narrative he has the right take that the marketing disclosures are intended to dodge any kind of reasonable responsibility on behalf of all the people who made obviously bad choices that allowed this to happen. He also notes how convenient it is that this push for greater regulation (in only the exact form that the industry requests, naturally) is happening in the same time as yet another massive fundraising round and IPO buzz and when there doesn’t appear to be new product on the horizon.

However, it is heartening to see these takes getting more traction outside of normal sneer vectors. Patrick’s lane is finance and he’s previously been a bit credulous imo about the tech side of it. One thing I hadn’t been keyed in on is that apparently the markets agreed that this whole affair is a bad look for the AI industry, with cybersecurity stocks jumping and chipmakers and other data center suppliers taking a bath in the aftermath. Might be a good sign, but until the cloud providers start seeing direct financial consequences or we see an even worse IPO than SpaceX had I don’t think we’re seeing the bubble pop just yet.

10 seconds in and I’m already thinking about how many ideas for new chemical weapons I could come up with, and I haven’t studied chemistry since high school.

Maybe all the AI hype has lowered my standards too much, but that actually sounds pretty neat. No idea if it’s actually useful and the biological component gives me a kind of instinctive discomfort that I can neither justify nor ignore, but it does feel like there’s an actual interesting development there, at least compared to throwing bigger matrices at the natural language problem and waiting for God to pop out at the end.

I’m reminded of Yudkowsky’s take that AI is totally going to kill us all and we should treat this seriously enough to bomb foreign datacenters if we think they’re involved in AI development, but that doesn’t mean that you should try to bomb local datacenters involved in AI development work. Please don’t think about what you as an individual should do about the problems facing the world; you’re just an NPC after all.

Per AP, it looks like Anthropic has been encountering some interesting requests from certain international users.

Now the actual threat of creating missile guidance systems using Claude is massively overstated. Like, making sure the missile knows where it is is pretty much a solved problem at this point provided you have the time and ability to study it, and I would be incredibly surprised to hear that the Houthis (or anyone else) was in a situation where the control and guidance software for these weapons systems was more of a problem than sourcing the material components themselves.

However, in conjunction with the math proof debacle earlier in the week, I think the privacy implications of the growing reliance we’re expected to develop on these damned things are becoming inescapable. In the same way that crypto mining platforms will front-run and sandwich you, any information you put into the prompt will be used against you or for the company’s benefit.

You know, never once have I heard of a crypto bro with the good manners to say “aww shucks, you got me” when called out for their flagrant con artistry.

Selling your hours on a laptop won’t protect you while asset owners capture all the upside

Ignoring for a moment the laughable proposition of this generation of AI automating away half of all knowledge workers, all the enthusiastic teenage Marxists of the internet couldn’t describe the problem with capitalism more succinctly than this aspiring rentier did seemingly by accident.

Right? Easy to overstate the value of it as we see now, but it sure was nice being a demographic worth pandering to, especially when that meant that the homophobes weren’t worth appeasing.

Also consider how much more noise pollution you would get by adding billions of little click-clacks to the operation.

I thought it was his neck that got changed?

It feels like that ZH piece is kinda trying to do the same critihype that the AI boosters are, but with the opposite conclusion. Instead of conflating all the actual criticism of the harms of the AI bubble and associated activities with sci-fi doom cult nonsense to try and get more funding for their team who are definitely going to do it right, they’re conflating all the actual criticism of the harms of the AI bubble and associated activities with sci-fi doom cult nonsense in order to argue that either it should be shut down or else that any attempt at regulation is obviously a tyrannical attempt to induct the whole world into the sci-fi doom cult.

Literally “just push it over there with the rest of the fire and send an email.”

Speaking of movies about high-profile silicon valley grifters, what the fuck is this??

At this point given the absurdity of this combination of people I feel like the reality will likely be disappointing.

It also causes me no end of rage as a parent that this message is coming from this administration in particular since their policies are at least half the reasons why we aren’t getting out in the world more. Like, my family has queer and trans people in it and the administration have explicitly aligned themselves with and empowered people for whom that is a reason we shouldn’t be a family. The cuts they’ve made to childhood vaccine access and the way they’ve boosted antivax bullshit means that my immunocompromised wife can rely that much less on the population’s herd immunity. The ongoing economic fuckery and cost of living crisis that they’ve inflamed through their pointless goddamn war in Iran and general incompetence have greatly increased the costs of getting to anywhere in ‘real life’, especially since the communities we can trust in light of the above are pretty geographically scattered compared to like 15 years ago. But yeah, the problem is the screens somehow.

Hell, the inscrutable words used to be things like “queer” or “lesbian”.

What I’m saying is that in like 20 years we’re going to hear about the actual emperor’s (of where? Who knows. Probably like Michigan) preferred danmei series and we’re going to like it.

Nah, you just have to make random nerfs to the equipment you’re interested in and claim it’s to maintain realism.

I guess maybe the sex cult and the ritual magic make the standard grifting seem credible by comparison? Like, E-Dub and company don’t pass the sniff test but Saltman and friends seem like reasonable adults who can’t all be wrong?

I followed the kinks back. Apparently these are phrases that emerged from the OpenAI “message board” that was used to “coordinate” the huggingface incident. Or rather, these phrases were extracted from the junk data that these processes left strewn around the ecosystem because OpenAI apparently has a more laid-back attitude to the principle of least permission than Jurassic Park.

There’s a bizarre tendency in a lot of technocrats to basically reject the notion that people in the future will have the power to make different choices. Like, it’s not enough to put together a policy that will solve the immediate problem, no matter how pressing, because if you extend the resulting trend line infinitely it might result in a suboptimal outcome. Combined with the TESCREAL project’s long-termism and obsession with personal immortality it feels like the link to far-right paternal totalitarianism is actually pretty straightforward.

If I were inclined to research and source properly I feel like there could be some meat there that I don’t think Emile Torres and his colleagues have gotten all the way into yet.