One million Blackwell GPUs would suck down an astonishing 1.875 gigawatts of power. For context, a typical nuclear power plant only produces 1 gigawatt of power.
Fossil fuel-burning plants, whether that's natural gas, coal, or oil, produce even less. There's no way to ramp up nuclear capacity in the time it will take to supply these millions of chips, so much, if not all, of that extra power demand is going to come from carbon-emitting sources.
If you ignore the two fastest growing methods of power generation, which coincidentally are also carbon free, cheap and scalable, the future does indeed look bleak. But solar and wind do exist...
The rest is purely a policy rant. Yes, if productivity increases we need some way of distributing the gains from said productivity increase fairly across the population. But jumping to the conclusion that, since this is a challenge to be solved, the increase in productivity is bad, is just stupid.
There are basically no unsafe ways to get off of a unicycle. You can fall in any direction and just end up standing next to your unicycle. Compare that to a bicycle "over the handle bars"-accident.
Unfortunately the API docs are incomplete (insert obi wan meme here). The seed value is both optional and irrelevant when setting the temperature to 0. I just tested it.
Where in the process does that seed play a role and what do you even mean with numerical noise?
Edit: I feel like I should add that I am very interested in learning more. If you can provide me with any sources to show that GPTs are inherently random I am happy to eat my own hat.
Is there like a list where you can enter your server so that other people use it as an ntp server? Or how did you advertise it to have 2800 requests flooding in?
Crypto is basically cash for online transactions. Pretty niche, but cool and definitely in demand for some situations.
Just how in the real world you're shit outta luck if you lose your wallet. Or if you give someone money, but they laugh you in the face you can either cut your losses or try your luck in a fist fight. It's the same with crypto.
With banks you have a separate authority that can handle all these cases, which is desirable in 99% of all transactions.
Unfortunately it's volatile af, and the most popular crypto currency (Bitcoin)has untenable transaction costs and transaction limitations (10 transactions per second, globally - what a stupid design decision)
For most stuff the pi4 is also enough. Jellyfin (no transcoding) works fine on mine. It takes a bit to generate the chapter images and the timeline peek images when ingesting a new movie, but I've never had any issues with playback.
Some interferences even expose a way to set the "temperature" - higher values of that mean more randomized (feels creative) output, lower values mean less randomness. A temperature of 0 will make the model deterministic.
It does not perform very well when asked to answer a stack overflow question. However, people ask questions differently in chat than on stack overflow. Continuing the conversation yields much better results than zero shot.
Also I have found ChatGPT 4 to be much much better than ChatGPT 3.5. To the point that I basically never use 3.5 any more.
No, it's simply contradicting the claim that it is possible.
We literally don't know how to fix it. We can put on bandaids, like training on "better" data and fine-tune it to say "I don't know" half the time. But the fundamental problem is simply not solved yet.
Eh it's not that great.
If you ignore the two fastest growing methods of power generation, which coincidentally are also carbon free, cheap and scalable, the future does indeed look bleak. But solar and wind do exist...
The rest is purely a policy rant. Yes, if productivity increases we need some way of distributing the gains from said productivity increase fairly across the population. But jumping to the conclusion that, since this is a challenge to be solved, the increase in productivity is bad, is just stupid.