I’m pretty sure the thing about datatypes is wrong. From experience programming shaders the most typical float values were 4 bytes. The physics simulations are run on cpus typically, not gpus, but for graphics processing of all kinds, smaller floats are used. The conclusion is right though.
That doesn’t really matter. Both AI hardware and consumer hardware use the same underlying materials and components. When supply is low due to AI companies hoarding compute, the prices for all the components rise.
Sadly no. AI hardware does not relies on the same fundamentals as consumer hardware.
Long story short AI stuff use Float 4 or 8 because accuracy is not a factor. Games or physics simulation use Float 32 or 64.
I’m pretty sure the thing about datatypes is wrong. From experience programming shaders the most typical float values were 4 bytes. The physics simulations are run on cpus typically, not gpus, but for graphics processing of all kinds, smaller floats are used. The conclusion is right though.
4 bytes not 4 bits, so 32 bits. You can’t do graphics on 4 bits, that’s way too small.
Good catch, thanks
Yeah, even the Game&Watch was 8-bit
But you can use 4bits neural networks.
Some people already replied but I would like to add that even if float type where the right one.
AI dedicated hardware doesn’t bundle stuff you usually espect from a gpu like dedicated encoder and decoders.
The “GPUs” used in these AI datacentres can’t even do graphics anymore. They’re now sloppy approximate matrix math machines.
SAS hard drives and server ECC ram incoming!
That doesn’t really matter. Both AI hardware and consumer hardware use the same underlying materials and components. When supply is low due to AI companies hoarding compute, the prices for all the components rise.