Xeon E5-2640 unfortunately does not, though still an upgrade of what I have now. Stream limit seems entirely configurable, so that will be just a matter of stress testing.
Won’t lie I always forget about all the new CPU hardware acceleration after using decade old hardware for so long 😅
I didn’t even realize CUDA had a weight on LLMs, thank you!
For whatever reason acorns are her preferred chase toy, which she will literally pick up and throw. Strangest cat I’ve owned yet
The writing really was on the wall, unfortunately
It is our duty to make such a service unusable for its intended purpose.
Minimum wage who?
555 drivers have given me a couple issues on my main PC, I’ve heard of some issues with newer cards but I figure its just a matter of time before better drivers. I haven’t had to touch pci passthroughs yet and I was unsure if theres more a challenge on server hardware with Nvidia, but it sounds like I’ll be happy to have CUDA