I'm sick and tired of the Capitalist religion and all their fanatic believers. The Western right-wing population are the most propagandized and harmful people on Earth.
Primitive propaganda attack on China. Embarrassing that Anthropic goes along with it. Great that the Chinese now have models and coding plans that are on par with claude/claude code, just way way cheaper (Z.ai/glm4.6). I'm ditching Anthropic for Chinese AI.. F these coping *sswhipes..
I have not tested it, but Zluda are are drop-in cuda replacement for non-nvidia gpus. The speed should be great. You could check if your goto card is supported..
A backup drive ? dotfiles (.config) ? /tmp /var/log /boot ? map it into your home for something temporary - Downloads ? Slow audio files ? If you like to tinker for fun: btrfs / bcachefs could perhaps utilize it for something, like automatically offloading unused/slow files to the slow usb ? Raid ? ;) Create a partition and let zram swap compressed unused memory pages to the usb partition (I think it keeps pages compressed now ?). You can also run 'usb over ethernet', so another machine can use it directly - not sure why tho ;)
On a side note. I still use one of my first usb 1.? drives with 32mb in my old router. 32mb is still 12mb more than my first hard drive, and it fits well with the small openwrt packages. It even has a little slide button to select 'floppy drive' mode and a physical 'readonly' mode. I wonder what the smallest/oldest usb stick people still use, are ?
Looks cool and simple. Here's for convenience: https://www.youtube.com/watch?v=IkriZGyjoeU
Neat initiative, but Uh Oh.. you said the cursed word "AI" and won a few downvotes from the angries.
Lordsawar! have cost me many hours in its time. Played the original too. Currently its Tome4, pixel dungeon variants and dungeon crawl stone soup that takes my time.
Keep talking to your ai friend (but make it local/private).
Hah, the first one is almost a 1:1 copy of the US regime change playbook..
"lol here have some communist propaganda in your AI"..
I use google studio only for the purpose to do critical research on Capitalism. It never goes well for the Psycho religion, so I hope some critique gets into their data. If they reject the data, I get wiser and they pay the bill, so..
Damn China's TIME-THEFT !! It's true, they have their own time now with timezones and all - American time-tech stolen from the backs of corn fed American wage-slaves ! Can we ever feel safe again ?!? Stand up, or the Chinese will steal YESTERDAY !
This is just a normal "Surveillance Capitalism". ALL corporations feed on our data and they ALL collect/sell and infringe on our privacy, ALL the time - nothing new here..
"And with that, hopefully we can put this argument to rest."
That's not how the internet works, but nice try though ;-)
Not judging ? I assume you mean 'free' ? It is more difficult now. Groq.com once claimed that they didn't collect data from the free service, but I just checked their privacy rules, and they have now learned the proper Capitalist virtue of surveilling their users and sell their data. Perhaps one of the other fast npu endpoints, cerberus, or sambanova, that are not directly focused on selling data ?
Duckduckgo ai doesn't require login, but are very limited for chat.
Alternatively, pick free Chinese AI services ? I guess the data they can accumulate are pretty useless to them unless you buy much over there, but not sure to be honest.
Maybe a vpn and gpt4free ? Someone can see and train on your messages alright, but they don't know who. This gives different models each time, so maybe not cool.
Something like aihorde maybe okay. Your messages are openly processed elsewhere, but you are not likely to be tracked. There's a lot of personal chat models available. It afaik still requires a 'small' nvidia card to join in. Vpn could help anonymity.
For those that don't mind local AI, there's a setting that uses localhost:8080 as ai endpoint. You can throw open-webui, or ollama/others at that port.
Good thoughts and choices.
A small side tangent: I remember Ubuntu made a small exe file that could install ubuntu on a running windows machine. I cant remember clearly, or fork/develop it, but it could be nice for windows users to have a simple Linux-install.exe app that does all the confusing work for them and perhaps follows your advice here. Just a quick thought..
I dislike the whole idea/musk/maga, but there are problems with wikipedia, and it is naive to think it is unbiased - money and pressure breaks that principle really fast when necessary.
Here, grokopedia were absolutely right about Russia/Ukraine, and surprisingly the first western/US based platform to actually honestly write what Russia says instead of inferring what Russia says/want from ridiculous rumors/claims from the anti-russia campaign/pundits. Wikipedia is filled with biased 'truths' on that article and likely all other high stakes pro-liberal views.
All that unfortunately just means that wikipedias leadership is lying, and that we now have not one, but two biased sources of 'truth'. Each blasting their own path - away from unbiased scientific truth. We cannot trust sources originating from the Western hemisphere where money incentives are above the search for truth. We also see it in our media, where journalists write whatever they are paid to write. Profit and scientific truth only correlate if scientists/oligarchy have the same goal, but usually they don't. Profit and Truth are orthogonal to each other and only overlap at one point.
I wouldn't use/support the private/racist grokopedia - even when verifiably less biased than wikipedia on Russia. I suspect that 'truths' are biased in both. Wikipedia are pretty good at non-controversial topics, but slightly to heavily biased towards the liberal view on most controversial topics (especially current western propaganda topics, bad Russia, bad China, many sexes good, etc). OC the Guardian is at the forefront of deliberate liberal anti-russia propaganda in the West, so they have to write biased claims to keep their readers convinced, and keep the conflict going (money pouring in).
In the end, it is just two right-wing databases fighting for supremacy - anything not right-wing are shut down and other activist - or non-capitalist encyclopedias have been build around on the net instead of fighting wikipedias bias. (no, a 'liberal' is not 'left', they are all capitalists, and thus all following the capitalist doctrines).
Not recommending anything, but; with all the guns Americans have, its pretty wild that such people is still here. Apparently, schools are an easier target..
Compute prices are not going down. If you want a budget friendly compute, then you may need to look for NPU's. They are slower, and is unfortunately also getting more expensive pr TOPS. Electricity prices in the West are going up as a low output gets bought up by datacenters instead. The newest GPU's are more efficient in re. to power pr Top, but they are not budget friendly.
I have not seen a recent comparison of GPU vs Npu; TOPS vs price vs power consumption, but @ aliexpress, I saw a small 40 TOPS Npu as a nvme stick with 16gb ram that draws 10 watts, or so (search for 'ai accelerator nvme'). This little thing can scan files 24/7 and your i5 can help out in peaks. Afaik you can run a distributed model that also runs in, and uses your i5 memory/compute, so if you max out i5 memory, perhaps the combined compute is enough for a larger model ? Maybe a few Npu sticks can work together on the same model ?
Alternatively, you could look for the next version of a Huawei gpu card (first had baby kinks afaik), or one of the other upcoming producers from China. They'll come faster and faster, but are earmarked for local consumption first.
Another suggestion is to buy one of the old P40/80 (from the 'pascal' chipset, I think) (or was it k40/80 ??). They should still support a descent range of modern quantization needs and often have 24gb ram. A refurbished miner card cost around 50-70$+ - cant remember exactly tho.
Lastly, you could try something different. If the i5, with enough memory, can run a large model slowly, you could add a dedicated KV cache, so most of the tokens won't need to be recalculated. Memory and bandwidth are the most important here, but any old server could be upgraded to be a dedicated KV cache server (might need a network upgrade tho!).
Anyway, Ideas are easy and cheap. If I were you, I would ask an AI for a little python app where you can add a product and it returns a graph where it compares with other products and show optimality over time given prices/power and Tops - Gpu vs Npu. Good hunting..
Oi, the US/Plutocratic anti-China propaganda is running in high gears atmo 🙃 Why anyone would believe these obvious moronic claims about 'other guys' doing exactly what US Plutocracy and Capitalism have done for centuries, are beyond me. But they do anyway.. Perhaps complete ignorance of what the West and their contrived ideology are doing in/to the world ? Who knows..
Anyway, congratulations to China for pushing though all the bullshit and continues attacks from US (and its liberal puppets), and because they won against the US Empire of Lies.. In fact, congratulations to all enemies of the psychopathic US Plutocracy: Russia, Iran, North Korea, Cuba, Venezuela, and so on and so on. All victims of the Western ideological dictatorship through a hundred years..
Seems incompatible with Capitalism. 'Surveillance-capitalism' is a huge problem, and no other system in history have gathered so much private data about its citizens. Everything we do on the internet, or in some closed ecosystem, is indirectly monitored and the market system knows all about us, our activities, our social groupings, opinions etc and this knowledge is not used for our benefit. Further, as long as we might influence the system, or as long as we might have digital data 'belonging' to someone else, capitalism will step in and take control of our 'privacy'. We and privacy are a threat to that system..
Paywalled, but interesting topic. Afair, being able to generate internal vision in the same way as our inner voice, is called "Phantasia". "Aphantasia" is the lack of that ability. I learned ~6 months ago that everybody else could actually close their eyes and see a thing in front of them. However, somehow I can still sense movement and some vague 3D shapes of stuff, and that seem to be enough for me to 'navigate' most information.
OC I felt cheated out of ~50 years of opportunities to conjure unwanted images up in other peoples heads ! Cock, sweat, anal, tits, puss, a hot turd between toes, and a million other image generating references that I could have casually snuck into conversations in the most in-appropriate situations .. what a waste of a great supervillain power ! "The Nasty-Visions-Man" was not to arise :-(
Anyway, I'm curious to how blind-born people imagine or sense the physical world. They must have their proprioception and a 3d world model, so they should be able to sense movement/shapes etc like me, and imagine how others move. We all have a dozen+ internal representations of the outside world, and besides the potential for human mis-communication etc, it also hints at how to build a full artificial brain, AGI.
The world is de-dollarizing and the dollar will collapse, so the Oligarchs are trying to create a safe haven for them selves while ordinary peasants burn.. I think they'll fail eventually no matter what they do. The game is up..