Awesome thanks! Please consider a step by step self-host installation guide for non-technical people. I’m confortable with the command line but know nothing about docker.

Do you need a YT account or it’s like Freetube?

Las Lenovo Thinkpad son lo mas recomendado con razón, pero suelen ser bastantes caras aquí en Latinoamerica. Una buena opción más económica son las Lenovo Thinkbook, tengo una con Debían instalado y funciona todo.

Solved. I was using a config file generated using the Export Settings button, but llama-server --webui-config-fle doesn’t understand it because it has extra params, only the config entry of the saved json file should be passed to llama-server webui flag. No errors show up in the browser’s console, qwen pointed me out the conflict.

deleted by creator

Thanks! yeah, the configuration has passed through and I can see the correct settings there, but they don’t show up in the Settings and I also checked that they are no “loaded”, e.g. the model ignores the system prompt of the config file, something that doesn’t happen when I load the config file manually.

Good catch. Yeah I run both browsers from flatpak. The weird thing is that the presets.ini and mcp-servers.json files are loaded without issues.

LineageOS, good enough to degoogle and if it’s possible for you to use F-Droid-only apps you are out of the surveillance machinery (with the exception of the TSP if you use a SIM card) and it’s a huge step from stock Android in terms of privacy.

If Torvalds and Debian are OK using AI and if I were against it, I would at least consider the possibility that may be I’m wrong about it.

Check Posteo. Working great for me since I left gmail.

You shouldn’t use an LLM to do your homework but you can certainly use it to learn and clarify things you don’t understand. I teach math and physics and tested local LLMs for learning and I can say they really help, at least in these subjects. The best option is to learn from books and making your homework, but when you’re stuck with something that you don’t understand, ask a good LLM to clarify things, give examples and context. I tested myself while learning about differential geometry and relativity, it really speeds up the learning process and understanding. But don’t use them as a primary source, nothing beats a good book and practice on that. I wish there was something like that when I was in college, I wouldn’t have carried some misunderstandings so many years. Being just a tool it’s up to you if you use it responsibly or not, as any other tool.

Someone reported q5_1 having indistinguishable results from q8 for kV cache up to 130k IIRC. You could give it a try.

Awesome. Any known public instance working?

Cool! Any theme that could be a good match?

There are lots of scientific groups that work in the so called soft sciences that apply the usual methods of the hard sciences. It’s not about soft or hard, it’s about good or bad.

So it seems that letting LLMs to write sloppy posts for us can be useful after all. May be c/privacy should implement an automatic AI reformating XD

I mean… yeah, you have to be pretty crazy to be happy living in this world as it is right now.

So you had to go to the meme version of the story to ease your pain about a non-specialist using AI to find a novel treatment that successfully made his dog’s cancer recede?

deleted by creator

Interesting, I’ll check it out. I see the flapak release, will you make it available from flathub?