Haha, that sounds like procrastination to me.

There are tools like crontab.guru which helped me get started.

Not necessarly, I’d say. We’ve seen many releases with multiple sizes and the 27B class has been around since at least the Gemma3 times.

I hope an instruction tuned will be released as well.

I find the overall parameter size interesting. On 16GB VRAM the whole thing fits at an excellent quantisation without having to offload anything to system RAM and taking hits on PP & TG.

According to the officially reported benchmarks, Ling wins on GPQA Diamond (73.4 vs. 64.6) and BFCLv4 (62.72 vs. 62.3). No other overlaps.

That being said, I’m neither trusting benchmarks alone nor have tested any of the two extensively enough to have a solid impression.

Welcome.

https://en.wikipedia.org/wiki/David_Heinemeier_Hansson#Controversy

I totally get your point but it really depends on what scope you define. For me, coming from Gnome and not feeling like constructing the whole shell aspect of my desktop myself, these tools do that job very well.

Also Noctalia v5, it’s a joy to use!

There is the Swiss project Apertus AI, and I think I’ve read about others but don’t remember the names.

That being said, if the benchmarks translate to real utility, it is the first competitive open source model, I’d say.

The service starts as it should, right? The errors appear only on request, right? Any other sections in the compose logs that seem relevant?

You use podman-compose with the Podman backend?

And there are no volumes mounted, just to be sure?

No expert but don’t the logs look like the requests are coming through?

I guess some people consider it cool. I’m not one of them.

Yeah right? At least a layer of VPN on top.

Hugging Face used the incident to promote running open-weights LLMs on-prem, which a large part of their business focusses on.

Their blog post

Pixelfed

I’ve used KISS before, but moved to Blue Line Console some months ago. I’d say it’s a bit more opinionated and less customizable than KISS but I guess I like the opinions.

Well compared to the strix, 400GB/s is not that bad, I think with fast system RAM and expert offloading you could squeeze quite something out of it when running stuff in the 100b-a10b regions.

Your bigger problem is going to be future software support.