Skip Navigation

User banner

ddh

@ DarkDarkHouse @lemmy.sdf.org

Posts
5
Comments
1251
Joined
3 yr. ago

  • Self hosting LLMs on a remote VPS

    Jump

  • I’d be interested to see how it goes. I’ve deployed Ollama plus Open WebUI on a few hosts and small models like Llama3.2 run adequately (at least as fast as I can read) on even an old i5-8500T with no GPU. Oracle Cloud free tier might work OK.

  • Self hosting LLMs on a remote VPS

    Jump

  • Running an LLM can certainly be an on-demand service. Apart from training, which I don’t think we are discussing, GPU compute is only used while responding to prompts.

  • Fedora Linux Flatpak cool apps to try for December - Fedora Magazine

    Jump

  • Love these posts. Plus every month you get to see the flatpak haters try to convince us we are using the wrong technology.

  • Have you used so-called "AI" for actually productive work ?

    Jump

  • I’ve used it productively this week by…

    • Summarising and finding relevant parts of Microsoft Teams meetings.
    • Finding relevant parts of the labyrinthine policies I have to comply with.
    • Quickly finding out what’s going on with corporate events in the market.
    • Generating SQL code instead of starting a blank query from scratch (I can never remember the exact way to declare various structures)
    • At home, feeding private documents into Ollama for insight and producing compliance reports.
    • Instructions for stepping through flashing some temperature sensors.
  • Deleted

    Xfce 4.20 Pre2 Released

    Jump

  • This is so exciting! Go little mouse, you can do it

  • Loki catching George Russell

    Jump

  • My neighbour’s cat was also a Loki, very chill for a trickster god, and sadly passed away a few weeks ago. Glad yours is enjoying the race. We’re considering getting a cat, might give it the same name, just spelled Lowkey.

  • Study: The average millennial is earning about 20% less than baby boomers did at the same stage of life

    Jump

  • It’s the billionaires. Apparently it was trickle-up economics all along.

  • Deleted

    TIL , Why Do Animals Keep Evolving into Crabs?

    Jump

  • I thought it was once every other pig, thanks for the info!

  • Ubuntu spotted in the latest Mark Rober video

    Jump

  • Built a booby-trap device to cover porch pirates in glitter. Oh no, such a disgrace.

  • Beri decided to attack my cursor

    Jump

  • Ah, the old game of cat and mouse

  • TURKEY POWER

    Jump

  • Turkey control rods

  • Trump Team Is Having a Terrifying Debate on How to Invade Mexico

    Jump

  • Might be the insanity is the part about Canadians joining in?

  • Australia bans social media for under 16s

    Jump

  • I guess Australia.gov can be the site in the middle handing out the tokens

  • Dabbling again [Extra Ordinary Comics]

    Jump

  • I didn’t know so many awesome comics came from just one person!

  • What is on your holiday wish list this year?

    Jump

  • Same as last year. Socks and whiskey.

  • How do you make your favorite sandwich?

    Jump

  • With great relish

  • Firefox introduces AI as experimental feature

    Jump

  • Skill issue

    Jump

  • Arrogance, then more arrogance.

  • Are Overemployed ‘Ghost Engineers’ Making Six Figures to Do Nothing?

    Jump

  • And slack capacity can be used effectively e.g., spend some time on process improvement. There’s always some saw to sharpen or some technical debt to repay.