Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)P

puck

@ puck @lemmy.world

Posts
2
Comments
26
Joined
3 yr. ago

  • Starting out with Selfhosting

    Jump

  • Yeah mine is a Broadwell i7, 3.1ghz with boost up to 3.4ghz, model number 5557U. The guy I bought it from maxed out the specs at launch and I bought pretty cheap a few years ago. For a ten year old device it runs like a dream and handles pretty much anything short of gaming and video editing with ease

  • Starting out with Selfhosting

    Jump

  • This is very true to be fair, I’ve noticed it hallucinating multiple times. Critical thinking should be taught in schools, I feel like kids growing up with LLMs are taking way too much of it what they say at face-value. Interrogation and reflection is a must. For me, I use it as a shortcut to gain a base-level of knowledge, I only tinker when I’m sure I have the right information and won’t mess anything up.

  • Starting out with Selfhosting

    Jump

  • I’d likely be running it with the lid closed 95% of the time

  • Starting out with Selfhosting

    Jump

  • Okay thanks. Damn shame manufacturers keep removing useful ports

  • Starting out with Selfhosting

    Jump

  • I should definitely play it relatively safe when it comes to this stuff. But I do think that, in lieu of formal training in networking, LLMs can be useful in the hands of someone who is cautious and responsible. I’m an adult with a full time job and other responsibilities, I don’t have the time or the inclination to take a course on networking. So, I’m strictly a hobbyist when it comes to this stuff, but I’m also not an idiot who thinks ChatGPT can magically solve any problems I throw at it.

  • Starting out with Selfhosting

    Jump

  • That’s definitely a consideration. Are minipcs less power-hungry?

  • Starting out with Selfhosting

    Jump

  • Thanks, yeah my Mac will be a dedicated machine for this setup. Do you think I should keep sonoma on it (obviously that’s an issue as far as my goal of going all-FOSS) or install proxmox/ another Linux distro?

  • Starting out with Selfhosting

    Jump

  • Thank you, I’ll look into VPS, that’s new territory for me.

    Re transcoding on Jellyfin. Yes that’s something I have considered. A lot of my media is x265 10-bit 1080p stuff, decent quality but not huge lossless blu-ray rips. I stick to encodes that are about 4-8gb a movie. Clients connecting to the server are a couple of laptops and two smart tvs using the native Jellyfin apps. So far I’ve only run into issue with things like AV1 files or very large 4k rips that won’t play on smart tv, mkvs play fine.

  • Starting out with Selfhosting

    Jump

  • Thanks for the reply. Regarding pi-hole on WiFi, I can connect the laptop via LAN with a usb adapter. So that may mitigate that issue

  • Selfhosted @lemmy.world
    puck @lemmy.world

    Starting out with Selfhosting

  • Deleted

    Permanently Deleted

    Jump

  • Thanks for the info. Yeah, I was wondering what kind of hardware you’d need to host LLMs locally with decent performance and your post clarifies that. I doubt many people would have the kind of hardware required.

  • Deleted

    Permanently Deleted

    Jump

  • Hi there, I’m thinking about getting into self-hosting. I already have a Jellyfin server set up at home but nothing beyond that really. If you have a few minutes, how can self-hosting help in the context of OPs post? Do you mean hosting LLMs on Ollama?

  • Game codes giveaway (Microsoft Store, XBox, GOG) (all claimed)

    Jump

  • Could I get Xbox old blood if still avail? Thank you so much. No worries if gone

  • Deleted

    Permanently Deleted

    Jump

  • Does using rdx benefit Reddit at all? I don’t have a Reddit account anymore but I sometimes check it with rdx but I think im ready to cut ties altogether.

  • Vanilla OS 2 - Future Plans, Updates, and Next Release

    Jump

  • KDE user here. Never used gnome, why is it an issue?

  • Linux on old School Machines?

    Jump

  • Thanks for the advice re: management. Definitely something we’ll need to plan for.

  • Linux on old School Machines?

    Jump

  • Yeah, I said they’re “useless as is”, because they’re running an outdated OS, have internet explorer on them, etc. the hardware is obviously far from useless but getting it to a good place in terms of user experience for a younger audience will involve a time investment. So yes, useless as is.

  • Linux on old School Machines?

    Jump

  • This is a good idea honestly, I’ll consider it!

  • Linux on old School Machines?

    Jump

  • Thanks for the super-informative post :) I’ve had a look around some more machines and there’s some i3’s in the mix too. Think I’m going to try Mint xfce on one of them and see if it copes. Yeah, consolidating ram seems like it should be a priority. There are a few i3 machines sitting headless gathering dust on the floor, they seem like a good place to scavenge from

  • Linux on old School Machines?

    Jump

  • There’s about 15 machines. Not a huge amount, I was definitely exaggerating with ‘a tonne’ haha. I think it just feels like a big waste, hence the exaggeration 😅

  • Linux @lemmy.ml
    puck @lemmy.world

    Linux on old School Machines?