Skip Navigation

xcjs

@ xcjs @programming.dev

Posts
0
Comments
115
Joined
3 yr. ago

  • Advice - Getting started with LLMs

    Jump

  • I think there was a special process to get Nvidia working in WSL. Let me check... (I'm running natively on Linux, so my experience doing it with WSL is limited.)

    https://docs.nvidia.com/cuda/wsl-user-guide/index.html - I'm sure you've followed this already, but according to this, it looks like you don't want to install the Nvidia drivers, and only want to install the cuda-toolkit metapackage. I'd follow the instructions from that link closely.

    You may also run into performance issues within WSL due to the virtual machine overhead.

  • Advice - Getting started with LLMs

    Jump

  • Good luck! I'm definitely willing to spend a few minutes offering advice/double checking some configuration settings if things go awry again. Let me know how things go. :-)

  • Advice - Getting started with LLMs

    Jump

  • It should be split between VRAM and regular RAM, at least if it's a GGUF model. Maybe it's not, and that's what's wrong?

  • Advice - Getting started with LLMs

    Jump

  • Ok, so using my "older" 2070 Super, I was able to get a response from a 70B parameter model in 9-12 minutes. (Llama 3 in this case.)

    I'm fairly certain that you're using your CPU or having another issue. Would you like to try and debug your configuration together?

  • Advice - Getting started with LLMs

    Jump

  • Unfortunately, I don't expect it to remain free forever.

  • Advice - Getting started with LLMs

    Jump

  • No offense intended, but are you sure it's using your GPU? Twenty minutes is about how long my CPU-locked instance takes to run some 70B parameter models.

    On my RTX 3060, I generally get responses in seconds.

  • Nice demonstration of why mastodon's dominance is problematic

    Jump

  • It's a W3C managed standard, but there are tons of behavior not spelled out in the specification that platforms can choose to impose.

    The standard doesn't impose a 500 character limit, but there's nothing that says there can't be a limit.

  • Instagram is updating its algorithm to surface more content from smaller, original creators | TechCrunch

    Jump

  • Or maybe just let me focus on who I choose to follow? I'm not there for content discovery, though I know that's why most people are.

  • Zuckerberg says Meta's Llama 3 is really good but no chatbot is sophisticated enough to be an 'existential' threat — yet

    Jump

  • I was reflecting on this myself the other day. For all my criticisms of Zuckerberg/Meta (which are very valid), they really didn't have to release anything concerning LLaMA. They're practically the only reason we have viable open source weights/models and an engine.

  • Disney+ debuts a new logo and integrates Hulu content, offering joint subs in the US

    Jump

  • That's the funny thing about UI/UX - sometimes changing non-functional colors can hurt things.

  • How to drop files from Android to home server?

    Jump

  • My go-to solution for this is the Android FolderSync app with an SFTP connection.

  • How to distribute an open source font in a git repository?

    Jump

  • I'm not familiar with creating fonts specifically, but you'll want to commit any resources necessary to recreate the font file, including any build scripts to help ease the process and instructions specifying compatible versions of tooling (FontForge in this case). Don't include FontForge in the repository, of course.

    The compiled font files should be under releases in GitHub for the repository.

    Git isn't generally meant for binary resources but as long as they're not too large, they'll be fine. You just may not have meaningful ways to compare changes easily.

  • Linux Mobile Distro postmarketOS Adopts systemd to Better Support GNOME, KDE Plasma

    Jump

  • I mean, sysvinit was just a bunch of root-executed bash scripts. I'm not sure if systemd is really much worse.

  • Linux Mobile Distro postmarketOS Adopts systemd to Better Support GNOME, KDE Plasma

    Jump

  • Systemd was created to allow parallel initialization, which other init systems lacked. If you want proof that one processor core is slower than one + n, you don't need to compare init systems to do that.

  • Deleted

    Permanently Deleted

    Jump

  • With UI decisions like the shortcut bar, they really don't. I switched to another SMS app because I couldn't stand it.

  • Microsoft revives aggressive Windows 11 upgrade campaign with intrusive popups for Windows 10 users

    Jump

  • I...do not miss XP, but I understand the nostalgia attached to it.

    I learned a lot of technical skills on XP, but that's what made me appreciate the architectural decisions behind UNIX-likes all the more.