I was able to run a distilled version of DeepSeek on Linux. I ran it inside a PODMAN container with ROCM support (I have an AMD GPU). It wasn't super fast but for a locally deployed and self hosted option the performance was okay. Apart from that I have deployed Fooocus for image generation in a similar manner. Currently, I am working on deploying Stable Diffusion with either ComfyUI or Automatic1111 inside a PODMAN container with ROCM support.
- Posts
- 0
- Comments
- 2
- Joined
- 9 mo. ago
- Posts
- 0
- Comments
- 2
- Joined
- 9 mo. ago
- JumpRemoved
How to transfer a lot of data?
Maybe you could try Syncthing? It's pretty fast over a local network and can do the job fairly well.