128GB won't make any difference in gaming when compared to, say, 32GB, so it's just to fit larger LLMs into memory. However, 0.5t/s is hardly usable for every day tasks, so 32GB will still be more realistic combination with the RTX4070.
Selfhosted @lemmy.world donatas @feddit.uk 11mo ago Some local LLMs tested on an average gaming PC github.com /donatas-xyz/AI/discussions/1
Buy European @feddit.uk donatas @feddit.uk 11mo ago Self-hosting web services (email, www etc) as an alternative reminder www.reddit.com /r/BuyFromEU/s/QH8X0QpZD7
128GB won't make any difference in gaming when compared to, say, 32GB, so it's just to fit larger LLMs into memory. However, 0.5t/s is hardly usable for every day tasks, so 32GB will still be more realistic combination with the RTX4070.