With an AMD RX 6800 + 32gb DDR4, I can run up to a 34b model at an acceptable speed.
- 0 Posts
- 4 Comments
Joined 28 days ago
Cake day: March 6th, 2025
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
1·11 days agoWhat I’m thinking about is more that in Linux, it’s common to access URLs directly from the terminal for various purposes, instead of using a browser.
So if you try to access a website using this technology via terminal, what happens? The connection fails?
With Ollama, all you have do is copy an extra folder of ROCm files. Not hard at all.