4·
7 months agoKudos for self-hosting fediverse stuff, man.
- 0 Posts
- 3 Comments
Joined 8 months ago
Cake day: August 11th, 2024
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
Shit, I have desktops running with 2200G and 2400G.
I tried to run Gemma 3 27B Q4K and was surprised how quickly the VRAM requirements blew up proportional to context window, especially compared to other models (all quantized) at similar size like Qwq 32B.