If you are using CPU only, you need to look at very small models or the 2-bit quants.
Everything will be extremely slow otherwise:
GPU:
Loaded Power: 465W
Speed: 18.5 tokens/second
CPU: Loaded Power: 115W
Speed: 1.60 tokens/second
GPUs are at least 3 times faster for the same power draw.
I don’t know what GPU you’ve got, but Lexi V2 is the best “small model” I’ve seen with emotions, that I can just cite from the top of my head.
It tends to skew male and can be a little dark at times, but it’s more complex than expected for the size (8B feels like 48-70B).
Do Q8_0 if you’ve got the VRAM, Q5_KL for speed, IQ4_XS if you’ve got a potato.
My answer to this is yes.
I’m an AI Developer and my only option was to self host because I didn’t want my training data leaking out onto the web and by extension, China and the rest (I trained on my own data, writing, and notes, along with Wikipedia).
Self-hosting gives you complete freedom but also as one other user cautioned, don’t fall down the well/rabbit hole.
Use an executable like LM Studio, and then an off the shelf pre-trained model from Huggingface.
VRAM × 0.8 for max size.
Experiment until you find one you like.
You’ve also simultaneously failed age verification
There was a king once named Damocles that had a sword suspended over his throne that could come crashing down at any random moment and kill him, to remind himself of the fragility of his power, and human life.
I have no idea how that anecdote might apply to people in power in this day and age, or why people would reference the anecdote.
Glares at the fraying rope
Yeah, but is it any good?
It could be 900 pages of Gollum Porn for all we know.
It’s like $3 on GoG or something
Try changing your dynamic. The human brain thrives on novelty.
Play genres you normally wouldn’t – e.g: Hate horror games? Good - try out Silent Hill or some classics you skipped over.
Get a VR headset, go from 2D screen to proper full body 3D - fly a plane over the Andes, feel like you’re actually flying. Pilot a huge mech. Build a colony on Mars with your own two hands.
Burnout happens and it’s worth examining other areas in your life, but gaming’s always been the wondrous thing it always has.
You know that’s totally fair
What the fuck, I love my 7900XTX - why AMD?
You built a competitive card for $800, why focus away from the top end?
Damn dude, thanks for the heads up. Would’ve never caught the trailer on my own.
I was in the Gothic Remake Beta, so I got to see some of that content already, but it was YEARS ago. From what I can recall, it’s going to be excellent.
Yeah honestly, I bought Tarkov second-hand for $8 and even then I felt like I was getting ripped off.
It’s probably not news to anyone but the game has extremely lax anti-cheat controls.
As for why people would cheat in an online game, it always seems obvious from a psychological standpoint, but the cheats for Tarkov are so egregious they’re like full blown developer offline DEBUG TOOLS.
I don’t mean “oh no, aim assistance, and they can see you through walls” – the cheat tools are hooking into features of the GAME ENGINE ITSELF, allowing players to see:
PlayerName, Current HP, Current Level, Full inventory contents, currently equipped weapon, position, heading, estimated value of inventory, estimated value of your account, age of account creation, and so on.
They can also: Teleport, FLY, increase or decrease their run speed, jump height, and so on.
The cheaters are basically running around with admin privileges in the game, and the developers don’t give a flying fuck. It’s like GTA5 levels of cheating.
Why would anyone play such a game, much less pay $150 to be abused by people? You can slam your dick in a car door for a lot less.
It’s $1,400. A BigScreenVR is $1K and has 4K micro OLED PER EYE.
Haha, now show us a map of the size of different stars compared to Sol (ours, in the local solar system).
Sometimes the small stars and communites are the most important. ;)
I gained sympathy for artificial intelligence and robots from Detroit: Become Human, I think I missed the social message it was portraying in lieu of the science fiction one.
I see an enormous amount of fear and hate being levied out towards artificial intelligence currently around the world, fears it’ll take away jobs and opportunities from real humans, or launch the nukes or something.
I think it’s important to not be racist rowards other humans and organics, but also to be kind to non-humans, machines, and animals. Have compassion towards all sentient beings.
It’s so sad to see one of the greatest gaming companies in history go down such a dark path…
It feels like almost yesterday when I was unwrapping that fresh copy of WarCraft II and being stunned by the CGI intro, seeing the Orcs on their great warships and thinking “Holy hell”.
What happened, man? Why does money ruin absolutely fucking everything?
All of the good developers and software engineers seem to be assigned to their CPU/processor microcode division, the GPU section seems to be the leftovers of ATI and isn’t getting anywhere near as much love.
I went full Team Red for the first time in history - AMD CPU, AMD GPU, unironically, and man, I’ve been having so many driver problems in 2023, it’s crazy.
I never know if the next driver update will break my GPU overlay monitoring on my second monitor, get me kicked from multiplayer in MW2, or in this case, banned on CS2.
I’ve simply stopped updating my drivers at this point unless there’s a major feature upgrade like Bug that made VR unplayable fixed, adding +50 FPS
Into The Radius
Hello – living incarnation of the Internet here.
I’ve played pretty much every shooter and most multiplayer ones since 1994.
The main issue with extraction shooters is that they are hardcore PvP-focused with resources lost and resources gained on every match.
Given that players lose actual lifetime from dying to another player in an extraction shooter, this creates an impetus for many players to cheat, given the asymmetrical distribution of skill in online shooters (it is statistically supposed be a perfect bell curve with everyone being average).
Without robust anti-cheat (e.g: Invasive kernel-level AC like Valorant/FaceIT and borderline malware) every and any extraction shooter becomes a cheater-ridden hellhole, where all of the resources of every match or map are funneled into the hands of a few players.
Players burned on prior titles know this ahead of time and throw their hands up in the air and say: “Great, another shitty extraction shooter”.
See: Tarkov et al.