bobburger

I like that they say “outdated” stereotypes like they used to be true but now they aren’t.

Come on people, keep your steroetypes current.

Llamafile is a great way to get use an LLM locally. Inference is incredibly fast on my ARM macbook and rtx 4060ti, its okay on my Intel laptop running Ubuntu.

Llamafile runs entirely on your machine. The largest one I can run locally is Mistral-7B and Wizardcoder 13B. They seem to be on par with chatgpt-3, but that’s okay for my purposes.

I use it for exactly the same thing.

I used to spend hours agonizing over documenting things because I couldn’t get the tone right, or in over explained, or some other stupid shit.

Now I give my llamafile the code, it gives me a reasonable set of documentation, I edit the documentation because the LLM isn’t perfect, and I’m done in 10 minutes.

A simpler answer might be llamafile if you’re using Mac or Linux.

If you’re on windows you’re limited to some smaller LLMs without some work. In my experience the smaller LLMs are still pretty good as chat bots so they might translate well.