#localllm
Local AI is the vinyl record of software
Local AI is the vinyl record of software. Takes more setup. Sounds weirdly better. Costs more upfront and less long-term. Annoys exactly the right people.…
Local AI runs at 12 tokens/sec on a $999 MacBook Air
Local AI runs at 12 tokens/sec on a $999 MacBook Air. Cloud AI runs at 80 tokens/sec on Sam Altman's mood. Pick your bottleneck. Some weeks the latter is…
My friend's mom asked if AI could read Korean
My friend's mom asked if AI could read Korean. I tested ChatGPT and a 3B local model. The local one was actually slightly better at hangul nuance —…
Plot twist: the AI on your laptop is dumber than ChatGPT
Plot twist: the AI on your laptop is dumber than ChatGPT. And that's exactly why you should use it. A 3B model can't write Hamlet. But it CAN draft your…
What if your laptop already had everything you need?
What if your laptop already had everything you need? Spoiler: it does. You just keep paying for the cloud version because someone in San Francisco told…
12 tokens/sec on a 2024 MacBook Air
12 tokens/sec on a 2024 MacBook Air. That's faster than you can read this sentence. Local AI is not the slow option anymore — that was 2023. The new…