Recent AI Endeavors
Why must we imagine Sisyphus happy? tldr, because he may as well be. I'm playing around with local AI models again since I recently got a newer, more AI-capable GPU. These newer gen models have gotten more interesting; I can now happily run Qwen3.8-27B Q4 with decent context. Context in this case is just as you'd think, ability to keep context within a conversation. Incidentally, I suspect there are many people out there running in low-context mode, at least sometimes, revealed by just how quickly they seem to forget things when called out on something that doesn't reconcile with past conversations, not to say that I'm beyond it. Keep in mind, the instance in the screenshot is all running on local hardware, no internet required, all in a 16GB file. This size is interestingly less than the whole of wikipedia that you can download for offline viewing which is roughly 50GB-100GB depending on if you want images. I still revel in being able to have the entirely of Wikipedi...
