Meat meets Machine
It was January 2023 and I had just purchased a brand new gaming PC because it was easier than trying to track down an RTX 4090 on its own. My original need was to satisfy my Skyrim mod obsession, but once I had the PC set up in my room I started to explore what else I could do with such a powerful graphics card in my possession. That’s when I read about a little LLM called Pygmalion.
Having always been a hardware guy, it seemed a bit daunting at first to install python, create venvs, and all the dev tools necessary to get an early release of Oobabooga TextgenUI up and running. And with TextgenUI running I could now talk to the computer and it kinda felt like the beginning of Wargames. Rudimentary, not very flashy, but sci-fi as hell as the machine replied to whatever question I had.
Running the 2 billion parameter Pygmalion model, I learned about System Prompts,