Building a Product Powered by Local LLM's Only - Using LLM's in Cursor

I wanted to describe my journey that started about 5 months ago upon my first AI Tinkerers event where I was curious to work with LLM’s but didn’t really know how to get started. After my first event, I got advice to use LM Studio to play with local LLM’s to create.

I was instantly hooked, but I wanted to put them to work in a way other’s hadn’t in a privacy sensitive way, using Locally hosted LLM’s only. To learn, I had to get creative, and I wanted to use LLM’s to help build it in a language I’m not as proficint in, Python.

This started an multi-month journey into building games to guess who’s a murderer to building a bot that uses Experience Sampling Method (ESM) to capture real-time, contextual data about how people feel during different activities, avoiding the biases of memory recall.

The talk will talk about my journey to build the app, the types of things people run into, including dropping $2k on an RTX 4090 Super.