Members-Only
Recent Talks & Demos are for members only
You must be an AI Tinkerers active member to view these talks and demos.
Artecon: Local CPU AI Hotspot
Learn how to run CPU‑based ML models with low latency, using small public models and post‑processing, then bundle into a simple GUI hotspot for sharing.
An inference engine running a variety of machine learning workloads on commodity hardware, making prototyping easy, private and cheap. The project places a special focus on ease-of-use. The goal is to have an app that allows even non-technical users to use common models locally or turn their PC/laptop into a hotspot for others to use.
(i) The app includes an LLM that uses tools to respond to queries. Each tool itself might contain models (object detector, vision-language models, etc.).
(ii) Users can run the app one PC/laptop and easily allow friends to share this through a discord/telegram/signal group chat.
Artecon: Local ONNX/GGUF inference engine enabling user-friendly ML model sharing.
Artecon: Local ONNX/GGUF inference engine enabling user-friendly ML model sharing.