Members-Only

Recent Talks & Demos are for members only

Exclusive feed

You must be an AI Tinkerers active member to view these talks and demos.

Sign in View FAQ

April 25, 2024 · Seattle

Moondream 2 in Rust

Overview

An implementation of the Moondream 2 vision model in Rust made possible with Hugging Face’s Candle ML framework.

Links

https://github.com/huggingface/candle/tree/main/candle-examples/exa...
Candle executes 1.6B Moondream VQA model inference efficiently using Rust.
https://github.com/huggingface/candle/pull/1970
Adds Moondream multimodal model, integrating Vision Encoder and Phi Mixformer.

Tech stack