Members-Only
Recent Talks & Demos are for members only
You must be an AI Tinkerers active member to view these talks and demos.
December 12, 2023
·
Seattle
Mixtral 8x7B
This talk provides a quick walkthrough of the Mixtral 8x7B, a new mixture of experts model that has generated significant interest.
Overview
Quick walk through the new mixture of experts model
Links
PyTorch inference code for Mixtral 8x7B MoE supporting 32k sequence length.
Static HTML fallback page confirms X.com requires client-side JavaScript rendering.
Tech stack