Members-Only

Recent Talks & Demos are for members only

Exclusive feed

You must be an AI Tinkerers active member to view these talks and demos.

Sign in View FAQ

December 12, 2023 · Seattle

Mixtral 8x7B

Overview

Quick walk through the new mixture of experts model

Links

https://github.com/vikhyat/mixtral-inference
PyTorch inference code for Mixtral 8x7B MoE supporting 32k sequence length.
https://x.com/vikhyatk/status/1733280878200336696
Static HTML fallback page confirms X.com requires client-side JavaScript rendering.

Tech stack