
Sesame CSM
Open-weight conversational speech model — dialogue-aware TTS with natural turn-taking prosody.
About
CSM is Sesame AI's Conversational Speech Model, open-sourced in March 2025 under Apache-2.0 after the company's Maya voice demo went viral for its eerily natural pauses and intonation. Unlike plain text-to-speech, CSM generates Mimi audio codes from both text and prior audio, so its delivery responds to the conversation that came before — interruptions, hesitations and all. The 1B-parameter base model sits on Hugging Face as sesame/csm-1b, plugs into Transformers from 4.52, and has picked up around 14.7k GitHub stars.
The honest picture, and it matters: the voice everyone raves about in Sesame's demo is a larger closed production model you cannot download, buy or call — the open CSM-1B is a smaller synthesis block, and people who have run both describe it as distinctly weaker. It's English-only, needs a CUDA GPU and a gated Llama-3.2 download to run, and the license bars impersonation and deception. Treat it as a research-grade building block for voice agents, not a drop-in ElevenLabs replacement.
What it can do
- Dialogue-context-aware speech synthesis
- Voice cloning from a 10-15 second reference clip
- Mimi RVQ codec output at 24kHz
- Apache-2.0 open weights
- Native Hugging Face Transformers integration
Setup
pip install from the SesameAILabs/csm GitHub repo, or load sesame/csm-1b via Hugging Face Transformers (>=4.52). Needs a CUDA GPU and HF access to the gated Llama-3.2-1B weights.
Prerequisites
CUDA-capable GPU, Python 3.10, Hugging Face account with the Llama-3.2 license accepted.
Use cases
Works with
Trust score — 8/10
Scored 8/10 (verified tier, metrics-v1). Evidence: Verified via vendor site/docs/GitHub and reputable coverage, wave 45; Trending score 80/100 from researcher assessment.
★ 14,700 GitHub stars
Sources
Every fact above was checked against these sources. Where a claim comes from the provider and couldn't be independently verified, the text says so.