Research
Falcon Mamba: The First 7B Model to Ditch Attention Without Performance Loss
Hugging Face Blog · Aug 12, 2024 · 2 min read
The team behind Falcon has released Falcon Mamba, a 7-billion-parameter model that stands as the first general-purpose,...