Llama 3

Llama 3 was released on April 18, 2024, in 8B and 70B parameter sizes, trained on approximately 15 trillion tokens of publicly available data. The 8B model matched the prior generation's largest model in capability, while the 70B model beat Gemini 1.5 Pro and Claude 3 Sonnet on several benchmarks at launch, resetting expectations for open-weight models.

It shipped in pretrained and instruction-tuned variants under the Llama 3 Community License, which permits commercial use within its terms but is not OSI-approved open source. The release sparked a wave of fine-tunes and became the base for thousands of derivative models on Hugging Face.