GPT-J 6B
Historic 6B open-source GPT-3 alternative trained on the Pile.
About
GPT-J-6B is an open-source large language model developed by EleutherAI and released on June 9, 2021. With 6 billion parameters across 28 transformer layers, it was one of the largest publicly released GPT-like models of its time.
It is a GPT-3-like autoregressive, decoder-only transformer trained on the Pile, an 825GB curated dataset spanning Wikipedia, arXiv, GitHub, StackExchange and PubMed. The model ships under the Apache 2.0 license and remains a widely fine-tuned base for research and open-source derivatives.
Specs
Context window
Pricing
Free quota
API access
Weights
Released
Benchmarks
Provider-reported unless a source says otherwise. Benchmarks are marketing-adjacent by nature — treat them as directional.
Use cases
Trust score — 6/10
Scored 6/10 (metrics tier, metrics-v1). Evidence: Verified via vendor site/docs/GitHub and reputable coverage, wave 123; Trending score 48/100 from researcher assessment.