Falcon-H1-7B
TII's hybrid Transformer+Mamba 7B model with 256K context, released May 2025.
About
Falcon-H1-7B is the 7B member of TII's Falcon-H1 family, released May 21, 2025 in six sizes from 0.5B to 34B. It interleaves Transformer attention with Mamba state-space layers in a parallel hybrid design, which keeps long-context inference cheap: the family supports up to 256K tokens and 18 languages, and the 7B was trained in stages up to 262K.
All Falcon-H1 models ship under the TII Falcon License 2.0, an Apache-2.0-based permissive license with an acceptable-use policy. TII reports the flagship 34B matching or beating 70B-class models like Qwen3-32B and Llama 3.3 70B, with smaller sizes showing the same efficiency trend — though these are TII's own numbers and independent head-to-heads for the 7B specifically are thin.
Specs
Context window
Pricing
Free quota
API access
Weights
Released
Benchmarks
- Flagship 34B matches Qwen3-32B, Qwen2.5-72B, Llama 3.3 70B (TII-reported)
- Falcon-H1-1.5B-Deep rivals leading 7B-10B models (TII-reported)
Provider-reported unless a source says otherwise. Benchmarks are marketing-adjacent by nature — treat them as directional.
Use cases
Trust score — 8/10
Scored 8/10 (verified tier, metrics-v1). Evidence: TII Falcon family with 30+ checkpoints on HF; available on AWS Bedrock Marketplace; Hybrid Transformer+Mamba architecture; TII Falcon License 2.0 (Apache-2.0-based) with acceptable-use policy; TII-reported benchmarks competitive in class; independent head-to-heads for the 7B specifically are thin. License: TII Falcon License 2.0, based on Apache 2.0, with acceptable-use policy.
How the trust score is built
Full methodology →- Adoption · stars/downloads, log-scaled vs peers
- 7.0/10
- Maintenance · recency, releases, issue load
- 8.0/10
- Openness · license + docs
- 8.0/10
- Manual review · sanity read + red-flag check
- 8.0/10
- · TII Falcon family with 30+ checkpoints on HF; available on AWS Bedrock Marketplace
- · Hybrid Transformer+Mamba architecture; TII Falcon License 2.0 (Apache-2.0-based) with acceptable-use policy
- · TII-reported benchmarks competitive in class; independent head-to-heads for the 7B specifically are thin