Skip to content
← Models
Open weightsNexa AI/10 trustMetrics-checked

Octopus v4

3B on-device router that directs queries across a graph of specialist models.

Visit official page →

About

Octopus v4 is Nexa AI's 3B-parameter master model for what the company calls a graph of language models, described in arXiv 2404.19296 (April 2024, era-level date used here). Instead of answering everything itself, Octopus v4 uses patented functional tokens to route each user query to the most appropriate specialist open-source model and to reformat the query for that model's strengths, activating roughly 10B parameters of specialist capacity in total.

Nexa's vendor-reported figures claim an MMLU score of 74.8, competitive among models at that scale. The model is open-sourced with GGUF quantized builds for on-device deployment on phones and laptops. One caution carried over from the line: Octopus v2 shipped under CC-BY-NC-4.0, so verify the v4 model card license before commercial use.

Specs

Context window

Pricing

Free quota

API access

Weights

Open weights

Released

April 29, 2024

Benchmarks

Provider-reported unless a source says otherwise. Benchmarks are marketing-adjacent by nature — treat them as directional.

Use cases

on-devicemodel-routingfunction-callingagentssmall-models

Trust score — 7/10

/10 trustMetrics-checked

Scored 7/10 (metrics tier, metrics-v1). Evidence: Verified via vendor site/docs/GitHub and reputable coverage, wave 93; Trending score 74/100 from researcher assessment.

Sources