Skip to content
← Models
Open weightsConway Research/10 trustMetrics-checked

Underdog Saluki 27B 1.0

Qwen3.8-27B compressed into 7.89 GB with tool calling kept intact — a 2-bit GGUF that runs serious agents on ordinary hardware.

Visit official page →

About

Underdog Saluki 27B 1.0 is a 2-bit quantized build of Qwen3.8-27B (IQ2-mix, 7.89 GB) tuned to preserve agentic behavior. On the vendor's Underdog Bench it keeps 96% of the full model's capability across 9 benchmarks, scoring 88 vs 84 on tool calling and 42 vs 35 on parallel tool calls — numbers that come from Conway Research's own harness, not independent testing. It runs on stock llama.cpp with an OpenAI-compatible server, keeps Qwen3.8's switchable thinking mode, and offers an optional mmproj vision add-on for image input. Conway positions it for local agents, coding assistants, and instruction-heavy workloads where a full 54 GB model is impractical. Released 2026-10-08 under Apache 2.0, it gathered about 371k downloads and 513 likes in its first week on Hugging Face.

Specs

Context window

32K tokens in the published llama-server example (--c 32768)

Pricing

Free — open weights, self-hosted

Free quota

Weights free under Apache 2.0; 7.89 GB file fits consumer GPUs and Apple silicon

API access

Try it at underdog.ai/saluki; self-host via stock llama.cpp or Ollama (Modelfile from the GGUF)

Weights

Open weights

Released

Not disclosed

Benchmarks

  • Underdog Bench tool calling: 88 vs full model 84 — provider-reported
  • Parallel tool calls: 42 vs 35 — provider-reported
  • Average retention 96% across 9 benchmarks vs full Qwen3.8-27B — provider-reported

Provider-reported unless a source says otherwise. Benchmarks are marketing-adjacent by nature — treat them as directional.

Use cases

agentscodechat

Trust score — 5/10

/10 trustMetrics-checked

Scored 7/10 (METRICS tier, metrics-v1). Evidence: ~371k downloads in 9 days, strong signal of real demand; Apache 2.0; standard GGUF for stock llama.cpp with documented quickstart; quant methodology (GSQ-RCO via ISTA-DASLab) disclosed. Docked for: (1) all retention claims come from the vendor's own bench, no independent eval seen; (2) new small company, single release so far. License: Apache-2.0.

How the trust score is built

Full methodology →
Adoption · stars/downloads, log-scaled vs peers
9.0/10
Maintenance · recency, releases, issue load
6.0/10
Openness · license + docs
8.0/10
Manual review · sanity read + red-flag check
7.0/10
  • · HF: 513 likes, ~371k downloads in 9 days, created 2026-10-08
  • · manual review: quant base and method disclosed; standard GGUF for stock llama.cpp
  • · docked: all retention claims from the vendor's own bench; new small company, single release so far

More in the qwen3 family

Sources