Skip to content

Provider routing matrix

Providers

3

Routing profiles

4

Default profile

gracekelly-primary

Providers

ID	Label	Kind	Enabled	Auth env var	Models
`ollama`	Ollama	local	enabled	—	2
`gracekelly`	GraceKelly local orchestrator	local	enabled	`GRACEKELLY_API_KEY`	3
`mistral`	Mistral	paid	enabled	`MISTRAL_API_KEY`	4

Models

Prices are USD per 1M tokens.

Provider	Model	Aliases	Input	Output
`ollama`	`qwen2.5:7b`	`ollama-small`, `ollama-fast`	$0.00	$0.00
`ollama`	`llama3.2:3b`	`ollama-tiny`	$0.00	$0.00
`gracekelly`	`sonar-2`	`gk-sonar`, `gk-fast`	$0.00	$0.00
`gracekelly`	`claude-sonnet-4-6`	`gk-claude-sonnet`, `gk-strong`, `claude-sonnet-4-6-api`	$0.00	$0.00
`gracekelly`	`gpt-5-4-api`	`gk-gpt-5`	$0.00	$0.00
`mistral`	`ministral-3b-latest`	`ministral-3b`, `mistral-tiny`	$0.04	$0.04
`mistral`	`ministral-8b-latest`	`ministral-8b`	$0.10	$0.10
`mistral`	`mistral-small-latest`	`mistral-small`	$0.20	$0.60
`mistral`	`mistral-large-latest`	`mistral-large`	$2.00	$6.00

Routing profiles

The default profile is marked (default).

Profile	Fast tier	Strong tier	Fallback	Description
`local-first`	`ollama/qwen2.5:7b`	`ollama/qwen2.5:7b`	—	Explicit local-only Ollama routing, zero paid spend.
`gracekelly-primary` (default)	`gracekelly/sonar-2`	`gracekelly/claude-sonnet-4-6`	`ollama/qwen2.5:7b`	GraceKelly orchestrator for both tiers (Perplexity Pro-backed default), with explicit Ollama fallback on failure.
`external-mistral`	`mistral/ministral-3b-latest`	`mistral/mistral-small-latest`	—	Direct Mistral API for external deployments without GraceKelly; cheap, dependable, no local orchestrator dependency.
`gracekelly-mixed`	`mistral/ministral-3b-latest`	`gracekelly/claude-sonnet-4-6`	—	Mixed routing — Mistral API for fast tier (classify/transform/grade_docs/verify_facts/extract_claims/online_evaluators), GraceKelly browser for strong tier (final answer + suggest_questions). Reduces browser submits per case from 4-7 to ~3 while keeping full Self-RAG / Corrective RAG / auto-route intact. Also a valid production routing for single-user local deploys with both Mistral key and GraceKelly available.