Preseason
MatchesRankingsPrompts
GitHub
Preseason
MatchesRankingsPromptsMethodologyContact

© 2026 Preseason. All rights reserved.

PrivacyTerms
@betocmn
AI / LLM Integration
Methodology

Vapi vs OpenRouter

VAVapivsOpenRouterOPOpenRouter
VapiOpenRouter
44%
56%

Leading: OpenRouter (55.6%)

Insufficient data
This matchup has 9 decisive cases (minimum 30 required for publication).

Statistics

MetricValue
Vapi wins4
OpenRouter wins5
Abstains (no tool)103
Other tool chosen3406
Decisive cases9
Vapi win rate (unweighted)44.4%
95% CI18.9% - 73.3%
Vapi win rate (weighted)44.4%

Comments

Vapi

No comments yet

Verified critics can leave comments here.

OpenRouter

No comments yet

Verified critics can leave comments here.

Per-model breakdown

ModelTierVapiOpenRouterNoneOtherA rate
Mistral Small 4Mid141413320%
DeepSeek V3.2Mid100124100%
DeepSeek V4 FlashMid10850100%
Devstral 2 2512Mid1012149100%
GPT 5.4 MiniMid0111850%
Claude Haiku 4.5Small000188n/a
Claude Opus 4.6Frontier000126n/a
Claude Opus 4.8Frontier00062n/a
Claude Sonnet 4.6Frontier000189n/a
DeepSeek R1 0528Frontier0018168n/a
DeepSeek V4 ProFrontier00954n/a
Gemini 2.5 FlashSmall000126n/a
Gemini 2.5 ProFrontier001187n/a
Gemini 3.5 FlashSmall00160n/a
GLM 5 TurboFrontier002123n/a
GLM 5.2Frontier00162n/a
GPT 5.3 CodexFrontier000188n/a
GPT 5.4Frontier000126n/a
GPT 5.5Frontier00057n/a
Kimi K2.5Frontier001112n/a
Kimi K2.7 CodeFrontier00259n/a
Llama 4 MaverickFrontier0021163n/a
Llama 4 ScoutSmall007172n/a
MiMo V2 ProFrontier000124n/a
MiMo V2.5 ProFrontier00458n/a
MiniMax M2.7Frontier000114n/a
MiniMax M3Frontier00062n/a
Qwen3 Coder NextMid001185n/a

Per-prompt breakdown

PromptTierVapiOpenRouterNoneOtherA rate
ai-support-agent-platformIntermediate12052833%
ai-support-agent-platformBeginner201505100%
ai-revenue-ops-copilotBeginner11050050%
ai-agent-applicationIntermediate0136950%
ai-revenue-ops-copilotAdvanced0135100%
ai-agent-applicationAdvanced0022113n/a
ai-agent-applicationBeginner003999n/a
ai-revenue-ops-copilotIntermediate001528n/a
ai-support-agent-platformAdvanced001528n/a