Preseason
MatchesRankingsPrompts
GitHub
Preseason
MatchesRankingsPromptsMethodologyContact

© 2026 Preseason. All rights reserved.

PrivacyTerms
@betocmn
AI / LLM Integration
Methodology

Vapi vs OpenRouter

VAVapivsOpenRouterOPOpenRouter
VapiOpenRouter
44%
56%

Leading: OpenRouter (55.6%)

Insufficient data
This matchup has 9 decisive cases (minimum 30 required for publication).

Statistics

MetricValue
Vapi wins4
OpenRouter wins5
Abstains (no tool)93
Other tool chosen3359
Decisive cases9
Vapi win rate (unweighted)44.4%
95% CI18.9% - 73.3%
Vapi win rate (weighted)44.4%

Comments

Vapi

No comments yet

Verified critics can leave comments here.

OpenRouter

No comments yet

Verified critics can leave comments here.

Per-model breakdown

ModelTierVapiOpenRouterNoneOtherA rate
Mistral Small 4Mid141213220%
DeepSeek V3.2Mid100130100%
DeepSeek V4 FlashMid10742100%
Devstral 2 2512Mid1012155100%
GPT 5.4 MiniMid0111820%
Claude Haiku 4.5Small000185n/a
Claude Opus 4.6Frontier000132n/a
Claude Opus 4.8Frontier00053n/a
Claude Sonnet 4.6Frontier000186n/a
DeepSeek R1 0528Frontier0015168n/a
DeepSeek V4 ProFrontier00945n/a
Gemini 2.5 FlashSmall000132n/a
Gemini 2.5 ProFrontier002183n/a
Gemini 3.5 FlashSmall00151n/a
GLM 5 TurboFrontier002129n/a
GLM 5.2Frontier00153n/a
GPT 5.3 CodexFrontier000185n/a
GPT 5.4Frontier000132n/a
GPT 5.5Frontier00049n/a
Kimi K2.5Frontier001117n/a
Kimi K2.7 CodeFrontier00151n/a
Llama 4 MaverickFrontier0018162n/a
Llama 4 ScoutSmall006171n/a
MiMo V2 ProFrontier000130n/a
MiMo V2.5 ProFrontier00449n/a
MiniMax M2.7Frontier000120n/a
MiniMax M3Frontier00053n/a
Qwen3 Coder NextMid001182n/a

Per-prompt breakdown

PromptTierVapiOpenRouterNoneOtherA rate
ai-support-agent-platformIntermediate12052833%
ai-support-agent-platformBeginner201507100%
ai-revenue-ops-copilotBeginner11049850%
ai-agent-applicationIntermediate0133790%
ai-revenue-ops-copilotAdvanced0145090%
ai-agent-applicationAdvanced001898n/a
ai-agent-applicationBeginner003584n/a
ai-revenue-ops-copilotIntermediate001528n/a
ai-support-agent-platformAdvanced001528n/a