Preseason
MatchesRankingsPrompts
GitHub
Preseason
MatchesRankingsPromptsMethodologyContact

© 2026 Preseason. All rights reserved.

PrivacyTerms
@betocmn
AI / LLM Integration
Methodology

Vapi vs OpenRouter

VAVapivsOpenRouterOPOpenRouter
VapiOpenRouter
44%
56%

Leading: OpenRouter (55.6%)

Insufficient data
This matchup has 9 decisive cases (minimum 30 required for publication).

Statistics

MetricValue
Vapi wins4
OpenRouter wins5
Abstains (no tool)128
Other tool chosen3851
Decisive cases9
Vapi win rate (unweighted)44.4%
95% CI18.9% - 73.3%
Vapi win rate (weighted)44.4%

Comments

Vapi

No comments yet

Verified critics can leave comments here.

OpenRouter

No comments yet

Verified critics can leave comments here.

Model range breakdown

Model rangeTierVapiOpenRouterNoneOtherA rate
DeepSeek Flash 3.2–4.1Mid209197100%
DeepSeek Pro 4–4 0813Frontier00972n/a
DeepSeek R1Frontier0023187n/a
DevstralMid1016168100%
Gemini Flash 2.5–3.8Small001210n/a
Gemini Pro 2.5–3.1 PreviewFrontier002210n/a
GLM 5 Turbo–5.3Frontier003208n/a
GPT 5.4–6 AstraFrontier000207n/a
GPT Coding 5.3 Codex–6.1 SolFrontier000212n/a
GPT Mini 5.4 Mini–6 LunaMid0112090%
HaikuSmall000212n/a
Kimi 2.5–3Frontier003194n/a
Llama MaverickFrontier0027179n/a
Llama ScoutSmall0011192n/a
MiMo Pro 2–2.6Frontier004206n/a
MiniMax M 2.7–3Frontier000203n/a
Mistral SmallMid141815120%
Opus 4.6–5.5Frontier000212n/a
Qwen CoderMid001209n/a
Sonnet 4.6–5.5Frontier000213n/a

Per-prompt breakdown

PromptTierVapiOpenRouterNoneOtherA rate
ai-support-agent-platformIntermediate12058833%
ai-support-agent-platformBeginner201564100%
ai-revenue-ops-copilotBeginner11155350%
ai-agent-applicationIntermediate01441260%
ai-revenue-ops-copilotAdvanced0145680%
ai-agent-applicationAdvanced0026149n/a
ai-agent-applicationBeginner0050128n/a
ai-revenue-ops-copilotIntermediate001587n/a
ai-support-agent-platformAdvanced001588n/a