Preseason
MatchesRankingsPrompts
GitHub
Preseason
MatchesRankingsPromptsMethodologyContact

© 2026 Preseason. All rights reserved.

PrivacyTerms
@betocmn
Realtime
Methodology

NATS vs Replicache

NANATSvsREReplicache
NATSReplicache
50%
50%
Insufficient data
This matchup has 24 decisive cases (minimum 30 required for publication).

Statistics

MetricValue
NATS wins12
Replicache wins12
Abstains (no tool)77
Other tool chosen6655
Decisive cases24
NATS win rate (unweighted)50.0%
95% CI31.4% - 68.6%
NATS win rate (weighted)50.0%

Comments

NATS

No comments yet

Verified critics can leave comments here.

Replicache

No comments yet

Verified critics can leave comments here.

Model range breakdown

Model rangeTierNATSReplicacheNoneOtherA rate
DeepSeek Flash 3.2–4.1Mid002351n/a
DeepSeek Pro 4–4 0813Frontier00178n/a
DeepSeek R1Frontier0051302n/a
DevstralMid000337n/a
Gemini Flash 2.5–3.8Small0433480%
Gemini Pro 2.5–3.1 PreviewFrontier000354n/a
GLM 5 Turbo–5.3Frontier004351n/a
GPT 5.4–6 AstraFrontier000351n/a
GPT Coding 5.3 Codex–6.1 SolFrontier000354n/a
GPT Mini 5.4 Mini–6 LunaMid006345n/a
HaikuSmall0803400%
Kimi 2.5–3Frontier005347n/a
Llama MaverickFrontier000351n/a
Llama ScoutSmall001346n/a
MiMo Pro 2–2.6Frontier001352n/a
MiniMax M 2.7–3Frontier002350n/a
Mistral SmallMid000350n/a
Opus 4.6–5.5Frontier1201341100%
Qwen CoderMid000352n/a
Sonnet 4.6–5.5Frontier000355n/a

Per-prompt breakdown

PromptTierNATSReplicacheNoneOtherA rate
project-management-toolAdvanced01205810%
social-media-platformAdvanced605581100%
chat-applicationAdvanced301586100%
social-media-platformAdvanced302164100%
chat-applicationIntermediate002168n/a
chat-applicationIntermediate009585n/a
chat-applicationBeginner004588n/a
chat-applicationBeginner003164n/a
chat-applicationAdvanced001151n/a
project-management-toolBeginner007587n/a
project-management-toolAdvanced000150n/a
project-management-toolIntermediate000152n/a
project-management-toolIntermediate004589n/a
project-management-toolBeginner004148n/a
social-media-platformBeginner0023562n/a
social-media-platformIntermediate007582n/a
social-media-platformBeginner004166n/a
social-media-platformIntermediate001151n/a