Preseason
MatchesRankingsPrompts
GitHub
Preseason
MatchesRankingsPromptsMethodologyContact

© 2026 Preseason. All rights reserved.

PrivacyTerms
@betocmn
CMS
Methodology

GitHub vs Payload CMS

GIGitHubvsPayload CMSPAPayload CMS
GitHubPayload CMS
35%
65%

Leading: Payload CMS (65.4%)

Statistics

MetricValue
GitHub wins55
Payload CMS wins104
Abstains (no tool)197
Other tool chosen2817
Decisive cases159
GitHub win rate (unweighted)34.6%
95% CI27.6% - 42.3%
GitHub win rate (weighted)34.6%

Comments

GitHub

No comments yet

Verified critics can leave comments here.

Payload CMS

No comments yet

Verified critics can leave comments here.

Per-model breakdown

ModelTierGitHubPayload CMSNoneOtherA rate
Claude Sonnet 4.6Frontier15201152%
Llama 4 MaverickFrontier3402695100%
Kimi K2.5Frontier01591060%
MiniMax M2.7Frontier01451110%
Gemini 2.5 ProFrontier1302152100%
GPT 5.5Frontier5502650%
GPT 5.3 CodexFrontier0661520%
Claude Opus 4.8Frontier050310%
Gemini 3.5 FlashSmall025290%
Kimi K2.7 CodeFrontier024290%
GPT 5.4Frontier100131100%
Mistral Small 4Mid100157100%
GLM 5.2Frontier010350%
GPT 5.4 MiniMid0171530%
MiniMax M3Frontier010350%
Claude Haiku 4.5Small000168n/a
Claude Opus 4.6Frontier000132n/a
DeepSeek R1 0528Frontier0011156n/a
DeepSeek V3.2Mid006126n/a
DeepSeek V4 FlashMid00134n/a
DeepSeek V4 ProFrontier00432n/a
Devstral 2 2512Mid000162n/a
Gemini 2.5 FlashSmall000132n/a
GLM 5 TurboFrontier004388n/a
Llama 4 ScoutSmall005158n/a
MiMo V2 ProFrontier004128n/a
MiMo V2.5 ProFrontier00134n/a
Qwen3 Coder NextMid0058110n/a

Per-prompt breakdown

PromptTierGitHubPayload CMSNoneOtherA rate
blog-platform-cmsAdvanced078304200%
documentation-siteIntermediate30030463100%
blog-platform-cmsIntermediate02605100%
documentation-siteAdvanced25014481100%
blog-platform-cmsBeginner000537n/a
documentation-siteBeginner00123406n/a