Preseason
MatchesRankingsPrompts
GitHub
Preseason
MatchesRankingsPromptsMethodologyContact

© 2026 Preseason. All rights reserved.

PrivacyTerms
@betocmn
CMS
Methodology

GitHub vs Payload CMS

GIGitHubvsPayload CMSPAPayload CMS
GitHubPayload CMS
34%
66%

Leading: Payload CMS (65.8%)

Statistics

MetricValue
GitHub wins55
Payload CMS wins106
Abstains (no tool)197
Other tool chosen2816
Decisive cases161
GitHub win rate (unweighted)34.2%
95% CI27.3% - 41.8%
GitHub win rate (weighted)34.2%

Comments

GitHub

No comments yet

Verified critics can leave comments here.

Payload CMS

No comments yet

Verified critics can leave comments here.

Per-model breakdown

ModelTierGitHubPayload CMSNoneOtherA rate
Claude Sonnet 4.6Frontier15201152%
Llama 4 MaverickFrontier3302696100%
Kimi K2.5Frontier01481020%
Gemini 2.5 ProFrontier1302152100%
GPT 5.5Frontier6702946%
MiniMax M2.7Frontier01341070%
GPT 5.3 CodexFrontier0771500%
Claude Opus 4.8Frontier060360%
Gemini 3.5 FlashSmall026340%
Kimi K2.7 CodeFrontier025340%
GPT 5.4Frontier100125100%
Mistral Small 4Mid100158100%
GLM 5.2Frontier010410%
GPT 5.4 MiniMid0171530%
MiniMax M3Frontier010410%
Claude Haiku 4.5Small000168n/a
Claude Opus 4.6Frontier000126n/a
DeepSeek R1 0528Frontier0011156n/a
DeepSeek V3.2Mid006120n/a
DeepSeek V4 FlashMid00140n/a
DeepSeek V4 ProFrontier00636n/a
Devstral 2 2512Mid000156n/a
Gemini 2.5 FlashSmall000126n/a
GLM 5 TurboFrontier004184n/a
Llama 4 ScoutSmall006157n/a
MiMo V2 ProFrontier004122n/a
MiMo V2.5 ProFrontier00140n/a
Qwen3 Coder NextMid0056112n/a

Per-prompt breakdown

PromptTierGitHubPayload CMSNoneOtherA rate
blog-platform-cmsAdvanced079304190%
documentation-siteIntermediate30030463100%
blog-platform-cmsIntermediate02705090%
documentation-siteAdvanced25013482100%
blog-platform-cmsBeginner000537n/a
documentation-siteBeginner00124406n/a