LLM Evals

UpTrain vs LMSYS Chatbot Arena

UpTrainLMSYS Chatbot Arena

50%

Insufficient data

This matchup has 24 decisive cases (minimum 30 required for publication).

Verified critics can leave comments here.

Verified critics can leave comments here.

Model	Tier	UpTrain	LMSYS Chatbot Arena	None	Other	A rate
Llama 4 Scout	Small	0	12	20	153	0%
DeepSeek V3.2	Mid	7	0	22	99	100%
Gemini 2.5 Pro	Frontier	5	0	11	186	100%
Claude Haiku 4.5	Small	0	0	3	191	n/a
Claude Opus 4.6	Frontier	0	0	0	132	n/a
Claude Opus 4.8	Frontier	0	0	6	65	n/a
Claude Sonnet 4.6	Frontier	0	0	6	198	n/a
DeepSeek R1 0528	Frontier	0	0	9	195	n/a
DeepSeek V4 Flash	Mid	0	0	4	67	n/a
DeepSeek V4 Pro	Frontier	0	0	2	70	n/a
Devstral 2 2512	Mid	0	0	14	163	n/a
Gemini 2.5 Flash	Small	0	0	1	126	n/a
Gemini 3.5 Flash	Small	0	0	7	65	n/a
GLM 5 Turbo	Frontier	0	0	19	113	n/a
GLM 5.2	Frontier	0	0	0	72	n/a
GPT 5.3 Codex	Frontier	0	0	0	204	n/a
GPT 5.4	Frontier	0	0	0	132	n/a
GPT 5.4 Mini	Mid	0	0	8	193	n/a
GPT 5.5	Frontier	0	0	2	70	n/a
Kimi K2.5	Frontier	0	0	3	116	n/a
Kimi K2.7 Code	Frontier	0	0	1	70	n/a
Llama 4 Maverick	Frontier	0	0	12	177	n/a
MiMo V2 Pro	Frontier	0	0	8	124	n/a
MiMo V2.5 Pro	Frontier	0	0	8	63	n/a
MiniMax M2.7	Frontier	0	0	5	124	n/a
MiniMax M3	Frontier	0	0	5	67	n/a
Mistral Small 4	Mid	0	0	3	186	n/a
Qwen3 Coder Next	Mid	0	0	4	194	n/a

Prompt	Tier	UpTrain	LMSYS Chatbot Arena	None	Other	A rate
ai-support-agent-platform	Advanced	4	4	5	514	50%
ai-revenue-ops-copilot	Beginner	3	2	11	510	60%
ai-support-agent-platform	Beginner	3	0	73	451	100%
ai-agent-application	Intermediate	0	2	1	110	0%
ai-support-agent-platform	Intermediate	0	2	6	514	0%
ai-agent-application	Advanced	1	0	0	111	100%
ai-engineering-workflow	Beginner	1	0	53	62	100%
ai-engineering-workflow	Advanced	0	1	1	110	0%
ai-revenue-ops-copilot	Advanced	0	1	3	510	0%
ai-agent-application	Beginner	0	0	25	94	n/a
ai-engineering-workflow	Intermediate	0	0	1	111	n/a
ai-revenue-ops-copilot	Intermediate	0	0	4	518	n/a