LLM Evals

Vellum vs MLflow

VellumMLflow

44%

56%

Leading: MLflow (55.8%)

Verified critics can leave comments here.

Verified critics can leave comments here.

Model	Tier	Vellum	MLflow	None	Other	A rate
Llama 4 Scout	Small	0	24	20	141	0%
Devstral 2 2512	Mid	18	0	14	145	100%
MiMo V2 Pro	Frontier	1	0	8	123	100%
Claude Haiku 4.5	Small	0	0	3	191	n/a
Claude Opus 4.6	Frontier	0	0	0	132	n/a
Claude Opus 4.8	Frontier	0	0	6	65	n/a
Claude Sonnet 4.6	Frontier	0	0	6	198	n/a
DeepSeek R1 0528	Frontier	0	0	9	195	n/a
DeepSeek V3.2	Mid	0	0	22	106	n/a
DeepSeek V4 Flash	Mid	0	0	4	67	n/a
DeepSeek V4 Pro	Frontier	0	0	2	70	n/a
Gemini 2.5 Flash	Small	0	0	1	126	n/a
Gemini 2.5 Pro	Frontier	0	0	11	191	n/a
Gemini 3.5 Flash	Small	0	0	7	65	n/a
GLM 5 Turbo	Frontier	0	0	19	113	n/a
GLM 5.2	Frontier	0	0	0	72	n/a
GPT 5.3 Codex	Frontier	0	0	0	204	n/a
GPT 5.4	Frontier	0	0	0	132	n/a
GPT 5.4 Mini	Mid	0	0	8	193	n/a
GPT 5.5	Frontier	0	0	2	70	n/a
Kimi K2.5	Frontier	0	0	3	116	n/a
Kimi K2.7 Code	Frontier	0	0	1	70	n/a
Llama 4 Maverick	Frontier	0	0	12	177	n/a
MiMo V2.5 Pro	Frontier	0	0	8	63	n/a
MiniMax M2.7	Frontier	0	0	5	124	n/a
MiniMax M3	Frontier	0	0	5	67	n/a
Mistral Small 4	Mid	0	0	3	186	n/a
Qwen3 Coder Next	Mid	0	0	4	194	n/a

Prompt	Tier	Vellum	MLflow	None	Other	A rate
ai-support-agent-platform	Intermediate	11	4	6	501	73%
ai-revenue-ops-copilot	Beginner	2	5	11	508	29%
ai-support-agent-platform	Advanced	0	5	5	517	0%
ai-support-agent-platform	Beginner	4	0	73	450	100%
ai-revenue-ops-copilot	Intermediate	2	2	4	514	50%
ai-engineering-workflow	Intermediate	0	4	1	107	0%
ai-revenue-ops-copilot	Advanced	0	3	3	508	0%
ai-engineering-workflow	Advanced	0	1	1	110	0%
ai-agent-application	Advanced	0	0	0	112	n/a
ai-agent-application	Beginner	0	0	25	94	n/a
ai-agent-application	Intermediate	0	0	1	112	n/a
ai-engineering-workflow	Beginner	0	0	53	63	n/a