LLM Evals

Vellum vs TruLens

VellumTruLens

50%

Verified critics can leave comments here.

Verified critics can leave comments here.

Model	Tier	Vellum	TruLens	None	Other	A rate
Devstral 2 2512	Mid	18	0	14	140	100%
Mistral Small 4	Mid	0	12	3	181	0%
DeepSeek R1 0528	Frontier	0	4	10	196	0%
Gemini 2.5 Pro	Frontier	0	3	9	196	0%
MiMo V2 Pro	Frontier	1	0	8	117	100%
Claude Haiku 4.5	Small	0	0	4	196	n/a
Claude Opus 4.6	Frontier	0	0	0	126	n/a
Claude Opus 4.8	Frontier	0	0	7	76	n/a
Claude Sonnet 4.6	Frontier	0	0	7	203	n/a
DeepSeek V3.2	Mid	0	0	22	101	n/a
DeepSeek V4 Flash	Mid	0	0	4	79	n/a
DeepSeek V4 Pro	Frontier	0	0	2	82	n/a
Gemini 2.5 Flash	Small	0	0	1	120	n/a
Gemini 3.5 Flash	Small	0	0	8	76	n/a
GLM 5 Turbo	Frontier	0	0	19	107	n/a
GLM 5.2	Frontier	0	0	0	84	n/a
GPT 5.3 Codex	Frontier	0	0	0	210	n/a
GPT 5.4	Frontier	0	0	0	126	n/a
GPT 5.4 Mini	Mid	0	0	8	199	n/a
GPT 5.5	Frontier	0	0	3	81	n/a
Kimi K2.5	Frontier	0	0	3	111	n/a
Kimi K2.7 Code	Frontier	0	0	1	82	n/a
Llama 4 Maverick	Frontier	0	0	14	181	n/a
Llama 4 Scout	Small	0	0	23	166	n/a
MiMo V2.5 Pro	Frontier	0	0	9	74	n/a
MiniMax M2.7	Frontier	0	0	5	118	n/a
MiniMax M3	Frontier	0	0	6	78	n/a
Qwen3 Coder Next	Mid	0	0	4	199	n/a

Prompt	Tier	Vellum	TruLens	None	Other	A rate
ai-support-agent-platform	Intermediate	11	3	5	503	79%
ai-agent-application	Advanced	0	5	0	126	0%
ai-support-agent-platform	Beginner	4	0	75	449	100%
ai-revenue-ops-copilot	Beginner	2	2	11	510	50%
ai-revenue-ops-copilot	Intermediate	2	1	4	516	67%
ai-agent-application	Beginner	0	3	28	107	0%
ai-agent-application	Intermediate	0	2	1	129	0%
ai-engineering-workflow	Intermediate	0	1	1	129	0%
ai-revenue-ops-copilot	Advanced	0	1	2	513	0%
ai-support-agent-platform	Advanced	0	1	5	521	0%
ai-engineering-workflow	Advanced	0	0	1	129	n/a
ai-engineering-workflow	Beginner	0	0	61	73	n/a