LLM Evals

TruLens vs Vellum

TruLensVellum

47%

53%

Leading: Vellum (52.8%)

Verified critics can leave comments here.

Verified critics can leave comments here.

Model	Tier	TruLens	Vellum	None	Other	A rate
Devstral 2 2512	Mid	0	18	14	145	0%
Mistral Small 4	Mid	10	0	3	176	100%
DeepSeek R1 0528	Frontier	4	0	9	191	100%
Gemini 2.5 Pro	Frontier	3	0	11	188	100%
MiMo V2 Pro	Frontier	0	1	8	123	0%
Claude Haiku 4.5	Small	0	0	3	191	n/a
Claude Opus 4.6	Frontier	0	0	0	132	n/a
Claude Opus 4.8	Frontier	0	0	6	65	n/a
Claude Sonnet 4.6	Frontier	0	0	6	198	n/a
DeepSeek V3.2	Mid	0	0	22	106	n/a
DeepSeek V4 Flash	Mid	0	0	4	67	n/a
DeepSeek V4 Pro	Frontier	0	0	2	70	n/a
Gemini 2.5 Flash	Small	0	0	1	126	n/a
Gemini 3.5 Flash	Small	0	0	7	65	n/a
GLM 5 Turbo	Frontier	0	0	19	113	n/a
GLM 5.2	Frontier	0	0	0	72	n/a
GPT 5.3 Codex	Frontier	0	0	0	204	n/a
GPT 5.4	Frontier	0	0	0	132	n/a
GPT 5.4 Mini	Mid	0	0	8	193	n/a
GPT 5.5	Frontier	0	0	2	70	n/a
Kimi K2.5	Frontier	0	0	3	116	n/a
Kimi K2.7 Code	Frontier	0	0	1	70	n/a
Llama 4 Maverick	Frontier	0	0	12	177	n/a
Llama 4 Scout	Small	0	0	20	165	n/a
MiMo V2.5 Pro	Frontier	0	0	8	63	n/a
MiniMax M2.7	Frontier	0	0	5	124	n/a
MiniMax M3	Frontier	0	0	5	67	n/a
Qwen3 Coder Next	Mid	0	0	4	194	n/a

Prompt	Tier	TruLens	Vellum	None	Other	A rate
ai-support-agent-platform	Intermediate	3	11	6	502	21%
ai-agent-application	Advanced	4	0	0	108	100%
ai-revenue-ops-copilot	Beginner	2	2	11	511	50%
ai-support-agent-platform	Beginner	0	4	73	450	0%
ai-revenue-ops-copilot	Intermediate	1	2	4	515	33%
ai-agent-application	Beginner	2	0	25	92	100%
ai-agent-application	Intermediate	2	0	1	110	100%
ai-engineering-workflow	Intermediate	1	0	1	110	100%
ai-revenue-ops-copilot	Advanced	1	0	3	510	100%
ai-support-agent-platform	Advanced	1	0	5	521	100%
ai-engineering-workflow	Advanced	0	0	1	111	n/a
ai-engineering-workflow	Beginner	0	0	53	63	n/a