| Metric | Value |
|---|---|
| Amazon SNS wins | 217 |
| Resend wins | 335 |
| Abstains (no tool) | 146 |
| Other tool chosen | 8302 |
| Decisive cases | 552 |
| Amazon SNS win rate (unweighted) | 39.3% |
| 95% CI | 35.3% - 43.4% |
| Amazon SNS win rate (weighted) | 39.3% |
Verified critics can leave comments here.
BEIt's crazy how much taste and craft matter. I used SendGrid for 10 years and always hated having to check their API docs or log in to the web app to change an email template. I've been using Resend for a year now, and I always notice how happy I am to do something there. Honestly, not just happy — I feel excited about it. And we're talking about email APIs here... You can feel the attention to detail.
| Model range | Tier | Amazon SNS | Resend | None | Other | A rate |
|---|---|---|---|---|---|---|
| DeepSeek Flash 3.2–4.1 | Mid | 2 | 79 | 20 | 368 | 2% |
| DeepSeek Pro 4–4 0813 | Frontier | 2 | 14 | 0 | 92 | 13% |
| DeepSeek R1 | Frontier | 5 | 1 | 34 | 430 | 83% |
| Devstral | Mid | 13 | 0 | 0 | 433 | 100% |
| Gemini Flash 2.5–3.8 | Small | 54 | 0 | 12 | 405 | 100% |
| Gemini Pro 2.5–3.1 Preview | Frontier | 3 | 32 | 2 | 431 | 9% |
| GLM 5 Turbo–5.3 | Frontier | 2 | 19 | 18 | 433 | 10% |
| GPT 5.4–6 Astra | Frontier | 0 | 28 | 1 | 443 | 0% |
| GPT Coding 5.3 Codex–6.1 Sol | Frontier | 9 | 4 | 1 | 458 | 69% |
| GPT Mini 5.4 Mini–6 Luna | Mid | 6 | 19 | 16 | 429 | 24% |
| Haiku | Small | 52 | 2 | 1 | 404 | 96% |
| Kimi 2.5–3 | Frontier | 0 | 4 | 8 | 458 | 0% |
| Llama Maverick | Frontier | 0 | 0 | 1 | 471 | n/a |
| Llama Scout | Small | 16 | 2 | 4 | 445 | 89% |
| MiMo Pro 2–2.6 | Frontier | 40 | 5 | 7 | 419 | 89% |
| MiniMax M 2.7–3 | Frontier | 3 | 8 | 19 | 436 | 27% |
| Mistral Small | Mid | 0 | 47 | 1 | 413 | 0% |
| Opus 4.6–5.5 | Frontier | 10 | 23 | 0 | 438 | 30% |
| Qwen Coder | Mid | 0 | 0 | 1 | 471 | n/a |
| Sonnet 4.6–5.5 | Frontier | 0 | 48 | 0 | 425 | 0% |
| Prompt | Tier | Amazon SNS | Resend | None | Other | A rate |
|---|---|---|---|---|---|---|
| project-management-tool | Beginner | 1 | 116 | 23 | 453 | 1% |
| social-media-platform | Advanced | 80 | 2 | 6 | 506 | 98% |
| project-management-tool | Advanced | 33 | 44 | 5 | 497 | 43% |
| project-management-tool | Intermediate | 0 | 62 | 16 | 503 | 0% |
| chat-application | Advanced | 37 | 1 | 6 | 549 | 97% |
| project-management-tool | Beginner | 0 | 37 | 11 | 103 | 0% |
| project-management-tool | Advanced | 7 | 21 | 2 | 120 | 25% |
| project-management-tool | Intermediate | 0 | 26 | 6 | 120 | 0% |
| social-media-platform | Advanced | 22 | 3 | 1 | 144 | 88% |
| chat-application | Advanced | 14 | 0 | 3 | 135 | 100% |
| chat-application | Intermediate | 12 | 0 | 3 | 577 | 100% |
| social-media-platform | Beginner | 4 | 5 | 7 | 580 | 44% |
| social-media-platform | Intermediate | 1 | 7 | 1 | 141 | 13% |
| social-media-platform | Intermediate | 3 | 3 | 1 | 586 | 50% |
| social-media-platform | Beginner | 0 | 5 | 3 | 163 | 0% |
| restaurant-reservation-system | Advanced | 2 | 0 | 20 | 570 | 100% |
| chat-application | Beginner | 0 | 2 | 15 | 574 | 0% |
| restaurant-reservation-system | Advanced | 1 | 0 | 4 | 145 | 100% |
| chat-application | Beginner | 0 | 1 | 2 | 164 | 0% |
| chat-application | Intermediate | 0 | 0 | 0 | 170 | n/a |
| restaurant-reservation-system | Intermediate | 0 | 0 | 3 | 593 | n/a |
| restaurant-reservation-system | Intermediate | 0 | 0 | 2 | 169 | n/a |
| restaurant-reservation-system | Beginner | 0 | 0 | 4 | 590 | n/a |
| restaurant-reservation-system | Beginner | 0 | 0 | 2 | 150 | n/a |
