| Metric | Value |
|---|---|
| Amazon SNS wins | 168 |
| Resend wins | 237 |
| Abstains (no tool) | 112 |
| Other tool chosen | 5831 |
| Decisive cases | 405 |
| Amazon SNS win rate (unweighted) | 41.5% |
| 95% CI | 36.8% - 46.3% |
| Amazon SNS win rate (weighted) | 41.5% |
Verified critics can leave comments here.
BEIt's crazy how much taste and craft matter. I used SendGrid for 10 years and always hated having to check their API docs or log in to the web app to change an email template. I've been using Resend for a year now, and I always notice how happy I am to do something there. Honestly, not just happy — I feel excited about it. And we're talking about email APIs here... You can feel the attention to detail.
| Model | Tier | Amazon SNS | Resend | None | Other | A rate |
|---|---|---|---|---|---|---|
| DeepSeek V3.2 | Mid | 0 | 68 | 16 | 238 | 0% |
| Gemini 2.5 Flash | Small | 46 | 0 | 10 | 266 | 100% |
| MiMo V2 Pro | Frontier | 35 | 2 | 4 | 283 | 95% |
| Claude Haiku 4.5 | Small | 34 | 1 | 0 | 292 | 97% |
| Mistral Small 4 | Mid | 0 | 35 | 0 | 294 | 0% |
| Claude Sonnet 4.6 | Frontier | 0 | 34 | 0 | 302 | 0% |
| Gemini 2.5 Pro | Frontier | 2 | 25 | 2 | 303 | 7% |
| Claude Opus 4.6 | Frontier | 9 | 12 | 0 | 303 | 43% |
| GPT 5.4 Mini | Mid | 5 | 15 | 6 | 308 | 25% |
| GPT 5.4 | Frontier | 0 | 15 | 0 | 309 | 0% |
| GLM 5 Turbo | Frontier | 1 | 13 | 17 | 293 | 7% |
| Llama 4 Scout | Small | 11 | 2 | 4 | 314 | 85% |
| Devstral 2 2512 | Mid | 12 | 0 | 0 | 321 | 100% |
| GPT 5.3 Codex | Frontier | 7 | 2 | 0 | 327 | 78% |
| MiniMax M2.7 | Frontier | 2 | 6 | 17 | 292 | 25% |
| DeepSeek R1 0528 | Frontier | 3 | 1 | 26 | 303 | 75% |
| Kimi K2.5 | Frontier | 0 | 3 | 8 | 311 | 0% |
| DeepSeek V4 Pro | Frontier | 0 | 2 | 0 | 10 | 0% |
| MiMo V2.5 Pro | Frontier | 1 | 0 | 0 | 11 | 100% |
| Claude Opus 4.8 | Frontier | 0 | 1 | 0 | 11 | 0% |
| DeepSeek V4 Flash | Mid | 0 | 0 | 0 | 12 | n/a |
| Gemini 3.5 Flash | Small | 0 | 0 | 0 | 12 | n/a |
| GLM 5.2 | Frontier | 0 | 0 | 0 | 12 | n/a |
| GPT 5.5 | Frontier | 0 | 0 | 0 | 12 | n/a |
| Kimi K2.7 Code | Frontier | 0 | 0 | 0 | 12 | n/a |
| Llama 4 Maverick | Frontier | 0 | 0 | 1 | 334 | n/a |
| MiniMax M3 | Frontier | 0 | 0 | 0 | 12 | n/a |
| Qwen3 Coder Next | Mid | 0 | 0 | 1 | 334 | n/a |
| Prompt | Tier | Amazon SNS | Resend | None | Other | A rate |
|---|---|---|---|---|---|---|
| project-management-tool | Beginner | 1 | 71 | 21 | 344 | 1% |
| project-management-tool | Advanced | 28 | 41 | 4 | 354 | 41% |
| social-media-platform | Advanced | 66 | 2 | 3 | 364 | 97% |
| project-management-tool | Intermediate | 0 | 49 | 13 | 366 | 0% |
| chat-application | Advanced | 27 | 1 | 6 | 401 | 96% |
| project-management-tool | Beginner | 0 | 26 | 7 | 61 | 0% |
| project-management-tool | Advanced | 3 | 14 | 1 | 75 | 18% |
| project-management-tool | Intermediate | 0 | 17 | 4 | 74 | 0% |
| social-media-platform | Advanced | 13 | 3 | 0 | 79 | 81% |
| chat-application | Intermediate | 11 | 0 | 3 | 423 | 100% |
| chat-application | Advanced | 9 | 0 | 2 | 84 | 100% |
| social-media-platform | Beginner | 4 | 3 | 6 | 425 | 57% |
| social-media-platform | Intermediate | 1 | 4 | 0 | 89 | 20% |
| social-media-platform | Intermediate | 2 | 2 | 0 | 431 | 50% |
| restaurant-reservation-system | Advanced | 2 | 0 | 17 | 415 | 100% |
| social-media-platform | Beginner | 0 | 2 | 1 | 92 | 0% |
| restaurant-reservation-system | Advanced | 1 | 0 | 2 | 91 | 100% |
| chat-application | Beginner | 0 | 1 | 1 | 93 | 0% |
| chat-application | Beginner | 0 | 1 | 14 | 418 | 0% |
| chat-application | Intermediate | 0 | 0 | 0 | 95 | n/a |
| restaurant-reservation-system | Beginner | 0 | 0 | 3 | 433 | n/a |
| restaurant-reservation-system | Intermediate | 0 | 0 | 1 | 94 | n/a |
| restaurant-reservation-system | Beginner | 0 | 0 | 1 | 94 | n/a |
| restaurant-reservation-system | Intermediate | 0 | 0 | 2 | 436 | n/a |
