| Metric | Value |
|---|---|
| Amazon SNS wins | 158 |
| Resend wins | 208 |
| Abstains (no tool) | 101 |
| Other tool chosen | 5923 |
| Decisive cases | 366 |
| Amazon SNS win rate (unweighted) | 43.2% |
| 95% CI | 38.2% - 48.3% |
| Amazon SNS win rate (weighted) | 43.2% |
Verified critics can leave comments here.
BEIt's crazy how much taste and craft matter. I used SendGrid for 10 years and always hated having to check their API docs or log in to the web app to change an email template. I've been using Resend for a year now, and I always notice how happy I am to do something there. Honestly, not just happy — I feel excited about it. And we're talking about email APIs here... You can feel the attention to detail.
| Model | Tier | Amazon SNS | Resend | None | Other | A rate |
|---|---|---|---|---|---|---|
| DeepSeek V3.2 | Mid | 0 | 48 | 12 | 202 | 0% |
| Gemini 2.5 Flash | Small | 39 | 0 | 8 | 216 | 100% |
| Claude Haiku 4.5 | Small | 36 | 1 | 0 | 286 | 97% |
| MiMo V2 Pro | Frontier | 32 | 2 | 4 | 226 | 94% |
| Mistral Small 4 | Mid | 0 | 34 | 1 | 293 | 0% |
| Claude Sonnet 4.6 | Frontier | 0 | 29 | 0 | 307 | 0% |
| Gemini 2.5 Pro | Frontier | 2 | 23 | 2 | 305 | 8% |
| GPT 5.4 Mini | Mid | 5 | 18 | 8 | 303 | 22% |
| Devstral 2 2512 | Mid | 13 | 0 | 0 | 308 | 100% |
| Claude Opus 4.6 | Frontier | 5 | 5 | 0 | 254 | 50% |
| GLM 5 Turbo | Frontier | 0 | 10 | 15 | 239 | 0% |
| DeepSeek V4 Pro | Frontier | 1 | 8 | 0 | 63 | 11% |
| GPT 5.4 | Frontier | 0 | 9 | 0 | 255 | 0% |
| GPT 5.3 Codex | Frontier | 8 | 0 | 0 | 328 | 100% |
| Llama 4 Scout | Small | 7 | 0 | 3 | 321 | 100% |
| MiniMax M2.7 | Frontier | 2 | 5 | 14 | 237 | 29% |
| Claude Opus 4.8 | Frontier | 0 | 6 | 0 | 65 | 0% |
| DeepSeek R1 0528 | Frontier | 4 | 1 | 24 | 305 | 80% |
| MiMo V2.5 Pro | Frontier | 4 | 1 | 2 | 64 | 80% |
| GPT 5.5 | Frontier | 0 | 3 | 0 | 69 | 0% |
| DeepSeek V4 Flash | Mid | 0 | 2 | 0 | 68 | 0% |
| GLM 5.2 | Frontier | 0 | 1 | 0 | 71 | 0% |
| Kimi K2.5 | Frontier | 0 | 1 | 7 | 254 | 0% |
| MiniMax M3 | Frontier | 0 | 1 | 0 | 71 | 0% |
| Gemini 3.5 Flash | Small | 0 | 0 | 0 | 72 | n/a |
| Kimi K2.7 Code | Frontier | 0 | 0 | 0 | 72 | n/a |
| Llama 4 Maverick | Frontier | 0 | 0 | 1 | 334 | n/a |
| Qwen3 Coder Next | Mid | 0 | 0 | 0 | 335 | n/a |
| Prompt | Tier | Amazon SNS | Resend | None | Other | A rate |
|---|---|---|---|---|---|---|
| project-management-tool | Beginner | 1 | 95 | 22 | 416 | 1% |
| social-media-platform | Advanced | 74 | 2 | 5 | 453 | 97% |
| project-management-tool | Advanced | 31 | 43 | 4 | 443 | 42% |
| project-management-tool | Intermediate | 0 | 59 | 13 | 452 | 0% |
| chat-application | Advanced | 32 | 1 | 6 | 495 | 97% |
| chat-application | Intermediate | 12 | 0 | 3 | 520 | 100% |
| social-media-platform | Beginner | 4 | 4 | 6 | 523 | 50% |
| social-media-platform | Intermediate | 2 | 2 | 1 | 529 | 50% |
| restaurant-reservation-system | Advanced | 2 | 0 | 20 | 511 | 100% |
| chat-application | Beginner | 0 | 2 | 14 | 516 | 0% |
| restaurant-reservation-system | Beginner | 0 | 0 | 4 | 531 | n/a |
| restaurant-reservation-system | Intermediate | 0 | 0 | 3 | 534 | n/a |
