How We Test Email Tools & Score Email Health

How we test email tools is documented here in full: every rating on ToolTrusted comes from the same hands-on process — we run each email marketing tool in production, score it on a fixed five-axis rubric, and date-stamp the result. This page documents that methodology in full so you can judge our verdicts for yourself. For who we are and how the work is funded, see About ToolTrusted.

In short, this is testing email tools the hard way: a documented email tool evaluation protocol, an email health testing methodology built on live DNS measurement, and an email deliverability testing rubric applied identically to every product we review.

how we test email tools
How we test email tools: the five-axis rubric at a glance.

How we test email tools: the protocol

Before we publish a verdict, every tool is tested in production for at least four weeks — not clicked through for an afternoon. In that window we:

  • Send real campaigns to seed lists and measure inbox placement with independent deliverability testing, rather than trusting the vendor’s own numbers.
  • Build at least one non-trivial automation in the tool’s workflow editor — a welcome series with branching and tagging — to test real capability, not the demo.
  • Contact support at least twice, once during business hours and once off-hours (around 2 AM), and time the response on every channel the plan offers.
  • Model the real price at common contact and send volumes, including what’s locked behind upgrades, so the cost reflects what you would actually pay.
  • Record the platform version and the test date. Software changes; a review from 18 months ago is not a review of today’s product, so every verdict carries the date we last verified it.

Our five-axis rubric

The rubric is the core of how we test email tools. Each tool is scored 1–5 on five axes, then averaged into the star rating you see in the verdict box:

  • Deliverability — independent seed-list inbox placement, sender-reputation policy, and authentication setup quality.
  • Pricing transparency — what you actually pay at common contact and send volumes, how the price scales, and what is locked behind upgrades.
  • Automation depth — workflow-builder capability, trigger and condition variety, and how powerful the cheapest automation-capable tier is.
  • Integration coverage — count and quality of native integrations, especially WordPress, WooCommerce, Shopify, Stripe, Zapier, and the major form builders.
  • Customer support — response time, channel availability per plan, and documentation quality.

That refusal to weight is core to how we test email tools. We do not weight the axes. We would rather be transparent than convenient — a tool that scores 5 on pricing and 1 on deliverability is not a 3-star tool, it is a tool with one fatal flaw, and we would rather you read that section than the headline number.

How scores become verdicts

Because how we test email tools stays fixed, verdicts stay comparable across tools and over time — the averaged score maps to a fixed recommendation band:

  • 4.5–5.0 — Top pick. Best-in-class for its use case; we recommend it without reservation.
  • 4.0–4.4 — Strong choice. Excellent for most users, with minor trade-offs we spell out.
  • 3.0–3.9 — Situational. Right for specific needs and wrong for others; read the section before buying.
  • Below 3.0 — Not recommended. A material flaw outweighs the strengths for most readers.

What we publish with every review

Transparency is built into how we test email tools: so you can verify our work, each review states the platform version and the date we tested, a dated pricing snapshot, and the deliverability result we measured. Where we cite third-party averages — Trustpilot, G2, or Capterra — we label them as external data and keep them clearly separate from our own editorial rating. The number in our verdict box is always ToolTrusted’s independent score, never an imported one.

How the Email Health Score works

Our free Email Health Check grades any domain out of 100. That score is the public output of our Email Health Engine, which reads live, public DNS records — nothing is self-reported. We group the measured signals into four dimensions, each with its own 0–100 sub-score:

  • Authentication — SPF, DKIM and DMARC: the records that prove your mail genuinely comes from you.
  • Infrastructure — MX, MTA-STS and TLS-RPT: how your mail is routed and encrypted in transit.
  • Security — DMARC enforcement, MTA-STS and BIMI: your defence against spoofing and brand abuse.
  • Reputation — a live check of the domain’s host IP against major blacklists (Spamhaus ZEN, Barracuda, SpamCop). We check the domain’s host IP; your ESP’s sending IPs may differ.

The headline score weights the core authentication records most heavily (DMARC 30, SPF 25, DKIM 20 points), with MX and the optional transport and brand records (MTA-STS, TLS-RPT, BIMI) making up the remainder. These weights are editorial, but every input is a real, verifiable measurement — we publish no invented numbers.

Why we don’t claim a deliverability score

Inbox placement depends on factors only a live seed-list test can measure — which our free DNS-based engine deliberately does not fake. Instead, every check includes a Deliverability Intelligence section that explains how your measured authentication, infrastructure, security and reputation signals typically influence whether mailbox providers inbox or filter your mail. It is guidance grounded in what we can measure, never a fabricated placement number.

What the score means for you: Sender Trust, Readiness & Risk

Below the score and its dimensions we add a Business-Intelligence layer — plain-English readouts that interpret the same measured checks. These are not extra scores; the Email Health Score stays the one headline. Each readout is a level, a verdict and the exact signals behind it:

  • Sender Trust (Strong / Moderate / Limited / Poor) — can recipients trust that mail is genuinely from you? Driven by DMARC enforcement, a strict SPF -all and DKIM signing. On the live check, a current blacklist listing caps it and a validated DNSSEC record is noted.
  • Deliverability Readiness (Ready / Nearly ready / Not ready) — are you set up to send at volume against the Gmail, Yahoo and Microsoft bulk-sender bar? We measure SPF, DKIM and DMARC; we also flag the requirements we cannot read from DNS (one-click unsubscribe per RFC 8058, keeping spam complaints under 0.3%) so you can check them yourself.
  • Risk Level (Low / Elevated / High / Critical) — how exposed are you to spoofing and interception? A domain with no DMARC (or p=none) is spoofable; a live blacklist listing is critical.

Every level is set by explicit, published rules from real measurements — no hidden scoring, no invented numbers. DNSSEC and blacklist reputation are live signals: they appear on the interactive Email Health Check but are never frozen into a saved report, because a weeks-old blacklist status is meaningless.

Infrastructure Intelligence — measuring the real mail servers

Reputation only means something when it’s measured on the servers that actually carry your mail. From your domain we resolve the MX records, discover every mail server, resolve each to its real IPv4/IPv6 addresses, then measure reverse DNS (PTR), the ASN and network owner (via Team Cymru), the hosting/email provider, DNSSEC, the MTA-STS policy, and blacklist reputation on the mail-server IPs — not the website’s IP. These measured signals sharpen the existing Reputation dimension and the Sender Trust / Risk / Readiness readouts. The Email Health Score itself is unchanged: we measure the right infrastructure, we don’t change how the score is calculated.

Every value is a live measurement or is clearly marked “not measured” — we never fabricate. Live SMTP-banner and TLS-certificate inspection require a direct connection to your mail servers, which our current environment can’t make; that capability is planned and labelled “coming soon” rather than guessed at.

Independence and funding

We earn commissions from some of the tools we recommend, and every page with an affiliate link says so — see our Affiliate Disclaimer, in line with the FTC’s Endorsement Guides. What commissions never do is change how we test email tools or the score that results: we do not take payment for positive reviews, let a vendor approve a draft, or rank by commission. Tools that pay us nothing have topped our rankings, and tools that pay us well have landed in our “not recommended” sections.

Updates and corrections

Re-testing is part of how we test email tools. Tools change — pricing shifts, features ship, deliverability drifts. We re-verify our data on a regular cadence and mark each update with a revision date. If you spot something out of date, tell us via the contact page and we will re-test and correct the post.

Who runs the tests

ToolTrusted’s reviews are written by people who have built and broken email infrastructure for years. Elena Tarrant covers lifecycle and broadcast email, ESP comparisons, pricing, and automation; Raj Kapoor covers deliverability — SPF, DKIM, DMARC, BIMI, warm-up, and migrations. Our verdicts are built on that experience, not on press releases.