A/B testing subject lines at agency scale means more variants, more sends per prospect, and more mailboxes to maintain reputation across. Woodpecker's prospect-metered pricing rewards narrow targeting, not systematic testing. SpamCipher runs sequences with up to 5 A/B variants per step, warm-up and placement tests in one platform, alongside cold email sending, and on SpamCipher ONE sending is unlimited, with every mailbox kept inside its own daily cap, so no meter counts every test send against the bill.
Woodpecker's A/B testing is priced for small lists and simple splits. The problem arrives when you run it like an agency: twelve clients, forty subject line variants per campaign, and a ramp that touches the same prospect three times before you pick a winner. Woodpecker meters by prospects contacted, not emails sent. Every test variant counts against your meter. Every follow-up to a prospect already in the sequence counts again. On Woodpecker.co, the pricing model that looks cheap at 100 prospects becomes expensive fast when you need statistical power.
How Woodpecker Actually Meters A/B Testing
Woodpecker's pricing, as of 2026-07-27, runs $7 per 100 contacted prospects monthly. On Woodpecker.co, that base rate includes 16,000 emails monthly, 4,000 stored prospects, 4 warm-ups, and 100 Lead Finder credits. The key word is contacted. A prospect becomes "contacted" when they enter a sequence, not when they receive their first email.
What one A/B test actually consumes
| Stage | Calculation | Emails sent |
|---|---|---|
| Initial sends | 3 variants × 1,000 prospects | 3,000 |
| Follow-up round 1 | 3 variants × 1,000 prospects | 3,000 |
| Follow-up round 2 | 3 variants × 1,000 prospects | 3,000 |
| Follow-up round 3 | 3 variants × 1,000 prospects | 3,000 |
| Total | 12,000 | |
| Woodpecker prospect meter | 1,000 prospects contacted | 1,000 |
The meter reads 1,000 prospects. The send counter reads 12,000. On Woodpecker.co, you have 4,000 prospects of headroom, but only 4,000 emails remaining.
This shapes A/B testing in a specific way. On Instantly.ai, suppose you split test three subject lines to 1,000 prospects. Woodpecker counts 1,000 contacted prospects, not 3,000 emails sent. The 16,000 email allowance looks generous until you map what a real test consumes.
Woodpecker's condition-based campaigns let you branch on opens and replies, which is powerful for personalization. For A/B testing, it means your test architecture affects your bill. On Woodpecker.co, a complex sequence with multiple branches consumes the same prospect meter whether the branches fire or not, but burns through email allowance faster when they do.
The Agency Panel add-on, at $27 monthly per active client with centralized billing, helps with multi-client management on Woodpecker. Woodpecker's white-label runs another $5 monthly per client. Woodpecker's API access is a further $20 monthly add-on, not included in the base rate. For an agency running systematic subject line testing across a book of clients, almost everything sits outside the headline $7 rate.
Where Prospect Metering Breaks Down for Testing
Statistical power in subject line testing requires sample size. Industry convention calls for at least 100 opens per variant before calling a winner, which at 30% open rates means 300+ sends per variant. A four-variant test to reach significance needs 1,200+ sends minimum, often 2,000+ to account for variance.
Three pricing models for the same test
| Model | What you pay for | Cost structure |
|---|---|---|
| Prospect-metered (Woodpecker, Saleshandy) | Prospects entering sequence | Woodpecker: $7 per 100 prospects/mo [https://woodpecker.co/pricing/, verified 2026-07-27]; Saleshandy: $25/mo for 2,000 prospects [https://www.saleshandy.com/pricing/, verified 2026-07-27] |
| Contact + send capped (Instantly, Smartlead) | Contacts uploaded + emails sent | Within base tier limits |
| Unlimited sending on ONE, per-mailbox caps (SpamCipher) | The ONE plan, $94.99/mo | No marginal cost for test volume |
Three ways prospect metering breaks testing
- Statistical power costs extra. You pay per prospect, not per send, so multi-touch testing inflates bills without increasing reach.
- Sequential testing bias. To save money, you test A this week and B next week, confounding results with time.
- Add-on creep. Placement testing, API access, and warm-up beyond the base allowance all carry separate fees.
Woodpecker's model inverts the economics of this. The cost is fixed to prospects contacted, not sends delivered. On Instantly.ai, you pay for the 1,000 prospects whether you send them one email or ten. On Woodpecker.co, your send ceiling is hard: 16,000 emails on the base plan. An agency running weekly tests across multiple clients hits that ceiling fast.
The workaround is sequential testing: run variant A to 500 prospects, then variant B to 500 prospects, comparing results across time. This sacrifices the controlled comparison that A/B testing exists for. Seasonality, list fatigue, and external events contaminate the results. You are no longer testing subject lines; you are testing subject lines on Tuesday versus Thursday.
Woodpecker's adaptive sending and inbox rotation help deliverability, but they do not change the metering. The tool rotates across connected mailboxes to preserve reputation, yet every rotation still counts against your prospect and email allowances. An agency with 40 client domains and aggressive testing schedules finds themselves managing allowances more than campaigns.
Woodpecker's pricing page, as of 2026-07-27, does not list blocklist monitoring or inbox placement testing. For A/B testing at volume, this matters because a reputation hit on one sending domain contaminates test results across all variants using that domain. You cannot separate "subject line performance" from "domain reputation degradation" without placement data.
How Competitors Meter Testing: The Full Ladder
Other platforms structure A/B testing costs differently. Understanding the shape of each ladder helps identify which model fits systematic testing at scale.
| Platform | Starting price | What it is | Where it leaves you exposed | Best for |
|---|---|---|---|---|
| Woodpecker.co | $7/100 prospects/mo | Prospect-metered cold email with LinkedIn add-on | Connects mailboxes you own; site does not list placement testing or blocklist monitoring | Simple sequences, narrow targeting, low test volume |
| Instantly.ai | $47/mo Growth | Email + lead database platform with A/Z testing | Connects and warms mailboxes you own; placement rides on your account reputation | Teams who want database and sending in one tool |
| Smartlead.ai | $39/mo Base | Send-metered platform with SmartDelivery placement add-on | Sends through connected mailboxes; placement testing is separate paid add-on | Send-focused operations with budget for placement testing |
| Lemlist | $55/user/mo billed annually | Multichannel outreach with lemwarm included | Connects Google, Microsoft, SMTP senders; site does not list blocklist monitoring | Teams prioritizing LinkedIn + email together |
| Saleshandy | $25/mo Outreach Starter | Active-prospect-metered sending with separate placement product | Placement testing is a separate product, not one pipeline | Small teams with simple testing needs |
| SpamCipher | 30-day free trial, then $94.99/mo (ONE) or credit packs | Sales engagement, lead data, deliverability and email security in one platform | Unlimited sending needs ONE; packs give 1.25 sends per credit | Agencies and teams that want leads, A/B-tested sequences, replies and deliverability in one platform |
Instantly.ai's Growth plan, at $47 monthly as of 2026-08-06, includes 5,000 emails monthly and 1,000 uploaded contacts. A/Z testing is included. On Instantly.ai, the meter is contacts uploaded and emails sent, not prospects contacted, so a 4-variant test to 250 contacts consumes 1,000 sends and 250 contacts. The shape is cleaner for testing than Woodpecker's prospect model, though the 5,000 email ceiling is low for aggressive testing.
Smartlead.ai's Base plan, at $39 monthly ($32.50 annually) as of 2026-08-06, includes 6,000 sends and 2,000 verified prospect emails. Sends are the meter, not prospects contacted. SmartDelivery placement testing is a $49 to $599 monthly Smartlead add-on depending on test volume. The platform sends through Google, Outlook, and SMTP mailboxes you connect, so placement results depend on the reputation of those mailboxes.
Lemlist's Email plan, at $55 per user monthly billed annually ($69 monthly) as of 2026-07-27, includes 50,000 emails monthly and unlimited email senders. The per-user pricing scales with headcount, not volume. Lemlist includes lemwarm and what it calls built-in deliverability protections on all plans. A/B testing is supported and Lemlist lists placement tests, though its site does not list blocklist monitoring.
Saleshandy's Outreach Starter, at $25 monthly billed annually ($36 monthly) as of 2026-07-27, includes 6,000 emails monthly and 2,000 active prospects. The meter is active prospects, similar to Woodpecker. Inbox placement testing is a separate product with its own ladder, starting at $34 monthly for 120 tests across 50 sender accounts.
A Real Agency Testing Scenario: The Math
Suppose an agency runs cold email for 12 clients. Each client wants weekly subject line tests with four variants, targeting 500 prospects per test for statistical power.
| Cost component | Calculation | Monthly total |
|---|---|---|
| Tests per month | 12 clients × 4 weeks | 48 tests |
| Prospects per test | 4 variants × 500 prospects | 2,000 prospects |
| Total prospects contacted | 48 tests × 2,000 prospects | 96,000 prospects |
| Prospect meter | 960 (hundreds) × $7 | $6,720 |
| Agency Panel | 12 clients × $27 | $324 |
| API access | Flat fee | $20 |
| Base total | $7,064+ |
On Woodpecker.co, the 16,000 email allowance is exhausted in the first two tests. The real Woodpecker bill includes warm-up add-ons at $5 per mailbox beyond the four included.
Instantly.ai's Lightspeed plan, at $358 monthly as of 2026-08-06, includes 500,000 emails monthly and 100,000 uploaded contacts. The 96,000 prospect count fits under the contact ceiling. The 500,000 email allowance covers generous testing. But A/Z testing at this volume on connected mailboxes requires those mailboxes to carry the reputation load. Instantly lists seed placement tests, and the results reflect those connected mailboxes.
Smartlead.ai's Unlimited Prime plan, at $379 monthly ($314.60 annually) as of 2026-08-06, includes 500,000 sends and 170,000 verified prospect emails. API, webhooks, and client workspaces are included. On Smartlead.ai, smartDelivery placement testing is still a $174 monthly add-on for unlimited tests up to 200 sender accounts. The sends flow through connected mailboxes, so the placement data reflects those mailboxes' performance.
The structural difference: Woodpecker and Saleshandy meter by prospects contacted, which penalizes testing that touches the same prospect multiple times. Instantly and Smartlead meter by sends and contacts, which is cleaner but still caps volume. All four connect mailboxes you own or buy as add-ons, so reputation management sits with the operator.
What Placement Testing Actually Requires
A/B testing subject lines assumes the test reaches the inbox. If variant A lands in spam and variant B lands in inbox, you are testing placement luck, not subject line appeal. This is where most platforms leave a gap.
Woodpecker's pricing page, as of 2026-07-27, does not list inbox placement testing. Lemlist lists placement tests, though its site does not list blocklist monitoring. Instantly lists seed placement tests and blacklist monitoring. Apollo.io lists domain warming, inbox placement and blacklist monitoring. None of the four sites lists DMARC report monitoring, which SpamCipher includes next to placement tests and blacklist monitoring.
Saleshandy offers Inbox Placement Test as a separate product, starting at $34 monthly for 120 tests across 50 sender accounts. Smartlead offers SmartDelivery as a $49 to $599 monthly add-on. These are not features of the sending plans; they are parallel products with their own meters.
The consequence: an agency running subject line tests must either trust that connected mailboxes are healthy, or buy and manage a separate placement testing workflow. Trusting unmonitored mailboxes is risky because reputation degrades invisibly. On Outreach, a domain that performed last month may be listed this month, and the first signal is collapsed open rates on what looks like a valid test.
In our 2026-08-12 scan of 401 B2B company sending domains, 43.9% were on at least one DNS blocklist at scan time. 38.7% had no detectable DKIM key. These are not edge cases; they are the baseline condition of sending infrastructure in the wild. Running A/B tests on unmonitored domains means a significant chance of testing against compromised reputation.
The fix is continuous monitoring: blocklist checks, placement tests to seed inboxes, and DMARC reporting to catch authentication drift. Most platforms do not bundle this. The operator assembles it from separate tools or skips it and hopes.
SpamCipher: A/B Testing and Deliverability in One Platform
SpamCipher is an AI-powered sales engagement platform, B2B lead intelligence database, and email deliverability and security suite in one product. For agencies and growth teams that send at volume, sequences, warm-up, verification and inbox placement tests sit in the same place, with unlimited sending on SpamCipher ONE and every mailbox kept inside its own daily cap.
For A/B testing subject lines, this changes the economics. There is no prospect meter, and sending on ONE is not metered. Each step takes up to 5 A/B variants with an automatic winner, and an agency can test across thousands of prospects while every mailbox stays inside its own daily cap. Warm-up runs on SpamCipher's own seed network. Leads that were never checked are verified before the first send at no charge. Placement tests report from SpamCipher's own seed mailboxes, by provider.
The comparison is not feature-for-feature. Woodpecker has condition-based campaigns; SpamCipher has sequences with conditions and no-code automations. Instantly has A/Z testing; SpamCipher has up to 5 variants per step with an automatic winner. The difference is what sits around the test. Woodpecker, Instantly, Smartlead, Lemlist, and Saleshandy all send through mailboxes you connect or buy, and so does SpamCipher. SpamCipher also tests placement on its own seed mailboxes, watches domains and IPs on blacklists, and reads DMARC reports in the same platform.
For an agency, this means testing subject lines without managing allowances. No counting prospects contacted. No buying placement testing as a separate product. No discovering that a client's domain was listed three days ago and contaminated a week's tests, because blacklist monitoring sends an alert when a domain or IP is listed. The infrastructure is warmed, tested and monitored in one platform.
SpamCipher starts with a 30-day free trial, then SpamCipher ONE at $94.99 a month for unlimited sending. The model fits teams that would otherwise be assembling Woodpecker plus extra warm-ups plus placement testing plus blocklist monitoring, each with its own interface and billing line.
An Actionable Testing Workflow for Any Platform
- Isolate reputation per client. Do not share sending domains across clients. A reputation hit on Client A's domain must not affect Client B's test results. On platforms without true multi-workspace isolation, this means separate accounts or separate connected mailboxes with no shared infrastructure.
- Validate before you test. Run your list through verification before it enters the sequence. Bounces from bad addresses damage sender reputation and waste test sends. Most platforms include verification; use it.
- Fix your sample size before you start. Do not peek at results early. Decide in advance how many opens per variant you need for significance, calculate the sends required at your expected open rate, and run to that number. Peeking and stopping early produces false winners.
- Monitor placement continuously, not just at test start. A domain that was healthy last week may be listed this week. Check blocklists before each campaign wave. If your platform does not include this, subscribe to a separate monitoring service or build your own DNSBL checks.
- Separate test sends from production sends. Do not mix subject line testing with live prospecting in the same sequence. The variance from testing contaminates your production metrics, and the pressure to hit production numbers corrupts the test discipline.
- Document your test architecture. Which prospects got which variant, when, and from which domain. Six months later, you will need to explain why Q3 results differ from Q2. Without records, you are guessing.
These steps work on Woodpecker, Instantly, Smartlead, Lemlist, or SpamCipher. The difference is how much of this workflow the platform covers versus how much you assemble yourself. Woodpecker provides the sequence logic; you provide placement testing, blocklist monitoring, and allowance management. SpamCipher covers sequences, warm-up, placement tests and monitoring in one platform.
Choosing Your Platform: Who Each Fits
Woodpecker meters by prospects contacted, which costs least when testing is light and prospect lists are narrow, and it lists condition-based campaign logic. The Agency Panel covers multi-client billing, though most operational features are priced separately. SpamCipher fits light testers too: conditions in sequences, 5 variants per step, and no prospect meter.
Instantly.ai combines a lead database and sending, with A/Z testing included and parallel Outreach, Credits and Bundle plans whose meters bind at different points. SpamCipher ONE combines Super Search and sequences with up to 5 A/B variants per step and an automatic winner, on one plan.
Smartlead.ai meters by sends and sells placement testing as a separate SmartDelivery fee. The tier ladder pushes agencies to Unlimited Prime for API and client workspaces regardless of volume needs. SpamCipher includes 100 placement tests a month on ONE.
Lemlist runs multichannel sequences, email plus LinkedIn, with per-user pricing on Multichannel plans. SpamCipher ONE tests up to 5 variants per step for $94.99 a month with 3 team members included.
Saleshandy meters active prospects and sells placement testing as a separate product, which adds vendor management for testing at scale. SpamCipher ONE includes 100 placement tests a month alongside A/B variants and sending.
Choose SpamCipher if you are an agency or growth team testing subject lines at volume, and you want sequences, warm-up, placement tests and blacklist monitoring in one platform rather than mailboxes you manage separately. You can test placement on seed mailboxes before launch, schedule tests with alerts, and require a passing test before a campaign goes out.
The real decision is not which tool has A/B testing. All of them do. It is what sits around the test to make it meaningful, and whether your pricing model rewards or penalizes the testing discipline you need. On SpamCipher ONE, test sends are not metered.
Category coverage: SpamCipher vs Woodpecker
SpamCipher is one platform across 11 market categories, all in one plan. The SpamCipher column shows what SpamCipher ONE includes in each category; the other columns show what each tool lists on its own website.
| Category | SpamCipher ONE | Woodpecker |
|---|---|---|
| Sales Engagement & Sales Automation | Sequences with conditions, A/B variants, a CRM and booking pages | Listed |
| B2B Lead Intelligence | Super Search people and company database, and Email Finder | Paid add-on (Lead Finder) |
| Email Deliverability Operations & Technical Infrastructure | Warm-up on its own seed network, rotation, done-for-you domains and mailboxes | Listed |
| SDR Enablement | Unibox, the Reply Agent, roles, assignment and a deal board | Listed |
| Autonomous AI Agents | Reply, Deliverability, Sales, Lead Finder and Signal agents | Not listed |
| AI Email Sequencing & Copy Generation | Emails from your profile, a 12-point check, sequences from approved emails | Listed |
| AI-Driven Intent Categorization | Every reply labelled by intent, custom labels and AI triage | Listed |
| Email Deliverability & Testing | Seed placement tests by provider, scheduled tests, a spam score per step | Not listed |
| Email Marketing Solutions | Verification, bulk cleaning, ESP list hygiene with write-back, and an API | Listed |
| Cybersecurity & Email Spam Protection | DMARC aggregate and forensic reports, BIMI, MTA-STS, TLS-RPT and alerts | Not listed |
| IT Monitoring | Domain health checks every 15 minutes to weekly, blacklist monitoring, Postmaster data | Not listed |
| In one plan | All 11 in SpamCipher ONE, $94.99 a month | 6 of 11, 1 more as paid add-ons |
Competitor columns read from each vendor's own website on October 11, 2026 (Woodpecker). "Not listed" means we did not find it on their site.
Frequently asked questions
Run your whole outbound in one platform
Leads, sequences, replies, deliverability and email security, together. 30-day free trial. No credit card.
Start free trial


