Email A/B Testing & Experiment Analytics

Brightbox Electronics · Validated revenue lift, statistical power & learning velocity

Last 90 days
Goal: 8 revenue-validated tests/month, false winners <8%
Active Tests
6
+2 vs Q1
Avg Revenue Lift
+11.2%
+3.1pp
Statistical Power
84%
+6pp
False Winner Rate
5%
-2pp
Velocity (tests/mo)
7.0
-1 vs goal
SRM Index
1.02
Balanced

Test Outcomes (Last 90 Days)

Revenue Lift vs Statistical Power

Recent Experiments

Week Test Element Variant Open Δ Revenue Δ Power Outcome
W12 Send Time 10am vs 2pm +8.3% +14.1% 88% Winner
W11 Preheader Benefit vs Feature +5.2% +9.7% 82% Winner
W10 Multivariate Hero+CTA interaction +6.1% +14.0% 91% Winner
W9 CTA Copy Action vs Benefit +3.8% -1.2% 74% Inconclusive
W7 Image Position Top vs Inline +4.1% +7.3% 79% Winner
W6 Personalization Name vs Generic +7.5% +11.2% 86% Winner
W5 Layout 1-col vs 2-col -0.8% -2.1% 81% Loser
W4 Subject Line Urgency Copy +12.0% -7.0% 85% False Winner
W3 Discount Frame % vs $ Off +2.9% +5.8% 77% Winner
W2 Footer CTA Added vs None +1.4% +0.3% 68% Inconclusive

Learning Velocity (Tests/Month)

Revenue Impact by Element

Complaint Rate Delta by Variant