A/B Testing Dashboard

Personalization & Segmentation Lift Decomposition — Novara Digital

Current Experiment
Annual Plan Pricing Banner
Concluded 2 days ago • 124K users
Segment-Weighted Revenue Lift
+0.9%
vs +2.8% naive
High-LTV Segment Harm Rate
14.3%
-4.1pp MoM
Segment Lift Variance (Gini)
0.68
+0.12 vs avg
Device-Cohort Interaction
+3.2%
Mobile lift
Targeted Rollout Coverage
62%
+18pp WoW
Segment Discovery Lag
1.8d
-0.4d vs target

Segment Lift Decomposition Heatmap

Revenue lift (%) by persona cluster and acquisition channel — red = harm, green = lift

Organic Search
Paid Social
Email
Direct
Referral
Partnerships
Aspiring Professional
+4.2%
+6.1%
+2.8%
+4.5%
+1.9%
+5.3%
Career Accelerator
+2.1%
+3.8%
+0.4%
+1.6%
+0.7%
+3.2%
Senior Practitioner
-4.1%
-3.8%
-5.2%
-3.5%
-2.1%
-4.6%
Re-entrant
+1.2%
+0.3%
-0.2%
+0.9%
+0.5%
+1.4%
Student
+5.7%
+7.3%
+4.8%
+6.2%
+3.9%
+5.1%
Enterprise-Sponsored
-1.8%
-2.3%
-0.6%
-1.5%
-0.3%
-2.1%
Casual Browser
+3.4%
+6.8%
+2.9%
+4.1%
+1.7%
+3.6%

Behavioral Cohort Lift by Tenure Band

Revenue lift by user tenure — newer users respond positively, veterans negatively

Geo-Segment Lift Dispersion

Top markets by segment-weighted lift — variance within each geography

Persona Cluster Response Rate

Conversion rates, revenue per user, and lift by persona cluster

Persona Cluster Control CVR Treatment CVR CVR Lift Avg Revenue/User Revenue Lift Sample Size Confidence Decision
Aspiring Professional 3.82% 4.18% +9.4% $42.30 +4.5% 24,180 99% Ship
Career Accelerator 5.21% 5.42% +4.0% $68.50 +2.1% 18,920 95% Ship
Senior Practitioner 8.43% 8.08% -4.2% $124.80 -4.1% 16,540 98% Block
Re-entrant 2.94% 2.98% +1.4% $38.20 +0.6% 12,360 72% Monitor
Student 4.12% 4.56% +10.7% $28.90 +5.7% 31,480 99% Ship
Enterprise-Sponsored 6.78% 6.63% -2.2% $92.40 -1.8% 9,720 89% Caution
Casual Browser 1.86% 1.99% +7.0% $18.60 +3.4% 10,800 91% Ship

Segment Discovery Lag Waterfall

Days from experiment conclusion to segment-level insights available

High-LTV Segment Protection

Prevented revenue loss from blocking harmful variants in premium segments