Survey Data Integrity & Quality Monitoring

Meridian Insights Group · Q4 2024 Brand Tracker Wave

Wave Status
REVIEW REQUIRED
LQTI
68.2
Wave Disqualification Rate
11.4%
▲ 3.2pp vs Q3
Avg Panel Source Quality
72.8
▼ 5.4 pts
Speeder Detection Rate
6.7%
→ Stable
Straight-Lining Index
4.9
▼ 1.2 pts
Attention Check Pass
91.3%
▲ 2.1pp
Duplicate Submissions
1.8%
→ Within range

Wave-Level Disqualification Rate by Criterion

Total responses collected: 4,840 | Disqualified: 553 (11.4%)

Panel Source Quality Score (PSQS) by Wave

Panel Source Q2 '24 Q3 '24 Q4 '24 Status
Internal Email List 92.1 90.8 91.4 CERTIFIED
Panelco-A 78.3 82.6 79.2 CERTIFIED
Panelco-B 68.4 52.3 44.1 BLOCKED
ResearchNow 84.7 81.9 77.6 CERTIFIED
SurveyMonkey Audience 75.2 69.1 71.3 REVIEW
Social Media Ads 62.8 64.5 66.9 REVIEW

Current Wave Summary

Total Collected 4,840
Certified Sources 3
Blocked Sources 1
Under Review 2
Panelco-B Flags
Extreme Speeders: 9.1%
Disqual Rate: 23.8%
PSQS: 44.1 (threshold 70)

Speeder Severity Distribution (Completion Time vs Median)

Median completion time: 8.4 min | Speeders (<50% median): 6.7% | Extreme speeders (<25% median): 2.1%

Attention Check Pass Rate by Position

Straight-Lining by Question Block

Q1-Q5: Brand Awareness 2.3%
Q6-Q10: Usage Behavior 3.8%
Q11-Q18: Satisfaction Grid 7.9%
Q19-Q24: Feature Importance 6.1%
Q25-Q30: Loyalty & NPS 4.2%
Overall SLI 4.9
Threshold: 8.0 | Status: Pass

Panel Source Performance Detail — Q4 2024 Wave

Panel Source Collected Disqual % Speeders SLI Attn Pass PSQS Certification
Internal Email List 620 2.1% 1.3% 2.8 96.7% 91.4 CERTIFIED
ResearchNow 1,240 6.8% 4.2% 3.9 93.1% 77.6 CERTIFIED
Panelco-A 1,120 9.2% 5.8% 5.2 89.4% 79.2 CERTIFIED
SurveyMonkey Audience 780 12.3% 7.1% 6.4 87.9% 71.3 REVIEW
Social Media Ads 320 15.6% 8.9% 7.8 84.2% 66.9 REVIEW
Panelco-B 980 23.8% 14.3% 9.7 72.1% 44.1 BLOCKED
Certification thresholds: Disqual <15%, SLI <8, Attn Pass >85%, PSQS >70

Verbatim Quality Index (VQI) Over Time

VQI components: GPTZero AI-detection flag rate, avg word count, sentiment coherence. Spike at Wave 14 triggered vendor audit.

Duplicate Detection Summary

Exact Duplicates (IP + Timestamp)
Count 34
Rate 0.7%
Near-Duplicates (MinHash LSH ≥0.85)
Count 53
Rate 1.1%
Total Duplicate Rate
Combined 1.8%
Threshold: <3% | Status: Pass
Primary Duplicate Sources
Panelco-B 47 (54%)
Social Media Ads 24 (28%)
Other 16 (18%)

Response Distribution Normality Score (Kolmogorov-Smirnov) — Key Questions

KS statistic benchmarked against expected distributions. Q7 Overall Satisfaction shows high departure (0.18) — investigate ceiling effect or panel bias.

Longitudinal Quality Trend Index (LQTI) — 16 Wave History

LQTI aggregates 9 quality metrics into a 0-100 composite. Current wave (68.2) below certification threshold (70). Primary drivers: Panelco-B disqualification surge, verbatim quality decline.