Insights Curry
All case studies
InsignAICase study

The bad data would have shipped in the old process. It got caught on day two.

The bad data would have shipped in the old process. It got caught on day two.
Category
Quarterly brand tracker, FMCG, multi-market
Team
Insights, Brand
Question
Is the tracker's quarter-over-quarter dip in consideration a real shift, or a data quality problem that would only surface after the report was already written?
Time in InsignAI
Fieldwork issue caught and corrected within 48 hours of launch, full report delivered in the usual quarterly window
What changed
A sampling issue that would normally have surfaced after the tables were built got flagged while fieldwork was still running. The quarter's numbers went into the boardroom deck clean, not with a footnote explaining a correction made after the fact.

The situation

A consumer brand ran a quarterly tracker across four markets, the kind of study built to move slowly and stay comparable quarter to quarter. Under the team's usual process, fieldwork ran for two weeks, data got cleaned and weighted by a separate analytics vendor, and the insights team saw the first tables roughly five days after fieldwork closed. If something looked wrong at that point, tracing it back to a fieldwork issue meant going through partial completes and vendor logs from a study that had already ended.

This quarter, an early build of the tables showed brand consideration down sharply in one market, enough to trigger a call with the CMO before the full readout was ready. The team needed to know within days, not the usual week, whether that number reflected something real in the market or a problem with how the data had come in.

What they put in

The team ran the tracker inside InsignAI using the same questionnaire structure as the previous eleven waves, so quarter-over-quarter comparisons would hold. Historical wave data sat in the same environment, available to check the new wave against as responses came in rather than only after the study closed.

What InsignAI did

While fieldwork was still live, InsignAI's quality monitoring flagged a skew in one market: a disproportionate share of completes coming from a single panel source, with response patterns on unrelated questions that looked too similar to be independent respondents. That pattern showed up on day two of a two-week fieldwork period, while there was still time to act on it.

The team paused sourcing from that panel in the affected market and extended fieldwork slightly to bring the sample back into balance, a decision that would have been far more expensive to make after the study had already closed and completes couldn't be added back in proportion.

Once fieldwork finished, analysis ran in the same environment the data had been collected in. Quantitative results sat next to the open-ended brand-perception questions, so when consideration numbers came back, the team could check the stated reasons behind them in the same pass rather than requesting a separate qualitative cut afterward. Cross-tabs isolated the affected market from the other three, so the eventual read wasn't muddied by a data issue that had already been resolved before it ever reached the tables.

What they asked

Once the corrected data was in, the questions were the ones a tracker exists to answer: had consideration actually moved in that market, what was driving it if it had, and whether the shift showed up consistently across the segments that mattered or only in one part of the sample.

What changed

The corrected market showed a smaller, real decline in consideration, tied to a pricing change a competitor had made two months earlier, visible in the open-ended responses once the skewed completes were out of the sample. Without the mid-fieldwork flag, that finding would have gone to the CMO as a much larger number, driven partly by a panel artifact, with the correction surfacing later as a revision nobody wanted to explain.

The report went out on the normal quarterly schedule. The one extra step, catching and correcting the panel issue, added roughly two days to fieldwork and no delay at all to delivery, because the correction happened before analysis started rather than after it finished.

Let's Talk AboutYour Next Insight.

Tell us what you are trying to decide and our team will show you how Insights Curry can help.

Talk to an Expert