Quantitative market research: measure what the business needs to decide
Six delivery-offer records show why deadline understanding and service usefulness need separate measures. Follow the questions, stored values and denominators into a wording decision.
Quantitative market research uses numerical data to measure defined needs, preferences or behavior. A grocery-delivery service deciding whether to revise its terms needs to distinguish understanding the change deadline from finding the delivery window useful. Six fictional records below show why those questions need separate measures.
If a survey combines understanding and usefulness in one score, the team won't know whether to change the wording or investigate the service. The measure you choose determines which business question the numbers can answer.
Understanding and usefulness lead to different actions
The proposition for recent grocery-delivery users reads: “Select a two-hour delivery window at checkout. Changes are allowed until the evening before delivery.”
Six records reveal more than one average
Record | Responses |
|---|---|
R1 | Deadline understood: Yes (1) Usefulness: 5 |
R2 | Deadline understood: Yes (1) Usefulness: 4 |
R3 | Deadline understood: No (0) Usefulness: 4 |
R4 | Deadline understood: Yes (1) Usefulness: 3 |
R5 | Deadline understood: No (0) Usefulness: 2 |
R6 | Deadline understood: Yes (1) Usefulness: Cannot judge |
Understanding: 4/6. Ratings 4–5: 3/5 substantive ratings, with one Cannot judge. R3 likes the offer but misread the deadline; R4 understood it but found it less useful.
The audience is recent grocery-delivery users. The decision is whether to revise this wording. The primary measure is correct understanding of the change deadline, assessed before showing answer choices. A separate relevance rating explores usefulness. Neither measure tests operational delivery performance.
For a real study, define recent use, geography, recruitment and exclusions. Decide whether the evidence concerns eligible respondents, a target human population or a modeled population. Do not let the same chart quietly stand for all three.
Start with the unit and opportunity: an eligible buyer shown a particular offer, an account facing renewal or a customer able to place an order. Then define the response or behavior. A measure is more useful when the decision owner knows what a high or low result would change.
For a brand question, that may be awareness under a specified prompt. For a concept, it may be correct unaided interpretation. For an intervention, it may be an observed outcome under assigned conditions. Those measures can all be quantitative while serving different claims.
The questionnaire and stored values define one measure
- Have you received a grocery delivery in the past 30 days? Yes; No; Prefer not to answer. Continue eligible respondents only.
- Show the proposition exactly as written. When can you last change the delivery window? Open response.
- How useful would this arrangement be for your household? 1 Not at all; 2 Slightly; 3 Moderately; 4 Very; 5 Extremely; Cannot judge.
- What information is missing from this description? Open response.
Variable | Values and rule |
|---|---|
record_id | Type and allowed values: Unique text Rule: One eligible record per participant |
recruitment_source | Type and allowed values: Text Rule: Preserve actual source, not an inferred demographic |
deadline_text | Type and allowed values: Original text Rule: Store before coding |
comprehension | Type and allowed values: 1 correct; 0 incorrect; missing unanswerable Rule: Correct requires the evening before delivery |
usefulness | Type and allowed values: Integer 1–5; Cannot judge; missing Rule: Do not encode “Cannot judge” as 3 |
information_needed | Type and allowed values: Text Rule: Code separately from comprehension |
The data dictionary prevents an interface choice from quietly changing the measure. If Cannot judge becomes 3, uncertainty becomes moderate usefulness. If missing comprehension becomes 0, unanswerability becomes an incorrect answer. The analysis must preserve the distinction chosen in the instrument.
Plan any group cuts before collection. A new/repeat split needs a defined history; a service zone needs the relevant geography. Collect only the context that can change a planned comparison or help explain a diagnostic.
Different questions need different denominators
Use the six records above. Code correct deadline understanding as 1 and incorrect understanding as 0, while keeping unanswerable records separate. Read the usefulness scale as 1 Not at all through 5 Extremely, with Cannot judge outside that scale.
Correct comprehension is 4/6. Top-two usefulness is 3/5 among substantive ratings. Its denominator is five because “Cannot judge” is reported separately. An ordinal scale’s distribution is more informative here than a mean that could conceal misunderstanding.
If a provisional gate required all six demonstration records to understand the deadline, the wording would fail. That is an instructional decision rule, not an industry standard. Inspect incorrect responses and revise the deadline sentence before testing again.
Read an incorrect answer before revising
Record R3 says: “I can change it during the two-hour slot.” Under the stated evening-before rule, code comprehension as 0 even though usefulness is 4. R1 says: “No later than the evening before it arrives,” which receives 1. The favorable rating doesn't repair the misunderstanding. Test this deadline-first candidate: “Change your delivery window until the evening before delivery. At checkout, choose a two-hour delivery window.” Keep the offer and exposure conditions unchanged.
R3 rates usefulness 4 but misunderstands the deadline; R4 understands it but rates usefulness 3. A single average can hide that difference. R3's answer points to clearer wording to test. R4's raises a separate question about whether the service terms fit the household's needs. Read that pattern before asking for another copy revision: the offer itself may need investigation.
Use the distribution and cross-pattern that address the action. It is unnecessary to choose the most elaborate statistic if a count and an original answer identify the information gap. Complexity should answer a question the simpler readout cannot.
An audience comparison needs the same complete offer
A group difference can help choose an offer when exposure, eligibility and response base are comparable. If the first-time group sees one delivery condition and repeat users see another, audience and offer changed together. Label the comparison accordingly.
Here comprehension uses six records, usefulness uses five substantive ratings and one Cannot judge answer is separate. A percentage on all six answers a different question from the percentage among five ratings. Put the base beside every result so the reader can see which question is being answered.
For a real sample, assess who is reachable, who responds and how the intended inference is supported. A whole-study total does not guarantee useful subgroup bases. For modeled comparisons, record audience grounding and relevant validation rather than assigning a human sampling margin from the number of generated profiles.
The readout should choose a specific next investigation
Ask for the question-level distributions, valid bases and the records that explain incorrect answers. Keep routing, missing values and recruitment coverage in the supporting analysis. A number without its question and audience cannot tell marketing what to change.
Sampling uncertainty depends on the human design and estimator. For modeled comparisons, disclose grounding and task-relevant validation; generating more profiles does not create more independent human observations. The AAPOR disclosure standards provide a reference for reporting the design.
Use our analysis walkthrough for the data and our market research survey guide for fieldwork.
Vensia's study workflow takes a data-grounded synthetic audience through research to an interactive report and interpretation. Audience comparisons, recommendations and follow-up questions can help explain the modeled responses. For this delivery offer, use that work to distinguish a misunderstood deadline from service terms that don't fit the household.
Book a demo to discuss a modeled comparison of the deadline-first wording and the original, with understanding and usefulness reported separately.
The completed wording decision is a deadline-first candidate with unchanged offer terms. Retest unaided understanding. If clarity is restored but usefulness is still weak, inspect the household occasion or compare another complete arrangement. If you need to know whether the change affects ordering, run a behavioral test once people understand the offer.
