Open vs closed research questions: discover the obstacle, then measure it
A missed collection is coded as an access problem, not an unclear location. See how the open explanation changes the next closed list without rewriting past answers.
Open research questions let people answer in their own words; closed questions ask them to choose from defined options. In this illustrative delivery-service example, a recipient misses a collection because the desk closes before they can get there. A list that omits opening hours can hide that obstacle inside “another reason” or tempt the analyst to code it as unclear location.
The same event needs a category that fits
The open answer becomes a different closed choice
“I couldn’t get to the collection desk before it shut.”
Open code: collection access, not unclear location.
Which one best describes the main reason for the missed collection?
- Could not locate the collection point
- Could not reach it during opening hours
- Another reason
- Cannot recall
Pretest what buyers understand by each option before using this revised list. It is for the next survey; the earlier example didn't use these options.
Format and question | What you get and how to read it |
|---|---|
Open: “Tell me what happened during your most recent missed delivery.” | An episode and the respondent’s explanation. You need to interpret and code the answer. |
Closed: “Which one best describes the main reason for your most recent missed delivery?” | A selection among defined categories. The supplied list shapes what the person can report. |
The earlier illustrative closed list contained: not home during the window; did not hear the arrival; could not find the collection point; delivery went to the wrong address; another reason; cannot recall. These weren't a validated taxonomy, and the collection-hours answer exposes an omission.
Define “missed delivery” and the recall period before fielding. If the question concerns delivery attempts that the recipient could not collect, do not combine those with a courier’s failure to arrive.
The open account can preserve a sequence or several obstacles. The closed main-reason item requests one selected category. Neither is universally better; their different outputs should serve different decisions.
The unlisted answer changes the next instrument
Example response | Code and reason |
|---|---|
“I was on a work call and didn’t hear the buzzer.” | Code: Did not hear arrival Reason: The account reports not hearing the buzzer during a work call |
“The driver left it at number 18; I live at 16.” | Code: Wrong address Reason: Explicit location mismatch |
“I couldn’t get to the collection desk before it shut.” | Code: Collection access Reason: Not the same as an unclear collection location |
“I don’t remember.” | Code: Cannot recall Reason: Keep separate from missing response |
The third response reveals a gap in the proposed closed list. Add and test a collection-hours option if the study needs it. Do not force the response into “could not find the collection point” simply to keep the first codebook unchanged.
Write code definitions, inclusion/exclusion rules and handling of multiple reasons. Retain original text. If a question asks for the main reason, a multi-code analysis should not quietly become a single-choice percentage.
The format changes what you can report
Ask the unaided open question before showing the reason list so discovery isn't merely a repetition of supplied choices. Then decide whether the next comparison needs one main obstacle or every obstacle. A single-main-reason result has one choice per substantive response; a multiple-response design can have overlapping option shares. Pew Research Center's question-writing guidance explains how earlier choices can influence later open answers.
Pretest location and hours as separate meanings. Keep another reason and cannot recall where appropriate.
Save a new list version. The revised question can measure collection hours going forward; it cannot create a past selected response that the earlier instrument never offered. Preserve open text when the evolution of the categories matters.
Neutrality matters in both formats
Original: “Why is our delivery service convenient?”
Open rewrite: “What worked well or poorly in your most recent delivery experience?” This permits an unfavorable account.
Closed rewrite: “How easy or difficult was it to receive your most recent delivery?” Very difficult; Somewhat difficult; Neither; Somewhat easy; Very easy; Cannot judge. This measures perceived ease, rather than the reason for it.
Follow-up: “What made it easy or difficult?” The open explanation helps interpret the rating without assuming a positive result.
For a modeled collection questionnaire, see how Vensia builds populations and runs a study. Agree how the intended audience and delivery context are represented before comparing the obstacle descriptions or answer choices.
Keep modeled answers identified: fluent open text doesn't establish that a real recipient had the experience. Use our market research survey guide for routing and saved-response checks. Discuss a managed synthetic questionnaire with Vensia if you need to explore which collection obstacles and options the next instrument should distinguish.
Use the open explanation, ease rating and main-reason choice for their different decisions; report each as its own measure.