Vensia
← All articlesJournal7 min read

Hard-to-reach audience research: make the study feasible

Plan hard-to-reach audience research with clear eligibility, recruitment-yield arithmetic and an evidence route that preserves the niche experiences you need.

A selected group within a broader outlined audience beside two comparison groups, with a blank tablet and booklet on ivory platforms.

Hard-to-reach audience research investigates people whose relevant experience makes them difficult to identify, contact or recruit. For a countertop-dishwasher seller choosing between compatibility information and setup help, the scarce audience is renters who personally chose and tried to set up the machine.

A rare characteristic, a recent purchase and direct involvement can each reduce the available group. A supplier’s total panel membership tells you little about their intersection. Before accepting a promise of 80 usable answers, establish the contact source, eligibility checks and experiences that route could miss.

Consider HarborHome, a fictional seller of countertop dishwashers. Its team is choosing whether to prioritize clearer compatibility information or a guided setup service. The current offer is one machine with a connection kit, USD 279 before tax plus USD 20 delivery; installation is excluded and tap compatibility must be checked. The recruitment counts and planning assumptions below are constructed for this example.

Define the experience before counting the audience

HarborHome wants U.S. adults renting an apartment who personally chose and tried to set up a countertop dishwasher during the past twelve months. Include people who kept it, returned it or never completed setup. Requiring successful weekly use would remove some of the failures the team needs to understand.

Recruitment should establish the person’s role and recent episode. Someone who lives with a dishwasher may know little about buying or connecting it. Conversely, the buyer who returned the machine can explain a decisive obstacle despite no longer owning one. Record one relevant episode per participant and identify shared households so several accounts of the same setup do not silently become independent experiences.

Our research sampling guide explains how the population, contact frame and analysis unit fit together. For this commission, the frame is the actual source of contactable people; the target population is the group whose experience the team wants to understand.

AAPOR’s disclosure standards call for the population, recruitment source, eligibility, coverage gaps and relevant quality procedures to be described. Put those details in the proposal before debating the final respondent count.

The recruitment funnel ends with usable answers

Suppose HarborHome’s initial recruiting exercise has the following dispositions. A usable record must retain an eligible participant’s substantive setup account; an unsuccessful setup remains useful. The stages are nested: every usable answer came from a completed interview, every completion from a confirmed eligible person, and every eligible person from a completed screener.

Recruiting stage

People and stage meaning

Unique people invited

People: 2,000

Meaning: Entered this recruiting exercise

Completed the screener

People: 800

Meaning: Supplied enough to assess eligibility

Confirmed eligible

People: 24

Meaning: Met the stated experience criteria

Completed the interview

People: 20

Meaning: Finished the planned questions

Retained for the decision

People: 18

Meaning: Passed the declared relevance and quality review

The remaining 1,200 invitees have no completed screener. Their eligibility is unknown. The 776 screened people who did not qualify are a different disposition. Among the 24 eligible people, four did not complete. Of the twenty completions, one record’s setup answers are unavailable and another supplies no substantive setup account. Keep those reasons rather than assigning every loss to “low incidence.”

Here, incidence means the proportion confirmed eligible among completed screeners: 24 ÷ 800 = 3%. It does not mean 3% of U.S. adults qualify. The invitation source and the people willing to complete its screener shape that result.

Planning measure

Calculation and result

Eligibility among completed screeners

Calculation: 24 ÷ 800

Result: 3%

Completion among confirmed eligible people

Calculation: 20 ÷ 24

Result: 83.3%

Usable answers among completions

Calculation: 18 ÷ 20

Result: 90%

Usable answers per invitation

Calculation: 18 ÷ 2,000

Result: 0.9%

These are explicitly defined recruitment-funnel ratios. Calling all of them a response rate would conceal where the study loses people. AAPOR distinguishes response, cooperation and completion rates; use the appropriate formal definition when reporting one.

If the brief calls for 80 usable answers, extending the same overall yield gives 80 ÷ 0.009, or about 8,889 invitations. That is a conditional planning calculation. It assumes the source can supply additional unique contacts with the same eligibility, participation and usable-answer yield. Exhausting the most relevant members early could make the next invitations less productive.

Eighteen answers also cannot establish stable planning rates. Request an uncertainty allowance, recruitment progress checkpoints and a stop rule rather than budgeting exactly 8,889 invitations as a delivery guarantee. The target of 80 belongs to this brief; it is not a general recommended sample size or a promise of statistical precision.

Each recruiting source leaves a different gap

A targeted source can improve feasibility while narrowing what the study represents. Compare the people it can actually reach.

Possible route

Access and consequential gap

Retailer customer records

Useful access: Identifiable recent purchasers

Consequential gap: May omit competitor buyers and unlinked returns

Product-owner community

Useful access: Detailed product experience

Consequential gap: Self-selection; unsuccessful owners may have left

Specialist recruitment

Useful access: Explicit experience criteria

Consequential gap: Availability and verification need demonstration

Ask each supplier how it confirms purchase timing and personal involvement, handles overlapping sources and recruits returned or abandoned setups. Agree proportionate verification that does not collect unnecessary personal material. A plausible profile label alone does not verify an episode.

Suppose fifteen of HarborHome’s eighteen usable accounts kept the machine and three returned it. Raising the total to 80 does not guarantee enough returned or abandoned experiences to explain failure. The analyst may need a deliberate qualitative contrast, with recruitment and interpretation stated accordingly, before commissioning a larger comparable measure.

AAPOR’s online-sample quality overview identifies recruitment, self-selection, attrition and missing data as issues beyond completion metrics. A better yield is useful operationally; it does not establish better coverage or a representative estimate.

If a source cannot reach failed setups, the completed recommendation may be to investigate that group through a different route. Quietly dropping it from the criteria would answer an easier question about the people who remained.

Change the study deliberately when access is weak

HarborHome can first commission detailed recent-episode interviews across successful and unsuccessful setups. The purpose is to distinguish incompatible equipment, unclear instructions and a need for assistance. A small purposive set can investigate those explanations; it cannot supply their population prevalence.

Then compare the relevant remedy. If buyers misunderstood a compatible connection, clearer information may be worth testing. If the equipment is genuinely incompatible, persuasive instructions leave the product problem intact. A guided service is a different offer with staffing, price and delivery requirements to establish.

Broader eligibility is sometimes justified. Extending the purchase period might make recruitment possible, but changes which product versions and memories enter. Including homeowners changes the audience. Save that revision and explain what the resulting study can answer. Do not relabel the broader group as the original niche.

Modeled comparisons need evidence about the niche

At Vensia, our team builds simulated audiences grounded in purchase, behavioral and research data, runs the study and helps interpret the results. Customer data and past research can add context; an interactive report connects findings, segment comparisons and recommendations, with follow-up questions to the same population.

For HarborHome, a scoped comparison could explore reactions to a truthful compatibility explanation or proposed setup service. First establish what evidence represents recent purchasers, returned products and the relevant household constraints. If those experiences are missing, more generated profiles do not create them.

Ask for validation relevant to the audience and task before relying on a prediction. Modeled objections can help choose what to investigate or compare. They cannot verify that a tap fits, observe a physical installation or establish how many real people had a failed setup. Our synthetic versus human respondents guide follows that evidence choice as the decision changes.

HarborHome should leave commissioning with an achievable recruiting route, an explicit way to recover failed experiences and a study that chooses between information, assistance and product work. Bring the audience definition, available evidence and alternatives to a study discussion with Vensia. The goal is a feasible answer to the original decision, with the missing evidence still visible.

← Back to all articles