All articles

Data Quality & Governance

Working with a research agency

An agency relationship works or fails on how the two sides handle the parts of a project that were not specified. Briefs are always incomplete, methods always require judgment, and the quality of what comes back depends on whether those judgments were discussed or assumed.

What should be established at the outset?

Who decides on method, how changes are handled, what happens if fieldwork underdelivers, and who the single point of contact is on each side. Four things, agreed before work starts, and they cover most of what goes wrong.

The fieldwork contingency is the one most often omitted and most often needed, because samples in specialist populations regularly come in short.

How much method should the client specify?

The requirements rather than the technique. Specifying a method you are not expert in constrains the agency to something that may not fit, and it transfers responsibility for a choice you are not equipped to make.

State what the output has to support and let the agency propose how. Then challenge the proposal on whether it delivers that.

What should be challenged in a proposal?

The sample definition and how it will be achieved, the questionnaire or protocol, the analysis plan, and the assumptions behind any modelling. Those four determine the quality of everything that follows.

Ask to see the instrument before fieldwork. Question wording effects are real and a review takes an hour.

What about timelines?

An honest timeline is one that allows the sample to be achieved properly. Compression usually comes out of sample quality rather than out of agency margin, and the compromise should be made explicitly rather than absorbed.

If the deadline is immovable, say so at briefing so the method can be chosen to fit it.

How should results be reviewed?

Against the brief, and with the limitations read as carefully as the findings. An agency that volunteers its limitations is doing its job; one whose deck contains no caveats has either done extraordinary work or omitted something.

Ask for the achieved sample composition rather than the target. Achieved is what the findings rest on.

What is the client's responsibility?

Availability during the project, prompt decisions, and honesty about the decision context. An agency working without knowing what the decision is will produce something reasonable and unfocused.

Feedback afterwards matters too, and it is rarely given. An agency that never learns what was useful cannot improve what it delivers.

When should you change agency?

When the relationship stops producing challenge. An agency that agrees with every brief and never pushes back on an unanswerable question has become a supplier of documents rather than a research partner.

Frequently asked questions

Should I use the same agency repeatedly?

Continuity builds understanding of your categories and it can reduce challenge over time. A periodic competitive review, even one the incumbent wins, keeps both sides honest.

How do I judge a proposal I do not fully understand?

Ask the agency to explain the method's limitations in plain language. An expert can do that; an answer heavy on terminology and light on limitations is a signal.

What if fieldwork comes in short?

Agree in advance what happens: extend, accept with a stated caveat, or stop. Deciding in the moment, under deadline, produces a decision that favours delivery over quality.

Should I share my hypothesis?

Share the hypothesis and not the desired answer. Agencies are responsive to what a client wants, which is a strength when it is a question and a risk when it is a conclusion.

Do I get the raw data?

That is a contractual question to settle before work starts. Owning the raw data allows re-analysis later and it is worth more than most clients realise at the point of signing.

How do I compare quotes?

On sample, method and deliverable rather than on headline price. Two quotes at different prices usually differ in something material, and identifying what is the point of the comparison.

What about international projects?

Comparability across markets is harder than it looks, and local fieldwork practice varies. Specify how comparability will be achieved rather than assuming it.

Should the agency present to leadership?

Frequently yes, because they can answer method questions the internal team cannot. Preparing them on the internal context first makes the session considerably more useful.

What is the best single investment in the relationship?

A proper debrief with honest feedback after each project. It is free, it is rare, and it changes what the next project looks like. Industry context is collected by trade bodies such as FMI.

Should the agency be told the decision that followed?

Yes, and it is almost never done. An agency that learns what was decided and why produces sharper work next time, because it understands what the findings had to support.

### What should a brand actually do with this?

Treat the briefing conversation as the most valuable hour in the project. Everything downstream is constrained by what was agreed there, and time spent challenging the brief returns more than time spent reviewing the deck.

Then schedule the debrief when the work is commissioned rather than afterwards. A debrief arranged at the end tends not to happen, and the feedback that would improve the next project is lost.

Include the achieved sample in that conversation. Where fieldwork fell short of the design, understanding why is what prevents the same shortfall on the next project in the same population.

Working with retail data? See NRS Insights data solutions or contact NRS Insights.