Testing scope sensitivity in environmental valuation DCEs

Scope sensitivity - WTP increasing with the scope of environmental improvement - is a fundamental validity criterion for environmental valuation studies. Failing this test undermines your results.

This article explains what scope sensitivity is, why it matters for environmental DCE validity, and how to design and test for it in SurveyEngine.

Ben White, 07.07.2026

What is scope sensitivity and why does it matter?

Scope sensitivity requires that WTP increases with the scope of the good being valued. If respondents state the same WTP for a 10% improvement in water quality as for a 50% improvement, this is scope insensitive - a strong signal that choices are not driven by genuine preferences for the environmental good but by other motivations (warm glow, protest, or disengagement).

The embedding effect - related to scope insensitivity - occurs when WTP for a specific environmental good is similar whether it is valued alone or as part of a larger set of goods. Embedding suggests respondents are expressing a general willingness to support environmental causes rather than specifically valuing the good in question.

Scope sensitivity as a validity criterion

Scope sensitivity is considered a necessary (though not sufficient) condition for valid non-market valuation. A study that fails a scope sensitivity test cannot credibly claim to be measuring genuine preferences for the environmental good. Results from scope-insensitive studies are routinely rejected by regulatory agencies, government departments, and peer-reviewed journals.

The risk of scope insensitivity is highest when: the environmental good is abstract or unfamiliar to respondents; the payment vehicle is not credible; respondents are not engaged with the choice tasks; or the survey context primes warm glow responses.

Designing scope sensitivity checks into your DCE before fieldwork - and reporting the results transparently - demonstrates methodological rigour and strengthens the credibility of your WTP estimates.

TLDR Quick links

Environment resources

Protest responses article

Open a free account

Designing and testing scope sensitivity in SurveyEngine

Step 1: Design scope sensitivity check attributes. Include a key environmental attribute at two or more very different levels - for example, water quality improvement of 10%, 30%, and 60%. The WTP difference between levels should increase proportionally with the scope of improvement.

Step 2: Use a split-sample or within-sample design. In a split-sample design, different respondents see different levels of the key attribute. In a within-sample design, all respondents see multiple levels across different choice sets. SurveyEngine supports both approaches.

Step 3: Estimate WTP for each scope level. After fieldwork, estimate separate WTP values for each level of the key attribute and calculate confidence intervals. Scope sensitivity is confirmed if WTP for the larger improvement is significantly greater than WTP for the smaller improvement.

Step 4: Test for embedding effects. If budget allows, include a sub-sample who values the environmental good in isolation and compare their WTP to respondents who value it as part of a broader environmental programme. Significant differences indicate embedding.

Step 5: Report scope sensitivity results explicitly. In your methods section, describe the scope sensitivity test design and the results. If the test is passed, this strengthens the credibility of your WTP estimates. If the test fails, investigate the cause and report it honestly.

Worked example - scope sensitivity in peatland restoration

A study valuing peatland restoration for carbon sequestration and biodiversity uses a split-sample scope sensitivity design. Sample A values a restoration covering 500 hectares; Sample B values a restoration covering 5,000 hectares. All other attributes and levels are identical.

WTP for Sample A (500 ha) is £34/household/year. WTP for Sample B (5,000 ha) is £67/household/year. The ratio (1.97) is not proportional to the scope ratio (10:1), indicating some scope insensitivity - respondents value the larger restoration more than the smaller, but not ten times more. The study reports this finding and discusses possible explanations: diminishing marginal utility of additional restored area, or warm glow motivation partially independent of scope.