Lack of Replication or Generalization? Cultural Values Explain a Question Wording Effect

• In the context of the current "replication crisis" across the sciences, failures to reproduce a finding are often viewed as discrediting it. This paper shows how such a conclusion can be incorrect. In 1981, Schuman and Presser showed that including the word "freedom" in a survey question significantly increased approval of allowing a speech against religion in the USA. New experiments in probability sample surveys (n = 23,370) in the USA and 10 other countries showed that the wording effect replicated in the USA and appeared in four other countries (Canada, Germany, Taiwan, and the Netherlands) but not in the remaining countries. The effect appeared only in countries in which the value of freedom is especially salient and endorsed. Thus, public support for a proposition was enhanced by portraying it as embodying a salient principle of a nation's culture. Instead of questioning initial findings, inconsistent results across countries signal limits on generalizability and identify an important moderator.

Subject headings

NATURVETENSKAP  -- Matematik -- Sannolikhetsteori och statistik (hsv//swe)

NATURAL SCIENCES  -- Mathematics -- Probability Theory and Statistics (hsv//eng)

SAMHÄLLSVETENSKAP  -- Annan samhällsvetenskap (hsv//swe)

SOCIAL SCIENCES  -- Other Social Sciences (hsv//eng)

Keyword

Cross-cultural comparisons

Generalization

Questionnaire design

Question wording effects

Replication

Survey research methods

european social survey

national anthems

replicability

science

suicide

quality

crisis

back

Mathematical Methods In Social Sciences

Mathematics

Publication and Content Type

ref (subject category)

art (subject category)