2. |
- Stark, T. H., et al.
(author)
-
Generalization of Classic Question Order Effects Across Cultures
- 2020
-
In: Sociological Methods & Research. - : SAGE Publications. - 0049-1241 .- 1552-8294. ; 49:3, s. 567-602
-
Journal article (peer-reviewed)abstract
- Questionnaire design is routinely guided by classic experiments on question form, wording, and context conducted decades ago. This article explores whether two question order effects (one due to the norm of evenhandedness and the other due to subtraction or perceptual contrast) appear in surveys of probability samples in the United States and 11 other countries (Canada, Denmark, Germany, Iceland, Japan, the Netherlands, Norway, Portugal, Sweden, Taiwan, and the United Kingdom;N= 25,640). Advancing theory of question order effects, we propose necessary conditions for each effect to occur, and found that the effects occurred in the nations where these necessary conditions were met. Surprisingly, the abortion question order effect even appeared in some countries in which the necessary condition was not met, suggesting that the question order effect there (and perhaps elsewhere) was not due to subtraction or perceptual contrast. The question order effects were not moderated by education. The strength of the effect due to the norm of evenhandedness was correlated with various cultural characteristics of the nations. Strong support was observed for the form-resistant correlation hypothesis.
|
|
3. |
- Silber, H., et al.
(author)
-
Lack of Replication or Generalization? Cultural Values Explain a Question Wording Effect
- 2022
-
In: Journal of Survey Statistics and Methodology. - : Oxford University Press (OUP). - 2325-0984 .- 2325-0992. ; 10:5, s. 1121-1147
-
Journal article (peer-reviewed)abstract
- In the context of the current "replication crisis" across the sciences, failures to reproduce a finding are often viewed as discrediting it. This paper shows how such a conclusion can be incorrect. In 1981, Schuman and Presser showed that including the word "freedom" in a survey question significantly increased approval of allowing a speech against religion in the USA. New experiments in probability sample surveys (n = 23,370) in the USA and 10 other countries showed that the wording effect replicated in the USA and appeared in four other countries (Canada, Germany, Taiwan, and the Netherlands) but not in the remaining countries. The effect appeared only in countries in which the value of freedom is especially salient and endorsed. Thus, public support for a proposition was enhanced by portraying it as embodying a salient principle of a nation's culture. Instead of questioning initial findings, inconsistent results across countries signal limits on generalizability and identify an important moderator.
|
|