| 1. |
- Silber, H., et al.
(författare)
-
Lack of Replication or Generalization? Cultural Values Explain a Question Wording Effect
- 2022
-
Ingår i: Journal of Survey Statistics and Methodology. - : Oxford University Press (OUP). - 2325-0984 .- 2325-0992. ; 10:5, s. 1121-1147
-
Tidskriftsartikel (refereegranskat)abstract
- In the context of the current "replication crisis" across the sciences, failures to reproduce a finding are often viewed as discrediting it. This paper shows how such a conclusion can be incorrect. In 1981, Schuman and Presser showed that including the word "freedom" in a survey question significantly increased approval of allowing a speech against religion in the USA. New experiments in probability sample surveys (n = 23,370) in the USA and 10 other countries showed that the wording effect replicated in the USA and appeared in four other countries (Canada, Germany, Taiwan, and the Netherlands) but not in the remaining countries. The effect appeared only in countries in which the value of freedom is especially salient and endorsed. Thus, public support for a proposition was enhanced by portraying it as embodying a salient principle of a nation's culture. Instead of questioning initial findings, inconsistent results across countries signal limits on generalizability and identify an important moderator.
|
|
| 2. |
- Andreasson, Maria, 1982, et al.
(författare)
-
Recruitment using 'hot topics'. Consequences for efficiency and representativeness. LORE working paper 2013:2 : Recruitment using 'hot topics'. Consequences for efficiency and representativeness
- 2013
-
Rapport (övrigt vetenskapligt/konstnärligt)abstract
- Cost-efficient and representative recruitment to online panels is a persistent challenge for commercial enterprises and academic research alike. In this study we examine how taking advantage of a “hot topic” that most people find involving and important affects recruitment rates and demographic and attitudinal representativeness. The hypothesis is that “hot topic” recruitment helps attract people that are normally not interested in social or political issues, and people with lower trust in politicians, therefore improving representativeness of those recruited. In this study, the case of the introduction of congestion charges around the city of Gothenburg is used as a local “hot topic”. We compare four surveys with a benchmark. Two random samples, and two opt-in samples. In each of these groups one survey used a topical inviation highlighting the issue of congestion charges, while the other used a general invitation to the survey. We find that using a “hot topic” in the recruitment phase doubles the response rate/recruitment rate, thereby making the topical approach twice as efficient and half as expensive as the general approach.No large differences were found concerning demographical representativeness between topical and general recruitment. Concerning political interest and trust, the hypothesis is partly confirmed: topical invitation attracts more respondents with low political interest, but no significant differencen is found conerning trust in politicians
|
|
| 3. |
- Christensen, Love, et al.
(författare)
-
Field work, survey completion times and data quality in Citizen Panel 4 - 2012. LORE working paper 2013:1 : Field work, survey completion times and data quality in Citizen Panel 4 - 2012
- 2013
-
Rapport (övrigt vetenskapligt/konstnärligt)abstract
- This report examines the inflow over the period of field work of a web survey, the amount of time it takes a respondent to complete the survey (duration) and a few data quality indicators. The first part shows us a very large part of the total completed questionnaires are received during the very first day of field work, close to 50 percent. However, after a field work period extended to three weeks, twice as many completed surveys are received in total. It is also made clear that the time of day when most people tend to answer their questionnaires is between 8 am and 11 am. These hours account for almost 40 percent of all completed questionnaires. We also discover a high amount of variation when it comes to the time respondents spend filling out the web questionnaire. On average, this particular survey took 25 minutes to complete. When it comes to predictors of survey duration it is found that people who answer late at night or who are highly interested in politics spend more time on the survey than others. When it comes to data quality the respondents of the Citizen Panel 4 seem be straight-lining to a fairly high extent. As many as one out of four respondents had straight-lined at least one out of seven question batteries. We also confirm a curve-linear relationship between time spent on survey and data quality. Those filling out the questionnaire just slightly slower than the average respondent are those who are least likely to be straight-lining.
|
|
| 4. |
- Dahlberg, Stefan, 1975, et al.
(författare)
-
How representative is a self-selected web-panel? The effect on representativeness of different sampling procedures and survey modes
- 2012
-
Ingår i: The Annual Meeting of the American Association for Public Opinion Research, Orlando, May 2012.
-
Konferensbidrag (övrigt vetenskapligt/konstnärligt)abstract
- This paper makes a systematic comparison between different sampling procedures and survey modes by making use of three different types of surveys. In all three surveys, identical questions and wordings are used. However, they are all three separate studies whereas the first study is based on a representative sample of approximately 3 000 Swedish citizens (based on the national census register). This study is carried out as a traditional postal survey by the Swedish SOM-institute. The second study is also based on a representative sample of approximately 3 000 Swedish citizens (recruited by telephone from the national census register), but in this case the survey is entirely carried out as a web-survey, distributed by e-mail. The third and final study is carried out as a web-survey as well but is instead based on a selfrecruited citizen panel of 10 000 Swedish citizens. All three surveys were carried out during October to December, 2011. In order to evaluate potential differences between varying sampling procedures and survey modes, we will a) compare the composition of respondents in terms of general SES-related background characteristics between the three surveys, both in terms of potential differences in levels and correlations, and b) analyze the differences in three sets of questions tapping, values, attitudes and behavior. By doing this we will be able to uncover how representative a large-sample self-recruited panel actually can become as well as what the usage of new technological media in surveys does to an initially representative sample in a technologically advanced country. Important questions that we will be able to answer concerns to what extent different sampling procedures and survey modes affect the representativeness of a sample? If potential differences varies between different types of survey questions, i.e. questions relating to values, attitudes and behavior etc.
|
|
| 5. |
- Dumitrescu, Delia, 1980, et al.
(författare)
-
Surveys as a social experience: The lingering effects of survey design choices on respondents’ survey experience and subsequent optimizing behavior
- 2014
-
Ingår i: WAPOR.
-
Konferensbidrag (övrigt vetenskapligt/konstnärligt)abstract
- We propose that the choice of question format and information provided to the respondents in the course of a survey affects their behavior not just with respect to the immediate items following them, but also on further responses to questions in other domains. We hypothesize that the structure of the survey is socially construed, and when the survey choices are in line with the rules of social conversation, individuals perform better at later items, and are more satisfied with the survey. We find evidence consistent with this expectation from two experiments, but future research is needed to sort out the causal mechanism responsible for these effects.
|
|
| 6. |
- Jagers, Sverker C., 1967, et al.
(författare)
-
The impact of compensatory measures on public support for carbon taxation: an experimental study in Sweden
- 2019
-
Ingår i: Climate Policy. - : Informa UK Limited. - 1469-3062 .- 1752-7457. ; 19:2, s. 147-160
-
Tidskriftsartikel (refereegranskat)abstract
- This study aims at better understanding how, and to what extent, perceptions of a policy instrument's distributional effects impact on policy support, focusing on the case of CO2 taxes on petrol in Sweden. Through a large-scale (N = 5000) randomized survey experiment with a 2 x 3 factorial design, the extent to which perceptions of fairness determine attitudes to a suggested increase of the Swedish CO2 tax is explored. Furthermore, the study considers whether these effects change with the level of the suggested tax increase, as well as whether negative sentiments can be alleviated by combining it with a compensatory measure in the shape of a simultaneous income tax cut financed by the revenues from the tax increase. The results show that a higher tax increase is both viewed as more unfair and enjoys weaker support. Furthermore, compensatory measures can be a powerful policy design tool to increase perceptions of the policy as fair, but the effect of compensation on policy support is conditioned by the individual's left-right ideological position. Whereas people self-identifying to the right react favourably to compensatory measures, people self-identifying to the left become less supportive of a tax increase when combined with a simultaneous cut in income taxes. Key policy insights Perceptions of fairness are highly important for explaining public support for climate policy tools, specifically CO2 taxes. Compensatory measures can be a powerful policy design tool to increase perceptions of the policy as less unfair. However, the effect of compensatory measures on policy support is conditioned by ideological position, and only successful among people to the ideological right. In contexts dominated by right-wing ideals, a combination of a tax and a compensatory scheme may be a successful route forward towards increased climate policy support. In left-oriented contexts the results imply that a CO2 tax without compensation seems more likely to increase support.
|
|
| 7. |
- Markstedt, Elias, et al.
(författare)
-
Device used to answer web surveys – data quality. LORE methodological note 2014:12
- 2014
-
Rapport (övrigt vetenskapligt/konstnärligt)abstract
- There seem to be no cause for concern regarding data quality differences between desktop/laptop computers on one hand and tablet and smartphones on the other, at least for the time being. However, small but significant differences in terms of item nonresponse and time use, combined with a slow increase in use of handheld devices as shown in Note 2014:11, indicate that survey methodologists might need to keep an eye on future developments.
|
|
| 8. |
- Markstedt, Elias, et al.
(författare)
-
Survey reminder timing – the effect of time between contact attempts. LORE methodological note 2015:6
- 2015
-
Rapport (övrigt vetenskapligt/konstnärligt)abstract
- An experiment with 9,000 respondents divided into three treatment groups with two reminders with different frequency, i.e. the “density” of reminders, show that the length of the data collection period matters very little. Only a 2.5 percent higher participation rate, a statistically non-significant result, was produced with a 4 week data collection period rather than 2 weeks.
|
|
| 9. |
- Markstedt, Elias, et al.
(författare)
-
When during the day do respondents want their e-mail survey invitation? LORE methodological note 2014:18
- 2014
-
Rapport (övrigt vetenskapligt/konstnärligt)abstract
- This methodological note examines the times of day respondents prefer to answer online surveys. The results show that evenings seem to be the time of day most respondents prefer. Further, it is revealed that respondents also have a slight tendency to state that they prefer the time of day when they actually received their e-mail invitation, and that the short-term participation rate is higher when matching respondents’ preferred response time to when they receive the survey invitation. Lastly, responses collected during weekends seem to follow respondents’ preferred answer times less closely and have another logic.
|
|
| 10. |
- Martinsson, Johan, 1975, et al.
(författare)
-
Are incentives more efficient when recruiting to a panel or when inviting to a survey. LORE methodological note 2015:2
- 2015
-
Rapport (övrigt vetenskapligt/konstnärligt)abstract
- In this note the efficiency of a small lottery incentive is evaluated. Through a two by two experimental design we examine the effects of offering an incentive when they sign up to an online panel and/or when they answer the first panel wave. The results reveal that offering an incentive in the recruitment phase has a long term effect on survey participation and even reaches a significantly higher cumulative response rate than the other groups after two years and eight panel waves. Giving an incentive in the first panel wave increases the survey participation rate in that particular wave but has no significant effect over time. Incentives also seem to somewhat decrease the prevalence of item nonresponse but has no clear effect on the amount of time respondents use to complete surveys.
|
|
