Search: WFRF:(Lindberg Michael)
> (2015-2019) >
Experts, Coders, an...
Experts, Coders, and Crowds:An analysis of substitutability
-
- Marquardt, Kyle L., 1983 (author)
- Gothenburg University,Göteborgs universitet,V-Dem Institute,Statsvetenskapliga institutionen,Department of Political Science
-
Pemstein, Daniel (author)
-
- Petrarca, Constanza Sanhueza, 1984 (author)
- Gothenburg University,Göteborgs universitet,Statsvetenskapliga institutionen,V-Dem Institute,Department of Political Science
-
show more...
-
Seim, Brigitte (author)
-
Wilson, Steven Lloyd (author)
-
Bernhard, Michael (author)
-
Coppedge, Michael (author)
-
- Lindberg, Staffan I, 1969 (author)
- Gothenburg University,Göteborgs universitet,V-Dem Institute,Quality of Government Institute (QoG),Statsvetenskapliga institutionen,Department of Political Science
-
show less...
-
(creator_code:org_t)
- Göteborg : University of Gothenburg, Varieties of Democracy Institute: Working Paper No. 53. October 2017, 2017
- English.
-
Series: V-Dem Working Paper Series
- Related links:
-
https://gup.ub.gu.se...
Abstract
Subject headings
Close
- Recent work suggests that crowd workers can replace experts and trained coders in common coding tasks. However, while many political science applications require coders to both and relevant information and provide judgment, current studies focus on a limited domain in which experts provide text for crowd workers to code. To address potential over-generalization, we introduce a typology of data producing actors - experts, coders, and crowds - and hypothesize factors which affect crowd-expert substitutability. We use this typology to guide a comparison of data from crowdsourced and expert surveys. Our results provide sharp scope conditions for the substitutability of crowd workers: when coding tasks require contextual and conceptual knowledge, crowds produce substantively dierent data from coders and experts. We also find that crowd workers can cost more than experts in the context of cross-national panels, and that one purported advantage of crowdsourcing - replicability - is undercut by an insucient number of crowd workers.
Subject headings
- SAMHÄLLSVETENSKAP -- Statsvetenskap (hsv//swe)
- SOCIAL SCIENCES -- Political Science (hsv//eng)
Publication and Content Type
- vet (subject category)
- ovr (subject category)
To the university's database