Search: onr:"swepub:oai:DiVA.org:lnu-70907" >
Many analysts, one ...
Many analysts, one dataset : Making transparent how variations in analytical choices affect results
-
- Silberzahn, Raphael (author)
- University of Sussex Business School, UK,University of Sussex (United Kingdom, Brighton)
-
- Uhlmann, Eric (author)
- INSEAD, Singapore,INSEAD (France, Fontainebleau)
-
- Martin, Daniel (author)
- University of Virginia, USA,University of Washington (United States, Seattle) - UW,University of Virginia (United States, Charlottesville) - UVA
-
show more...
-
- Anselmi, Pasquale (author)
- University of Padua, Italy
-
- Aust, Frederik (author)
- University of Cologne, Germany
-
- Awtrey, Eli (author)
- University of Cincinnati, USA,University of Cincinnati (United States, Cincinnati) - UC
-
- Bahník, Štěpán (author)
- University of Economics, Czech Republic,Prague University of Economics and Business (Czechia, Prague) - VSE
-
- Bai, Feng (author)
- Hong Kong Polytechnic University, Hong Kong
-
- Bannard, Colin (author)
- University of Liverpool, UK
-
- Bonnier, Evelina (author)
- Stockholm School of Economics, Sweden,Stockholm School of Economics (Sweden, Stockholm) - HHS
-
- Carlsson, Rickard, 1984- (author)
- Linnéuniversitetet,Institutionen för psykologi (PSY),University of Nottingham (United Kingdom, Nottingham),Linnaeus University
-
- Cheung, Felix (author)
- University of Hong Kong, Hong Kong,University of Hong Kong (China, Hong Kong) - HKU
-
- Christensen, Garret (author)
- University of California, USA,University of California, Berkeley
-
- Clay, Russ (author)
- City University of New York, USA,City University of New York (United States, New York) - CUNY
-
- Craig, Maureen (author)
- New York University, USA
-
- Dalla Rosa, Anna (author)
- University of Padua, Italy,Univ Padua, Dept Philosophy Sociol Educ & Appl Psychol, Padua, Italy
-
- Dam, Lammertjan (author)
- University of Groningen, Netherlands
-
- Evans, Mathew (author)
- University of Manchester, UK
-
- Flores Cervantes, Ismael (author)
- Westat, USA
-
- Fong, Nathan (author)
- Temple University, USA
-
- Gamez-Djokic, Monica (author)
- Northwestern University, USA,Northwestern University (United States, Evanston) - NU
-
- Glenz, Andreas (author)
- University of Zurich, Switzerland
-
- Gordon-McKeon, Shauna (author)
- Washington D.C., USA
-
- Heaton, Tim (author)
- University of Sheffield, UK
-
- Hederos, Karin (author)
- Stockholms universitet,Institutet för social forskning (SOFI),Stockholm University,Stockholm University, Sweden
-
- Heene, Mortiz (author)
- Ludwig-Maximilians-Universität München, Germany
-
- Hofelich Mohr, Alicia (author)
- University of Minnesota, USA
-
- Högden, Fabia (author)
- University of Cologne, Germany
-
- Hui, Kent (author)
- Xiamen University, China,Xiamen University (China, Amoy) - XMU
-
- Johannesson, M. (author)
- Stockholm School of Economics,Handelshögskolan i Stockholm,Loyola University Maryland (United States, Baltimore),Stockholm School of Economics, Sweden
-
- Kalodimos, Jonathan (author)
- Oregon State University, USA
-
- Kaszubowski, Erikson (author)
- Federal University of Santa Catarina, Brazil,Universidade Federal de Santa Catarina (Brazil, Florianópolis) - UFSC
-
- Kennedy, Deanna (author)
- University of Washington Bothell, USA
-
- Lei, Ryan (author)
- New York University, USA
-
- Lindsay, Thomas (author)
- University of Minnesota, USA
-
- Liverani, Silvia (author)
- Queen Mary University of London, UK,Queen Mary University of London (United Kingdom, London) - QMUL
-
- Madan, Christopher (author)
- University of Nottingham, UK
-
- Molden, Daniel (author)
- Northwestern University, USA,Northwestern University (United States, Evanston) - NU
-
- Molleman, Eric (author)
- University of Groningen, Netherlands
-
- Morey, Richard (author)
- Cardiff University, UK
-
- Mulder, Laetitia (author)
- University of Groningen, Netherlands
-
- Nijstad, Bernard (author)
- University of Groningen, Netherlands
-
- Pope, Nolan (author)
- University of Maryland, USA,University of Maryland, College Park
-
- Pope, Bryson (author)
- Brigham Young University, USA
-
- Prenoveau, Jason (author)
- Loyola University Maryland, USA
-
- Rink, Floor (author)
- University of Groningen, Netherlands
-
- Robusto, Egidio (author)
- University of Padua, Italy
-
- Roderique, Hadiya (author)
- University of Toronto, Canada
-
- Sandberg, Anna (author)
- Stockholms universitet,Institutet för social forskning (SOFI),Stockholm University (Sweden, Stockholm),United States Military Academy (United States, West Point) - USMA,Stockholm University, Sweden
-
- Schlüter, Elmar (author)
- Justus Liebig University, Germany,Justus Liebig Univ, Inst Sociol, Dept Social Sci & Cultural Studies, Giessen, Germany
-
- Schönbrodt, Felix (author)
- Ludwig-Maximilians-Universität München, Germany,Ludwig Maximilian University of Munich
-
- Sherman, Martin (author)
- Loyola University Maryland, USA
-
- Sommer, S. Amy (author)
- United States Military Academy at West Point, USA,Concordia University,Concordia University, Canada
-
- Sotak, Kristin (author)
- State University of New York at Oswego, USA
-
- Spain, Seth (author)
- Concordia University, Canada,University of Groningen,Temple University (United States, Philadelphia)
-
- Spörlein, Christoph (author)
- Otto-Friedrich-Universität Bamberg, Germany,University of Bamberg
-
- Stafford, Tom (author)
- University of Sheffield, UK
-
- Stefanutti, Luca (author)
- University of Padua, Italy
-
- Täuber, Susanne (author)
- University of Groningen, Netherlands
-
- Ullrich, Johannes (author)
- University of Zurich, Switzerland
-
- Vianello, Michelangelo (author)
- University of Padua, Italy,University of Padua (Italy, Padova) - UNIPD
-
- Wagenmakers, Eric-Jan (author)
- University of Amsterdam, Netherlands
-
- Witkowiak, Maciej (author)
- Poznań, Poland
-
- Yoon, Sangsuk (author)
- Temple University, USA
-
- Nosek, Brian (author)
- University of Virginia, USA;Center for Open Science, USA,University of Virginia (United States, Charlottesville) - UVA
-
show less...
-
(creator_code:org_t)
- 2018-08-23
- 2018
- English.
-
In: Advances in Methods and Practices in Psychological Science. - : Sage Publications. - 2515-2459 .- 2515-2467. ; 1:3, s. 337-356
- Related links:
-
https://doi.org/10.1...
-
show more...
-
https://journals.sag...
-
https://research.hhs... (primary) (Object in context)
-
https://urn.kb.se/re...
-
https://doi.org/10.1...
-
https://urn.kb.se/re...
-
https://research.hhs...
-
show less...
Abstract
Subject headings
Close
- Twenty-nine teams involving 61 analysts used the same dataset to address the same research question: whether soccer referees are more likely to give red cards to dark skin toned players than light skin toned players. Analytic approaches varied widely across teams, and estimated effect sizes ranged from 0.89 to 2.93 in odds ratio units, with a median of 1.31. Twenty teams (69%) found a statistically significant positive effect and nine teams (31%) observed a non-significant relationship. Overall 29 differentanalyses used 21 unique combinations of covariates. We found that neither analysts' prior beliefs about the effect, nor their level of expertise, nor peer-reviewed quality of analysis readily explained variation in analysis outcomes. This suggests that significant variation in the results of analyses of complex data may be difficult to avoid, even by experts with honest intentions. Crowdsourcing data analysis, a strategy by which numerous research teams are recruited to simultaneously investigate the same research question, makes transparent how defensible, yet subjective analytic choices influence research results.
Subject headings
- SAMHÄLLSVETENSKAP -- Psykologi -- Psykologi (hsv//swe)
- SOCIAL SCIENCES -- Psychology -- Psychology (hsv//eng)
- SAMHÄLLSVETENSKAP -- Ekonomi och näringsliv -- Nationalekonomi (hsv//swe)
- SOCIAL SCIENCES -- Economics and Business -- Economics (hsv//eng)
- SAMHÄLLSVETENSKAP -- Sociologi -- Socialpsykologi (hsv//swe)
- SOCIAL SCIENCES -- Sociology -- Social Psychology (hsv//eng)
Keyword
- Psychology
- Psykologi
- crowdsourcing science
- Economics
Publication and Content Type
- ref (subject category)
- art (subject category)
Find in a library
To the university's database
- By the author/editor
-
Silberzahn, Raph ...
-
Uhlmann, Eric
-
Martin, Daniel
-
Anselmi, Pasqual ...
-
Aust, Frederik
-
Awtrey, Eli
-
show more...
-
Bahník, Štěpán
-
Bai, Feng
-
Bannard, Colin
-
Bonnier, Evelina
-
Carlsson, Rickar ...
-
Cheung, Felix
-
Christensen, Gar ...
-
Clay, Russ
-
Craig, Maureen
-
Dalla Rosa, Anna
-
Dam, Lammertjan
-
Evans, Mathew
-
Flores Cervantes ...
-
Fong, Nathan
-
Gamez-Djokic, Mo ...
-
Glenz, Andreas
-
Gordon-McKeon, S ...
-
Heaton, Tim
-
Hederos, Karin
-
Heene, Mortiz
-
Hofelich Mohr, A ...
-
Högden, Fabia
-
Hui, Kent
-
Johannesson, M.
-
Kalodimos, Jonat ...
-
Kaszubowski, Eri ...
-
Kennedy, Deanna
-
Lei, Ryan
-
Lindsay, Thomas
-
Liverani, Silvia
-
Madan, Christoph ...
-
Molden, Daniel
-
Molleman, Eric
-
Morey, Richard
-
Mulder, Laetitia
-
Nijstad, Bernard
-
Pope, Nolan
-
Pope, Bryson
-
Prenoveau, Jason
-
Rink, Floor
-
Robusto, Egidio
-
Roderique, Hadiy ...
-
Sandberg, Anna
-
Schlüter, Elmar
-
Schönbrodt, Feli ...
-
Sherman, Martin
-
Sommer, S. Amy
-
Sotak, Kristin
-
Spain, Seth
-
Spörlein, Christ ...
-
Stafford, Tom
-
Stefanutti, Luca
-
Täuber, Susanne
-
Ullrich, Johanne ...
-
Vianello, Michel ...
-
Wagenmakers, Eri ...
-
Witkowiak, Macie ...
-
Yoon, Sangsuk
-
Nosek, Brian
-
show less...
- About the subject
-
- SOCIAL SCIENCES
-
SOCIAL SCIENCES
-
and Psychology
-
and Psychology
-
- SOCIAL SCIENCES
-
SOCIAL SCIENCES
-
and Economics and Bu ...
-
and Economics
-
- SOCIAL SCIENCES
-
SOCIAL SCIENCES
-
and Sociology
-
and Social Psycholog ...
- Articles in the publication
-
Advances in Meth ...
- By the university
-
Linnaeus University
-
Stockholm University
-
Stockholm School of Economics