Search: onr:"swepub:oai:DiVA.org:liu-190642" > Observing many rese...
Fältnamn | Indikatorer | Metadata |
---|---|---|
000 | 17041naa a2202401 4500 | |
001 | oai:DiVA.org:liu-190642 | |
003 | SwePub | |
008 | 221220s2022 | |||||||||||000 ||eng| | |
009 | oai:DiVA.org:umu-200696 | |
024 | 7 | a https://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-1906422 URI |
024 | 7 | a https://doi.org/10.1073/pnas.22031501192 DOI |
024 | 7 | a https://urn.kb.se/resolve?urn=urn:nbn:se:umu:diva-2006962 URI |
040 | a (SwePub)liud (SwePub)umu | |
041 | a engb eng | |
042 | 9 SwePub | |
072 | 7 | a ref2 swepub-contenttype |
072 | 7 | a art2 swepub-publicationtype |
100 | 1 | a Breznau, Nateu Univ Bremen, Germany,Research Center on Inequality and Social Policy (SOCIUM), University of Bremen, Bremen, Germany4 aut |
245 | 1 0 | a Observing many researchers using the same data and hypothesis reveals a hidden universe of uncertainty |
264 | c 2022-10-28 | |
264 | 1 | b National Academy of Sciences,c 2022 |
338 | a electronic2 rdacarrier | |
500 | a Funding Agencies|Freies Wissen ("Open Knowledge") Fellowship of Wikimedia | |
500 | a Edited by Douglas Massey, Princeton University, Princeton, NJ | |
520 | a This study explores how researchers analytical choices affect the reliability of scientific findings. Most discussions of reliability problems in science focus on systematic biases. We broaden the lens to emphasize the idiosyncrasy of conscious and unconscious decisions that researchers make during data analysis. We coordinated 161 researchers in 73 research teams and observed their research decisions as they used the same data to independently test the same prominent social science hypothesis: that greater immigration reduces support for social policies among the public. In this typical case of social science research, research teams reported both widely diverging numerical findings and substantive conclusions despite identical start conditions. Researchers expertise, prior beliefs, and expectations barely predict the wide variation in research outcomes. More than 95% of the total variance in numerical results remains unexplained even after qualitative coding of all identifiable decisions in each teams workflow. This reveals a universe of uncertainty that remains hidden when considering a single study in isolation. The idiosyncratic nature of how researchers results and conclusions varied is a previously underappreciated explanation for why many scientific hypotheses remain contested. These results call for greater epistemic humility and clarity in reporting scientific findings. | |
650 | 7 | a SAMHÄLLSVETENSKAPx Annan samhällsvetenskapx Tvärvetenskapliga studier inom samhällsvetenskap0 (SwePub)509012 hsv//swe |
650 | 7 | a SOCIAL SCIENCESx Other Social Sciencesx Social Sciences Interdisciplinary0 (SwePub)509012 hsv//eng |
650 | 7 | a SAMHÄLLSVETENSKAPx Sociologix Sociologi0 (SwePub)504012 hsv//swe |
650 | 7 | a SOCIAL SCIENCESx Sociologyx Sociology0 (SwePub)504012 hsv//eng |
653 | a metascience; many analysts; researcher degrees of freedom; analytical flexibility; immigration and policy preferences | |
700 | 1 | a Rinke, Eike Marku Univ Leeds, England,School of Politics and International Studies, University of Leeds, Leeds, United Kingdom4 aut |
700 | 1 | a Wuttke, Alexanderu Univ Mannheim, Germany,Mannheim Centre for European Social Research, University of Mannheim, Mannheim, Germany; Department of Political Science, Ludwig Maximilian University, Munich, Germany4 aut |
700 | 1 | a Nguyen, Hung H. V.u Univ Bremen, Germany; Bremen Int Grad Sch Social Sci, Germany4 aut |
700 | 1 | a Adem, Munau Indiana Univ, IN 47405 USA4 aut |
700 | 1 | a Adriaans, Juleu German Inst Econ Res DIW, Germany4 aut |
700 | 1 | a Alvarez-Benjumea, Amaliau Max Planck Inst Res Collect Goods, Germany4 aut |
700 | 1 | a Andersen, Henrik K.u Tech Univ Chemnitz, Germany,Johannes Gutenberg Univ Mainz, Germany4 aut |
700 | 1 | a Auer, Danielu Univ Mannheim, Germany4 aut |
700 | 1 | a Azevedo, Flaviou Univ Cambridge, England4 aut |
700 | 1 | a Bahnsen, Okeu Univ Mannheim, Germany4 aut |
700 | 1 | a Balzer, Daveu Johannes Gutenberg Univ Mainz, Germany4 aut |
700 | 1 | a Bauer, Gerritu Ludwig Maximilians Univ Munchen, Germany4 aut |
700 | 1 | a Bauer, Paul C.u Univ Mannheim, Germany4 aut |
700 | 1 | a Baumann, Markusu Heidelberg Univ, Germany; Goethe Univ Frankfurt, Germany4 aut |
700 | 1 | a Baute, Sharonu Univ Konstanz, Germany4 aut |
700 | 1 | a Benoit, Verenau Ludwig Maximilians Univ Munchen, Germany; Univ Bamberg, Germany4 aut |
700 | 1 | a Bernauer, Julianu Univ Mannheim, Germany4 aut |
700 | 1 | a Berning, Carlu Johannes Gutenberg Univ Mainz, Germany4 aut |
700 | 1 | a Berthold, Annau Univ Bamberg, Germany4 aut |
700 | 1 | a Bethke, Felix S.u Peace Res Inst Frankfurt, Germany,UCL, England4 aut |
700 | 1 | a Biegert, Thomasu London Sch Econ & Polit Sci, England4 aut |
700 | 1 | a Blinzler, Katharinau Leibniz Inst Social Sci GESIS, Germany4 aut |
700 | 1 | a Blumenberg, Johannes N.u Leibniz Inst Social Sci GESIS, Germany4 aut |
700 | 1 | a Bobzien, Liciau Hertie Sch, Germany4 aut |
700 | 1 | a Bohman, Andrea,d 1983-u Umeå universitet,Sociologiska institutionen,Umea Univ, Sweden4 aut0 (Swepub:umu)aeabon03 |
700 | 1 | a Bol, Thijsu UCL, England; Univ Amsterdam, Netherlands4 aut |
700 | 1 | a Bostic, Amieu Univ Texas Rio Grande Valley, TX 78520 USA4 aut |
700 | 1 | a Brzozowska, Zuzannau Austrian Acad Sci, Austria; Gesundheit Osterreich GOG, Austria4 aut |
700 | 1 | a Burgdorf, Katharinau Univ Mannheim, Germany4 aut |
700 | 1 | a Burger, Kasparu UCL, England; Univ Zurich, Switzerland; Univ Zurich, Switzerland4 aut |
700 | 1 | a Busch, Kathrin B.4 aut |
700 | 1 | a Carlos-Castillo, Juanu Univ Chile, Chile; Pontificia Univ Catolica Chile, Chile4 aut |
700 | 1 | a Chan, Nathanu Loyola Marymount Univ, CA 90045 USA4 aut |
700 | 1 | a Christmann, Pablou Leibniz Inst Social Sci, Germany4 aut |
700 | 1 | a Connelly, Roxanneu Univ Edinburgh, Scotland4 aut |
700 | 1 | a Czymara, Christian S.u Goethe Univ Frankfurt, Germany4 aut |
700 | 1 | a Damian, Elenau Sciensano, Belgium4 aut |
700 | 1 | a Ecker, Alejandrou Univ Mannheim, Germany4 aut |
700 | 1 | a Edelmann, Achimu Medialab Sci Po, France4 aut |
700 | 1 | a Eger, Maureen A.,c Dr.d 1977-u Umeå universitet,Sociologiska institutionen,Umea Univ, Sweden4 aut0 (Swepub:umu)maeg0005 |
700 | 1 | a Ellerbrock, Simonu Univ Mannheim, Germany; Univ Mannheim, Germany4 aut |
700 | 1 | a Forke, Anna4 aut |
700 | 1 | a Forster, Andreau Free Univ Berlin, Germany4 aut |
700 | 1 | a Gaasendam, Chrisu Katholieke Univ Leuven, Belgium4 aut |
700 | 1 | a Gavras, Konstantinu Univ Mannheim, Germany4 aut |
700 | 1 | a Gayle, Vernonu Univ Edinburgh, Scotland4 aut |
700 | 1 | a Gessler, Theresau European Univ Viadrina, Germany4 aut |
700 | 1 | a Gnambs, Timou Leibniz Inst Educ Trajectories, Germany4 aut |
700 | 1 | a Godefroidt, Amelieu Katholieke Univ Leuven, Belgium4 aut |
700 | 1 | a Groemping, Maxu Griffith Univ, Australia4 aut |
700 | 1 | a Gross, Martinu Univ Tubingen, Germany4 aut |
700 | 1 | a Gruber, Stefanu Max Planck Inst Social Law & Social Policy, Germany4 aut |
700 | 1 | a Gummer, Tobiasu Leibniz Inst Social Sci, Germany4 aut |
700 | 1 | a Hadjar, Andreasu Univ Luxembourg, Luxembourg; Hans Bockler Fdn, Germany; Univ Fribourg, Switzerland; Univ Luxembourg, Luxembourg4 aut |
700 | 1 | a Heisig, Jan Paulu Univ Groningen, Netherlands; Berlin Social Sci Ctr WZB, Germany4 aut |
700 | 1 | a Hellmeier, Sebastianu Berlin Social Sci Ctr WZB, Germany4 aut |
700 | 1 | a Heyne, Stefanieu Univ Mannheim, Germany4 aut |
700 | 1 | a Hirsch, Magdalenau Berlin Social Sci Ctr WZB, Germany,German Inst Econ Res DIW, Germany; Humboldt Univ, Germany4 aut |
700 | 1 | a Hjerm, Mikael,d 1969-u Umeå universitet,Sociologiska institutionen,Umea Univ, Sweden4 aut0 (Swepub:umu)mihj0001 |
700 | 1 | a Hochman, Oshratu Leibniz Inst Social Sci, Germany4 aut |
700 | 1 | a Hovermann, Andreasu Hans Bockler Fdn, Germany; German Socio Econ Panel Survey, Germany4 aut |
700 | 1 | a Hunger, Sophiau Berlin Social Sci Ctr, Germany4 aut |
700 | 1 | a Hunkler, Christianu Humboldt Univ, Germany4 aut |
700 | 1 | a Huth, Norau Univ Wuppertal, Germany4 aut |
700 | 1 | a Ignacz, Zsofia S.u Goethe Univ Frankfurt, Germany4 aut |
700 | 1 | a Jacobs, Laurau Univ Libre Bruxelles, Belgium4 aut |
700 | 1 | a Jacobsen, Jannesu Zeppelin Univ, Germany; German Ctr Integrat & Migrat Res DeZIM, Germany,Univ Calif Los Angeles, CA 90095 USA,Univ Tubingen, Germany,German Inst Econ Res DIW, Germany4 aut |
700 | 1 | a Jaeger, Bastianu Tilburg Univ, Netherlands4 aut |
700 | 1 | a Jungkunz, Sebastianu Univ Duisburg Essen, Germany; Univ Munster, Germany; Univ Groningen, Netherlands; Univ Bamberg, Germany4 aut |
700 | 1 | a Jungmann, Nilsu Leibniz Inst Social Sci GESIS, Germany4 aut |
700 | 1 | a Kauff, Mathiasu Med Sch Hamburg, Germany4 aut |
700 | 1 | a Kleinert, Manuelu Justus Liebig Univ Giessen, Germany4 aut |
700 | 1 | a Klinger, Juliau Univ Cologne, Germany4 aut |
700 | 1 | a Kolb, Jan-Philippu Gesundheit Osterreich GOG, Austria; Fed Stat Off Germany, Germany4 aut |
700 | 1 | a Kolczynska, Martau Polish Acad Sci, Poland4 aut |
700 | 1 | a Kuk, Johnu Univ Oklahoma, OK 73019 USA4 aut |
700 | 1 | a Kunissen, Katharinau Johannes Gutenberg Univ Mainz, Germany4 aut |
700 | 1 | a Sinatra, Dafina Kurti4 aut |
700 | 1 | a Langenkamp, Alexanderu Goethe Univ Frankfurt, Germany4 aut |
700 | 1 | a Lersch, Philipp M.u German Inst Econ Res DIW, Germany; Humboldt Univ, Germany,Univ Konstanz, Germany4 aut |
700 | 1 | a Lobel, Lea-Mariau German Inst Econ Res DIW, Germany4 aut |
700 | 1 | a Lutscher, Philippu Univ Oslo, Norway4 aut |
700 | 1 | a Mader, Matthiasu Univ Konstanz, Germany,German Inst Econ Res DIW, Germany,Univ S Florida, FL 33620 USA4 aut |
700 | 1 | a Madia, Joan E.u Univ Oxford, England; Fdn Bruno Kessler, Italy4 aut |
700 | 1 | a Malancu, Nataliau Univ Geneva, Switzerland4 aut |
700 | 1 | a Maldonado, Luisu Pontificia Univ Catolica Chile, Chile4 aut |
700 | 1 | a Marahrens, Helgeu Indiana Univ, IN 47405 USA4 aut |
700 | 1 | a Martin, Nicoleu Univ Manchester, England4 aut |
700 | 1 | a Martinez, Paulu Western Governors Univ, UT 84107 USA4 aut |
700 | 1 | a Mayerl, Jochenu Tech Univ Chemnitz, Germany4 aut |
700 | 1 | a Mayorga, Oscar J.u Univ Calif Los Angeles, CA 90095 USA4 aut |
700 | 1 | a McManus, Patriciau Indiana Univ, IN 47405 USA4 aut |
700 | 1 | a McWagner, Kyleu Univ Calif Irvine, CA 92617 USA4 aut |
700 | 1 | a Meeusen, Cecilu Katholieke Univ Leuven, Belgium4 aut |
700 | 1 | a Meierrieks, Danielu Berlin Social Sci Ctr WZB, Germany4 aut |
700 | 1 | a Mellon, Jonathanu Univ Manchester, England4 aut |
700 | 1 | a Merhout, Friedolinu Univ Copenhagen, Denmark; Univ Copenhagen, Denmark4 aut |
700 | 1 | a Merk, Samuelu Univ Educ Karlsruhe, Germany4 aut |
700 | 1 | a Meyer, Danielu Univ Cologne, Germany4 aut |
700 | 1 | a Micheli, Leticiau Julius Maximilians Univ Wurzburg, Germany4 aut |
700 | 1 | a Mijs, Jonathanu Boston Univ, MA 02215 USA4 aut |
700 | 1 | a Moya, Cristobalu Univ Bielefeld, Germany4 aut |
700 | 1 | a Neunhoeffer, Marcelu Univ Mannheim, Germany4 aut |
700 | 1 | a Nust, Danielu Univ Munster, Germany4 aut |
700 | 1 | a Nygård, Olavu Linköpings universitet,Avdelningen för migration, etnicitet och samhälle (REMESO),Filosofiska fakulteten,REMESO - Institutet för forskning om Migration, Etnicitet och Samhälle4 aut0 (Swepub:liu)olany64 |
700 | 1 | a Ochsenfeld, Fabianu Max Planck Gesell, Germany4 aut |
700 | 1 | a Otte, Gunnaru Johannes Gutenberg Univ Mainz, Germany4 aut |
700 | 1 | a Pechenkina, Anna O.u Utah State Univ, UT 84321 USA4 aut |
700 | 1 | a Prosser, Christopheru Royal Holloway Univ London, England4 aut |
700 | 1 | a Raes, Louisu Tilburg Univ, Netherlands4 aut |
700 | 1 | a Ralston, Kevinu Univ Edinburgh, Scotland4 aut |
700 | 1 | a Ramos, Miguel R.u Univ Birmingham, England4 aut |
700 | 1 | a Roets, Arneu Univ Ghent, Belgium4 aut |
700 | 1 | a Rogers, Jonathanu New York Univ Abu Dhabi, U Arab Emirates4 aut |
700 | 1 | a Ropers, Guidou Univ Mannheim, Germany4 aut |
700 | 1 | a Samuel, Robinu Univ Luxembourg, Luxembourg; Univ Luxembourg, Luxembourg4 aut |
700 | 1 | a Sand, Gregoru Max Planck Inst Social Law & Social Policy, Germany4 aut |
700 | 1 | a Schachter, Arielau Leibniz Inst Social Sci GESIS, Germany4 aut |
700 | 1 | a Schaeffer, Merlinu Univ Copenhagen, Denmark4 aut |
700 | 1 | a Schieferdecker, Davidu Free Univ Berlin, Germany4 aut |
700 | 1 | a Schlueter, Elmaru Justus Liebig Univ Giessen, Germany4 aut |
700 | 1 | a Schmidt, Regineu Univ Bamberg, Germany4 aut |
700 | 1 | a Schmidt, Katja M.u German Inst Econ Res DIW, Germany4 aut |
700 | 1 | a Schmidt-Catran, Alexanderu Goethe Univ Frankfurt, Germany4 aut |
700 | 1 | a Schmiedeberg, Claudiau Ludwig Maximilians Univ Munchen, Germany4 aut |
700 | 1 | a Schneider, J. Urgenu Univ Tubingen, Germany4 aut |
700 | 1 | a Schoonvelde, Martijnu Univ Coll Dublin, Ireland; Univ Groningen, Netherlands4 aut |
700 | 1 | a Schulte-Cloos, Juliau European Univ Inst, Italy4 aut |
700 | 1 | a Schumann, Sandyu UCL, England4 aut |
700 | 1 | a Schunck, Reinhardu Univ Wuppertal, Germany4 aut |
700 | 1 | a Schupp, J. Urgenu German Inst Econ Res DIW, Germany4 aut |
700 | 1 | a Seuring, Julianu Leibniz Inst Educ Trajectories, Germany4 aut |
700 | 1 | a Silber, Henningu Leibniz Inst Social Sci GESIS, Germany4 aut |
700 | 1 | a Sleegers, Willemu Tilburg Univ, Netherlands4 aut |
700 | 1 | a Sonntag, Nicou Johannes Gutenberg Univ Mainz, Germany4 aut |
700 | 1 | a Staudt, Alexander4 aut |
700 | 1 | a Steiber, Nadiau Univ Vienna, Austria4 aut |
700 | 1 | a Steiner, Nilsu Johannes Gutenberg Univ Mainz, Germany4 aut |
700 | 1 | a Sternberg, Sebastian4 aut |
700 | 1 | a Stiers, Dieteru Katholieke Univ Leuven, Belgium4 aut |
700 | 1 | a Stojmenovska, Draganau Univ Amsterdam, Netherlands4 aut |
700 | 1 | a Storz, Norau Univ Utrecht, Netherlands4 aut |
700 | 1 | a Striessnig, Erichu Univ Vienna, Austria4 aut |
700 | 1 | a Stroppe, Anne-Kathrinu Leibniz Inst Social Sci GESIS, Germany4 aut |
700 | 1 | a Teltemann, Jannau Univ Hildesheim, Germany4 aut |
700 | 1 | a Tibajev, Andreyu Linköpings universitet,Avdelningen för migration, etnicitet och samhälle (REMESO),Filosofiska fakulteten,REMESO - Institutet för forskning om Migration, Etnicitet och Samhälle4 aut0 (Swepub:liu)andti43 |
700 | 1 | a Tung, Brianu Washington Univ, MO 63130 USA4 aut |
700 | 1 | a Vagni, Giacomou UCL, England4 aut |
700 | 1 | a Van Assche, Jasperu Univ Ghent, Belgium; Univ Libre Bruxelles, Belgium4 aut |
700 | 1 | a van der Linden, Metau Univ Utrecht, Netherlands4 aut |
700 | 1 | a van der Noll, Jolandau Univ Hagen, Germany4 aut |
700 | 1 | a Van Hootegem, Arnou Katholieke Univ Leuven, Belgium4 aut |
700 | 1 | a Vogtenhuber, Stefanu Univ Vienna, Austria4 aut |
700 | 1 | a Voicu, Bogdanu Romanian Acad, Romania; Lucian Blaga Univ Sibiu, Romania4 aut |
700 | 1 | a Wagemans, Fiekeu Netherlands Inst Social Res, Netherlands; Netherlands Inst Social Res, Netherlands4 aut |
700 | 1 | a Wehl, Nadjau Univ Konstanz, Germany4 aut |
700 | 1 | a Werner, Hannahu Katholieke Univ Leuven, Belgium4 aut |
700 | 1 | a Wiernik, Brenton M.u Univ S Florida, FL 33620 USA4 aut |
700 | 1 | a Winter, Fabianu Max Planck Inst Res Collect Goods, Germany4 aut |
700 | 1 | a Wolf, Christofu Univ Mannheim, Germany; Univ Mannheim, Germany; Leibniz Inst Social Sci GESIS, Germany4 aut |
700 | 1 | a Yamada, Yukiu Kyushu Univ, Japan4 aut |
700 | 1 | a Zhang, Nanu Univ Mannheim, Germany4 aut |
700 | 1 | a Ziller, Conradu Univ Duisburg Essen, Germany; Univ Duisburg Essen, Germany4 aut |
700 | 1 | a Zins, Stefanu Fed Employment Agcy, Germany4 aut |
700 | 1 | a Zoltak, Tomaszu Polish Acad Sci, Poland,Department of Research on Social and Institutional Transformations, Institute of Political Studies of the Polish Academy of Sciences, Warsaw, Poland4 aut |
710 | 2 | a Univ Bremen, Germanyb Research Center on Inequality and Social Policy (SOCIUM), University of Bremen, Bremen, Germany4 org |
773 | 0 | t Proceedings of the National Academy of Sciences of the United States of Americad : National Academy of Sciencesg 119:44q 119:44x 0027-8424x 1091-6490 |
856 | 4 | u https://liu.diva-portal.org/smash/get/diva2:1720735/FULLTEXT01.pdfx primaryx Raw objecty fulltext:print |
856 | 4 | u https://doi.org/10.1073/pnas.2203150119y Fulltext |
856 | 4 | u https://umu.diva-portal.org/smash/get/diva2:1707400/FULLTEXT01.pdfx primaryx Raw objecty fulltext:print |
856 | 4 8 | u https://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-190642 |
856 | 4 8 | u https://doi.org/10.1073/pnas.2203150119 |
856 | 4 8 | u https://urn.kb.se/resolve?urn=urn:nbn:se:umu:diva-200696 |
Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.
Copy and save the link in order to return to this view