Search: onr:"swepub:oai:DiVA.org:su-160133" >
Data availability, ...
Data availability, reusability, and analytic reproducibility : evaluating the impact of a mandatory open data policy at the journal Cognition
-
Hardwicke, Tom E. (author)
-
Mathur, Maya B. (author)
-
MacDonald, Kyle (author)
-
show more...
-
- Nilsonne, Gustav (author)
- Karolinska Institutet,Stockholms universitet,Stressforskningsinstitutet,Stanford University, USA; Karolinska Institutet, Sweden
-
Banks, George C. (author)
-
Kidwell, Mallory C. (author)
-
Mohr, Alicia Hofelich (author)
-
Clayton, Elizabeth (author)
-
Yoon, Erica J. (author)
-
Tessler, Michael Henry (author)
-
Lenne, Richie L. (author)
-
Altman, Sara (author)
-
Long, Bria (author)
-
Frank, Michael C. (author)
-
show less...
-
(creator_code:org_t)
- 2018-08-15
- 2018
- English.
-
In: Royal Society Open Science. - : The Royal Society. - 2054-5703. ; 5:8
- Related links:
-
https://doi.org/10.1...
-
show more...
-
https://royalsociety...
-
https://urn.kb.se/re...
-
https://doi.org/10.1...
-
http://kipublication...
-
show less...
Abstract
Subject headings
Close
- Access to data is a critical feature of an efficient, progressive and ultimately self-correcting scientific ecosystem. But the extent to which in-principle benefits of data sharing are realized in practice is unclear. Crucially, it is largely unknown whether published findings can be reproduced by repeating reported analyses upon shared data ('analytic reproducibility'). To investigate this, we conducted an observational evaluation of a mandatory open data policy introduced at the journal Cognition. Interrupted time-series analyses indicated a substantial post-policy increase in data available statements (104/417, 25% pre-policy to 136/ 174, 78% post-policy), although not all data appeared reusable (23/ 104, 22% pre-policy to 85/136, 62%, post-policy). For 35 of the articles determined to have reusable data, we attempted to reproduce 1324 target values. Ultimately, 64 values could not be reproduced within a 10% margin of error. For 22 articles all target values were reproduced, but 11 of these required author assistance. For 13 articles at least one value could not be reproduced despite author assistance. Importantly, there were no clear indications that original conclusions were seriously impacted. Mandatory open data policies can increase the frequency and quality of data sharing. However, suboptimal data curation, unclear analysis specification and reporting errors can impede analytic reproducibility, undermining the utility of data sharing and the credibility of scientific findings.
Subject headings
- NATURVETENSKAP -- Biologi (hsv//swe)
- NATURAL SCIENCES -- Biological Sciences (hsv//eng)
- SAMHÄLLSVETENSKAP -- Statsvetenskap -- Studier av offentlig förvaltning (hsv//swe)
- SOCIAL SCIENCES -- Political Science -- Public Administration Studies (hsv//eng)
- SAMHÄLLSVETENSKAP -- Medie- och kommunikationsvetenskap (hsv//swe)
- SOCIAL SCIENCES -- Media and Communications (hsv//eng)
- NATURVETENSKAP -- Data- och informationsvetenskap (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences (hsv//eng)
Keyword
- open data
- reproducibility
- open science
- meta-science
- interrupted time series
- journal policy
Publication and Content Type
- ref (subject category)
- art (subject category)
Find in a library
To the university's database
- By the author/editor
-
Hardwicke, Tom E ...
-
Mathur, Maya B.
-
MacDonald, Kyle
-
Nilsonne, Gustav
-
Banks, George C.
-
Kidwell, Mallory ...
-
show more...
-
Mohr, Alicia Hof ...
-
Clayton, Elizabe ...
-
Yoon, Erica J.
-
Tessler, Michael ...
-
Lenne, Richie L.
-
Altman, Sara
-
Long, Bria
-
Frank, Michael C ...
-
show less...
- About the subject
-
- NATURAL SCIENCES
-
NATURAL SCIENCES
-
and Biological Scien ...
-
- SOCIAL SCIENCES
-
SOCIAL SCIENCES
-
and Political Scienc ...
-
and Public Administr ...
-
- SOCIAL SCIENCES
-
SOCIAL SCIENCES
-
and Media and Commun ...
-
- NATURAL SCIENCES
-
NATURAL SCIENCES
-
and Computer and Inf ...
- Articles in the publication
-
Royal Society Op ...
- By the university
-
Stockholm University
-
Karolinska Institutet