| 1. |
- Schweinsberg, Martin, et al.
(författare)
-
Same data, different conclusions : Radical dispersion in empirical results when independent analysts operationalize and test the same hypothesis
- 2021
-
Ingår i: Organizational Behavior and Human Decision Processes. - : Elsevier BV. - 0749-5978 .- 1095-9920. ; 165, s. 228-249
-
Tidskriftsartikel (refereegranskat)abstract
- In this crowdsourced initiative, independent analysts used the same dataset to test two hypotheses regarding the effects of scientists' gender and professional status on verbosity during group meetings. Not only the analytic approach but also the operationalizations of key variables were left unconstrained and up to individual analysts. For instance, analysts could choose to operationalize status as job title, institutional ranking, citation counts, or some combination. To maximize transparency regarding the process by which analytic choices are made, the analysts used a platform we developed called DataExplained to justify both preferred and rejected analytic paths in real time. Analyses lacking sufficient detail, reproducible code, or with statistical errors were excluded, resulting in 29 analyses in the final sample. Researchers reported radically different analyses and dispersed empirical outcomes, in a number of cases obtaining significant effects in opposite directions for the same research question. A Boba multiverse analysis demonstrates that decisions about how to operationalize variables explain variability in outcomes above and beyond statistical choices (e.g., covariates). Subjective researcher decisions play a critical role in driving the reported empirical results, underscoring the need for open data, systematic robustness checks, and transparency regarding both analytic paths taken and not taken. Implications for orga-nizations and leaders, whose decision making relies in part on scientific findings, consulting reports, and internal analyses by data scientists, are discussed.
|
|
| 2. |
- Kasliwal, Mansi M., et al.
(författare)
-
Kilonova Luminosity Function Constraints Based on Zwicky Transient Facility Searches for 13 Neutron Star Merger Triggers during O3
- 2020
-
Ingår i: Astrophysical Journal. - : American Astronomical Society. - 0004-637X .- 1538-4357. ; 905:2
-
Tidskriftsartikel (refereegranskat)abstract
- We present a systematic search for optical counterparts to 13 gravitational wave (GW) triggers involving at least one neutron star during LIGO/Virgo's third observing run (O3). We searched binary neutron star (BNS) and neutron star black hole (NSBH) merger localizations with the Zwicky Transient Facility (ZTF) and undertook follow-up with the Global Relay of Observatories Watching Transients Happen (GROWTH) collaboration. The GW triggers had a median localization area of 4480 deg(2), a median distance of 267 Mpc, and false-alarm rates ranging from 1.5 to 10(-25) yr(-1). The ZTF coverage in the g and r bands had a median enclosed probability of 39%, median depth of 20.8 mag, and median time lag between merger and the start of observations of 1.5 hr. The O3 follow-up by the GROWTH team comprised 340 UltraViolet/Optical/InfraRed (UVOIR) photometric points, 64 OIR spectra, and three radio images using 17 different telescopes. We find no promising kilonovae (radioactivity-powered counterparts), and we show how to convert the upper limits to constrain the underlying kilonova luminosity function. Initially, we assume that all GW triggers are bona fide astrophysical events regardless of false-alarm rate and that kilonovae accompanying BNS and NSBH mergers are drawn from a common population; later, we relax these assumptions. Assuming that all kilonovae are at least as luminous as the discovery magnitude of GW170817 (-16.1 mag), we calculate that our joint probability of detecting zero kilonovae is only 4.2%. If we assume that all kilonovae are brighter than -16.6 mag (the extrapolated peak magnitude of GW170817) and fade at a rate of 1 mag day(-1) (similar to GW170817), the joint probability of zero detections is 7%. If we separate the NSBH and BNS populations based on the online classifications, the joint probability of zero detections, assuming all kilonovae are brighter than -16.6 mag, is 9.7% for NSBH and 7.9% for BNS mergers. Moreover, no more than <57% (<89%) of putative kilonovae could be brighter than -16.6 mag assuming flat evolution (fading by 1 mag day(-1)) at the 90% confidence level. If we further take into account the online terrestrial probability for each GW trigger, we find that no more than <68% of putative kilonovae could be brighter than -16.6 mag. Comparing to model grids, we find that some kilonovae must have M-ej M, X-lan > 10(-4), or > 30 degrees to be consistent with our limits. We look forward to searches in the fourth GW observing run; even 17 neutron star mergers with only 50% coverage to a depth of -16 mag would constrain the maximum fraction of bright kilonovae to <25%.
|
|
