Beyond Publication Bias: Characterizing and Understanding Missing Results in EconomicsIn Preparation
Hoces de la Guardia, F., Miguel, E., Shaji, A., Silva da Rocha, V., Pathan, G., Sørensen, E.Ø., & Tungodden, B.
Abstract
What scientists choose not to publish can be as important as what they do publish. This paper measures missing research results at the level of individual pre-registered hypotheses and uses this approach to study under-reporting in economics. We develop a standardized procedure for encoding hypotheses from registry entries and pre-analysis plans and apply it to 317 studies registered in the American Economic Association RCT Registry between 2015 and 2017, yielding 5,057 pre-registered hypotheses. Eight to nine years after registration, we search published papers, working papers, reports and other public materials to document whether a result is available for each hypothesis and, if so, whether it is statistically significant. We benchmark these patterns against expert forecasts. We then run a pre-registered randomized controlled trial with study authors to test which barriers keep results from becoming public: awareness of the value of reporting, the effort of documenting results (addressed through direct engagement with a pre-filled report of their hypotheses and our findings), or a lack of research resources. Finally, we introduce the Results Report, a simple, standardized format for reporting results of pre-registered hypotheses that registries and journals could adopt.
First-Born Daughters Increase Mothers’ Desired Number of DaughtersIn Preparation
Shaji, A., Anttila-Hughes, J. K., Borden, L., Lamson, L., & Jina, A. S.
Abstract
Do parents’ stated fertility preferences respond to the children they actually have? Ideal family size and desired sex composition are widely used to measure unwanted fertility and son preference, on the assumption that they are formed before births occur. We test that assumption using the sex of a first birth as a natural experiment. Drawing on survey data from more than 90,000 first-time mothers and 30,000 first-time fathers across many countries, we estimate how a first-born daughter shifts parents’ desired number of daughters, sons, and children, and compare how mothers and fathers update.