4 Open Science
We believe in the principles of open science. Have even written about the importance of it for anthropologists looking to make an impact with their science (Jones et al. 2021).
I will be completely frank and say that this is very much a work-in-progress for me. Coming out of anthropology, there was very little tradition – and absolutely no training – in open science. However, open science is very consistent with my personal philosophy (and desire for producing the best scientific work) and I’ve received great help in learning these tools from collaborators and students alike. Among others, I am grateful to Anne Pisor, Elspeth Ready, Mike Price, and Matt Turner for lessons in the practice of open science.
4.1 Principles
4.1.1 Free and Open Software
Whenever possible, use free software. Remember, free software is akin to “free speech,” not “free beer.”
Using open-source software and publishing source code for analyses (lab github). For a model of how to do this, see the code repository for Turner et al. (2023).
Publishing data. However, this is sometimes complicated by the nature of field research on human subjects in communities. There are ethical considerations with which we must be conform.
4.1.2 Reproducibility
When you’re doing experiments or planning analysis of data collected in the field, pre-register your analysis plan. There are several different platforms that you can use for pre-registration. I use the Open Science Framework. Pre-registration is not the panacea it was perhaps initially claimed to be, but it is a solid practice nonetheless. It is particularly important when you are doing confirmatory research, i.e., attempting to test a specific hypothesis.
In all likelihood, open code and open data probably do more to ensure replicability than preregistration.
An essential – and often under-appreciated – element of reproducibility is theory. Muthukrishna and Henrich (2019) argue that the reproducibility crisis in the behavioral sciences – and psychology in particular – arises from poor use of theory. Will Gervais summarized this state of affairs perfectly in a meme:
4.1.3 Open-Access Publication
Scientific publication in open-access outlets. We have a preference for open-access journals, but when this isn’t possible, always publish preprints. Because of the interdisciplinary nature of our group, we use a variety of preprint servers including BioRXiv, PsyArXiv, SocArXiv, and OSF Preprints.
Ensuring that your work is easily found is important both for your professional development and for the goal of making science broadly accessible. You should definitely get a Google Scholar profile as well as an ORCID account.
4.1.4 Community Engagement
Support for marginalized researchers.
One essential way to support marginalized researchers from the Global South and under-resourced institutions more generally is to eschew software that requires expensive licensing. For example, many demographers and other population scientists are trained at NICHD-funded population centers in the US. In many of these centers (particularly the ones with a strong economics infuence) trainees are taught statistics and other aspects of formal demography using expensive proprietary software that is favored by economists. When these population scientists graduate and return to their home countries to work in ministries or even their flagship national universities, it is unlikely that they have an up-to-date license for this software (let alone the most recent operating system or productivity suite!), hampering their ability to do the work they trained for.
If we train our students – all our students – using free, open software, we avoid this problem.
Work with scientists and policy-makers from marginalized communities. Leverage the resource-abundance of an institution like Stanford to diversify the voices you hear and the people whose counsel you keep.
Engagement with collaborating communities. This goes beyond the Belmont Principles to forming real partnerships.
4.1.5 Scientific Communication
Strong SciComm is as essential public good. The landscape is rapidly changing with the ongoing implosion of Twitter, so we will clearly need to adapt. Stay tuned.
4.1.6 Open Educational Material
I also believe very strongly in open educational material.
Some examples include my open course, Life History Theory in Ten Papers, that I ran in the pandemic Spring of 2020.
Another example, which is very much a work-in-progress, is the material from my Adaptation class.
In general, I think that providing brief explainers – both written and video – of key theoretical and methodological tools is an incredibly valuable service. It’s hard to overstate how much I have learned from the generosity of scientists and other methodologists who have done this. I feel like we should all pay this service forward.