Hire me

I’m an independent economist focused on replicating empirical social science research. I check if published findings are reliable by testing for robustness to alternative statistical methods or data sources.

Why replication? Academia is currently too focused on quantity of research at the expense of quality. In my work, I’ve found that even research in top economics journals has unreliable findings. If we want our scientific institutions to discover truths about the world, we need to incentivize researchers to care more about quality. We can do this by making replication a regular part of the scientific process. When researchers expect their work to be scrutinized, they will put more effort into research design. The problem is that replication work is undervalued in academia—that’s where I come in.

Previously I have worked for Open Philanthropy, GiveWell, and on my own projects. Please get in touch [maswiebe[at]gmail.com] if you have research you’d like to see scrutinized (or original research you want me to do). You can support me on Ko-fi here.

Here are some of my past projects:

• Do bigger cities cause more innovation? (summary, thread, html, pdf) Moretti (2021) studies agglomeration effects for innovation, where being in bigger cities causes inventors to patent more. The main results are from regression with fixed effects, while an event study (using inventors who change cities) and instrumental variables strategy (using size of tech clusters in other cities) are used to support a causal interpretation. I show that both the event study and IV results are caused by coding errors.

• Do vaccinated children have higher income as adults? (thread, html, pdf) Atwood (2022) studies the long-run economic effects of the 1963 measles vaccine. Since the vaccine was introduced nationally, the paper uses states with high and low measles incidence as the treatment and control groups. But measles is so contagious that this probably represents differences in reporting capacity rather than actual disease incidence. I run an event study and find that the results are explained by trends, instead of a treatment effect of the vaccine.

• How does racial violence affect patenting by Black inventors? (thread, html, pdf) I reanalyze Cook (2014) and show that the results don’t hold up. The paper claims that racial violence reduces patenting by Black inventors, using time series and panel data regressions. However, the time series results go away when using an alternative patent variable, while the panel data results are based on a dataset where most observations are missing. I use the timing of patent applications and grants to perform a more nuanced test of Cook’s hypothesis, and the predictions are falsified.

• Are Chinese mayors promoted based on GDP growth? (thread, html, pdf) The literature on meritocratic promotion claims that Chinese officials are promoted based on GDP growth. This system of tournament competition generates incentives for politicians to boost growth, and hence gives an explanation for China’s rapic economic growth. I reanalyze three papers on meritocratic promotion of prefecture leaders, and find that the results are not robust to alternative control variables, regression specifications, and outcome variables. This literature gives no reason to think that GDP growth is an important determinant of promotion.