Announcement of an RCT on the Effects of Author-Anonymized Reviewing
Recent feedback received from some AEA members and from the intersociety Report on Improving the Publication Process in Economics raised concerns about the perceived unfairness of single-blind peer reviewing. In response to these concerns, the AEA will soon be launching a three-year randomized controlled trial of the effects of author-anonymized peer reviewing, commonly referred to as "double-blind."
Blank (1991) previously conducted a randomized evaluation of double-blind vs. single-blind peer reviewing at the American Economic Review (AER). The current evaluation will involve the AER, AER: Insights, and the four American Economic Journals.
In the treatment group, information revealing author identities will be excluded from materials provided to reviewers, and reviewers will be asked to refrain from seeking them out through web searches or other means. The experiment will test the effects of removing author identities from the information routinely provided to reviewers, while recognizing that reviewers may become aware of author identities in other ways.
Key outcomes that will be examined include (1) author and reviewer perceptions of fairness, (2) reviewer awareness of author identities in the treatment (author-anonymized) group, and (3) differential impacts of author-anonymized review on manuscript decisions by characteristics of the authors and their papers.
The experimental design, implementation, and analysis are being conducted by Amy Finkelstein (MIT) and staff from J-PAL North America, in consultation with the AEA. J-PAL North America is a research center specializing in RCTs, where Finkelstein serves as co-scientific director. Finkelstein will not have access to identified information on individual manuscript submissions.
We expect the experiment to be launched in fall 2026. The AEA will disseminate the results of the experiment. Results will not identify individual authors or institutions.