European Science Editing 51: e159921, doi: 10.3897/ese.2025.e159921

Attitudes and perceptions towards the use of artificial intelligence chatbots in medical journal peer review: A protocol for a large-scale, international cross-sectional survey

Jeremy Y. Ng^‡§|¶, Daivat Bhavsar^‡|, Neha Dhanvanthry^‡|, Lex Bouter^#¤, Teresa Chan^«, Annette Flanagin^», Alfonso Iorio^¶, Cynthia Lokker^¶, Hervé Maisonneuve^˄˅, Ana Marušić^¦, David Moher^ˀˁ₵, Holger Cramer^‡|

‡ University Hospital Tübingen, Tübingen, Germany§ University of Technology Sydney, Sydney, Australia| Bosch Health Campus, Stuttgart, Germany¶ McMaster University, Hamilton, Canada# Amsterdam Universities Medical Center, Amsterdam, Netherlands¤ Vrije Universiteit Amsterdam, Amsterdam, Netherlands« Toronto Metropolitan University, Toronto, Canada» 8JAMA and the JAMA Network, Chicago, United States of America˄ Institute of Research and Action on Fraud and Plagiarism in Academia, Geneva, Switzerland˅ Unaffiliated, Lyon, France¦ University of Split School of Medicine, Split, Croatiaˀ University of Toronto, Toronto, Canadaˁ Ottawa Hospital Research Institute, Ottawa, Canada₵ University of Ottawa, Ottawa, Canada

Corresponding author: Jeremy Y. Ng ( ngjy2@mcmaster.ca )

Academic editor: Joan Marsh

This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Citation: Ng JY, Bhavsar D, Dhanvanthry N, Bouter L, Chan T, Flanagin A, Iorio A, Lokker C, Maisonneuve H, Marušić A, Moher D, Cramer H (2025) Attitudes and perceptions towards the use of artificial intelligence chatbots in medical journal peer review: A protocol for a large-scale, international cross-sectional survey. European Science Editing 51: e159921. https://doi.org/10.3897/ese.2025.e159921

Abstract

Background: Artificial intelligence (AI) chatbots are advanced conversational programmes capable of performing tasks such as identifying methodological flaws, verifying references, and improving language clarity in manuscripts. Their use in peer review has the potential to enhance efficiency, reduce reviewer workload, and address inconsistencies in review quality. However, concerns remain regarding their reliability, ethical implications, and transparency in decision-making, and little is known about how peer reviewers perceive these tools.

Objectives: To assess peer reviewers’ attitudes and perceptions towards the use of AI chatbots in the peer review process, including their familiarity with AI, perceived benefits and challenges, ethical considerations, and expectations for future roles.

Methods: An international cross-sectional survey will be conducted among academic peer reviewers. The survey will collect data on participants’ prior experience with AI, perceptions of the utility of chatbots in supporting peer review, concerns related to ethics and transparency, and anticipated future applications.

Results: This study will report descriptive and comparative analyses of reviewers’ responses, highlighting patterns in attitudes and perceptions by demographic and professional characteristics.

Conclusions: The findings may offer evidence to inform the development of future policies and best practices for the ethical and effective integration of AI chatbots in peer review, with the goal of improving review quality while addressing potential risks.

Keywords

artificial intelligence, attitudes, chatbots, generative artificial intelligence, peer review, reviewers, survey