This paper is in the following e-collection/theme issue:

Artificial Intelligence (AI) in Medical Education (109) Chatbots and Conversational Agents (589) Theme Issue: ChatGPT and Generative Language Models in Medical Education (92) Artificial Intelligence (1602)

Published on in Vol 9 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/47049, first published .
The Potential and Concerns of Using AI in Scientific Research: ChatGPT Performance Evaluation

The Potential and Concerns of Using AI in Scientific Research: ChatGPT Performance Evaluation

The Potential and Concerns of Using AI in Scientific Research: ChatGPT Performance Evaluation

Authors of this article:

Zuheir N Khlaif1 Author Orcid Image ;   Allam Mousa2 Author Orcid Image ;   Muayad Kamal Hattab3 Author Orcid Image ;   Jamil Itmazi4 Author Orcid Image ;   Amjad A Hassan3 Author Orcid Image ;   Mageswaran Sanmugam5 Author Orcid Image ;   Abedalkarim Ayyoub1 Author Orcid Image
Article Authors Cited by (58) Tweetations (2) Metrics

Journals

  1. Khalifa A, Ibrahim M. Artificial intelligence (AI) and ChatGPT involvement in scientific and medical writing, a new concern for researchers. A scoping review. Arab Gulf Journal of Scientific Research 2024;42(4):1770 View
  2. Ozgor F, Caglar U, Halis A, Cakir H, Aksu U, Ayranci A, Sarilar O. Urological Cancers and ChatGPT: Assessing the Quality of Information and Possible Risks for Patients. Clinical Genitourinary Cancer 2024;22(2):454 View
  3. Sallam M, Barakat M, Sallam M. A Preliminary Checklist (METRICS) to Standardize the Design and Reporting of Studies on Generative Artificial Intelligence–Based Models in Health Care Education and Practice: Development Study Involving a Literature Review. Interactive Journal of Medical Research 2024;13:e54704 View
  4. Ranade N, Eyman D. Introduction: Composing with generative AI. Computers and Composition 2024;71:102834 View
  5. Weidener L, Fischer M. Proposing a Principle-Based Approach for Teaching AI Ethics in Medical Education. JMIR Medical Education 2024;10:e55368 View
  6. Goyanes M, Lopezosa C. ChatGPT en Ciencias Sociales: revisión de la literatura sobre el uso de inteligencia artificial (IA) de OpenAI en investigación cualitativa y cuantitativa. Anuario ThinkEPI 2024;18 View
  7. Khalifa M, Albadawy M. Using artificial intelligence in academic writing and research: An essential productivity tool. Computer Methods and Programs in Biomedicine Update 2024;5:100145 View
  8. Huang Y, Wu R, He J, Xiang Y. Evaluating ChatGPT-4.0’s data analytic proficiency in epidemiological studies: A comparative analysis with SAS, SPSS, and R. Journal of Global Health 2024;14 View
  9. Liu J. ChatGPT: perspectives from human–computer interaction and psychology. Frontiers in Artificial Intelligence 2024;7 View
  10. Zhai C, Wibowo S, Li L. The effects of over-reliance on AI dialogue systems on students' cognitive abilities: a systematic review. Smart Learning Environments 2024;11(1) View
  11. Gimeno-Ballester V, Trigo-Vicente C. El rol de la inteligencia artificial en la publicación científica: perspectivas desde la farmacia hospitalaria. Farmacia Hospitalaria 2024;48(5):246 View
  12. Gammoh L. ChatGPT in academia: exploring university students’ risks, misuses, and challenges in Jordan. Journal of Further and Higher Education 2024;48(6):608 View
  13. Hamamra B, Mayaleh A, Khlaif Z. Between tech and text: the use of generative AI in Palestinian universities - a ChatGPT case study. Cogent Education 2024;11(1) View
  14. Liu M, Okuhara T, Chang X, Shirabe R, Nishiie Y, Okada H, Kiuchi T. Performance of ChatGPT Across Different Versions in Medical Licensing Examinations Worldwide: Systematic Review and Meta-Analysis. Journal of Medical Internet Research 2024;26:e60807 View
  15. Aljamaan F, Temsah M, Altamimi I, Al-Eyadhy A, Jamal A, Alhasan K, Mesallam T, Farahat M, Malki K. Reference Hallucination Score for Medical Artificial Intelligence Chatbots: Development and Usability Study. JMIR Medical Informatics 2024;12:e54345 View
  16. Kim S. Research ethics and issues regarding the use of ChatGPT-like artificial intelligence platforms by authors and reviewers: a narrative review. Science Editing 2024;11(2):96 View
  17. Gimeno-Ballester V, Trigo-Vicente C. [Translated article] The role of artificial intelligence in scientific publishing: perspectives from hospital pharmacy. Farmacia Hospitalaria 2024;48(5):T246 View
  18. DeFoor M, Sheean A. Editorial Commentary: Experts in Shoulder Surgery Do Not Consistently Detect Artificial Intelligence–Generated Scientific Abstracts. Arthroscopy: The Journal of Arthroscopic & Related Surgery 2024 View
  19. Gravel J, Dion C, Fadaei Kermani M, Mousseau S, Osmanlliu E. Will ChatGPT-4 improve the quality of medical abstracts?. Paediatrics & Child Health 2024 View
  20. Omar A, Shaqour A, Khlaif Z. Attitudes of faculty members in Palestinian universities toward employing artificial intelligence applications in higher education: opportunities and challenges. Frontiers in Education 2024;9 View
  21. Su Z, Tang G, Huang R, Qiao Y, Zhang Z, Dai X. Based on Medicine, The Now and Future of Large Language Models. Cellular and Molecular Bioengineering 2024;17(4):263 View
  22. Tam T, Sivarajkumar S, Kapoor S, Stolyar A, Polanska K, McCarthy K, Osterhoudt H, Wu X, Visweswaran S, Fu S, Mathur P, Cacciamani G, Sun C, Peng Y, Wang Y. A framework for human evaluation of large language models in healthcare derived from literature review. npj Digital Medicine 2024;7(1) View
  23. Son A, Park J, Kim W, Yoon Y, Lee S, Park Y, Kim H. Revolutionizing Molecular Design for Innovative Therapeutic Applications through Artificial Intelligence. Molecules 2024;29(19):4626 View
  24. Chou W, Chow J. Enhancing English abstract quality for non-English speaking authors using ChatGPT: A comparative study of Taiwan, Japan, China, and South Korea with slope graphs. Medicine 2024;103(40):e39796 View
  25. Khlaif Z, Ayyoub A, Hamamra B, Bensalem E, Mitwally M, Ayyoub A, Hattab M, Shadid F. University Teachers’ Views on the Adoption and Integration of Generative AI Tools for Student Assessment in Higher Education. Education Sciences 2024;14(10):1090 View
  26. Hair J, Sabol M. Leveraging Artificial Intelligence (AI) in Competitive Intelligence (CI) Research. Revista Inteligência Competitiva 2024;15:e0469 View
  27. Liu M, Okuhara T, Dai Z, Huang W, Gu L, Okada H, Furukawa E, Kiuchi T. Evaluating the Effectiveness of advanced large language models in medical Knowledge: A Comparative study using Japanese national medical examination. International Journal of Medical Informatics 2025;193:105673 View
  28. Kim E. Analyzing AI use policy in LIS: association with journal metrics and publisher volume. Scientometrics 2024;129(12):7623 View
  29. Terblanche N. Smooth Talking: Generative Versus Scripted Coaching Chatbot Adoption and Efficacy Comparison. International Journal of Human–Computer Interaction 2024:1 View
  30. Almogren A, Al-Rahmi W, Dahri N. Integrated Technological Approaches to Academic Success: Mobile Learning, Social Media, and AI in Visual Art Education. IEEE Access 2024;12:175391 View
  31. Awadallah Alkouk W, Khlaif Z. AI-resistant assessments in higher education: practical insights from faculty training workshops. Frontiers in Education 2024;9 View
  32. Kale N, Kulkarni P, Kulkarni S. Artificial Intelligence Driven Accounting: Benefits, Risks, And The Road Ahead. ITM Web of Conferences 2024;68:01015 View
  33. Salman H, Ahmad M, Ibrahim R, Mahmood J. Systematic analysis of generative AI tools integration in academic research and peer review. Online Journal of Communication and Media Technologies 2025;15(1):e202502 View
  34. Motevalli M, Xie Z. Comparative Analysis of Systematic, Scoping, Umbrella, and Narrative Reviews in Clinical Research: Critical Considerations and Future Directions. International Journal of Clinical Practice 2025;2025(1) View
  35. Vaishya R, Vaish A, Scarlat M, Jain V. The crucial role and challenges of medical journal editors in the modern era. Journal of Clinical Orthopaedics and Trauma 2025;63:102918 View
  36. Rusinovich Y, Hasni N. Artificial Intelligence in Academic Writing: Time for Science 3.0. Web3 Journal: ML in Health Science 2025;1(1):d090125 View
  37. Raitskaya L, Tikhonova E. Appliances of Generative AI-Powered Language Tools in Academic Writing: A Scoping Review. Journal of Language and Education 2024;10(4):5 View
  38. Thaichana P, Oo M, Thorup G, Chansakaow C, Arworn S, Rerkasem K. Integrating Artificial Intelligence in Medical Writing: Balancing Technological Innovation and Human Expertise, with Practical Applications in Lower Extremity Wounds Care. The International Journal of Lower Extremity Wounds 2025 View
  39. Honkanen P, Nylund M. Media, media education, GAI and radical uncertainty. Media Education 2024;15(2):7 View
  40. Ruta M, Gaidici T, Irwin C, Lifshitz J. ChatGPT for Univariate Statistics: Validation of AI-Assisted Data Analysis in Healthcare Research. Journal of Medical Internet Research 2025;27:e63550 View
  41. Ahn S. Large language model usage guidelines in Korean medical journals: a survey using human-artificial intelligence collaboration. Journal of Yeungnam Medical Science 2024;42:14 View
  42. Gamboa-Rosales N, López-Robles J. Mapping the evolution of GPT-4o innovations: An analytical exploration of progress, applications, and horizons. Revista Científica de Sistemas e Informática 2025;5(1):e881 View
  43. da Veiga A. Ethical guidelines for the use of generative artificial intelligence and artificial intelligence-assisted tools in scholarly publishing: a thematic analysis. Science Editing 2025;12(1):28 View
  44. Chai D, Kim H, Kim K, Ha Y, Shin S, Yoon S. Generative Artificial Intelligence in Instructional System Design. Human Resource Development Review 2025 View
  45. Tuppal C, Ninobla M, Loresco R, Cabradilla M, Tuppal S, Pellacoeur L, Roa M, Chan J, Panes I, Ferreras A. Filipino Nurse Researchers' Knowledge, perception, and attitudes toward ChatGPT and Their Research Productivity. IJERI: International Journal of Educational Research and Innovation 2025;(23) View
  46. Rosca C, Stancu A, Iovanovici E. The New Paradigm of Deepfake Detection at the Text Level. Applied Sciences 2025;15(5):2560 View
  47. Ganguly A, Johri A, Ali A, McDonald N. Generative artificial intelligence for academic research: evidence from guidance issued for researchers by higher education institutions in the United States. AI and Ethics 2025 View
  48. Usher M, Amzalag M. From Prompt to Polished: Exploring Student–Chatbot Interactions for Academic Writing Assistance. Education Sciences 2025;15(3):329 View

Books/Policy Documents

  1. Garcia M, Arif Y, Khlaif Z, Zhu M, de Almeida R, de Almeida R, Masters K. Transformative Approaches to Patient Literacy and Healthcare Innovation. View
  2. Bhardwaj S, Sharma M, Dixit J, Agrawal V, Agarwal S, Saxena A. Utilizing AI Tools in Academic Research Writing. View
  3. Patel P, Shooshtarian S. Intelligent Computing. View
  4. Bryda G, Sadowski D. Computer Supported Qualitative Research. View
  5. Naiye O, Goosen L. Fostering Inclusive Education With AI and Emerging Technologies. View
  6. Hamad Z, Laouar M, Diallo Yaccoub M. Artificial Intelligence and Its Practical Applications in the Digital Economy. View