This paper is in the following e-collection/theme issue:

Natural Language Processing (783) Generative Language Models Including ChatGPT (459) Chatbots and Conversational Agents (614) Artificial Intelligence (1660) Artificial Intelligence (AI) in Medical Education (118) Human Factors and Usability Case Studies (876)

Published on in Vol 12 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/54345, first published .
Reference Hallucination Score for Medical Artificial Intelligence Chatbots: Development and Usability Study

Reference Hallucination Score for Medical Artificial Intelligence Chatbots: Development and Usability Study

Reference Hallucination Score for Medical Artificial Intelligence Chatbots: Development and Usability Study

Authors of this article:

Fadi Aljamaan1 Author Orcid Image ;   Mohamad-Hani Temsah1 Author Orcid Image ;   Ibraheem Altamimi1 Author Orcid Image ;   Ayman Al-Eyadhy1 Author Orcid Image ;   Amr Jamal1 Author Orcid Image ;   Khalid Alhasan1 Author Orcid Image ;   Tamer A Mesallam2 Author Orcid Image ;   Mohamed Farahat2 Author Orcid Image ;   Khalid H Malki2 Author Orcid Image
Article Authors Cited by (20) Tweetations (26) Metrics

Journals

  1. Temsah M, Jamal A, Alhasan K, Temsah A, Malki K. OpenAI o1-Preview vs. ChatGPT in Healthcare: A New Frontier in Medical AI Reasoning. Cureus 2024 View
  2. Giray L. Benefits and Challenges of Using AI for Peer Review: A Study on Researchers’ Perceptions. The Serials Librarian 2024;85(5-6):144 View
  3. Zhang P, Shi J, Kamel Boulos M. Generative AI in Medicine and Healthcare: Moving Beyond the ‘Peak of Inflated Expectations’. Future Internet 2024;16(12):462 View
  4. Barrot J. Balancing Innovation and Integrity: An Emerging Technology Report on SciSpace in Academic Writing. Technology, Knowledge and Learning 2025;30(1):587 View
  5. Thandla S, Armstrong G, Menon A, Shah A, Gueye D, Harb C, Hernandez E, Iyer Y, Hotchner A, Modi R, Mudigonda A, Prokos M, Rao T, Thomas O, Beltran C, Guerrieri T, LeBlanc S, Moorthy S, Yacoub S, Gardner J, Greenberg B, Hubal A, Lapina Y, Moran J, O’Brien J, Winnicki A, Yoka C, Zhang J, Zimmerman P. Comparing new tools of artificial intelligence to the authentic intelligence of our global health students. BioData Mining 2024;17(1) View
  6. Ullah M, Bin Naeem S, Kamel Boulos M. Assessing the Guidelines on the Use of Generative Artificial Intelligence Tools in Universities: A Survey of the World’s Top 50 Universities. Big Data and Cognitive Computing 2024;8(12):194 View
  7. Pergantis P, Bamicha V, Skianis C, Drigas A. AI Chatbots and Cognitive Control: Enhancing Executive Functions Through Chatbot Interactions: A Systematic Review. Brain Sciences 2025;15(1):47 View
  8. Temsah M, Nazer R, Altamimi I, Aldekhyyel R, Jamal A, Almansour M, Aljamaan F, Alhasan K, Temsah A, Al-Eyadhy A, Aljafen B, Malki K. OpenAI's Sora and Google's Veo 2 in Action: A Narrative Review of Artificial Intelligence-driven Video Generation Models Transforming Healthcare. Cureus 2025 View
  9. Temsah A, Alhasan K, Altamimi I, Jamal A, Al-Eyadhy A, Malki K, Temsah M. DeepSeek in Healthcare: Revealing Opportunities and Steering Challenges of a New Open-Source Artificial Intelligence Frontier. Cureus 2025 View
  10. Abouammoh N, Alhasan K, Aljamaan F, Raina R, Malki K, Altamimi I, Muaygil R, Wahabi H, Jamal A, Alhaboob A, Assiri R, Al-Tawfiq J, Al-Eyadhy A, Soliman M, Temsah M. Perceptions and Earliest Experiences of Medical Students and Faculty With ChatGPT in Medical Education: Qualitative Study. JMIR Medical Education 2025;11:e63400 View
  11. Choo S, Yoo S, Endo K, Truong B, Son M. Advancing Clinical Chatbot Validation Using AI-Powered Evaluation With a New 3-Bot Evaluation System: Instrument Validation Study. JMIR Nursing 2025;8:e63058 View
  12. Salyers A, Bull S, Silvasstar J, Howell K, Wright T, Banaei-Kashani F. Building and beta-testing a secure, credible and trustworthy artificially intelligent chatbot that will not misinform, hallucinate or stigmatize substance use disorder: the Be Well Buddy chatbot (Preprint). JMIR Human Factors 2024 View
  13. Sweed T, Mabrouk A, Dawson M. Transforming orthopaedics with AI: Insights from a custom ChatGPT on ESSKA osteotomy consensus. Knee Surgery, Sports Traumatology, Arthroscopy 2025 View
  14. Khawaja Z, Adhoni M, Byrnes K. Generative artificial intelligence powered chatbots in urology. Current Opinion in Urology 2025;35(3):243 View
  15. Zhou J, Zhang J, Wan R, Cui X, Liu Q, Guo H, Shi X, Fu B, Meng J, Yue B, Zhang Y, Zhang Z. Integrating AI into clinical education: evaluating general practice trainees’ proficiency in distinguishing AI-generated hallucinations and impacting factors. BMC Medical Education 2025;25(1) View
  16. Whitfield S, Yang S. Evaluating AI Language Models for Reference Services: A Comparative Study of ChatGPT, Gemini, and Copilot. Internet Reference Services Quarterly 2025:1 View
  17. Branda F, Stella M, Ceccarelli C, Cabitza F, Ceccarelli G, Maruotti A, Ciccozzi M, Scarpa F. The Role of AI-Based Chatbots in Public Health Emergencies: A Narrative Review. Future Internet 2025;17(4):145 View
  18. Triola M, Rodman A. Integrating Generative Artificial Intelligence Into Medical Education: Curriculum, Policy, and Governance Strategies. Academic Medicine 2025;100(4):413 View
  19. Temsah M, Al-Eyadhy A, Jamal A, Alhasan K, Malki K. Authors’ Reply: Citation Accuracy Challenges Posed by Large Language Models. JMIR Medical Education 2025;11:e73698 View
  20. Alhuzaimi A, Aljamaan F, AL-Ajwad F, Alabdulkareem W, Alshahrani F, Altamimi I, Al-Eyadhy L, Bukhari A, BinOmair A, Al-Subaie S, Shayah Y, Alhaboob A, Alanteet A, Alanteet A, Alharbi M, Jamal A, Barry M, Assiri R, Alhasan K, Al-Tawfiq J, Temsah M. Public knowledge of food poisoning, risk perception and food safety practices in Saudi Arabia: A cross-sectional survey following foodborne botulism outbreak. Medicine 2025;104(15):e41593 View