Accessibility settings

This paper is in the following e-collection/theme issue:

AI Language Models in Health Care (248) Applications of AI (345) Reviews in AI (37) Digital Health Reviews (1825) Clinical Information and Decision Making (2070) Artificial Intelligence (2349) Development and Evaluation of Research Methods, Instruments and Tools (811) Methods and Instruments in Medical Informatics (213) Computer-Aided Diagnosis (278)

Published on in Vol 12 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/49724, first published .
Task-Specific Transformer-Based Language Models in Health Care: Scoping Review

Task-Specific Transformer-Based Language Models in Health Care: Scoping Review

Task-Specific Transformer-Based Language Models in Health Care: Scoping Review

Authors of this article:

Ha Na Cho1 Author Orcid Image ;   Tae Joon Jun2 Author Orcid Image ;   Young-Hak Kim3 Author Orcid Image ;   Heejun Kang4 Author Orcid Image ;   Imjin Ahn1 Author Orcid Image ;   Hansle Gwon1 Author Orcid Image ;   Yunha Kim5 Author Orcid Image ;   Jiahn Seo5 Author Orcid Image ;   Heejung Choi5 Author Orcid Image ;   Minkyoung Kim5 Author Orcid Image ;   Jiye Han5 Author Orcid Image ;   Gaeun Kee1 Author Orcid Image ;   Seohyun Park1 Author Orcid Image ;   Soyoung Ko1 Author Orcid Image
Article Authors Cited by (40) Tweetations Metrics

Journals

  1. Adugna A, Abebaw D, Abebaw A, Jemal M. Deep learning architectures for influenza dynamics and treatment optimization: a comprehensive review. Frontiers in Artificial Intelligence 2025;8 View
  2. Yang Z, Yuan S, Shao Z, Li W, Liu R. A review on synergizing knowledge graphs and large language models. Computing 2025;107(6) View
  3. Pantelis A, Epiphaniou P, Lapatsanis D. Machine learning and artificial intelligence for predicting short and long-term complications following metabolic bariatric surgery - a systematic review. Artificial Intelligence Surgery 2025;5(3):322 View
  4. Huang Y, Yang G, Shen Y, Chen H, Wu W, Li X, Wu Y, Zhang K, Xu J, Zhang J. Application of Large Language Models in Complex Clinical Cases: Cross-Sectional Evaluation Study. JMIR Medical Informatics 2025;13:e73941 View
  5. Abubakar Ibrahim A, Khan F. Detecting Shifts in Public Discourse from Offline to Online Using Deep Learning. Electronics 2025;14(20):3987 View
  6. Chen K, Ao M, Moon S, Burns G, Zhu Q. Machine learning-based identification of natural history studies in rare diseases: a step toward understanding disease development and outcome. Journal of Rare Diseases 2025;4(1) View
  7. Teke J, Msiska M, Adanini O, Egbon E, Osborne A, Olawade D. Artificial intelligence for obesity management: A review of applications, opportunities, and challenges. Obesity Medicine 2025;58:100657 View
  8. Bin Tarique M, Ali U, Bang D. Advances in Healthcare IoT Devices for AI Driven Clinical Decision Supporting System for Emergency Medicine. JOURNAL OF SENSOR SCIENCE AND TECHNOLOGY 2025;34(5):498 View
  9. Delgado A, Balthazaar S, Soltesz A, Nightingale T, Panza G. Using Machine Learning With Wearable Devices to Advance Research and Patient Care Using Spinal Cord Injury as a Model. Archives of Physical Medicine and Rehabilitation 2025 View
  10. Sagheer S, K H M, Ameer P, Parayangat M, Abbas M. Transformers for Multi-Modal Image Analysis in Healthcare. Computers, Materials & Continua 2025;84(3):4259 View
  11. Hsieh C, Ye Q, Liu F, Wang X, Lee C, Lin C. Multi-label mental health classification in social media posts with multi-perspective prompt ensemble and auxiliary self-supervision. Scientific Reports 2025;16(1) View
  12. Pandian V, Rahimibashar F, Arabfard M, Alhalaiqa F, Vahedian-Azimi A. The role of AI-driven communication in delirium prevention, detection, and care for critically ill ICU patients: A systematic review with inductive thematic synthesis. Intensive and Critical Care Nursing 2026;93:104323 View
  13. Priyadharshini M, Murugesh V, Rybin O. Enhancing Alzheimer’s disease classification with a transformer-based model using self-supervised learning. Scientific Reports 2026;16(1) View
  14. Nguyen D, Lee S, La K, Kellogg M, Synghal R, Anwar B, Wang C, Shao T, Justus F, Chan L, Ethnasios R, Lara O, Nguyen K. Performance of an Intelligent Messaging Tool for Clinical Communications. JAMA Network Open 2026;9(1):e2553174 View
  15. Waseem H, Islam S, Matragkas N, Epiphaniou G, Arvanitis T, Maple C. Review of generative AI for synthetic data generation: a healthcare perspective. Artificial Intelligence Review 2025;59(2) View
  16. He Y, Zhang F, Wu X, Fang M, Zheng S, Zhu H. Understanding psychiatrist readiness for AI: a study of access, self-efficacy, trust, and design expectations. BMC Health Services Research 2026;26(1) View
  17. More V, Lu L, Ding Z, Xi Z, Mizia S, Guo N. TheraMind: a multi-LLM ensemble for accelerating drug repurposing in lung cancer via case report mining. npj Precision Oncology 2026;10(1) View
  18. Jiang Z, Chen H, Wu Y, Qin Y, Pei C, Zeng D, Sheng B, Wong T. Beyond multiple-choice questions: Rethinking evaluation frameworks for large language models for clinical medicine. Intelligent Medicine 2026 View
  19. Grangel R, Ibáñez Gual M, Simó Vidal A, Amengual Argudo J, Belmonte Fernández Ó. Inteligencia Artificial aplicada a los cuidados (I): origen y conceptos generales. Enfermería Clínica 2026:502486 View
  20. Kulshrestha S, Kumar N, Verma P, Sikri K, Gangwar M, Sengupta A, Aggarwal S, Narad P, Juengel J. A concept-enhanced, knowledge graph-guided framework for interpretable PCOS prediction: a case study in explainable biomedical artificial intelligence. Reproduction, Fertility and Development 2026;38(5) View
  21. Ercan Ş, Tanyıldızı E. Transformer Mimarisi Üzerine Kapsamlı Bir İnceleme: Teorik Temeller, Yapısal Özellikler ve Klinik Bir Uygulama. Fırat Üniversitesi Mühendislik Bilimleri Dergisi 2026;38(1):85 View
  22. Tsukiji Y, Kataoka S, Itokazu M, Nagai R, Imai T. Evaluating Encoder and Decoder Models for Extended Clinical Concept Recognition in Japanese Clinical Texts: A Comparative Study with Weighted Soft Matching (Preprint). Journal of Medical Internet Research 2025 View

Books/Policy Documents

  1. Syed M, Chauhan V, Mathur B, Goyal S, Narad P, Sengupta A. Artificial Intelligence and Blockchain in Precision Medicine and Virology. View
  2. Semenov-Flores D, Torres-Hurtado J, Gomez-Adorno H, Vázquez Noguera J, Mello-Román J. Advances in Soft Computing. MICAI 2025 Posters Track. View
  3. Hammad M, Ahmad S. AI for Medical Image Analysis. View
  4. Moreno-Lara Q, Román-Godínez I, Santos-Arce S, Hernández-Gordillo D, Torres-Ramos S. XLVIII Mexican Conference on Biomedical Engineering. View
  5. Saha S, Singh M, Obhrai S, Astuti Y. Natural Language Processing for Healthcare. View

Conference Proceedings

  1. Vishalatchi K, Thenmoezhi N, K S, S R, Sivagurunathan P, Udhayamoorthi M. 2025 8th International Conference on Trends in Electronics and Informatics (ICOEI). AI-Powered NLP Systems for Differential Diagnosis: Improving COPD Exacerbation Detection View
  2. Mahapatra R, Santhanam H, Priebe C, Xu H, Esmaeilzadeh H. Proceedings of the 52nd Annual International Symposium on Computer Architecture. In-Storage Acceleration of Retrieval Augmented Generation as a Service View
  3. Kalaiarasi P, Reddy M, Kousik K, Neeraj M. 2025 International Conference on Computational Robotics, Testing and Engineering Evaluation (ICCRTEE). SAHAYAK AI: A Next-Gen AI-Powered Intelligent Healthcare Management System for Enhanced Diagnosis and Hospital Efficiency View
  4. Dandu H. 2025 3rd International Conference on Sustainable Computing and Data Communication Systems (ICSCDS). Using Natural Language Processing to Classify Free-text Laboratory Results into Standardized Diagnostic Categories View
  5. Li S, Gong J, Ramirez Molina A. Proceedings of the ACM/IEEE International Conference on Connected Health: Applications, Systems and Engineering Technologies. Approximate Knowledge Graphs: Privacy-Preserving Healthcare Data Synthesis via LLM-Driven approximation View
  6. Oliveira F, Nascimento A, Silva A, Tiago L, Chaves L. Anais do XXIV Simpósio Brasileiro de Qualidade de Software (SBQS 2025). Analysis of Contributions at a Software Institute through the Introduction of a Pre-Trained Model for Requirements Classification View
  7. Zahid A, Sael N. 2025 International Conference on Intelligent Systems: Theories and Applications (SITA). Fake Review Detection on Online Platforms Using Machine Learning: A Comparative Study View
  8. Nagesh S, Sagar R, George S, Rajasekar E, Jothi J. 2025 International Conference on Digital Image Computing: Techniques and Applications (DICTA). Intelligent Prescription Digitization: Leveraging Multi-Engine OCR and Deep Contextual NLP for Reliable Medical Data Structuring View
  9. Aggarwal R, Jain S, Gandhi A, Lakhina U, Mehla S. 2025 2nd International Conference on Computational Intelligence and Computing Applications (ICCICA). Conversational Summarization and Response Generation Using Transformer-based Language Models View
  10. Santhoshkumar S, Reddy P, Geetha A, Jyothi S, Yasmin J, S G. 2026 7th International Conference on Mobile Computing and Sustainable Informatics (ICMCSI). Hybrid Transformer-Driven Healthcare: BERT—T5 Model for Precision Diagnosis and Adaptive Care Recommendations View
  11. Muntaha Punno S, Ahmed T, Siddiquee M, Saha S. 2026 5th International Conference on Electrical, Computer & Telecommunication Engineering (ICECTE). Transformer-Based Models for Student Mental Health Detection: A Comparative Study of BERT, RoBERTa and Gemma View
  12. Joshi V, Nirkhi S, Guda S, Motghare M, Singh Y, Patil S. 2025 International Conference on Artificial Intelligence and Quantum Computation-Based Sensor Application (ICAIQSA). Disambiguation of Clinical Abbreviations in EHRs Using Fine-Tuned Biomedical BERT View
  13. Chavan A, Zaware S. 2025 2nd International Conference on Recent Trends in Electrical, Electronics and Computing Technologies (ICRTEECT). Transformer-Based Adverse Event Detection in Oncology Clinical Trials: A Text Mining Approach View