This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on https://medinform.jmir.org/, as well as this copyright and license information must be included.
Background
With the proliferation of electronic medical record (EMR) systems, there is an increasing interest in utilizing EMR data for medical research; yet, there is no quantitative research on EMR data utilization for medical research purposes in China.
Objective
This study aimed to understand how and to what extent EMR data are utilized for medical research purposes in a Healthcare Information and Management Systems Society (HIMSS) Analytics Electronic Medical Record Adoption Model (EMRAM) Stage 7 hospital in Beijing, China. Obstacles and issues in the utilization of EMR data were also explored to provide a foundation for the improved utilization of such data.
Methods
For this descriptive cross-sectional study, cluster sampling from Xuanwu Hospital, one of two Stage 7 hospitals in Beijing, was conducted from 2016 to 2019. The utilization of EMR data was described as the number of requests, the proportion of requesters, and the frequency of requests per capita. Comparisons by year, professional title, and age were conducted by double-sided chi-square tests.
Results
From 2016 to 2019, EMR data utilization was poor, as the proportion of requesters was 5.8% and the frequency was 0.1 times per person per year. The frequency per capita gradually slowed and older senior-level staff more frequently used EMR data compared with younger staff.
Conclusions
The value of using EMR data for research purposes is not well studied in China. More research is needed to quantify to what extent EMR data are utilized across all hospitals in Beijing and how these systems can enhance future studies. The results of this study also suggest that young doctors may be less exposed or have less reason to access such research methods.
electronic medical recordsdata utilizationmedical researchChinaIntroduction
Electronic medical records (EMRs), or digitized versions of patient medical charts, are often considered a key component of a hospital or health care system’s health information system [1]. EMR systems have transformed data and record keeping in the medical field, and they enable providers to more systematically track patient information over time, promote a more holistic approach to patient care, support the streamlining of preventative screening, support the monitoring of patients, and improve overall quality [2,3]. For these reasons, there has been rapid growth in the implementation of EMR systems in health care settings throughout the world in recent decades [4-9]. Subsequently, the amount and availability of clinical data automatically collected by EMRs are increasing at an exponential rate [10,11], and EMRs have been recognized as a valuable resource for observational data and for large-scale analyses [12,13]. As such, EMR data are often used for research purposes in many universities and organizations around the world [14,15]. Using EMR data for medical research [16,17] has several benefits, such as being low cost, having a large volume of data, and saving time because there is no need to recruit and retain participants [18-21]. Thus, it is believed that using EMRs to obtain clinical information has the potential to revolutionize medical research in the coming years [22,23].
In China, the EMR system has become the core system for the collection and management of hospital information, as the National Electronic Medical Record System has been promoted across the country since 2011 [24-26]. Furthermore, with many hospitals implementing the Healthcare Information and Management Systems Society (HIMSS) Analytics Electronic Medical Record Adoption Model (EMRAM) standards, numerous Chinese hospitals have become international standard and accredited hospitals [27]. One result of this shift has been that increasing numbers of western institutions are collaborating with China on medical research using EMR data [28].
As research using EMR data has become increasingly prevalent, researchers have been pondering how to better explore the technical value of EMR data. In addition, there exists a growing body of literature on the feasibility and efficacy of using electronic health records for research purposes. Electronic health records (EHRs) are inclusive of a broader view of patient care, including diagnoses, medications, immunizations, family medical history, and provider contact information. EMR data, however, are digital versions of patient charts. They contain notes and information collected by and for clinicians in that particular care setting and are mostly used by providers for diagnosis and treatment [3]. In China and abroad, studies on the topic of using EMR or EHR data for research have primarily focused on the challenges of using such systems. Researchers over a decade ago raised concerns regarding the quality and comprehensiveness of clinical data being collected in EMR systems and mentioned that there were systematic biases inherent to data collected primarily for clinical care [29]. Other studies have identified other barriers, including legal, technical, ethical, social, and resource-related issues, such as privacy protection, data security, data custodians, and the motives for collecting data, as well as a lack of incentives to share data [15,30]. An additional systematic review identified four domains of potential limitations, including data quality issues (91.7%), data preprocessing challenges (53.3%), privacy concerns (18.3%), and potential for limited generalizability (21.7%) [31]. Some studies have consequently developed a list of caveats and recommendations for overcoming such limitations [30,32-35].
Additionally, the majority of existing research focuses on the quality of EMR/EHR data and its related challenges [36-39]. These challenges can be divided into five primary areas as follows: completeness, consistency, validity, reliability, and accuracy [40-42]. Some analyses have aimed to develop assessment frameworks to ensure data quality across studies [43], but there are few studies that quantitatively explore how and to what extent EMR or EHR data are being collected and used in China. Thus, it is necessary to build EMR data quality metrics and standardize routine documentation to enable its secondary use for medical research [44-46].
The paralleled use of EMR data for medical research has been noted. In one such study, the characteristics of EMR data in China were compared against data collected in hospitals in the United States in order to understand system and cultural differences that may exist between Chinese and English clinical documents [47]. A study by van Velthoven et al [48], for example, shed light on the feasibility of extracting EMR data across a number of countries. These studies are useful for understanding how data collection systems in China and the use of EMR data for medical research may adapt to more international standards, further supporting collaboration between Chinese and foreign research institutions.
Currently, in Chinese hospitals, the data available to researchers are limited in scope to just EMRs, rather than full EHRs. In order to further promote utilizing EMR data for research, a quantitative investigation of the current status of data utilization is warranted, since understanding the status quo is a prerequisite for determining barriers and improving the existing system. It is necessary to explore the obstacles that hinder EMR data utilization for medical research from the perspective of data consumers, but there is currently no quantitative research or surveys published on the recent status of EMR data utilization for medical research in any institution or region in China. Thus, this study aimed to understand the landscape, including barriers and obstacles, of utilizing EMR data for medical research in Chinese medical institutions. This study will provide data managers and medical research managers with a broader understanding of what types of data are being used; what extent they are being utilized; and who is accessing such data, laying the groundwork for further promotion of this research method.
MethodsStudy Design
A serial, cross-sectional, descriptive study was carried out at Xuanwu Hospital, Capital Medical University (XWHCMU) in Beijing, China. XWHCMU is a large 1600-bed tertiary general hospital with a complete EMR data repository and is one of the two HIMSS Analytics EMRAM Stage 7 hospitals in Beijing. The HIMSS Analytics EMRAM incorporates methodology and algorithms to automatically score hospitals around the world relative to their EMR capabilities. A Stage 7 rating signifies the highest level of EMR function and application, achieving a near paperless environment that harnesses technology to support optimized patient care. At Xuanwu Hospital, the EMRAM data system was implemented in 2014. All employees receive training on the content and scope of the EMR data available, the permissions for EMR data utilization, and the process of requesting and obtaining EMR data.
Data Sources and Extraction
All data from the Office Information System (Office Automation) was extracted, because each EMR data extraction request in the hospital must be approved through the EMR data management module in the Office Automation. Variables of interest included data request purpose, requester ID, requester department, and data request time. If the purpose of the data request was for scientific research, it was included in the study. The requester ID was used to retrieve the age and professional title of all requesters in the hospital human resources dictionary. The requester ID was also used as the main index for data matching and integration, forming a total of 933 EMR data request records for scientific research purposes between 2016 and 2019.
The use of EMR data for research purposes by key departments in the hospital was also assessed. XWHCMU evaluates the scientific research performance of each department every year based on a set of 18 evaluation criteria, including published papers/books, transformation of scientific research results, academic events, and approved scientific research projects. The top 10 clinical departments with the highest cumulative research work performance score over the last 4 years were selected as “key departments” for this study. The performance score of each department, evaluation indicators, and standards of scientific research work can be found in Multimedia Appendix 1.
Statistical Analysis
The data were analyzed using IBM SPSS Statistics for Windows version 23.0 (IBM Corp). The data were expressed using times, frequencies, and percentages. The chi-square test was used for categorical variables, with P<.05 considered statistically significant. A summary of the statistical indicators, their definitions, and how they were calculated can be found in Table 1.
Summary of the statistical indicators of the study, their corresponding definitions, and how they were calculated.
Statistical indicators
Definition
Calculation
Times
An absolute value index
The cumulative value of the number of requests for electronic medical record (EMR) data for research by professional and technical personnel in the observation unit (institution or department) during the observation period.
Frequency
An intensity index
The number of requests/∑the number of professional and technical personnel in this observation unit × time.
Proportion of requesters
A ratio indicator
∑the number of professional and technical personnel who have requested EMR data for research/∑the number of professional and technical personnel in this observation unit.
Number of departments that did not request data
A counting indicator
The number of departments that never requested EMR data for scientific research during the observation period.
Absolute increment of frequency
The absolute value of growth
Can be further divided into cumulative growth and annual growth.
Cumulative growth
The absolute value of growth
The difference between the frequency of a certain year and that at baseline (2016).
Annual growth
The absolute value of growth
The difference between the frequency of a year and that of the previous year.
Frequency growth rate
The growth rate of frequency
Divided into fixed base ratio growth rate and link ratio growth rate.
Relative ratio with fixed base
The growth rate of frequency
The net increase rate of frequency in a certain year compared with the baseline (2016), that is, the ratio of a certain year’s frequency to the baseline frequency minus 100%.
Link relative
The growth rate of frequency
The net increase rate of frequency in a year compared with the frequency of the previous year, that is, the ratio of frequency of a year to that of the previous year minus 100%.
ResultsEMR Data Utilization From 2016 to 2019 at XWHCMU
The frequency of EMR data utilization increased from 0.06 times per person per year (2016) to 0.1 times per person per year (2019), and the proportion of requesters increased from 3.3% (2016) to 5.8% (2019), as seen in Table 2. The majority of medical departments at the hospital are using the EMR system, with the number not using the system decreasing from 21 (2016) to 5 (2019). The fixed base ratio growth rate of the frequency of EMR data utilization was 66.67%, and the year-to-year growth rate in 2019 was zero.
The frequency at which EMR data was used for medical research increased significantly between 2016 and 2018 (Table 2). The growth rate frequency has gradually slowed down over the past 4 years, with a bottleneck occurring in 2019, during which the growth rate was 0%.
General trends in the utilization of electronic medical records in Xuanwu Hospital, Capital Medical University, Beijing, China between 2016 and 2019.
Year
Times
Frequency
Proportion of requesters, n/N (%)
Number of departments that did not request data, n/N (%)
Absolute increment of request frequency
Request frequency growth rate, %
Cumulative growth
Annual growth
Relative ratio with fixed base
Link relative
2016
171
0.06
98/3060 (3.2%)
21/47 (44.7%)
N/Aa
N/A
N/A
N/A
2017
201
0.07
119/2935 (4.1%)
19 /47 (40.4%)
0.01
0.01
16.67
16.67
2018
288
0.10
153/2883 (5.3%)
14/47 (29.8%)
0.04
0.03
66.67
42.86
2019
273
0.10
163/2667 (6.1%)
5/47 (10.6%)
0.04
0.00
66.67
0.00
aN/A: not applicable.
Utilization of EMR Data by Key Departments at XWHCMU From 2016 to 2019
The key departments had a per capita request frequency lower than the average per capita request frequency for the overall hospital (Table 3). The proportion of data utilization by key departments decreased from 70.0% in 2016 to 49.4% in 2019.
Utilization of electronic medical record data in the key scientific research departments of Xuanwu Hospital, Capital Medical University, Beijing, China between 2016 and 2019.
Research score ranking
Department
2016
2017
2018
2019
Times
Proportion of the whole hospital request times, %
Frequency
Times
Proportion of the whole hospital request times, %
Frequency
Times
Proportion of the whole hospital request times, %
Frequency
Times
Proportion of the whole hospital request times, %
Frequency
1
Neurology
49
28.8%
0.16
57
28.4%
0.19
70
24.3%
0.23
65
23.8%
0.16
2
Neurosurgery
18
10.6%
0.08
17
8.5%
0.08
16
5.6%
0.07a
8
2.9%
0.03a
3
Radiology
7
4.1%
0.06
6
3.0%
0.05a
8
2.8%
0.07a
7
2.6%
0.06a
4
General Surgery
5
2.9%
0.05a
21
10.4%
0.20
16
5.6%
0.15
10
3.7%
0.07a
5
Functional Neurosurgery
1
0.6%
0.01a
1
0.5%
0.01a
4
1.4%
0.05a
4
1.5%
0.05a
6
Interventional Radiography
0
0%
0.00a
1
0.5%
0.03a
9
3.1%
0.26
5
1.9%
0.14
7
Vascular Surgery
13
7.7%
0.19
15
7.5%
0.22
13
4.5%
0.19
5
1.9%
0.07a
8
Anesthesiology
0
0%
0.00a
2
1.0%
0.01a
2
0.7%
0.01a
6
2.0%
0.03a
9
Pharmacy
25
14.7%
0.20
19
9.5%
0.15
33
11.5%
0.26
22
8.1%
0.17
10
Orthopedics
1
0.6%
0.02a
3
1.5%
0.05a
3
1.0%
0.05a
3
1.0%
0.05a
Total
N/Ab
119
70.0%
N/A
142
70.8%
N/A
174
60.5%
N/A
135
49.4%
N/A
Frequency of the overall hospital
N/A
N/A
N/A
0.06
N/A
N/A
0.07
N/A
N/A
0.10
N/A
N/A
0.10
aThe annual per capita electronic medical record data utilization frequency of this department was lower than the annual average of the whole hospital. The annual average is based on all departments.
bN/A: not applicable.
Utilization of EMR Data by Age
As seen in Figure 1, the trend in the proportion of individuals using EMR data varied between 2016 and 2019. Those aged 36 to 45 years made up the largest proportion of researchers using EMR data from 2016 to 2018, though this trend declined in 2019, when those aged 46 years of age or older made up the larger proportion of requests. Generally speaking, those under the age of 35 years represented the smallest proportion of EMR data users at the hospital.
Trend in the proportion of electronic medical record data users by age group at Xuanwu Hospital, Capital Medical University, Beijing, China between 2016 and 2019.
Utilization of EMR Data by Staff Level
In 2016, the proportion of junior-level professionals using EMR data for medical research was the lowest (1.2%), while those with senior-level titles made up the largest proportion of EMR data users (8.8%). This trend continued through 2019, as seen in Table 4. Between 2016 and 2019, senior-level professionals made up the largest proportion of those requesting EMR data (255/533, 47.8%), followed by intermediate-level staff (161/533, 30.2%) and then junior-level staff (117/533, 21.9%). Over the 4-year period, the proportion of senior- and intermediate-level staff requesting EMR data increased, while there was no significant change in the junior-level staff group.
Electronic medical record data utilization by junior-, intermediate-, and senior-level staff at Xuanwu Hospital, Capital Medical University, Beijing, China between 2016 and 2019.
Year
Professional title
Total, n/N (%)
Chi-square (df)
P value
Junior-level requester, n/N (%)
Intermediate-level requester, n/N (%)
Senior-level requester, n/N (%)
2016
23/1894 (1.2%)
26/658 (4.0%)
49/508 (9.6%)
98/3060 (3.2%)
84.155 (5)
<.001
2017
22/1811 (1.2%)
37/648 (5.7%)
60/476 (12.6%)
119/2935 (4.1%)
131.622 (5)
<.001
2018
38/1772 (2.1%)
44/644 (6.8%)
71/467 (15.2%)
153/2883 (5.3%)
191.04 (5)
<.001
2019
34/1755 (1.9%)
54/497 (10.9%)
75/415 (18.1%)
163/2667 (6.1%)
147.299 (5)
<.001
DiscussionPrincipal Findings
This study aimed to understand the landscape of EMR data utilization for medical research at XWHCMU between 2016 and 2019. In the past 4 years, the use of EMR data for medical research was quite uncommon at the hospital. Though overall utilization rates increased each year, the overall growth rate is slowing, with a frequency of just 0.1 times per person per year in 2019. More so, key research departments at the hospital are not utilizing EMR data for research purposes, while junior-level staff continue to be limited in their ability to use the system.
According to the results of this study, the proportion of hospital staff using EMR data was less than 6% and the frequency of EMR data utilization did not exceed 10 times per 100 researchers in 1 year. Meanwhile, even the top 10 research departments at Xuanwu Hospital reduced the frequency at which they used EMR data for medical research purposes. Current clinical scientific research data collection still heavily relies on semimanual input. In China, the Hospital Information System has continuously improved, with the EMR system accumulating a large amount of valuable health care data. According to the Annual Report on the Status of Chinese Hospital Informatization (2018-2019), more than one-fourth of tertiary medical institutions have invested in EMR data utilization for research [26]. Since prospective clinical research is more demanding and difficult to perform, retrospective research is an important means of obtaining clinical evidence. EMR data can be not only used as independent data, but also tied to administrative data for retrospective research [13,16,17], saving both time and money for medical institutions wishing to carry out such research studies with limited resources [18,19]. Thus, steps within the hospital should be taken to promote the awareness of this type of available research data, along with the encouragement to carry our medical research using these systems. Further evaluations are needed to gain a better understanding as to why current medical staff may not be accessing such data or why these trends may be declining.
Although the frequency of data usage has increased significantly (the fixed base ratio growth rate was 66.67%), this was not found to be significant, and a bottleneck was noted in 2019. The reasons for this decline in data utilization over the last 3 years were not analyzed, though further follow-up studies to determine the factors influencing the decisions for EMR data utilization would be beneficial. These studies could examine if the external environment has changed, including policies for utilizing EMR data, mechanisms for data sharing, and procedures for requesting and obtaining data.
This study also found that older more senior professionals at Xuanwu Hospital were more likely to use EMR data compared to younger age groups (P<.001). Junior-level staff should be the main force for tapping the value of the EMR data, as they need scientific research achievements to be promoted and younger individuals tend to accept new technologies and new methods faster compared to older populations [49]. In large general hospitals in China, all professional and technical staff are required to have independent scientific research capabilities and publications. However, there is a serious contrast between actual need and actual use of EMR data among junior-level staff, as seen in this study. While this study did not evaluate such contrasts, other research has aimed to identify why such barriers to data access may exist, as noted in the Introduction section of this manuscript. The first issue of data access may be inequality, as bureaucracy has been noted as one of main barriers when using EMR data for research [48]. If this is the case at hospitals in Beijing, it is urgent to establish an equal and open EMR data utilization mechanism. Another potential barrier is whether there is a lack of awareness of the research value of EMR data among younger junior-level staff [50]. Lastly, the EMR data utilization skills of junior-level staff may be insufficient [51,52]. If awareness and skills are indeed lacking, it is required to establish systematic training and technical support services for this group [53,54].
Limitations
As this study was limited to one hospital in Beijing, China, the results cannot represent the general situation of other medical institutions in China. In addition, due to information confidentiality, more personnel-related information could not be obtained and the included indicators may not be comprehensive. For other factors that may affect the utilization of EMR data, further research is needed.
Conclusions
This is the first quantitative study considering EMR data utilization for medical research in a hospital in Beijing. It offers unique insights into the frequency of EMR data usage for medical research purposes and who is utilizing such data. The value of using EMR data for research purposes remains understudied. The results of this study also suggest that young doctors may be less exposed or have less reason to access such research methods. More research is needed to quantify to what extent EMR data are utilized across all hospitals in Beijing and how these systems can enhance future studies.
Research performance assessment standard of XuanWu hospital.
AbbreviationsEHR
electronic health record
EMR
electronic medical record
EMRAM
Electronic Medical Record Adoption Model
HIMSS
Healthcare Information and Management Systems Society
XWHCMU
Xuanwu Hospital, Capital Medical University
We are grateful to the Information Center, the Scientific Research Management Department, and the Human Resources Department for their cooperation throughout the study. The Information Center helped us extract the data request records; the Scientific Research Management Department provided the performance score of each department, evaluation indicators, and standards of scientific research work; and the Human Resources Department provided related personnel information. We thank Anjie Ren for guidance on this study.
None declared.
LugnNEConnecting for Health: Global Vision, Local InsightJ Telemed Telecare2016062212316116210.1258/135763306776738585RheeCDantesREpsteinLMurphyDJSeymourCWIwashynaTJKadriSSAngusDCDannerRLFioreAEJerniganJAMartinGSSeptimusEWarrenDKKarczAChanCMenchacaJTWangRGruberSKlompasMCDC Prevention Epicenter ProgramIncidence and Trends of Sepsis in US Hospitals Using Clinical vs Claims Data, 2009-2014JAMA20171003318131241124910.1001/jama.2017.13836289031542654187PMC5710396What are the differences between electronic medical records, electronic health records, and personal health records?Health Information Technology2020-01-01https://www.healthit.gov/faq/what-are-differences-between-electronic-medical-records-electronic-health-records-and-personalKawaguchiHKoikeSOheKFacility and Regional Factors Associated With the New Adoption of Electronic Medical Records in Japan: Nationwide Longitudinal Observational StudyJMIR Med Inform2019061472e1402610.2196/1402631199307v7i2e14026PMC6598416O'DonnellAKanerEShawCHaightonCPrimary care physicians' attitudes to the adoption of electronic medical records: a systematic review and evidence synthesis using the clinical adoption frameworkBMC Med Inform Decis Mak2018111318110110.1186/s12911-018-0703-x3042475810.1186/s12911-018-0703-xPMC6234586OwensBFamily doctors call for guaranteed access to EMR data for research and quality improvementCMAJ201801151902E60E6110.1503/cmaj.109-554329335269190/2/E60PMC5770259ZhangXYZhangPRecent perspectives of electronic medical record systemsExp Ther Med2016061162083208510.3892/etm.2016.323327284289ETM-0-0-3233PMC4887954HenryJAdoption of Electronic Health Record Systems among U.S. Non-federal Acute Care Hospitals: 2008-2013Health Information Technology20142020-02-01https://www.healthit.gov/sites/default/files/briefs/oncdatabrief16.pdfMinistry of Health and Welfare2020-02-05http://www.mohw.go.kr/eng/PuskarichMACallawayCSilbergleitRPinesJMObermeyerZWrightDWHsiaRYShahMNMonteAALimkakengATMeiselZFLevyPDPriorities to Overcome Barriers Impacting Data Science Application in Emergency Care ResearchAcad Emerg Med2019012619710510.1111/acem.1352030019795PMC6637965EhrensteinVNielsenHPedersenABJohnsenSPPedersenLClinical epidemiology in the era of big data: new opportunities, familiar challengesClin Epidemiol2017924525010.2147/CLEP.S12977928490904clep-9-245PMC5413488SunWCaiZLiYLiuFFangSWangGData Processing and Text Mining Technologies on Electronic Medical Records: A ReviewJ Healthc Eng20182018430242510.1155/2018/430242529849998PMC5911323DeanBBLamJNatoliJLButlerQAguilarDNordykeRJReview: use of electronic medical records for health outcomes research: a literature reviewMed Care Res Rev2009126666113810.1177/1077558709332440192793181077558709332440De MoorGSundgrenMKalraDSchmidtADugasMClaerhoutBKarakoyunTOhmannCLasticPAmmourNKushRDupontDCuggiaMDanielCThienpontGCoorevitsPUsing electronic health records for clinical research: the case of the EHR4CR projectJ Biomed Inform201502531627310.1016/j.jbi.2014.10.00625463966S1532-0464(14)00226-3CanawayRBoyleDIManski-NankervisJAEBellJHockingJSClarkeKClarkMGunnJMEmeryJDGathering data for decisions: best practice use of primary care electronic records for researchMed J Aust201904210 Suppl 6S12S1610.5694/mja2.5002630927466PMC6487848LinnGYingYChangKDoes Computerized Physician Order Entry Benefit from Dynamic Structured Data Entry? A Quasi-Experimental StudyBMC Med Inform Decis Mak2018112618110910.1186/s12911-018-0709-43047749110.1186/s12911-018-0709-4PMC6258385ReimerAPMilinovichAMadiganEAData quality assessment framework to assess electronic medical record data for use in researchInt J Med Inform2016069040710.1016/j.ijmedinf.2016.03.00627103196S1386-5056(16)30047-8PMC4845906SafranCBloomrosenMHammondWELabkoffSMarkel-FoxSTangPCDetmerDEExpert PanelToward a national framework for the secondary use of health data: an American Medical Informatics Association White PaperJ Am Med Inform Assoc20071411910.1197/jamia.M227317077452M2273PMC2329823WeiskopfNRusanovAWengCSick patients have more data: the non-random completeness of electronic health recordsAMIA Annu Symp Proc201320131472724551421PMC3900159LingrenTSadhasivamSZhangXMarsoloKElectronic medical records as a replacement for prospective research data collection in postoperative pain and opioid response studiesInt J Med Inform201803111455010.1016/j.ijmedinf.2017.12.01429425633S1386-5056(17)30459-8PMC5808990LaiYSAfsethJDA review of the impact of utilising electronic medical records for clinical research recruitmentClin Trials20190416219420310.1177/174077451982970930764659DuzMMarshallJFParkinTValidation of an Improved Computer-Assisted Technique for Mining Free-Text Electronic Medical RecordsJMIR Med Inform2017062952e1710.2196/medinform.712328663163v5i2e17PMC5509949MurdochTBDetskyASThe inevitable application of big data to health careJAMA20130403309131351210.1001/jama.2013.3932354957916742452008-2013 white paper on the status of hospital informatization in ChinaChima2020-03-05https://chima.org.cn/Sites/Uploaded/File/2020/07/216373092256678657801360117.pdf2017-2018 white paper on the status of hospital informatization in ChinaChima2020-02-05https://chima.org.cn/Html/News/Articles/11000170.html2018-2019 white paper on the status of hospital informatization in ChinaChima2020-03-05https://chima.org.cn/Html/News/Articles/4878.htmlStage 6 and 7 AchievementHIMSS Analytics2020-04-01https://www.himssanalytics.org/asia-pacific/stage-6-7-achievementWuYLeiJWeiWQTangBDennyJCRosenbloomSTMillerRAGiuseDAZhengKXuHAnalyzing differences between chinese and english clinical text: a cross-institution comparison of discharge summaries in two languagesStud Health Technol Inform2013192662623920639PMC4957806WeinerMGEmbiPJToward reuse of clinical data for research and quality improvement: the end of the beginning?Ann Intern Med2009090115153596010.7326/0003-4819-151-5-200909010-00141196384040000605-200909010-00141CowieMRBlomsterJICurtisLHDuclauxSFordIFritzFGoldmanSJanmohamedSKreuzerJLeenayMMichelAOngSPellJPSouthworthMRStoughWGThoenesMZannadFZalewskiAElectronic health records to facilitate clinical researchClin Res Cardiol20170110611910.1007/s00392-016-1025-62755767810.1007/s00392-016-1025-6PMC5226988EdmondsonMReimerAChallenges Frequently Encountered in the Secondary Use of Electronic Medical Record Data for ResearchComput Inform Nurs20200738733834810.1097/CIN.00000000000006093214974200024665-202007000-00004HershWRWeinerMGEmbiPJLoganJRPaynePROBernstamEVLehmannHPHripcsakGHartzogTHCiminoJJSaltzJHCaveats for the use of operational electronic health record data in comparative effectiveness researchMed Care201308518 Suppl 3S30710.1097/MLR.0b013e31829b1dbd23774517PMC3748381HershWCiminoJPaynePREmbiPLoganJWeinerMBernstamEVLehmannHHripcsakGHartzogTSaltzJRecommendations for the use of operational electronic health record data in comparative effectiveness researchEGEMS (Wash DC)201311101810.13063/2327-9214.101825848563egems1018PMC4371471CallahanAShahNHChenJHResearch and Reporting Considerations for Observational Studies Using Electronic Health Record DataAnn Intern Med2020060217211 SupplS79S8410.7326/M19-087332479175PMC7413106MilinovichAKattanMWExtracting and utilizing electronic health data from Epic for researchAnn Transl Med201802634210.21037/atm.2018.01.1329610734atm-06-03-42PMC5879514NiKChuHZengLLiNZhaoYBarriers and facilitators to data quality of electronic health records used for clinical research in China: a qualitative studyBMJ Open2019070297e02931410.1136/bmjopen-2019-02931431270120bmjopen-2019-029314PMC6609143JensenPBJensenLJBrunakSMining electronic health records: towards better research applications and clinical careNat Rev Genet2012050213639540510.1038/nrg320822549152nrg3208RamanSRCurtisLHTempleRAnderssonTEzekowitzJFordIJamesSMarsoloKMirhajiPRoccaMRothmanRLSethuramanBStockbridgeNTerrySWassermanSMPetersonEDHernandezAFLeveraging electronic health records for clinical researchAm Heart J201808202131910.1016/j.ahj.2018.04.01529802975S0002-8703(18)30138-8Ming-YuZResource Management of Big Data of Clinical ResearchChina Digital Medicine2020150810.3969/j.issn.1673-7571.2020.08.034LongJARichardsJASekoCEThe Canadian Institute for Health Information (CIHI) Data Quality Framework, Version 1: A Meta-Evaluation and Future DirectionsProceedings of the 6th International Conference on Information Quality20016th International Conference on Information Quality2001Cambridge, MA370383OpmeerBCElectronic Health Records as Sources of Research DataJAMA201601123152201210.1001/jama.2015.15419267574732480997BaierAWSnyderDJLeahyICPatakLSBrustowiczRMA Shared Opportunity for Improving Electronic Medical Record DataAnesth Analg201709125395295710.1213/ANE.000000000000213428632540WeiskopfNGWengCMethods and dimensions of electronic health record data quality assessment: enabling reuse for clinical researchJ Am Med Inform Assoc201301012011445110.1136/amiajnl-2011-00068122733976amiajnl-2011-000681PMC3555312BrownMLCan't you just pull the data? The limitations of using of the electronic medical record for researchPaediatr Anaesth20161126111034103510.1111/pan.1295127747978von MartialSBrixTJKlotzLNeuhausPBergerKWarnkeCMeuthSGWiendlHDugasMEMR-integrated minimal core dataset for routine health care and multiple research settings: A case study for neuroinflammatory demyelinating diseasesPLoS One20191410e022388610.1371/journal.pone.022388631613917PONE-D-19-01741PMC6793844Assessing Data Quality for Healthcare Systems Data Used in Clinical ResearchNIH Collaboratory20142020-04-05https://dcricollab.dcri.duke.edu/sites/NIHKR/KR/Assessing-data-quality_V1%200.pdfWuYLeiJWeiWTangBDennyJCRosenbloomSTMillerRAGiuseDAZhengKXuHAnalyzing differences between chinese and english clinical text: a cross-institution comparison of discharge summaries in two languagesStud Health Technol Inform2013192662623920639PMC4957806van VelthovenMHMastellosNMajeedAO'DonoghueJCarJFeasibility of extracting data from electronic medical records for research: an international comparative studyBMC Med Inform Decis Mak20160713169010.1186/s12911-016-0332-12741194310.1186/s12911-016-0332-1PMC4944506LeeCCCzajaSJMoxleyJHSharitJBootWRCharnessNRogersWAAttitudes Toward Computers Across Adulthood From 1994 to 2013Gerontologist20190109591223310.1093/geront/gny081299824585049572PMC6326256ZhaoJWEstablishment of a clinical research big data center in a hospital in Henan provinceChin J Hosp Admin202036866867110.3760/cma.j.cn111325-20200415-01110HaixingWDiscussion on the application of health big data in clinical researchChinese Hospitals2020247636410.19660/j.issn.1671-0592.2020.07.19RuiLLanLZhigangLZhifangGYanYJiaLAnalysis of Data Utilization of Hospital Information System for Clinical ResearchChinese Journal of Health Informatics and Management2018151868910.3969/j.issn.1672-5166.2018.01.017FanxiuHHospital Big Data Framework System Construction and Data UtilizationChinese Journal of Health Informatics and Management2020173275278JiaQGPractice of cultivating the ability of big data mining in graduates working for professional degree in medical oncologyChin J Med Edu202019555155410.3760/cma.j.cn116021-20191204-00125