Published on in Vol 13 (2025)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/72237, first published .
Innovative Integration of 4D Cardiovascular Reconstruction and Hologram: Framework Development of a New Visualization Tool for Coronary Artery Bypass Grafting Planning

Innovative Integration of 4D Cardiovascular Reconstruction and Hologram: Framework Development of a New Visualization Tool for Coronary Artery Bypass Grafting Planning

Innovative Integration of 4D Cardiovascular Reconstruction and Hologram: Framework Development of a New Visualization Tool for Coronary Artery Bypass Grafting Planning

Authors of this article:

Shuo Wang1 Author Orcid Image ;   Tong Ren2 Author Orcid Image ;   Nan Cheng2 Author Orcid Image ;   Li Zhang1 Author Orcid Image ;   Rong Wang1 Author Orcid Image

1Department of Engineering Physics, Key Laboratory of Particle and Radiation Imaging, Ministry of Education, Tsinghua University, 30 Shuangqing Road, Haidian District, Beijing, China

2Department of Adult Cardiac Surgery, Senior Department of Cardiology, The Six Medical Center of People's Liberation Army General Hospital, 6 Fucheng Road,, Haidian District, Beijing, China

*these authors contributed equally

Corresponding Author:

Rong Wang, MD


Background: Planning for coronary artery bypass grafting (CABG) necessitates advanced spatial visualization skills and consideration of multiple factors, including the depth of coronary arteries within the subepicardium, calcification levels, and pericardial adhesions.

Objective: This study aimed to address these requirements by reconstructing a dynamic cardiovascular model, displaying it as a naked-eye hologram, and evaluating the clinical utility of this innovative visualization tool for preoperative CABG planning.

Methods: We used preoperative 4D cardiac computed tomography angiography (4D-CCTA) data from 14 patients scheduled for CABG to develop a semiautomated workflow. This workflow enabled time-resolved segmentation of the heart chambers, epicardial adipose tissue (EAT), and coronary arteries, complete with calcium scoring. Methods for segmenting cardiac structures, quantifying coronary calcification, visualizing coronary depth within EAT, and assessing pericardial adhesions via motion analysis were incorporated. These dynamic reconstructions captured spatial relationships, coronary stenosis, calcification, and depth in EAT, as well as pericardial adhesions. Dynamic cardiovascular holograms were then generated and displayed using the Looking Glass platform (Looking Glass Factory Inc). Thirteen cardiac surgeons assessed the utility of the holographic visualization tool on a Likert scale. In addition, a surgeon visually scored pericardial adhesions using the holograms of all 21 patients (including 7 undergoing secondary cardiac surgeries) and compared these scores with actual intraoperative findings.

Results: Cardiac surgeons highly rated the visualization tool for its utility in preoperative planning, with a mean Likert score of 4.57/5.0 (SD 0.5). The hologram-based scoring of pericardial adhesions showed a strong correlation with intraoperative findings (correlation coefficient r=0.786; P<.001).

Conclusions: This study delineates the structural framework of a visualization tool specifically designed for preoperative CABG planning. It produces high-quality, clinically relevant, dynamic holograms from patient-specific volumetric data, with clinical feedback confirming its practicality and effectiveness for preoperative surgical planning.

JMIR Med Inform 2025;13:e72237

doi:10.2196/72237

Keywords



Coronary artery disease (CAD) is one of the leading causes of death worldwide [1]. Coronary artery bypass grafting (CABG) is the most frequently performed cardiac surgery globally [2]. Compared with percutaneous interventions or medication therapy alone, CABG provides a survival advantage for patients with complex coronary artery disease [3]. Accurate identification of the coronary arteries and careful selection of the anastomotic site are critical for surgical success. If the chosen anastomosis site is located too deep within the thoracic cavity, the limited operating space may hinder surgical maneuverability. Furthermore, when a coronary artery lies deep within epicardial adipose tissue (EAT) or within the myocardium, intraoperative localization becomes challenging. This can lead to longer operative times, increased tissue trauma, and a reduction in the morphological quality of the anastomosis. In addition, plaque may obstruct suturing, and pericardial adhesions can increase the risk of injury to the heart or major vessels, further prolonging the procedure and raising its overall risk. Therefore, collecting detailed information on pericardial adhesions, spatial orientation, coronary artery depth within EAT, stenosis, and calcification is crucial for preoperative CABG planning.

Enhanced 3D cardiac models that incorporate multiple functional imaging modalities provide more comprehensive insights [4]. A practical strategy to realize precision medicine in cardiovascular care is through the digital twinning of the cardiovascular system, using coronary angiography, echocardiography, and coronary computed tomography angiography (CTA) data [5]. Compared with ultrasound and magnetic resonance imaging (MRI), CTA offers superior spatial resolution and is widely used for reconstructing patient-specific 3D models. While MRI techniques such as 4D cardiac MRI and cine multislice MRI offer excellent temporal resolution along with good spatial resolution and are well-established in clinical practice, 4D cardiac computed tomography (CT) imaging offers sufficient spatial and temporal resolution to support advanced visualization. This enables dynamic and functional assessments of cardiovascular conditions. Although 3D and 4D visualization technologies with effective depth cues are already established in clinical practice, enabled by robust 3D viewers that allow simultaneous multiview display and free-angle reformatting of volumetric datasets, our study hypothesizes that holographic displays may provide additional benefits for specific surgical planning tasks, warranting further investigation.

Building upon the established foundation of clinical 3D visualization, our research explores whether holographic displays can provide complementary benefits for CABG planning. Rather than suggesting limitations in current clinical displays, we aim to explore whether the stereoscopic nature of holography offers added value for specific surgical planning scenarios. Effective communication among health care team members can be hindered by individual differences in spatial visualization abilities. Researchers have made significant progress in representing medical 3D images through virtual and augmented reality (VR and AR) technologies, as well as various stereoscopic display systems. In recent years, holographic display technology has made notable advances in the fields of surgical planning and intraoperative navigation, with the Microsoft HoloLens emerging as the leading AR and MR headset [6-10]. Holography is widely considered the most advanced form of display technology, as it incorporates all human visual cues, including stereopsis and accommodation, allowing for naked-eye visualization [9]. Although modern head-mounted devices have become more lightweight and support networked multiuser viewing, they still present significant limitations. One persistent issue with VR is “cybersickness”—a condition marked by symptoms such as headaches, nausea, and vomiting [11]. In addition, these devices often fall short in providing true depth perception [10]. The HOLOSCOPE is the world’s first medical-grade holographic system. Bruckheimer et al [10] demonstrated the creation of real-time, internet-based 3D digital holograms without the need for headgear, using actual patient voxel data from 3D rotational angiography and intraoperative real-time 3D transesophageal echocardiography in patients with structural heart disease for preoperative assessment [12]. Looking Glass Factory has introduced the world’s first group-viewable holographic displays [13], offering a significantly more affordable alternative to the RealView HOLOSCOPE, which typically costs hundreds of thousands of dollars. In contrast, entry-level Looking Glass devices are priced at just a few thousand dollars. These displays offer substantial advantages for simultaneous multiuser viewing, collaborative discussion, and cost-effectiveness, making them particularly valuable for surgical planning in procedures like CABG, which often require input from multidisciplinary teams.

Building on a strong medical-industrial collaboration, our study addresses critical challenges in preoperative CABG planning by designing a 4D cardiovascular hologram based on 4D-CCTA data and evaluating the feasibility of using this holographic visualization tool for surgical planning.


Study Design and Overview

A total of 21 patients scheduled for cardiac surgery were evaluated using 4D-CCTA before the procedure. This cohort included 14 patients with complex coronary artery lesions who were candidates for CABG, with a mean age of 53.6 (SD 8.9) years; 13 of them were male. Because pericardial adhesions are common in patients undergoing repeat cardiac surgery, we selected 7 patients undergoing secondary procedures as a control group for evaluating pericardial adhesions. These patients had a mean age of 55.5(SD 11.5)years , and 6 were male. Operative reports confirmed extensive pericardial adhesions in all patients undergoing reoperation and the absence of adhesions in all patients undergoing first-time surgery. All reoperations involved heart valve procedures, with the interval between the initial and repeat surgeries ranging from 1 to 35 years. Among these patients, 3 had valve dysfunction following corrective surgery for congenital heart defects; 1 had infective endocarditis after left ventricular outflow tract unblocking, mitral valve replacement, and CABG; 1 developed infective endocarditis following mechanical valve replacement; 1 experienced tricuspid insufficiency after left heart valve surgery; 1 had mitral valve insufficiency after mitral valve plasty; and 1 had mitral valve insufficiency following prior left heart valve surgery. Inclusion criteria for the study were: (1) patients with complex coronary lesions meeting the clinical indications for CABG and no history of previous cardiac surgery; (2) patients undergoing secondary surgery in whom the autologous pericardium had been closed during the initial procedure. Exclusion criteria included poor-quality imaging data.

Our study aimed to construct a 4D cardiovascular hologram using individualized patient imaging to address key challenges in the preoperative planning of CABG. Clinicians will evaluate the effectiveness of the holographic visualization tool by comparing it with patients’ preoperative and intraoperative data, in order to assess the system’s practical utility for surgical planning. The surgeon will not use the holograms to guide the procedure or make clinical decisions based on these images.

Hologram Visualization System

The holographic display used in this study is the 8.9-inch Dev Kit from Looking Glass Factory Inc, which leverages advanced light field technology to produce highly realistic 3D visualizations of cardiovascular structures. This system generates true volumetric imagery by projecting 48 distinct horizontal perspectives of the same visual content through calibrated lenticular arrays, allowing multiple observers to simultaneously view and interact with the 3D cardiac models from various angles without positional restrictions (Figure 1).

Figure 1. Holographic display system consisting of 48 viewing angles.

The dynamic cardiac hologram is displayed at 60 frames per second, closely replicating the visual fluidity of normal cardiac cycles. The system provides a horizontal viewing angle of 58°, enabling up to 5 observers to simultaneously view the same holographic image from different perspectives without distortion. Depth perception is significantly enhanced by the system’s ability to render between 45 and 100 discrete depth planes along the z-axis, producing a seamless sense of depth that is crucial for interpreting complex cardiac anatomy. These complementary features—multiple horizontal perspectives and discrete depth planes—combine to deliver a truly immersive 3D visualization experience.

Unlike conventional VR or AR solutions, this technology does not require head-mounted displays or specialized eyewear, allowing surgical teams to communicate naturally while examining patient-specific anatomy. Interaction with the holographic model is enabled via a Leap Motion controller (Ultraleap Ltd), which supports intuitive, gesture-based manipulation. Users can rotate the model along any axis, zoom into regions of interest, adjust the playback speed of the cardiac cycle, and selectively display or hide specific tissue layers—including epicardial fat, coronary vessels, and calcification sites—using natural hand movements. This gesture control system is particularly valuable during preoperative planning sessions, where multiple specialists can collaboratively examine and manipulate complex anatomical structures while maintaining full situational awareness and unimpeded lines of communication.

Images and Processing

CT images were acquired during end-expiratory breath-hold and in sinus rhythm using a GE APEX CT scanner (Revolution Apex; GE Healthcare) with a retrospective electrocardiogram-gated protocol to optimize cardiac motion compensation. An iodinated contrast agent (Iohexol, 350 mg I/mL) was administered at a volume of 70 mL, followed by a 40 mL saline chaser at a flow rate of 5.5 mL/s via antecubital venous access. SmartPrep bolus tracking (GE Healthcare) was used to ensure optimal contrast timing. The z-axis coverage was 157.5 mm, encompassing the entire heart from above the carina to below the diaphragmatic surface. A noncontrast scan was performed before contrast-enhanced CCTA to allow for coronary calcium scoring. Images were reconstructed across 11 temporal phases, each corresponding to a range of R-R interval values from −5% to 106%. Slice thickness was 0.625 mm with matching intervals, and the in-plane resolution was 0.23 × 0.23 mm. The mean effective radiation dose, calculated according to European guidelines for multislice CT, was 14.93 mSv (DLP: 1066.66 mGy·cm, using a conversion factor of 0.014 mSv/mGy·cm). Coronary plaque quantification and Agatston scoring were performed using GE’s cardiac analysis software (AW VolumeShare 7), specifically the SmartScore module. As illustrated in Figure 2, our processing pipeline for cardiac CT data follows a sequential workflow beginning with retrospective electrocardiogram-gated image acquisition. The methodology proceeds through 4 key analytical stages. First, anatomical structure segmentation is performed, including multiphase reconstruction and skeletal structure delineation. Second, cardiac and vascular reconstruction is conducted with detailed cardiovascular modeling of chambers, vessels, and pathological features. Third, the EAT assessment quantifies the distribution and characteristics of pericardial fat deposits. Finally, dynamic modeling and motion analysis are achieved through temporal registration and displacement vector field analysis. This integrated approach enables a comprehensive evaluation of cardiac anatomy, function, and associated tissue characteristics, supporting both advanced clinical applications and research objectives.

Figure 2. Comprehensive cardiac computed tomography imaging pipeline for cardiovascular analysis. CT: computed tomography; EAT: epicardial adipose tissue; ECG: electrocardiogram; IMA: internal mammary artery.

First, we implemented our approach using MONAI [14] (Medical Open Network for Artificial Intelligence; NVIDIA), an open-source framework for deep learning in health care imaging, using its Auto3DSeg project (a component of the MONAI framework) for automated 3D segmentation. We segmented and reconstructed the ribs, vertebrae, sternum, diaphragm, and internal mammary artery from end-diastolic phase (70% R-R interval) CT images (Figure 3B-C). Next, we applied HeartDeformNet [15] to automatically segment the left ventricle, right ventricle, left atrium, right atrium, left ventricular myocardium, aorta, and pulmonary artery across all phases of the cardiac cycle (Figure 3A,E). A slightly modified version of DeepCarve [16] was used for aortic valve mesh reconstruction (Figure 3D). The primary modification involved using a template from an end-diastolic segmented left ventricle model, which contained fewer distorted elements. An experienced cardiologist manually marked and recorded arterial contours on planes perpendicular to the vessel centerline using SimVascular-v2023.03.27 [17], thus achieving segmentation of the coronary arteries from the 70% phase image (Figure 3F). Subsequently, we imported 9 cardiac phases (10%‐90%) and registered them to the selected 70% phase. This registration provided the transformations needed to adjust the 3D surface model points of the coronary arteries. These transformations were then used to generate a time-dependent sequence of 3D coronary artery models (Figure 3G,H), completing the process of dynamic modeling.

Second, for the visualization of calcified plaques, we followed the Agatston method [18]. We first identified contiguous calcium voxels within the 3D space of the binarized calcium image (Figure 4A). Three quantitative indices—Agatston score, mass score, and volume score—were calculated for the major branches of the coronary arteries (Figure 4B,C). In the calcified regions, medium and heavily calcified plaques were highlighted in red (Figure 4D). Fiz et al [19] classified plaque calcium density into tertiles: light (130‐210 HU), medium (211‐510 HU), and heavy (>510 HU) (Figure 4).

Figure 3. Technical visualization of cardiac computed tomography analysis results. (A) Electrocardiogram-gated sequential cardiac images showing the heart at different phases of the cardiac cycle. (B) 3D reconstruction of the thoracic cage and diaphragm. (C) Internal mammary artery visualization and anatomical relationships. (D) Detailed aortic valve structural analysis. (E) Complete heart mesh model displaying chambers and great vessels. (F) 3D reconstruction of coronary arteries. (G) Complete scene view with labeled epicardial adipose tissue and pericardium. (H) Model sequence of the cardiac cycle correlated with electrocardiogram waveform. EAT: epicardial adipose tissue.
Figure 4. Calculation and visualization of quantitative indices for coronary artery calcification. (A) Original cardiac computed tomography angiography image. (B) Coronary artery segmentation showing the contours of major coronary vessels. (C) Semantic segmentation with different coronary artery branches marked in distinct colors. (D) Quantitative analysis of calcified plaques, with visualization of calcification areas (marked in red) on the left, and a table on the right showing quantitative results including Agatston score, calcium mass, and volume for each coronary artery branch. CCTA: cardiac computed tomography angiography; LAD: left anterior descending artery; LCX: left circumflex artery; LMA: left main artery; RCA: right coronary artery.

Third, to visualize the depth of coronary artery travel, we modeled EAT to assess how deeply the coronary arteries are embedded within it. EAT measurements were performed using a semiautomated procedure (Figure 5A). Expert analysts segmented the pericardium using 3D Slicer v5.2.2 [20] in a sequential, slice-by-slice manner. EAT was measured from the bifurcation of the pulmonary trunk to the apex of the heart. Manual pericardial contours were drawn on every 5‐10 slices (Figure 5B), followed by interpolation and corrections where necessary. Contiguous voxels with attenuation values between −190 and −30 Hounsfield units were used to define and quantify EAT (Figure 5C) [21]. A fusion display combining EAT and coronary artery models was used to present depth information, visualized through variations in coronary artery fluoroscopy (Figure 5D).

Figure 5. Proposed epicardial adipose tissue segmentation method. (A) The pericardium appears as a thin white line in the coronary computed tomography angiography image. (B) The region encompassing the pericardium is first segmented by manual labeling (green region). (C) The threshold method is used to segment the adipose tissue within the pericardial mask (yellow region). (D) The volume rendering result of the segmented epicardial adipose tissue. LAD: left anterior descending artery.

Finally, when adhesions exist between the pericardium and the heart, the motion of the 2 structures tends to be synchronized. In contrast, the absence of adhesions results in noticeable differences in their relative motion. To observe this, we dynamically reconstructed both the pericardium and the outer cardiac tissue. Nine cardiac phases (10%‐90%) were imported and registered to the selected 50% phase. This registration used the symmetric diffeomorphic algorithm proposed by Avants et al [22], generating a sequence of transformations represented as a time-varying 3D displacement field. This sequence was then applied to deform the pericardium and EAT (Figure 6). The pericardium is cut open to help observe the inner EAT structures. The corresponding deformation field of the cutting plane is visualized using arrows, where each arrow represents the displacement vector, indicating the direction and magnitude of displacement originating from its starting point on the plane.

Figure 6. Relative motion of the pericardium and epicardial adipose tissue.

Evaluation of Outcomes

Evaluation of Naked-Eye Holographic Display

The outcome parameters were assessed qualitatively. Thirteen cardiac surgery clinicians evaluated various aspects of the holographic display, including display quality, realism of 3D spatial positioning, identification of calcified plaques, perception of coronary artery alignment depth, realism of dynamic visualization, and detection of pericardial adhesions. Evaluations were conducted using a Likert scale, based on preoperative and intraoperative data from 14 patients scheduled for CABG. In addition, the researchers evaluated participants’ attitudes toward the system’s usefulness in preoperative planning and clinical education, as well as their willingness to adopt the system in practice. A score of 5 represented the most positive evaluation, while a score of 1 indicated the least favorable response (see Questionnaire 1 in Multimedia Appendix 1).

Evaluation of Pericardial Adhesions

Pericardial adhesions were classified as either 0 or 1, where 0 indicated no adhesions and 1 indicated significant adhesions requiring the removal of a substantial portion of the pericardium. The intraoperative score was derived from the patient’s operative report. Adhesion severity in the holograms was visually assessed by an experienced cardiovascular surgeon trained in interpreting holographic representations of pericardial adhesions, including the significance of the color schemes. The surgeon was blinded to all patient information. To assess intrarater reliability, the same evaluator performed a second blinded evaluation of the same hologram samples 2 months later.

Statistical Analysis

The Spearman rank correlation test was conducted using SPSS version 25 for Windows (SPSS Inc) to evaluate the correlation between hologram-based adhesion scores and intraoperative adhesion scores. Statistical analysis of the holographic display evaluation scores was performed using Microsoft Excel (version 2021 MSO). All statistical analyses were descriptive. Continuous variables were summarized using the mean, standard deviation, minimum, median, and maximum values, while categorical variables were reported as counts and percentages.

Ethical Considerations

Ethics approval was granted by the Ethics Committee of the General Hospital of the Chinese People’s Liberation Army (approval number: S2024-580). This study was conducted in accordance with the Declaration of Helsinki. Informed consent was obtained from all individual participants included in the study. No compensation was provided to the participants of the study.


All 13 cardiac surgery professionals who tested the hologram system were male. The group consisted of 6 attending physicians and 7 senior doctors, with ages ranging from 34 to 54 years (median: 37 years).

When viewing the holograms from various angles (see Figure 7A-D; Video 1 in Multimedia Appendix 2), all participants—regardless of their level of expertise—agreed that the system offered a realistic visualization and allowed for accurate identification of the major coronary artery branches, the locations of severe stenosis, and calcified plaques. In addition, by zooming and rotating the model, users could clearly view the spatial relationships among the heart, coronary arteries, and internal mammary artery within the thoracic cavity (median rating: 5/5, Table 1). However, 2 experts assigned scores of 2 and 3, respectively, for the identification of coronary stenosis and calcified plaques. They expressed concern that CCTA data may not reliably discriminate coronary stenosis and noted that intravascular contrast enhancement could impact plaque identification, potentially leading to inaccurate results. To assess interrater reliability, Fleiss κ coefficients were calculated for each evaluation item. The results indicated substantial to almost perfect agreement among evaluators across all assessment criteria (κ ranging from 0.68 to 0.85). The highest agreement was observed for comparisons with traditional 2D displays (κ=0.85) and dynamic display fidelity (κ=0.82), reflecting strong consensus regarding the system’s superiority over conventional visualization methods. While all criteria demonstrated substantial agreement, coronary calcified plaque visualization received the relatively lowest κ score (κ=0.68), suggesting some variability in expert perception of this feature. Overall, the high κ values confirm the reliability of the evaluation results and strengthen the validity of the positive assessments across all measured dimensions.

Figure 7. Typical scenarios on a holographic viewing system. (A) Dynamic 3D coronary artery scene segmented from computed tomography data, medium and heavily calcified plaques are marked in red. (B) A 4D chest scene including the heart, coronary artery, internal mammary artery, ribs, vertebrae, sternum, and diaphragm. (C) Scenes demonstrating coronary depth. (D) Dynamic pericardium and cardiac motion scene.
Table 1. Holographic experience reviews and attitude toward (future) use of holographic imaging system.
Assessment itemsMean (SD)Median rating (1–5)Interrater agreement (κ)
Spatial perception4.78 (0.4)50.79
Coronary calcified plaque4.28 (1.0)50.68
Coronary depth4.71 (0.5)50.76
Dynamic display fidelity4.78 (0.4)50.82
Pericardial adhesions4.64 (0.6)50.73
Basic tools (rotate, zoom)4.71 (0.5)50.79
Compared to traditional 2D screens4.85 (0.4)50.85
Overall evaluation4.71 (0.5)50.74
Helpful for preoperative planning4.57 (0.5)50.71
Beneficial for clinical teaching4.78 (0.4)50.81
Useful for patient education4.64 (0.5)50.72

Anterior descending superficial myocardial bridges were observed in 2 of the 14 CABG patients based on CTA images. Evaluators perceived the depth trajectory of the coronary arteries within the EAT by noting a progressive transition in the holograms, from a blurred proximal segment to a clearer mid-to-distal segment. This trend corresponded with intraoperative findings, where anastomotic selection could not avoid the bridged region due to limitations in internal mammary artery length (Figure 8). Depth perception scores for the coronary arteries were consistently rated as “agree” or “strongly agree,” with a median score of 5/5. As demonstrated in patient number 9, the anterior descending branch anastomosis proposed before surgery was located deep in the EAT, with the anterior descending branch alignment appearing straight in preoperative coronary angiography, implying potential myocardial bridges. The hologram produced results consistent with both the intraoperative situation and the diagnostic results of preoperative imaging.

Figure 8. Figure 8. The intraoperative situation of patient number 9. EAT: epicardial adipose tissue; IMA: internal mammary artery; LAD: left anterior descending artery.

Conventionally, images are viewed on a 2D screen following 3D reconstruction of the heart and coronary arteries using 3D Slicer software. To compare approaches, we asked evaluators to respond to assessment item 7 “Compared to traditional 2D screens”: in obtaining the information needed for preoperative evaluation, it provides more intuitive and comprehensive insights compared to observing static 3D cardiovascular CT images on a 2D screen. The mean score was 4.85 (SD 0.4), with 5 representing the most positive evaluation and 1 the least. Cardiac surgeons who participated in the evaluation agreed that the visualization method used in this study provided superior insights compared with traditional techniques. Key advantages included enhanced depth perception and more detailed cardiac modeling, particularly in representing coronary artery travel depth and pericardial adhesions.

The hologram-based adhesion score showed a strong correlation with the intraoperative adhesion score (r=0.786; P<.001; 95% CI 0.53‐0.92), confirming the validity of the data. All participants acknowledged the effective visualization of pericardial adhesions (median score: 5/5; Figure 9), and noted that the holographic display provided a more intuitive and 3D representation than traditional ultrasound images. For example, patients without prior cardiac surgery showed clear relative motion between pericardium and epicardial adipose tissue (Figure 9A), while those with previous operations demonstrated restricted motion, indicating adhesions (Figure 9B). Notably, one case showed discordance between operative findings and holographic assessment (Figure 9C). The dynamic visualization of pericardial motion and adhesion patterns can be further observed in the supplementary video demonstration (Video 2 in Multimedia Appendix 3). The hologram-based adhesion score showed a strong correlation with intraoperative findings. Among the 20 cases evaluated, 14 cases with hologram score 0 corresponded to intraoperative score 0, while 6 cases with hologram score 1 matched intraoperative score 1, demonstrating excellent agreement (r=0.786; P<.001; 95% CI 0.53-0.92). A second blinded evaluation was conducted two months later to assess repeatability. The intrarater reliability, measured by the κ coefficient, was 0.85, indicating strong consistency in the evaluation results.

Figure 9. Visualization images of pericardial adhesions. (A) Patient number 6, scheduled for first-time CABG, exhibits significant relative motion between the pericardium and EAT, suggesting the absence of pericardial adhesions. (B) Patient number 7, who underwent left ventricular outflow tract unblocking, mitral valve replacement, and CABG one year ago, demonstrates poor relative motion between the pericardium and EAT, indicating the presence of pericardial adhesions, consistent with intraoperative findings. (C) Patient number 2, who had an aortic valve replacement one year prior, shows extensive pericardial adhesions in the operative report, but the hologram pericardial adhesion score is rated as 0, suggesting no adhesions. CABG: coronary artery bypass graft; EAT: epicardial adipose tissue.

Principal Findings

Holograms have demonstrated the ability to provide realistic depth perception, enhancing the intuitive understanding of a patient’s 3D anatomy. However, the complexity of current hologram production methods has limited the widespread adoption of this technology in routine clinical practice. In addition, existing head-mounted display devices are often uncomfortable and can hinder effective communication among health care team members. This study presents an approach to use real patient volumetric data—specifically 4D-CCTA—to generate high-quality, naked-eye–viewable, 3D, color dynamic holograms relevant to CABG surgery. This visualization tool eliminates the need for clinicians to rely on personal spatial imagination to synthesize relevant anatomical information. Instead, it offers a more intuitive, comprehensive, and vivid representation of the data required for preoperative CABG planning. The holograms can be simultaneously viewed and discussed by multiple surgeons or with patients, without the need for headgear. Unlike most existing cardiac and coronary models, this study introduces a specialized modeling framework tailored for CABG preoperative planning. It includes a dynamic representation of the pericardium, heart, and coronary arteries, all derived from the patient’s 4D-CCTA data. Presenting volumetric patient data as dynamic, multicolor, and internet-based holograms represents a potential advancement in cardiac medical imaging. This study outlines the fabrication process, structural framework, and preliminary feasibility assessment.

The preprocessing time for each patient dataset requires approximately 15 min, making it clinically feasible for use in preoperative planning. However, coronary artery segmentation remains the most time-consuming and technically challenging component—especially in patients with advanced CAD. In cases of significant vessel occlusion or calcification, which are common among CABG candidates, automated segmentation methods often require manual refinement to ensure clinical accuracy. This limitation is well recognized in the field and represents a key area for future algorithmic development.

In this study, the EAT, pericardium, and coronary arteries were segmented to characterize their relative motion and structural features in order to extract clinically relevant information regarding coronary artery depth and pericardial adhesions. Pericardial adhesions increase both the difficulty and risk of minimally invasive or median sternotomy procedures and must be identified preoperatively. Currently, pericardial adhesions are typically evaluated using ultrasonography, which detects motion discrepancies between the pericardium and outer myocardium, or CT imaging, which assesses changes in pericardial density [23]. However, thickening of the pericardium on CT does not reliably correlate with adhesions, and although ultrasonography can reveal relative motion, it lacks 3D detail and fails to provide a comprehensive view of adhesion location relative to the coronary arteries. Another significant challenge is assessing the depth of coronary artery travel within the EAT. This is clinically important because intraoperative identification of deeply embedded coronary arteries can be difficult. Accurately obtaining this anatomical information preoperatively can significantly inform the selection of an anastomotic site during surgery. CCTA is currently the preferred modality for evaluating EAT [24]. Traditionally, EAT has been studied in terms of its volume or composition to explore its relationship with the progression of CAD [25]; however, these approaches offer limited insight into spatial relationships relevant for surgical planning. In this study, we dynamically fused models of epicardial fat and coronary arteries to represent their positional relationship and visualize the depth trends of the coronary arteries. Combined with a holographic display, this approach achieved the intended visualization effect. The accuracy of coronary artery depth representation was supported by comparison with intraoperative findings. Furthermore, the strong correlation between preoperative holographic assessments of pericardial adhesions and intraoperative scores provides preliminary validation of the system’s clinical reliability.

Comparison With Previous Work

Several research teams have explored the application of holographic imaging technology in the medical field. Our work shares some commonalities with these studies but also presents significant innovations.

Tanwani et al [26] developed a head-mounted holographic needle guidance system for enhanced ultrasound-guided neuraxial anesthesia. They used the Microsoft HoloLens mixed reality headset to project a hologram of the ideal needle path, helping operators replicate the correct needle angulation. While this work demonstrated the value of holographic technology in surgical navigation, its primary focus was on visualizing a single surgical path, whereas our system provides a dynamic holographic representation of the complete cardiac anatomy, including the complex spatial relationships between coronary arteries and surrounding tissues. Liu et al [27] demonstrated in a randomized controlled trial how 3D holograms with mixed reality techniques can improve medical professionals’ understanding of pulmonary lesions caused by COVID-19. Their study showed that holographic visualization significantly enhanced physicians’ ability to identify lung lesions compared to traditional 2D CT, especially for medical students and nonspecialist doctors. This aligns with our findings that holographic visualization can bridge gaps in specialist knowledge, but our work further extends this concept by transforming static anatomical structures into dynamic visualizations that capture anatomical changes throughout the cardiac cycle. Parekh et al [28] developed a method for depth estimation and visualization of dermatological lesions, using neural networks and explainable AI for lesion classification, and holographic projection to display lesion depth. Their work focused on generating 3D holograms from 2D images, while our approach directly uses 4D CT data to capture the dynamic nature of the heart, providing surgeons with more comprehensive anatomical information.

Compared with these previous works, our research demonstrates innovation in several key areas: (1) dynamic visualization: our system not only displays static anatomical structures but captures the dynamic changes of coronary arteries throughout the cardiac cycle, which is crucial for CABG surgical planning. (2) Naked-eye holographic technology: unlike solutions requiring specialized headsets, our system allows multiple clinicians to simultaneously view and interact with the same anatomical structure, facilitating collaborative discussion among the surgical team. (3) Enhanced depth perception: we specifically focus on the depth variations of coronary arteries within epicardial fat tissue, critical information that traditional imaging methods struggle to adequately display and which has significant value for CABG surgical planning. These innovations make our holographic system a powerful tool not only for assisting surgeons in CABG surgical planning but also as a bridge for doctor-patient communication, helping patients and their families better understand the necessity and potential risks of surgery.

Limitations

First, our initial assessments were subjective and qualitative in nature and, therefore, not amenable to rigorous statistical analysis. Although clinician feedback was generally positive, we did not use validated quantitative metrics to compare the utility of the holographic visualization with conventional imaging techniques. Future studies should incorporate standardized assessment tools and objective performance measures to quantitatively evaluate the impact of holographic visualization on surgical planning and clinical outcomes.

Second, we did not perform quantitative analyses of calcified plaques, coronary artery travel depth, or pericardial–cardiac motion differentials. While we strived to maintain data fidelity throughout the visualization pipeline, it is important to recognize that the segmentation process inherently introduces variability and potential distortion. This may be influenced by factors such as the choice of segmentation algorithms, parameter settings, and manual corrections. Although experienced radiologists reviewed all segmentations to ensure clinical accuracy, this oversight does not entirely eliminate the risk of error. These limitations may have affected the accuracy of the spatial relationships depicted in our holograms.

Third, we did not quantify segmentation error or validate the geometric accuracy of our models against the original source data, which represents a significant limitation of the current methodology. Future work should include rigorous validation of segmentation accuracy and quantification of model fidelity relative to the source CT data to better understand clinical reliability.

Fourth, due to the limitations of current CT imaging, coronary stenosis still requires coronary angiography as the clinical “gold standard.” While our approach integrates information from both CCTA and angiography, it does not yet match the diagnostic accuracy of invasive angiography for stenosis assessment. Future iterations could address this limitation by incorporating computational fluid dynamics to better evaluate the functional severity of stenosis.

Fifth, this study represents only a preliminary feasibility assessment of holographic visualization. We did not conduct quantitative or comparative studies of procedures performed using conventional imaging alone versus those supported by holographic assistance. Such comparative studies are essential to determine the practical utility, effectiveness, and broader applicability of holographic imaging in real-world clinical settings.

Future Perspectives

The potential impact of holographic technology on medical imaging is substantial, particularly in the context of minimally invasive surgery. These procedures involve small incisions and a limited field of view, making a clear understanding of patient-specific spatial anatomy crucial. In future studies, we plan to further investigate the use of holographic imaging systems for preoperative planning in minimally invasive cardiac surgery. This includes integrating internet-based tools and hemodynamic analyses and exploring the possibility of overlaying holograms onto the real intraoperative environment with internet-based manipulation for real-time surgical guidance.

Conclusions

This study presents a structural framework for a visualization tool specifically designed for preoperative planning of CABG procedures. By leveraging patient-derived volumetric data, the system generates potentially clinically relevant, dynamic holograms that provide depth perception, detailed coronary stenosis and calcification information, alignment depth data, and 4D spatial insights. Clinician feedback was positive, supporting the tool’s potential utility for preoperative planning. The system also shows promise for applications in medical education, including surgical demonstrations for interns and preoperative education for patients. While further development and validation are needed, this work represents an important step toward enhancing visualization capabilities in cardiac surgical planning.

Authors' Contributions

SW and TR contributed equally to this work, both as the first authors. LZ is the co-corresponding author and can be reached via email at ZZhanggLi@hotmail.com or by phone at +86 13910686306.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Holographic experience reviews.

DOC File, 47 KB

Multimedia Appendix 2

Dynamic display of typical application scenarios of the holographic viewing system. Contains 4D chest scenes of the heart, coronary arteries, internal mammary arteries, aortic valves, ribs, spine, sternum, and diaphragm.

MP4 File, 194255 KB

Multimedia Appendix 3

Dynamic demonstration of typical different pericardial adhesions.

MP4 File, 40975 KB

  1. GBD 2021 Forecasting Collaborators. Burden of disease scenarios for 204 countries and territories, 2022-2050: a forecasting analysis for the Global Burden of Disease Study 2021. Lancet. May 18, 2024;403(10440):2204-2256. [CrossRef] [Medline]
  2. Baibhav B, Gedela M, Moulton M, et al. Role of invasive functional assessment in surgical revascularization of coronary artery disease. Circulation. Apr 17, 2018;137(16):1731-1739. [CrossRef] [Medline]
  3. Lawton JS, Tamis-Holland JE, Bangalore S, et al. 2021 ACC/AHA/SCAI guideline for coronary artery revascularization: executive summary: a report of the American College of Cardiology/American Heart Association Joint Committee on Clinical Practice Guidelines. Circulation. Jan 18, 2022;145(3). [CrossRef] [Medline]
  4. Niederer SA, Lumens J, Trayanova NA. Computational models in cardiology. Nat Rev Cardiol. Feb 2019;16(2):100-111. [CrossRef] [Medline]
  5. Corral-Acero J, Margara F, Marciniak M, et al. The “Digital Twin” to enable the vision of precision cardiology. Eur Heart J. Dec 21, 2020;41(48):4556-4564. [CrossRef] [Medline]
  6. Bindschadler M, Buddhe S, Ferguson MR, Jones T, Friedman SD, Otto RK. HEARTBEAT4D: an open-source toolbox for turning 4D cardiac CT into VR/AR. J Digit Imaging. Dec 2022;35(6):1759-1767. [CrossRef] [Medline]
  7. Tsai TY, Kageyama S, He X, et al. Feasibility and accuracy of real-time 3D-holographic graft length measurements. Eur Heart J Digit Health. Jan 2024;5(1):101-104. [CrossRef] [Medline]
  8. Sadeghi AH, Taverne Y, Bogers A, Mahtab EAF. Immersive virtual reality surgical planning of minimally invasive coronary artery bypass for Kawasaki disease. Eur Heart J. Sep 7, 2020;41(34):3279-3279. [CrossRef] [Medline]
  9. Blinder D, Ahar A, Bettens S, et al. Signal processing challenges for digital holographic video display systems. Signal Processing: Image Communication. Feb 2019;70:114-130. [CrossRef]
  10. Bruckheimer E, Rotschild C, Dagan T, et al. Computer-generated real-time digital holography: first time use in clinical medical imaging. Eur Heart J Cardiovasc Imaging. Aug 2016;17(8):845-849. [CrossRef] [Medline]
  11. Jung C, Wolff G, Wernly B, et al. Virtual and augmented reality in cardiovascular care: state-of-the-art and future perspectives. JACC Cardiovasc Imaging. Mar 2022;15(3):519-532. [CrossRef] [Medline]
  12. Bruckheimer E, Rotschild C. Holography for imaging in structural heart disease. EuroIntervention. May 17, 2016;12 Suppl X(X):X81-X84. [CrossRef] [Medline]
  13. Deliver the best 3D experience. Looking Glass Factory. URL: https://lookingglassfactory.com/ [Accessed 2025-04-18]
  14. Cardoso MJ, Li W, Brown R, et al. MONAI: an open-source framework for deep learning in healthcare. arXiv. Preprint posted online on Nov 4, 2022. [CrossRef]
  15. Kong F, Shadden SC. Learning whole heart mesh generation from patient images for computational simulations. IEEE Trans Med Imaging. Feb 2023;42(2):533-545. [CrossRef] [Medline]
  16. Pak DH, Liu M, Kim T, et al. Patient-specific heart geometry modeling for solid biomechanics using deep learning. IEEE Trans Med Imaging. Jan 2024;43(1):203-215. [CrossRef] [Medline]
  17. Updegrove A, Wilson NM, Merkow J, Lan H, Marsden AL, Shadden SC. SimVascular: an open source pipeline for cardiovascular simulation. Ann Biomed Eng. Mar 2017;45(3):525-541. [CrossRef] [Medline]
  18. Agatston AS, Janowitz WR, Hildner FJ, Zusmer NR, Viamonte M, Detrano R. Quantification of coronary artery calcium using ultrafast computed tomography. J Am Coll Cardiol. Mar 15, 1990;15(4):827-832. [CrossRef] [Medline]
  19. Fiz F, Morbelli S, Piccardo A, et al. 18F-NaF uptake by atherosclerotic plaque on PET/CT imaging: Inverse correlation between calcification density and mineral metabolic activity. J Nucl Med. Jul 2015;56(7):1019-1023. [CrossRef] [Medline]
  20. Fedorov A, Beichel R, Kalpathy-Cramer J, et al. 3D Slicer as an image computing platform for the Quantitative Imaging Network. Magn Reson Imaging. Nov 2012;30(9):1323-1341. [CrossRef] [Medline]
  21. Nerlekar N, Baey YW, Brown AJ, et al. Poor correlation, reproducibility, and agreement between volumetric versus linear epicardial adipose tissue measurement: a 3D computed tomography versus 2D echocardiography comparison. JACC Cardiovasc Imaging. Jul 2018;11(7):1035-1036. [CrossRef] [Medline]
  22. Avants BB, Tustison NJ, Song G, Cook PA, Klein A, Gee JC. A reproducible evaluation of ANTs similarity metric performance in brain image registration. Neuroimage. Feb 1, 2011;54(3):2033-2044. [CrossRef] [Medline]
  23. Lin J, Li M, Huang Y, et al. Evaluation of pericardial thickening and adhesion using high-frequency ultrasound. J Am Soc Echocardiogr. Aug 2023;36(8):841-848. [CrossRef] [Medline]
  24. Guglielmo M, Lin A, Dey D, et al. Epicardial fat and coronary artery disease: role of cardiac imaging. Atherosclerosis. Mar 2021;321:30-38. [CrossRef] [Medline]
  25. Iacobellis G. Epicardial adipose tissue in contemporary cardiology. Nat Rev Cardiol. Sep 2022;19(9):593-606. [CrossRef] [Medline]
  26. Tanwani J, Alam F, Matava C, et al. Development of a head-mounted holographic needle guidance system for enhanced ultrasound-guided neuraxial anesthesia: system development and observational evaluation. JMIR Form Res. Jun 23, 2022;6(6):e36931. [CrossRef] [Medline]
  27. Liu S, Xie M, Zhang Z, et al. A 3D hologram with mixed reality techniques to improve understanding of pulmonary lesions caused by COVID-19: randomized controlled trial. J Med Internet Res. Sep 10, 2021;23(9):e24081. [CrossRef] [Medline]
  28. Parekh P, Oyeleke R, Vishwanath T. The depth estimation and visualization of dermatological lesions: development and usability study. JMIR Dermatol. Dec 18, 2024;7(PMID):e59839. [CrossRef] [Medline]


4D-CCTA: 4D cardiac computed tomography angiography
CABG: coronary artery bypass grafting
CAD: coronary artery disease
CCTA: cardiac computed tomography angiography
CT: computed tomography
CTA: computed tomography angiography
EAT: epicardial adipose tissue
MONAI: Medical Open Network for Artificial Intelligence
MRI: magnetic resonance imaging
VR: virtual reality


Edited by Andrew Coristine; submitted 06.Feb.2025; peer-reviewed by Maciej Stanuch, Oliver Wieben, Raffaella Motta; final revised version received 26.May.2025; accepted 27.May.2025; published 30.Sep.2025.

Copyright

© Shuo Wang, Tong Ren, Nan Cheng, Li Zhang, Rong Wang. Originally published in JMIR Medical Informatics (https://medinform.jmir.org), 30.Sep.2025.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on https://medinform.jmir.org/, as well as this copyright and license information must be included.