Ex-vivo and live animal models are equally effective training for the management of a penetrating cardiac injury
© The Author(s). 2016
Received: 2 July 2016
Accepted: 19 August 2016
Published: 31 August 2016
Live tissue models are considered the most useful simulation for training in the management for hemostasis of penetrating injuries. However, these models are expensive, with limited opportunities for repetitive training. Ex-vivo models using tissue and a fluid pump are less expensive, allow repetitive training and respect ethical principles in animal research. The purpose of this study is to objectively evaluate the effectiveness of ex-vivo training with a pump, compared to live animal model training. Staff surgeons and residents were divided into live tissue training and ex-vivo training groups. Training in the management of a penetrating cardiac injury was conducted for each group, separately. One week later, all participants were formally evaluated in the management of a penetrating cardiac injury in a live animal.
There are no differences between the two groups regarding average years of experience or previous trauma surgery experience. All participants achieved hemostasis, with no difference between the two groups in the Global Rating Scale score (ex-vivo: 25.2 ± 6.3, live: 24.7 ± 6.3, p = 0.646), blood loss (1.6 ± 0.7, 2.0 ± 0.6, p = 0.051), checklist score (3.7 ± 0.6, 3.6 ± 0.9, p = 0.189), or time required for repair (101 s ± 31, 107 s ± 15, p = 0.163), except overall evaluation (3.8 ± 0.9, 3.4 ± 0.9, p = 0.037). The internal consistency reliability and inter-rater reliability in the Global Rating Scale were excellent (0.966 and 0.953 / 0.719 and 0.784, respectively), and for the checklist were moderate (0.570 and 0.636 / 0.651 and 0.607, respectively). The validity is rated good for both the Global Rating Scale (Residents: 21.7 ± 5.6, Staff: 28.9 ± 4.7, p = 0.000) and checklist (Residents: 3.4 ± 0.9, Staff Surgeons: 3.9 ± 0.3, p = 0.003). The results of self-assessment questionnaires were similarly high (4.2–4.9) with scores in self-efficacy increased after training (pre: 1.7 ± 0.8, post: 3.2 ± 1.0, p = 0.000 in ex-vivo, pre: 1.9 ± 1.0, post: 3.7 ± 0.7, p = 0.000 in live). Scores comparing pre-training and post-evaluation (pre: 1.7 ± 0.8, post: 3.7 ± 0.9, p = 0.000 in ex-vivo, pre: 1.9 ± 1.0, post: 3.8 ± 0.7, p = 0.000 in live) were increased.
Training with an ex-vivo model and live tissue training are similar for the management of a penetrating cardiac injury, with increased self-efficacy of participants in both groups. The ex-vivo model is useful to learn hemostatic skills in trauma surgery.
KeywordsTrauma surgery Ex-vivo training Surgical education Simulation Objective Structured Assessment of Technical Skills Self-efficacy
Simulation training is essential for learning a variety of skills in medical training. Concerns for patient safety and super-specialization have increased the need for simulation-based training. Simulation training for hemostasis in trauma surgery is especially desired because hemostasis is critical to save severely injured patients and there are limited opportunities for surgeons to learn the skills needed to treat traumatically injured patients in clinical practice [1, 2]. The number of surgical procedures performed by trainees has been decreasing with advancements in non-operative management . Various simulation courses are conducted around the world in part to make up for limited real-life experience [3–5].
Live tissue training is considered by some to be the most useful simulation for training in the hemostasis of traumatic injuries [6, 7]. However, these programs are expensive, repetitive training is impractical, and ethical issues regarding the use of live animals have gained intense focus . These factors limit the conduct of live tissue training programs. Other methods, such as cadaver training, virtual reality and bench model training, are less suitable for training in hemostatic skills because of decreased reality or a total lack of bleeding [6, 7].
Ex-vivo tissue can be used for simulation training for technical skills [8, 9]. It is generally considered to have mid-level fidelity, is financially reasonable and conducive to repetitive training. We previously conducted a pilot study in the use of a circulation pump for ex-vivo training in trauma surgery, with subjective evaluation . The pump mimics circulation, and appears similar to live tissue. However, objective assessment of this method has not been conducted.
The purpose of this study is to objectively evaluate the effectiveness of ex-vivo training with a pump, compared to live tissue training, for the management of a penetrating cardiac injury.
Institutional Animal Experiment Committee approval was obtained before beginning this study. This study was conducted in the Center for Development of Advanced Medical Technology (CDAMtec) at Jichi Medical University.
Staff surgeons and residents at Jichi Medical University Hospital took part in this study. This program was the first time any of the participants managed a penetrating cardiac injury. Participants were surveyed regarding their level of training, years of experience and details of their previous trauma surgery experience.
One week after the training session, all participants managed a standard one centimeter penetrating cardiac wound in a live animal using the skills acquired during the previous training session. Each participant managed the wound individually, and was assessed with an Objective Structured Assessment of Technical Skills (OSATS) instrument. After the evaluation, a post-evaluation survey form was completed by the participants (Fig. 3).
Ex-vivo training session (Fig. 4)
Live tissue training session (Fig. 5)
Participants were evaluated by direct observation in their management of a cardiac injury in the live animal model conducted one week after the training session. The animals were the same type and size used in the training session. The evaluation session was conducted similarly for all participants. Four evaluators assessed each participant, and completed an evaluation form using the OSATS instrument. The time required to repair the injury by each of the participants was recorded. The evaluators were blinded to whether participants had undergone training with live tissue or an ex-vivo model.
There were six evaluators in total, and four of the six assessed the performance of each participant using the OSATS. Two of the six were experienced surgeons with more than 25y experience in acute care surgery. Two were board certified surgeons and others included an experienced veterinarian, and an experienced veterinary technician with more than 30 years of experience in veterinary care and surgery.
Reliability and validity of the OSATS were evaluated in this study. The internal consistency reliability was analyzed by Cronbach’s α. The inter-rater reliability was analyzed by inter-class correlation. The validity was evaluated by comparing the outcome of the Global Rating Scale (as the sum of the seven component scores, each score range 1–5, overall range 7–35) and checklist score (4 items scored 0 or 1, overall range 0–4) of staff surgeons and residents, using a sum of the scores.
Participants completed questionnaires at three separate time points: pre-training post-training and post-evaluation. The questionnaires utilized a five point Likert scale (1 = poor ~ 5 = excellent) and included an assessment of self-efficacy (self-confidence) (Figs. 2 and 3).
Data were analyzed with SPSS (IBM, Armonk NY) version 22.0. Continuous variables are presented as means with standard deviations. Mann Whitney’s U test is used for continuous variables because most data were non-normal distributions. Wilcoxon signed-rank test is used for paired continuous variables. Inter-class correlation is used for the assessment of inter-rater reliability. Statistical significance was set at a P-value less than .05.
Characteristics of study participants: years after medical school graduation and previous experience in trauma surgery
Study group (n = number of participants)
(n = 16; residents 9, Staff Surgeons 7)
(n = 15; residents 8, Staff Surgeons 7)
Years after medical school graduation (mean years (Standard Deviation))
Prior experience in chest and abdominal trauma surgery (mean number of procedures (Standard Deviation))
Evaluation of management of a penetrating cardiac injury
Global Rating Scale score, amount of hemorrhage, overall evaluation, checklist and time required to repair comparing ex-vivo and live tissue groups
Study group (n = number of evaluation forms)
Ex-vivo (n = 64)
Live tissue (n = 60)
Global Rating Scale (sum of scores for seven items, Range 7–35)
Amount of hemorrhage (Range 1–3)
Time required (seconds)a
101 (31), n=16
107 (15), n=15
Internal consistency reliability and inter-rater reliability of Global Rating Scale and checklist scores
Internal consistency reliability, Cronbach’s α (Seven items)
Global Rating Scale
Inter-rater reliability, inter-class correlation score (Four evaluators)
Global Rating Scale
Validity of Global Rating Scale and checklist scores: Residents and staff surgeons, four evaluations for each participant (Mann–Whitney U test)
Group (n = number of evaluation forms)
Residents (n = 68)
Staff surgeons (n = 56)
Global Rating Scale (mean and standard deviation, sum of seven scores each score range 1–5, with overall range 7–35)
Checklist score (range 0–4)
Study group (n = number of participants)
Ex-vivo (n = 16)
Live tissue (n = 15)
I am looking forward to this training.
I am interested in trauma surgery.
I am confident in performing hemostatic procedures for a cardiac injury.
Post training and post evaluation questionnaires
Study group (n = number of participants)
Ex-vivo (n = 16)
Live tissue (n = 15)
I am satisfied with this training.
My interest in trauma care has increased.
I am confident to perform hemostatic procedures for a cardiac injury.
I would recommend this training to my colleagues.
I obtained new knowledge and skills to achieve hemostasis of a cardiac injury.
I would like to repeat this training.
Confidence level comparing pre-training, post-training and post-evaluation
Study group (n = number of participants)
(n = 31)
(n = 31)
(n = 31)
3.2 (1.0), p = 0.00
3.7 (0.9), p = 0.00
3.7 (0.7), p = 0.00, p** < .05
3.8 (0.7), p = 0.00
Interestingly, after the training session, the live tissue group had significantly more self-confidence (score 3.7) than the ex-vivo (score 3.2, p < .05) trained group. However, after the evaluation session, while the self-confidence of both groups was significantly greater compared to pre-training, there was no longer a difference in the self-confidence level of the two groups.
We conducted training using an ex-vivo model with a pump, and compared it with use of a live animal model to teach the management of penetrating cardiac injuries. After training, all participants were objectively evaluated in their management of a penetrating cardiac injury. All participants were able to achieve hemostasis at the injury site on the surface of the right ventricle. Objective assessment revealed that ex-vivo training was as effective as live tissue training, based on the evaluation conducted. The reliability and validity of the OSATS instrument were good. Participant responses to subjective questionnaires were positive and the level of self-efficacy increased.
Live tissue training is considered by some to be the most effective way to learn hemostatic skills for trauma surgery [6, 7]. Other training models, such as cadaver training, bench model training, or virtual reality training, do not have active blood circulation to mimic live tissue training. However, the ex-vivo system used in this study simulates active bleeding with an external pump which facilitates learning hemostatic procedures in a more realistic environment without a live animal .
Ethical issues regarding the use of experimental animals are also important  and ex-vivo training models are a good response to these ethical issues. Burch and Russel proposed the 3R’s for animal ethics , including Reduction, Replacement and Refinement. Although cadaver training and virtual reality training are beneficial from an ethical standpoint, these models may not be suitable for learning hemostatic skills. There are few studies comparing the effectiveness of training using these modalities with training using a live animal model . The ex-vivo model described here using a pump provides the opportunity to learn hemostatic skills in trauma surgery with objective results similar to training with a live animal and respects the principles represented by the 3R’s.
Although we did not calculate exact costs in this study, estimates can be made, based on average charges at our institution. The direct cost of the ex-vivo training is the facility fee and the price of the sutures. The facility fee is equivalent to the electrical charges of the circulation pump and the refrigerator for preservation of the harvested organs, which we estimate to about US$20 for one session. The sutures cost about US$50 per session, for a total cost of about US$70. Live tissue training requires the cost of the pig, the fee for general anesthesia, and the sutures. The pig costs about US$1800, and the cost of anesthesia and the facility fee is about US$300 for a total cost of about US$2150, with the sutures. While these are only estimates, the cost of live tissue training is far greater than ex-vivo training.
One factor which influences the results of the objective evaluation is the size of the penetrating cardiac injury. The amount of hemorrhage was not excessive because the stab wound was just one centimeter long. It was relatively easy to stop the bleeding. If the injury were larger, hemostasis would be more difficult and a greater difference in results may have been observed. Another important factor is the location of the wound in the heart, which directly affects the ease of achieving hemostasis. If the injury was created in the left atrium, the results may have been different. Manipulation of an ex-vivo heart during the procedure does not have a physiologic effect, limiting the reality of the simulation.
The overall evaluation of the ex-vivo group was statistically significantly higher than that of the live tissue group. Among other evaluation items, such as amount of hemorrhage and time required to repair, there was no significant difference between the two groups, but the mean scores of the ex-vivo group are higher than those of the live tissue group, though the characteristics of participants are similar in both groups. The pressure of the bleeding with the ex-vivo model, seemed higher than that in the live tissue model according to some participants , and might influence the difference in scores. The impression of higher pressure bleeding with the ex-vivo model might give participants the impression that repair of the injury in the live tissue model is easier than during the training session.
The OSATS instrument had good reliability and validity and was useful as an evaluation tool. OSATS is widely used for the evaluation of technical skills in simulation [10, 11, 13–16]. The internal consistency reliability and inter-rater reliability analysis of the Global Rating Scale were high and those for the checklist were moderate. The validity was evaluated by comparing the results of residents and staff surgeons, and a significant difference was observed, which means that the OSATS used in this study can identify differences between the study groups. Overall, the evaluation tools demonstrated that training with this ex-vivo model is as useful as live tissue training for the management of a penetrating cardiac injury in a porcine model simple.
The subjective evaluations also revealed the usefulness of training with this ex-vivo model. All responses to items in the questionnaires showed that the training was perceived well by the participants. Self-confidence in both groups significantly increased after the training. Self-confidence carries the same meaning as self-efficacy, which was advocated by Bandura in 1977 . Bandura described that self-efficacy means”people’s judgments of their capabilities to organize and execute courses of action required to attain designated types of performances .” In other words, it is a belief that one can accomplish a specific task. Self-efficacy is a very important characteristic for physicians and surgeons who perform procedures , particularly in emergency situations [20, 21]. Training with the ex-vivo model significantly increased the self-efficacy of participants for the repair of a penetrating cardiac injury. It was of interest that the increased self-efficacy in the live tissue trained group compared to the ex-vivo group was not sustained. Self-efficacy of the two groups was equal after the evaluation session.
This training is suitable for resident training as it facilitates repetitive practice. Aboud et al. reported that cadaver training for placement of an Intra-Aortic Balloon can be performed with a fluid pump to mimic circulation , but based on the description of the procedure, is far more complex than the system employed in this training program. This ex-vivo model is reasonable and needs less work to perform the training.
There are some limitations to this study. First, hemostasis is just one factor in the care of trauma patients. There are other technical skills required to save patients with penetrating cardiac injuries, such as performing a thoracotomy or median sternotomy to gain access to the injury site. Decision making and team dynamics for trauma are extremely important in emergency care. This ex-vivo training does not provide training for all of the requisite skills. Actual patient care experience in clinical practice is essential. There are a number of formal training programs to teach skills needed in the care of trauma patients. Second, the physical features of live tissue cannot be reproduced completely with this ex-vivo model, such as coagulation and motion of the heart. Third, a complex injury cannot be simulated using this ex-vivo model. Management of a single type of injury is a limitation using this model and this level of fidelity is suitable for learning basic procedures in trauma surgery. Fourth, the sample size is somewhat small. As Table 1 shows, there are differences between the two groups for time since graduation and prior experience (number of procedures) in chest and abdominal trauma surgery. While the differences are not significant, a significant difference may be identified with a larger sample size. Power analysis shows that the sample size required is 186 (α = 0.05, 1-β = 0.8), supporting the need for further study of the ex-vivo model.
Although this ex-vivo model has some limitations, simulation is an important modality in training for the care of injured patients. Utilizing this ex-vivo model is intended to bolster the competence of surgeons, and will hopefully lead to the increased survival of severely injured patients.
Ex-vivo training with a pump was as useful as live tissue training to learn hemostatic techniques for a penetrating cardiac injury. This training increased the self-efficacy of participants, and objective scores of results showed no differences for training with an ex-vivo model or live tissue. This study supports the use of ex-vivo models for training in hemostasis, at lower cost and respecting the principle of 3R’s for animal research.
Some part of this study was presented in the 10th Annual Congress of Korean Society of Acute Care Surgery, 4th Joint Scientific Congress of KSACS and JSACS in Busan, Republic of Korea on April 9th, 2016.
This study was supported by the Ministry of Education, Culture, Sports, Science and Technology (MEXT)-Supported Program for the Strategic Research Foundation at Private Universities.
Availability of data and materials
YI: Conceived the trial, conducted the training, collected and analyzed data, prepared the manuscript. SH: Conducted the training, collected data. TM: Collected the data. KY: Collected the data. HM: Collected data. MS: Conceived the trial. AKL: Conceived the trial, analyzed the data, preparation of manuscript. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
The approval of the Institutional Animal Experiment Committee of Jichi Medical University was obtained before beginning this study (reference No.14-026 and No.15-233).
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Spain DA, Miller FB. Education and training of the future trauma surgeon in acute care surgery: trauma, critical care, and emergency surgery. Am J Surg. 2005;190:212–7.View ArticlePubMedGoogle Scholar
- Fakhry SM, Watts DD, Michetti C, Hunt JP, EAST Multi-Institutional Blunt Hollow Viscous Injury Research Group. The resident experience on trauma: declining surgical opportunities and career incentives? Analysis of data from a large multi-institutional study. J Trauma. 2003;54:1–7.View ArticlePubMedGoogle Scholar
- Jacobs LM, Burns KJ, Luk SS, Marshall 3rd WT. Follow-up survey of participants attending the Advanced Trauma Operative Management (ATOM) Course. J Trauma. 2005;58:1140–3.View ArticlePubMedGoogle Scholar
- Jacobs L, Burns K, Luk S, Hull S. Advanced trauma operative management course: participant survey. World J Surg. 2010;34:164–8. doi:10.1007/s00268-009-0276-z.View ArticlePubMedGoogle Scholar
- Kuhls DA, Risucci DA, Bowyer MW, Luchette FA. Advanced surgical skills for exposure in trauma: a new surgical skills cadaver course for surgery residents and fellows. J Trauma Acute Care Surg. 2013;74:664–70. doi:10.1097/TA.Ob013e31827d5e20.View ArticlePubMedGoogle Scholar
- Reznick RK, MacRae H. Teaching surgical skills – change in the wind. N Engl J Med. 2006;355:2664–9.View ArticlePubMedGoogle Scholar
- Stefanidis D, Yonce TC, Green JM, Coker AP. Cadavers versus pigs: which are better for procedural training of surgery residents outside the OR? Surgery. 2013;154:34–7. doi:10.1016/j.surg.2013.05.001.View ArticlePubMedGoogle Scholar
- Izawa Y, Hishikawa S, Muronoi T, Yamashita K, Suzukawa M, Lefor AT. Ex-vivo porcine organs with a circulation pump are effective for teaching hemostatic skills. World J Emerg Surg. 2012;7:5. doi:10.1186/1749-7922-7-5.View ArticlePubMedPubMed CentralGoogle Scholar
- Thomas MB, Dandolu V, Caputo P, Milner R, Hernandez E. Resident education in principles and technique of bowel surgery using an ex-vivo porcine model. Obstet Gynecol Int. 2010;2010:852647. doi:10.1155/2010/852647.View ArticlePubMedPubMed CentralGoogle Scholar
- Steigerwald SN, Park J, Hardy KM, Gillman L, Vergis AS. Establishing the concurrent validity of general and technique-specific skills assessments in surgical education. Am J Surg. 2016;211:268–73. doi:10.1016/j.amjsurg.2015.04.024.View ArticlePubMedGoogle Scholar
- van Hove PD, Tuijthof GJ, Verdaasdonk EG, Stassen LP, Dankelman J. Objective assessment of technical surgical skills. Br J Surg. 2010;97:972–87. doi:10.1002/bjs.7115.View ArticlePubMedGoogle Scholar
- Russell WMS, Burch RL. The Principles of Humane Experimental Technique. London: Methuen and Co. Ltd.; 1959.Google Scholar
- Martin JA, Regehr G, Reznick R, MacRae H, Murnaghan J, Hutchison C, Brown M. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg. 1997;84:273–8.View ArticlePubMedGoogle Scholar
- Faulkner H, Regehr G, Martin J, Reznick R. Validation of an objective structured assessment of technical skill for surgical residents. Acad Med. 1996;71:1363–5.View ArticlePubMedGoogle Scholar
- Reznick R, Regehr G, MacRae H, Martin J, McCulloch W. Testing technical skill via an innovative ‘bench station’ examination. Am J Surg. 1997;173:226–30.View ArticlePubMedGoogle Scholar
- Ault G, Reznick R, MacRae H, Leadbetter W, DaRosa D, Joehl R, et al. Exporting a technical skills evaluation technology to other sites. Am J Surg. 2001;182:254–6.View ArticlePubMedGoogle Scholar
- Bandura A. Self-efficacy: toward a unifying theory of behavioral change. Psychol Rev. 1977;84:191–215.View ArticlePubMedGoogle Scholar
- Bandura A. Social foundations of thought and action: a social cognitive theory. Englewood Cliffs: Prentice Hall; 1986.Google Scholar
- Artino Jr AR. Academic self-efficacy: from educational theory to instructional practice. Perspect Med Educ. 2012;1:76–85. doi:10.1007/s40037-012-0012-5.View ArticlePubMedPubMed CentralGoogle Scholar
- Hall AB, Riojas R, Sharon D. Comparison of self-efficacy and its improvement after artificial simulator or live animal model emergency procedure training. Mil Med. 2014;179:320–3. doi:10.7205/MILMED-D-12-00446.View ArticlePubMedGoogle Scholar
- Martinic G. The use of animals in live-tissue trauma training and military medical research. Lab Anim (NY). 2011;40:319–22. doi:10.1038/laban1011-319.View ArticleGoogle Scholar
- Aboud ET, Krisht AF, O'Keeffe T, Nader R, Hassan M, Stevens CM, Ali F, Luchette FA. Novel simulation for training trauma surgeons. J Trauma. 2011;71:1484–90. doi:10.1097/TA.0b013e3182396337.View ArticlePubMedGoogle Scholar