Skip to main content

Which appendicitis scoring system is most suitable for pregnant patients? A comparison of nine different systems

Abstract

Background

Acute appendicitis is the most common non-gynecological emergency during pregnancy. The diagnosis of appendicitis during pregnancy is challenging due to changes in both physiological and laboratory variables. Guidelines suggest patients with suspected acute appendicitis should be stratified based on clinical scoring systems, to optimize the use of diagnostic imaging and prevent unnecessary surgery. Surgeons require additional information beyond that provided by imaging studies before deciding upon exploratory laparoscopy in patients with a high suspicion of appendicitis. Various scoring methods have been evaluated for the diagnosis of acute appendicitis. However, there is no consensus on a method to use during pregnancy, and a detailed comparison of existing scoring methods for this purpose has not yet been conducted. The purpose of this study was to evaluate the efficacy of the most popular scoring systems applied to diagnose acute appendicitis during pregnancy.

Methods

This single-center retrospective study included 79 pregnant patients who were admitted to the emergency department with abdominal pain between May 2014 and May 2019. The patients were diagnosed with acute appendicitis and underwent an appendectomy. As a control group, the study also included 79 non-pregnant patients who underwent appendectomy within the last 1.5 years. To ensure that the groups were similar, women in the case group were stratified according to age, and the proportions of women in the strata were determined. The women in the control group were similarly stratified. Women were randomly selected from the strata to prevent bias.

Both laboratory and examination findings required for each scoring method were obtained and assessed separately for each patient. Negative appendectomy rates were evaluated according to pathology results. Categorical variables were compared using the chi-square test. A p value < 0.05 was considered to indicate significance. Receiver operator characteristic curve analysis was used to identify the best threshold value and to assess the performance of the test scores in terms of diagnosing appendicitis.

Results

Among all scoring systems, the Tzanakis score was most efficacious at predicting appendicitis in non-pregnant women. The positive predictive value (PPV) of the Tzanakis score was 90.6%, whereas the negative predictive value (NPV) was 46.7%. The RIPASA score performed the best among the scoring systems in pregnant women. It was associated with a PPV of 94.40%, NPV of 44%, and sensitivity and specificity of 78.46% and 78.57%, respectively.

Conclusion

Although the RIPASA score can be used to efficaciously diagnose acute appendicitis in pregnant women, a specific scoring system is needed for diagnosis during the gestation period.

Background

Acute appendicitis is the most common cause of non-obstetric emergency surgery in pregnant women. Appendicitis occurs in one out of 1500 pregnant women [1]. Furthermore, negative appendectomy rates in females of reproductive age are reported to be up to 26% [2]. The differential diagnosis of acute abdominal pain during pregnancy is more complicated than in typical patients. In addition to symptoms such as nausea, vomiting, and abdominal pain, which are common during pregnancy, an increased white blood cell (WBC) count and limited radiological methods complicate the diagnosis of acute appendicitis [3,4,5]. Unfortunately, negative appendectomy rates remain relatively high regardless of the testing conducted [6,7,8,9,10].

The main goals in the diagnosis of appendicitis are to reduce negative appendectomy rates, avoid perforation, and protect the patient from unnecessary surgical intervention. A meta-analysis reported that it is essential to make an exact diagnosis and avoid any delay therein [11]. However, another article reported that a delay in the diagnosis of uncomplicated appendicitis of up to 24 h is safe [12]. That article stated that non-operative management through antibiotic treatment is safe in cases of uncomplicated appendicitis. Unfortunately, the rates of abortion and preterm labor are significantly higher in women with appendicitis [13, 14]. Timely diagnosis is critical, as delays may lead to both maternal (1–4%) and fetal (1.5–35%) mortality due to perforation of the appendix [15]. To this end, various scoring methods have been developed based on imaging studies, clinical findings, and laboratory results [16,17,18,19,20,21,22,23,24]. The present study aimed to evaluate the extent to which these scoring methods are suitable for the diagnosis of appendicitis in pregnancy.

Methods

This study included 79 pregnant patients who were admitted to the Sakarya University Faculty of Medicine (Serdivan, Turkey) with abdominal pain between May 2014 and May 2019. The patients were diagnosed with acute appendicitis and underwent appendectomy. The study also included a control group of 79 non-pregnant patients who underwent appendectomy within the last 1.5 years. To ensure similar groups, women in the case group were stratified according to age, and the proportions of women in the strata were determined. The women in the control group were similarly stratified. Women were randomly selected from the strata to avoid possible bias. Patients under the age of 20 or older than 45 were excluded from the control group, as well as those with chronic co-morbidities (e.g., hypertension, diabetes mellitus, chronic renal failure, or chronic pulmonary disease). All pregnant patients were examined by the obstetrician both before and after surgery.

Nine appendicitis clinical score methods were used for evaluating the patients. These clinical scoring systems (CSS) included the Alvarado, Eskelinen, Ohmann, AIR, RIPASA, Tzanakis, Lintula, Fenyo-Lindberg, and Karaman systems. Laboratory data such as WBC count, neutrophil count, and C-reactive protein level were collected, as well as examination findings and symptoms. In an Excel file, formulas were prepared separately for each CSS, and the data obtained from each patient were entered into the file so that CSS scores were calculated automatically. A visual analog scale pain score was calculated for all patients hospitalized with a diagnosis of acute appendicitis, who were classified into mild, moderate, and severe pain subgroups according to the literature [25]. This helped with calculating the score for the Lintula system, in which the pain system was graded at three different levels. Negative appendectomy rates were evaluated according to pathology results. The ethics committee of our university approved the study.

Statistical analysis

Descriptive analyses were performed to provide information on the general characteristics of the study population. The Kolmogorov-Smirnov test was used to evaluate whether the distributions of numeric variables were normal. Accordingly, either independent sample t tests or Mann-Whitney U tests were used to compare the numeric variables between pregnant and non-pregnant patients. The numeric variables are presented as the mean ± standard deviation or medians with interquartile ranges in square brackets. Categorical variables were compared using chi-square tests. Categorical variables are presented as counts and percentages. A p value < 0.05 was considered to indicate significance. Receiver operating characteristic curve analysis was used to identify the optimal threshold values and assess the diagnostic performance of test scores for appendicitis. Analyses were performed using SPSS 22.0 statistical software (IBM Corp., Armonk, NY, USA).

Results

The median ages in the pregnant and non-pregnant groups were 28 and 26 years, respectively. The mean WBC counts in the pregnant and non-pregnant groups were 14.07 ± 4.5 and 13.43 ± 4.5, and the median C-reactive protein levels were 16.2 [55.03] and 7.64 [41.69] mg/dl, respectively. The left shift in neutrophils was significantly higher in the pregnant group than in the non-pregnant group; 47 (59.5%) vs. 23 (29.1%), respectively (p < 0.001). The median total bilirubin level was also significantly higher in the non-pregnant group than in the pregnant group; 0.59 [0.75] vs. 0.47 [0.33] mg/dl, respectively (p < 0.001; Table 1).

Table 1 Distribution of features related to pregnant and non-pregnant women

Based on the pathology results, 65 pregnant patients (82.3%) had appendicitis and 14 (17.7%) did not. In the non-pregnant group, 66 patients (83.5%) had appendicitis and 13 (16.5%) did not. There was a significant difference between the groups in terms of severity of pain; most individuals in the non-pregnant group (54; 68.4%) reported moderate pain, whereas most in the pregnant group (57; 72.2%) reported a high degree of pain (p < 0.001). Findings in both groups were similar in terms of nausea, vomiting, and anorexia. Pregnant patients typically visited the hospital less than 24 h from the onset of symptoms. Based on direct examination of pregnant patients, abdominal guarding and rebound tenderness were significantly more common than in non-pregnant patients (Table 2).

Table 2 Distribution of features related to pregnant and non-pregnant women

We compared the efficacy of scoring systems for both groups. The Tzanakis system was the most efficacious among the scoring systems used in non-pregnant women. The positive predictive value (PPV) of the Tzanakis system was 90.6%, whereas the negative predictive value (NPV) was 46.7%. The sensitivity associated with the Tzanakis score was 87.8% and the specificity was 53.8%. Based on the area under the curve (AUC) analysis of predictive power, the Tzanakis score had the highest power in the non-pregnant group, followed by the AIR and Alvarado scores (Table 3) (Fig. 1).

Table 3 Distribution of appendicitis diagnostic performance criteria of scoring systems used in non-pregnant women
Fig. 1
figure 1

ROC curves for diagnostic performance of appendicitis scoring systems for non-pregnant women

RIPASA performed the best among the scoring systems used in pregnant patients. The PPV of this scoring method was 94.40%, its NPV was 44%, and its sensitivity and specificity were 78.46% and 78.57%, respectively. The AIR and Tzanakis systems were the second- and third-most efficacious, respectively. The PPV of the AIR score was 92.9%, its sensitivity was 80%, and its specificity was 71.4%. The PPV of the Tzanakis score was 97.1%, its sensitivity was 52.3%, and its specificity was 92.8% (Table 4) (Fig. 2).

Table 4 Distribution of appendicitis diagnostic performance criteria of scoring systems used in pregnant women
Fig. 2
figure 2

ROC curves for diagnostic performance of appendicitis scoring systems in pregnant women

Discussion

Appendicitis is generally diagnosed based on clinical and laboratory findings, including the results of imaging analysis. However, the presence of numerous gynecological pathologies in female patients makes it challenging to diagnose acute appendicitis, particularly in pregnant patients [26]. For example, symptoms such as nausea and vomiting are common during both pregnancy and appendicitis, and laboratory findings also tend to be similar.

Radiological examination has high diagnostic value for acute appendicitis [27]. However, the main disadvantages of computed tomography are its teratogenic effect and high cost [28, 29]. The presence of positive abdominal ultrasonography (USG) findings in pregnant women with suspected appendicitis is sufficient to confirm the condition. In cases where appendicitis cannot be diagnosed using USG, magnetic resonance imaging provides high diagnostic accuracy in pregnant patients [30,31,32]. When using new scoring systems that combine clinical and imaging features, 95% of patients with uncomplicated appendicitis can be diagnosed correctly [33].

Delays in diagnosis and treatment of appendicitis may result in more complicated illness and increased rates of preterm labor, perinatal morbidity, mortality, and fetal loss [6,7,8,9,10]. The use of scoring systems helps to support imaging methods [34, 35]. CSS may be used in acute appendicitis to facilitate early diagnosis of the disease and prevent morbidity, and the Alvarado scoring system is one of the most commonly used systems for this situation [27]. Although the Alvarado system may be used in pregnant patients, its use has been extensively validated mainly in non-pregnant patients [36].

CSS aim to diagnose appendicitis by assessing signs, symptoms, and laboratory results. Systems use different variables. For example, the Tzanakis system includes USG results as a factor, the Lintula and Fenyo-Lindberg systems include gender, and the RIPASA and Ohmann systems include urinary symptoms. In our study, we assessed nine different scoring systems that are commonly used worldwide to diagnose appendicitis and compared their performance in pregnant and non-pregnant patients.

The presence of nausea, vomiting, and physiological leukocytosis during pregnancy makes it challenging to diagnose appendicitis, as does the fact that the position of the appendix changes during the gestation period [26]. In addition to our traditional knowledge, while rare publications are stating that the position of the appendix does not vary during pregnancy, publications with high volume are inevitably required to clarify this circumstance [37, 38]. This may explain why the negative appendectomy rate is approximately 35% in pregnant patients [39]. Currently, there is no scoring system that specifically evaluates appendicitis during pregnancy. Therefore, we evaluated the efficacy of existing scoring systems in pregnant patients. Based on AUC analysis, the scoring systems with the highest predictive power for non-pregnant women were the Tzanakis, AIR, and Alvarado systems, in that order. The Lintula and Fenyo-Lindberg scoring systems produced the lowest AUC values among the nine scoring systems. These results suggest that including USG findings (e.g., as in the Tzanakis system) is valuable for the diagnosis of appendicitis in non-pregnant patients.

For pregnant women, the RIPASA score had the highest predictive value, followed by the AIR and Tzanakis scores. Scoring systems that were heavily based on signs and detailed laboratory findings had greater predictive power in the pregnant group. Although we determined that the RIPASA system performed best in pregnant patients, its sensitivity and specificity were below 80%. Based on our findings, we intend to conduct further CSS research focused on the gestation period.

The potential limitations of our study included its retrospective design, the small number of cases, and the retrospective control group, which may not have been representative of the main group.

In summary, systems that include variables such as changes in the neutrophil count, negative urinary findings, Rovsing’s sign, rebound, severe abdominal defense, absence of bowel sounds, short symptom duration, and severe abdominal pain perform well in pregnant patients (Table 2). Systems that score gender and pain displacement are less efficacious for pregnant patients. Notably, with the progression of pregnancy, the gravid uterus may affect pain migration.

Conclusion

Among the CSS evaluated, the RIPASA system was found to be the most suitable for pregnant patients, and this system may also help guide the use of imaging methods for pregnant patients in the clinic. Scoring systems tailored for acute appendicitis during the gestation period will improve treatment outcomes for both the mother and fetus.

Availability of data and materials

There is no additional data available to share with the readers. The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

ROC:

Receiver operating characteristics

PPV:

Positive predictive value

NPV:

Negative predictive value

WBC:

White blood count

VAS:

Visual analog scale

AUC:

Area under the curve

CT:

Computed tomography

USG:

Abdominal ultrasonography

MRI:

Magnetic resonance imaging

CSS:

Clinical scoring systems

NOM:

Non-operative management

References

  1. Babaknia A, Parsa H, Woodruff JD. Appendicitis during pregnancy. Obstet Gynecol. 1977;50:40–4.

    CAS  PubMed  Google Scholar 

  2. Flum DR, Morris A, Koepsell T, Dellinger EP. Has misdiagnosis of appendicitis decreased over time? A population-based analysis. J Am Med Assoc. 2001;286:1748–53.

    Article  CAS  Google Scholar 

  3. De Franca Neto AH, Do Amorim MMR, Nóbrega BMSV. Acute appendicitis in pregnancy: literature review. Vol. 61, Revista da Associacao Medica Brasileira. 2015. p. 170–7.

  4. Long SS, Long C, Lai H, Macura KJ. Imaging strategies for right lower quadrant pain in pregnancy. American Journal of Roentgenology. 2011;196:4–12.

    Article  Google Scholar 

  5. Lurie S, Rahamim E, Piper I, Golan A, Sadan O. Total and differential leukocyte counts percentiles in normal pregnancy. Eur J Obstet Gynecol Reprod Biol. 2008;136:16–9.

    Article  Google Scholar 

  6. Corneille MG, Gallup TM, Bening T, Wolf SE, Brougher C, Myers JG, et al. The use of laparoscopic surgery in pregnancy: evaluation of safety and efficacy. Am J Surg. 2010;200:363–7.

    Article  Google Scholar 

  7. Yoo KC, Park JH, Pak KH, Kim KY, Lee BH, Kim BC, et al. Could laparoscopic appendectomy in pregnant women affect obstetric outcomes? A multicenter study. Int J Colorectal Dis. 2016;1475:81.

    Google Scholar 

  8. Fallon WF, Newman JS, Fallon GL, Malangoni MA. The surgical management of intra-abdominal inflammatory conditions during pregnancy. Surg Clin North Am. 1995;75:15–31.

    Article  Google Scholar 

  9. Palanivelu C, Rangarajan M, Senthilkumaran S, Parthasarathi R. Safety and efficacy of laparoscopic surgery in pregnancy: experience of a single institution. J Laparoendosc Adv Surg Tech A. 2007;17:186–90.

    Article  Google Scholar 

  10. Al-Qudah MS, Amr M, Sroujieh A, Issa A. Appendectomy in pregnancy: the experience of a university hospital. J Obstet Gynaecol. 1999;19:362–4.

    Article  CAS  Google Scholar 

  11. Andersson RE. The natural history and traditional management of appendicitis revisited: spontaneous resolution and predominance of prehospital perforations imply that a correct diagnosis is more important than an early diagnosis. World Journal of Surgery. 2007. World J Surg. 2007;31:86-92.

  12. van Dijk ST, van Dijk AH, Dijkgraaf MG, Boermeester MA. Meta-analysis of in-hospital delay before surgery as a risk factor for complications in patients with acute appendicitis. Br J Surg. 2018;105:933–45.

    Article  Google Scholar 

  13. Podda M, Gerardi C, Cillara N, Fearnhead N, Gomes CA, Birindelli A, et al. Antibiotic treatment and appendectomy for uncomplicated acute appendicitis in adults and children: a systematic review and meta-analysis. Ann Surg. 2019;270:1028–40.

    Article  Google Scholar 

  14. Cheng HT, Wang YC, Lo HC, Su LT, Soh KS, Tzeng CW, et al. Laparoscopic appendectomy versus open appendectomy in pregnancy: a population-based analysis of maternal outcome. Surg Endosc. 2015;29:1394–9.

    Article  Google Scholar 

  15. Guttman R, Goldman RD, Koren G. Appendicitis during pregnancy. Can Fam Physician. 2004;50:355–7.

    PubMed  PubMed Central  Google Scholar 

  16. Alvarado A. A practical score for the early diagnosis of acute appendicitis. Ann Emerg Med. 1986;15:567–4.

    Article  Google Scholar 

  17. Tzanakis NE, Efstathiou SP, Danulidis K, Rallis GE, Tsioulos DI, Chatzivasiliou A, et al. A new approach to accurate diagnosis of acute appendicitis. World J Surg. 2005;29:1151–6.

    Article  Google Scholar 

  18. Butt MQ, Chatha SS, Ghumman AQ, Farooq M. RIPASA score: a new diagnostic score for diagnosis of acute appendicitis. J Coll Physicians Surg Pak. 2014;24:894–7.

    PubMed  Google Scholar 

  19. Von-Mühlen B, Franzon O, Beduschi MG, Kruel N, Lupselo D. AIR score assessment for acute appendicitis. Arq Bras Cir Dig. 2015;28:171–3.

    Article  Google Scholar 

  20. Sitter H, Hoffmann S, Hassan I, Zielke A. Diagnostic score in appendicitis: validation of a diagnostic score (Eskelinen score) in patients in whom acute appendicitis is suspected. Langenbeck’s Arch Surg. 2004;389:213–8.

    Article  CAS  Google Scholar 

  21. Ohmann C, Yang Q, Franke C. Diagnostic scores for acute appendicitis. Abdominal Pain Study Group. Eur J Surg. 1995;161:273–81.

    CAS  PubMed  Google Scholar 

  22. Lintula H, Kokki H, Pulkkinen J, Kettunen R, Gröhn O, Eskelinen M. Diagnostic score in acute appendicitis. Validation of a diagnostic score (Lintula score) for adults with suspected appendicitis. Langenbecks Arch Surg. 2010;395:495–500.

    Article  Google Scholar 

  23. Karaman K, Ercan M, Demir H, Yalkın Ö, Uzunoğlu Y, Gündoğdu K, et al. The Karaman score: a new diagnostic score for acute appendicitis. Ulus Travma ve Acil Cerrahi Derg. 2018;24:545–51.

    Google Scholar 

  24. Fenyö G, Lindberg G, Blind P, Enochsson L, Öberg Å. Diagnostic decision support in suspected acute appendicitis: validation of a simplified scoring system. Eur J Surg. 1997;163:831–8.

    PubMed  Google Scholar 

  25. Hayes MH. Patterson DG. Psychol Bull: Experimental development of the graphic rating method; 1921.

    Google Scholar 

  26. Zachariah SK, Fenn M, Jacob K, Arthungal SA, Zachariah SA. Management of acute abdomen in pregnancy: current perspectives. Int J Womens Health. 2019;11:119–34.

    Article  Google Scholar 

  27. Sartelli M, Baiocchi GL, Di Saverio S, Ferrara F, Labricciosa FM, Ansaloni L, et al. Prospective Observational Study on acute Appendicitis Worldwide (POSAW). World J Emerg Surg. 2018;13:19.

    Article  Google Scholar 

  28. Brenner DJ, Doll R, Goodhead DT, Hall EJ, Land CE, Little JB, et al. Cancer risks attributable to low doses of ionizing radiation: assessing what we really know. Proc Natl Acad Sci U S A. 2003;100:13761–6.

    Article  CAS  Google Scholar 

  29. Guidelines for diagnostic imaging during pregnancy and lactation. Obstet Gynecol. 2017;130:e210-e216.

  30. Theilen LH, Mellnick VM, Longman RE, Tuuli MG, Odibo AO, MacOnes GA, et al. Utility of magnetic resonance imaging for suspected appendicitis in pregnant women. Am J Obstet Gynecol. 2015;212:345.e1-345.e3456.

  31. Spalluto LB, Woodfield CA, Debenedectis CM, Lazarus E. MR imaging evaluation of abdominal pain during pregnancy: appendicitis and other nonobstetric causes. Radiographics. 2012;32:317–34.

    Article  Google Scholar 

  32. Freeland M, King E, Safcsak K, Durham R. Diagnosis of appendicitis in pregnancy. Am J Surg. 2009;198:753–8.

    Article  Google Scholar 

  33. Atema JJ, Van Rossem CC, Leeuwenburgh MM, Stoker J, Boermeester MA. Scoring system to distinguish uncomplicated from complicated acute appendicitis. Br J Surg. 2015;102:979–90.

    Article  CAS  Google Scholar 

  34. Tan WJ, Pek W, Kabir T, et al. Alvarado score: a guide to computed tomography utilization in appendicitis. ANZ J Surg. 2013;83:748–52.

    Article  Google Scholar 

  35. Jones RP, Brooke Jeffrey R, Shah BR, Desser TS, Rosenberg J, Olcott EW. The Alvarado score as a method for reducing the number of CT studies when appendiceal ultrasound fails to visualize the appendix in adults. Am J Roentgenol. 2015;204:519–26.

    Article  Google Scholar 

  36. Augustin G, Majerovic M. Non-obstetrical acute abdomen during pregnancy. Eur J Obstet Gynecol Reprod Biol. 2007;131:4–12.

    Article  Google Scholar 

  37. Ishaq A, Khan MJH, Pishori T, Soomro R, Khan S. Location of appendix in pregnancy: does it change? Clin Exp Gastroenterol. 2018;11:281–7.

    Article  Google Scholar 

  38. Hodjati H, Kazerooni T. Location of the appendix in the gravid patient: a re-evaluation of the established concept. Int J Gynecol Obstet. 2003;81:245–7.

    Article  CAS  Google Scholar 

  39. McGory ML, Zingmond DS, Tillou A, Hiatt JR, Ko CY, Cryer HM. Negative appendectomy in pregnant women is associated with a substantial risk of fetal loss. J Am Coll Surg. 2007;205:534–40.

    Article  Google Scholar 

Download references

Acknowledgements

None

Funding

None

Author information

Authors and Affiliations

Authors

Contributions

BM: design, data collection, data analysis + interpretation, writing and revision. YA: Data collection, data interpretation, and revision. MY: Data analysis, interpretation, and writing. FA: Interpretation and revision. EG: study design, data interpretation, and revision. EA: study design, writing/revision. UE: data interpretation, revision. NF: interpretation and revision. The authors read and approved the final manuscript.

Corresponding author

Correspondence to Baris Mantoglu.

Ethics declarations

Ethics approval and consent to participate

Sakarya University Ethics Committee has approved this research project.

Consent for publication

All patients or their caregivers signed a consent form giving permission to use their anonymous data for research.

Competing interests

The authors have no conflicts of interest. The authors are responsible for the content of the paper.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mantoglu, B., Gonullu, E., Akdeniz, Y. et al. Which appendicitis scoring system is most suitable for pregnant patients? A comparison of nine different systems. World J Emerg Surg 15, 34 (2020). https://doi.org/10.1186/s13017-020-00310-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13017-020-00310-7

Keywords