Addition of lactic acid levels improves the accuracy of quick sequential organ failure assessment in predicting mortality in surgical patients with complicated intra-abdominal infections: a retrospective study
World Journal of Emergency Surgery volume 13, Article number: 14 (2018)
The quick sequential organ failure assessment (qSOFA) alone has a poor sensitivity for predicting mortality in patients with complicated intra-abdominal infections, and plasma lactate levels have been shown to have a strong association with mortality in critically ill patients. Therefore, this study aimed to compare the performance of qSOFA with a score derived from a combination of qSOFA and serum lactate levels for predicting mortality in surgical patients with complicated intra-abdominal infections.
This retrospective study was performed at a university hospital. The medical records of 457 patients who presented to the emergency department (ED) between January 2008 and December 2016 and required emergency gastrointestinal surgery for a complicated intra-abdominal infection were reviewed retrospectively. qSOFA criteria, sequential organ failure assessment (SOFA) scores, and plasma lactate levels during their ED stay were collected. We performed area under receiver operating characteristic (AUROC) curve and sensitivity analysis to compare the performance of qSOFA alone with that of a score derived from the use of a combination of the qSOFA and lactate levels for predicting patient mortality.
Fifty patients (10.9%) died during hospitalization. The combined qSOFA and lactate level score was superior to qSOFA alone (AUROC = 0.754 vs. 0.717, p = 0.039, respectively) and comparable to the full SOFA score (AUROC = 0.754 vs. 0.795, p = 0.127, respectively) in predicting mortality. Sensitivity and specificity of qSOFA alone were 46 and 86%, respectively, and those of the combined score were 72 and 73%, respectively (p < 0.001).
A score derived from the qSOFA and serum lactate levels had better predictive performance with higher sensitivity than the qSOFA alone in predicting mortality in patients with complicated intra-abdominal infections and had a comparable predictive performance to that of the full SOFA score.
Sepsis has been a major cause of death for many decades in critically ill patients worldwide [1, 2]. Despite its high morbidity and mortality, there is no diagnostic gold standard test for sepsis. For the past decade, sepsis had been defined as a systemic inflammatory response syndrome (SIRS) by the host to an infection . Owing to advances in our understanding of the pathophysiology of sepsis, a 2016 consensus conference redefined sepsis as “life-threatening organ dysfunction caused by a dysregulated host response to infection” .
Based on this new definition, sepsis is now diagnosed when a ≥ 2-point change occurs in the sequential organ failure assessment (SOFA) score because of an infection. However, due to the complex nature of the SOFA score, the 2016 task force introduced quick SOFA (qSOFA) for the rapid identification of patients at a high risk of mortality in the setting where all components of the SOFA score cannot be measured . The qSOFA score includes (1) systolic blood pressure (SBP) ≤ 100 mmHg, (2) respiratory rate (RR) ≥ 22 breaths/min, and (3) an altered mental status (AMS). The total qSOFA score ranges from 0 to 3. Despite its simplicity, qSOFA showed better accuracy than SIRS criteria for predicting patient mortality in non-intensive care unit (ICU) settings in many studies [5,6,7]. However, others have questioned its utility as a quick screening tool due to its poor sensitivity [8,9,10].
Because of the limited sensitivity of qSOFA, we performed this study based on three assumptions. First, qSOFA alone has a poor sensitivity for predicting mortality in patients with complicated intra-abdominal infections. Second, plasma lactate levels have been shown to have a strong association with mortality in critically ill patients [11,12,13]. Therefore, the combination of the qSOFA score with a score based on lactate levels should have a better prognostic performance than qSOFA alone. Finally, the combination score should have a prognostic performance comparable to that of the full SOFA score. The aim of this study was to compare the performance of qSOFA with a combined score derived from qSOFA and serum lactate levels for predicting in-hospital mortality in surgical patients with complicated intra-abdominal infections.
We retrospectively reviewed the medical records of 1226 adult patients who underwent emergency gastrointestinal surgery for a complicated intra-abdominal infection from January 2008 to December 2016. Among this population, 511 patients were admitted via the emergency department (ED), but 51 of these patients did not have their plasma lactate level checked. Three patients with infection source inadequately controlled were also excluded because operations with inadequate source control usually end up with critical consequences regardless of their preoperative conditions. Excluding these 54 patients, 457 patients were finally included in the study.
Components of the qSOFA and full SOFA scores during the patients’ ED stay were collected from the electronic medical record (EMR). The qSOFA score included one point for each of the following: (1) systolic blood pressure ≤ 100 mmHg, (2) respiratory rate ≥ 22 breaths/min, and (3) altered mental status (AMS). The patient’s baseline characteristics, initial laboratory values, operation-related data, and clinical outcomes were collected from the EMR. In our ED, the initial mental status of non-traumatic patients is recorded using the alert/verbal/painful/unresponsive (AVPU) responsiveness scale. Therefore, the AVPU scale was used instead of the Glasgow Coma Scale score when calculating the central nervous system component of the full SOFA score [14, 15].
One additional point was added to the patient’s qSOFA score when their plasma lactate level was ≥ 2 mmol/L during their ED stay. This newly calculated combined score (qSOFA + lactate score) ranged from 0 to 4. Sensitivity analysis for each criterion was performed at a cutoff value of 2 for the qSOFA score, the qSOFA + lactate score, and the full SOFA score. Plasma lactate levels were included because they have been shown to be useful in predicting mortality in critically ill patients in numerous prior studies [11,12,13].
This study was approved by the Yonsei University Institutional Review Board (4-2017-0726), and informed consent was waived due to the retrospective design of the study.
A Student t test and the Mann-Whitney U test were performed for continuous variables, as appropriate, and presented as the mean ± standard deviation or median (interquartile range [IQR]). Categorical variables were presented as a frequency (%) and compared using the chi-square or Fisher’s exact test, as appropriate. Sensitivity analysis, receiver operating characteristic (ROC) curve, and area under ROC curve (AUROC) with 95% confidence intervals (CI) were analyzed for each score. To compare sensitivities and specificities of each score, generalized estimating equations and the weighted least square method were used.
The findings were considered statistically significant when p values were less than 0.05. Statistical analysis was performed using SPSS® Statistics 23.0 (IBM Corp., Armonk, NY), SAS (version 9.4, SAS Inc., Cary, NC, USA), and R package (version 3.1.3, https://www.r-project.org/).
Of the 457 patients, 407 (89.1%) patients survived, and 50 (10.9%) patients died during hospitalization. Non-survivors had a higher average age (68.94 ± 15.27 vs. 62.11 ± 16.19 years, respectively; p = 0.005), ASA score (p = 0.007), and APACHE II score (28.26 ± 9.08 vs. 20.11 ± 7.86, respectively; p < 0.001) (Table 1).
Components of qSOFA, lactate level, and full SOFA score
A SBP ≤ 100 mmHg and a RR ≥ 22 breaths/min were observed in 39.4 and 26.7% of the patients, respectively. Only 3.3% of the patients showed an AMS. The non-survivor group had higher qSOFA, qSOFA + lactate, and full SOFA scores (Table 2).
Predictive performance of qSOFA alone
The SIRS had the lowest predictive performance among the criteria (AUROC = 0.672, 95% CI = 0.599–0.745), though it was better than that of a single plasma lactate level with a cutoff value of 2.0 mmol/L (AUROC = 0.659, 95% CI = 0.581–0.736). The qSOFA score showed a better predictive performance compared to SIRS criteria, but this difference was not statistically significant (AUROC = 0.717, 95% CI = 0.673–0.758 vs. AUROC = 0.672, 95% CI = 0.599–0.745; p = 0.325). Furthermore, qSOFA had the lowest sensitivity (46%), though it had the highest specificity (86%) (Table 3).
Predictive performance of the qSOFA + lactate score
When the qSOFA score was combined with one additional point for hyperlactatemia, its predictive performance was significantly improved compared to that seen with the qSOFA alone (AUROC = 0.754, 95% CI = 0.712–0.793 vs. AUROC = 0.717, 95% CI = 0.673–0.758 p = 0.039, respectively) (Fig. 1). The qSOFA + lactate score had a higher sensitivity [72% (60–85%) vs. 46% (32–60%), respectively] with little change in specificity [73% (68–77%) vs. 86% (83–90%), respectively] (p < 0.001) compared with that of the qSOFA score alone.
Comparison of the qSOFA + lactate score with the full SOFA score
The qSOFA + lactate score had a predictive performance comparable to the full SOFA score (AUROC = 0.754, 95% CI = 0.712–0.793 vs. AUROC = 0.795, 95% CI = 0.755–0.831, respectively; p = 0.127) (Fig. 2) (Table 3). The full SOFA score had a higher sensitivity [82% (71–93%) vs. 72% (60–85%)], and a lower specificity [56% (51–61%) vs. 73% (68–77%)], compared to the qSOFA + lactate score, but these differences were not statistically significant (p = 0.123) (Table 3).
Our study results showed that the qSOFA alone has a poor sensitivity and a modest predictive performance. There are rising concerns on the poor sensitivity of qSOFA, despite its high specificity, and potential delays in identification and resuscitation for patients at a high risk of mortality . The addition of one point for hyperlactatemia (plasma lactate level > 2.0 mmol/L) resulted in improved sensitivity with a slightly decreased specificity. The addition of the use of serum lactate levels to the qSOFA improved the predictive performance significantly, increasing it to a level comparable to that of the full SOFA. The strengths of the qSOFA include its simplicity, rapidity, and ease of performance for all health care providers without requiring complicated equipment or laboratory results. However, after the qSOFA was introduced, we observed that surgical patients who required emergency gastrointestinal surgery rarely presented to the ED with AMS. In a study of ED patients with suspected infection conducted by Williams et al. , only 5.1% of patients had AMS, while 21.1% of patients had a respiratory rate ≥ 22 breaths/min, and 26.8% had a systolic blood pressure ≤ 100 mmHg. Our study also demonstrates that only 15 patients (3.3%) in our study population (457 patients) had AMS. In this population of patients, the most common presentation was abdominal pain with hypotension and tachypnea. The tachypnea was thought to be because of shallow respirations caused by diffuse peritoneal irritation in some patients. Because so few patients presented to the ED with AMS, only 17% of our patients had a qSOFA score ≥ 2, making it difficult to identify and screen patients at a high risk of mortality. In our study group, 27 patients with a qSOFA score < 2 did not survive. Other studies have emphasized the poor sensitivity of qSOFA as a screening test for sepsis [8, 9].
To improve the sensitivity of qSOFA, we analyzed several combination scores including qSOFA and diagnostic markers of inflammation, such as C-reactive protein, white blood cell count, delta neutrophil index, and plasma lactate concentration. As suggested in many studies, plasma lactate concentration is an important predictor of mortality in critically ill patients [11,12,13]. Plasma lactate concentration alone with a cutoff value of 2 mmol/L did not show a good predictive performance in our study, but when combined with qSOFA, it was the best predictor of in-hospital mortality in our study population.
The rapid point-of-care measurement and accuracy of plasma lactate levels is an important advantage . Singer et al. reported that an early bedside point-of-care (POC) lactate evaluation in the ED was associated with the early administration of intravenous fluid resuscitation and improved mortality in patients with suspected sepsis . The use of plasma lactate levels improves the discriminatory ability of qSOFA without complicating its use as a quick and simple screening method.
The association between full SOFA scores and patient mortality has been confirmed in previous studies [5, 19,20,21]. However, the calculation of the full SOFA score is time-consuming since many laboratory values and a significant amount of clinical information are needed. Therefore, the use of full SOFA scores is only suited for patients in an ICU environment. The use of the qSOFA + lactate score is a simple and rapid way to screen patients at high risk of mortality in pre-ICU, such as in the ED, or even in pre-hospital settings with a predictive performance comparable with that seen with the full SOFA score. The use of the qSOFA + lactate score will assist clinicians in immediately assessing the risk of mortality in patients with suspected intra-abdominal infection, allowing more rapid resuscitation and control of the infective source and reducing patient mortality.
Strengths and limitations of our study
A strength of this study is that it is the first to be performed solely in the surgical population. Early resuscitative therapy can be delivered to patients with intra-abdominal infection who have a high risk of mortality based on the results of a simple screening using qSOFA and a plasma lactate measurement. This could lead to an improved survival rate for patients who require emergency gastrointestinal surgery for a suspected intra-abdominal infection.
The present study has several limitations. First, surgical patients presenting to the ED are likely to get individualized treatment and do not always follow a tailored protocol. In a study performed by Rivers et al. in 2001 , patients requiring emergent surgery were excluded from the study protocol because they had a variety of different infections and had a different degree of urgency for surgical intervention. The diversity of patient characteristics and treatments in our study may have affected the outcome of our study. Second, our study is a retrospective study performed in a single center with a small study population. Due to the retrospective nature of the study, all of our patients had already undergone emergency gastrointestinal surgery. Prospective studies of patients presenting to the ED with suspected intra-abdominal infection, regardless of a consequent emergency gastrointestinal surgery, are needed to clarify the benefits of using the qSOFA + lactate score compared to qSOFA for predicting patient mortality.
The qSOFA score alone has poor sensitivity in screening surgical patients presenting to the ED with a high risk of mortality. Combining the qSOFA score with an additional one point for hyperlactatemia has a better predictive performance with higher sensitivity for patient mortality than that seen with qSOFA alone and comparable to that seen with full SOFA.
Altered mental status
Area under receiver operating characteristic curve
Electronic medical record
Intensive care unit
Quick sequential organ failure assessment
Receiver operating characteristic
Systolic blood pressure
Systemic inflammatory response syndrome
Sequential organ failure assessment
Park DW, Chun BC, Kim JM, et al. Epidemiological and clinical characteristics of community-acquired severe sepsis and septic shock: a prospective observational study in 12 university hospitals in Korea. J Korean Med Sci. 2012;27:1308–14.
Martin GS, Mannino DM, Eaton S, et al. The epidemiology of sepsis in the United States from 1979 through 2000. N Engl J Med. 2003;348:1546–54.
Bone RC, Balk RA, Cerra FB, et al. Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. The ACCP/SCCM Consensus Conference Committee. American College of Chest Physicians/Society of Critical Care Medicine. Chest. 1992;101:1644–55.
Singer M, Deutschman CS, Seymour CW, et al. The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA. 2016;315:801–10.
Seymour CW, Liu VX, Iwashyna TJ, et al. Assessment of clinical criteria for sepsis: for the Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA. 2016;315:762–74.
Finkelsztein EJ, Jones DS, Ma KC, et al. Comparison of qSOFA and SIRS for predicting adverse outcomes of patients with suspicion of sepsis outside the intensive care unit. Crit Care. 2017;21:73.
Park HK, Kim WY, Kim MC, et al. Quick sequential organ failure assessment compared to systemic inflammatory response syndrome for predicting sepsis in emergency department. J Crit Care. 2017;42:12–7.
Williams JM, Greenslade JH, McKenzie JV, et al. Systemic inflammatory response syndrome, quick sequential organ function assessment, and organ dysfunction: insights from a prospective database of ED patients with infection. Chest. 2017;151:586–96.
Dorsett M, Kroll M, Smith CS, et al. qSOFA has poor sensitivity for prehospital identification of severe sepsis and septic shock. Prehosp Emerg Care. 2017;21(4):489–97.
Askim A, Moser F, Gustad LT, et al. Poor performance of quick-SOFA (qSOFA) score in predicting severe sepsis and mortality—a prospective study of patients admitted with infection to the emergency department. Scand J Trauma Resusc Emerg Med. 2017;25:56.
Bou Chebl R, El Khuri C, Shami A, et al. Serum lactate is an independent predictor of hospital mortality in critically ill patients in the emergency department: a retrospective study. Scand J Trauma Resusc Emerg Med. 2017;25:69.
Freire Jorge P, Wieringa N, de Felice E, et al. The association of early combined lactate and glucose levels with subsequent renal and liver dysfunction and hospital mortality in critically ill patients. Crit Care. 2017;21:218.
Lokhandwala S, Andersen LW, Nair S, et al. Absolute lactate value vs relative reduction as a predictor of mortality in severe sepsis and septic shock. J Crit Care. 2017;37:179–84.
Kelly CA, Upex A, Bateman DN. Comparison of consciousness level assessment in the poisoned patient using the alert/verbal/painful/unresponsive scale and the Glasgow Coma Scale. Ann Emerg Med. 2004;44:108–13.
McNarry AF, Goldhill DR. Simple bedside assessment of level of consciousness: comparison of two simple assessment scales with the Glasgow Coma Scale. Anaesthesia. 2004;59:34–7.
Sartelli M, Kluger Y, Ansaloni L, et al. Raising concerns about the Sepsis-3 definitions. World J Emerg Surg. 2018;13:6.
Shapiro NI, Fisher C, Donnino M, et al. The feasibility and accuracy of point-of-care lactate measurement in emergency department patients with suspected infection. J Emerg Med. 2010;39:89–94.
Singer AJ, Taylor M, LeBlanc D, et al. ED bedside point-of-care lactate in patients with suspected sepsis is associated with reduced time to iv fluids and mortality. Am J Emerg Med. 2014;32:1120–4.
Vincent JL, de Mendonca A, Cantraine F, et al. Use of the SOFA score to assess the incidence of organ dysfunction/failure in intensive care units: results of a multicenter, prospective study. Working group on “sepsis-related problems” of the European Society of Intensive Care Medicine. Crit Care Med. 1998;26:1793–800.
Rivera-Fernandez R, Nap R, Vazquez-Mata G, et al. Analysis of physiologic alterations in intensive care unit patients and their relationship with mortality. J Crit Care. 2007;22:120–8.
Sakr Y, Vincent JL, Ruokonen E, et al. Sepsis and organ system failure are major determinants of post-intensive care unit mortality. J Crit Care. 2008;23:475–83.
Rivers E, Nguyen B, Havstad S, et al. Early goal-directed therapy in the treatment of severe sepsis and septic shock. N Engl J Med. 2001;345:1368–77.
The authors would like to thank HY Kim for assisting with the statistical analyses, and we thank all the coordinators for their valuable help and cooperation.
Availability of data and materials
All data generated or analyzed during this study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
This study was approved by the Institutional Review Board (4-2017-0726).
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Jung, Y.T., Jeon, J., Park, J.Y. et al. Addition of lactic acid levels improves the accuracy of quick sequential organ failure assessment in predicting mortality in surgical patients with complicated intra-abdominal infections: a retrospective study. World J Emerg Surg 13, 14 (2018). https://doi.org/10.1186/s13017-018-0173-6
- Retrospective studies
- Intra-abdominal infection