Internal vacuum-assisted closure device in the swine model of severe liver injury
© Everett et al.; licensee BioMed Central Ltd. 2012
Received: 18 September 2012
Accepted: 8 November 2012
Published: 5 December 2012
The authors present a novel approach to nonresectional therapy in major hepatic trauma utilizing intraabdominal perihepatic vacuum assisted closure (VAC) therapy in the porcine model of Grade V liver injury.
A Grade V injury was created in the right lobe of the liver in a healthy pig. A Pringle maneuver was applied (4.5 minutes total clamp time) and a vacuum assisted closure device was placed over the injured lobe and connected to suction. The device consisted of a perforated plastic bag placed over the liver, followed by a 15 cm by 15cm VAC sponge covered with a nonperforated plastic bag. The abdomen was closed temporarily. Blood loss, cardiopulmonary parameters and bladder pressures were measured over a one-hour period. The device was then removed and the animal was euthanized.
Feasibility of device placement was demonstrated by maintenance of adequate vacuum suction pressures and seal. VAC placement presented no major technical challenges. Successful control of ongoing liver hemorrhage was achieved with the VAC. Total blood loss was 625 ml (20ml/kg). This corresponds to class II hemorrhagic shock in humans and compares favorably to previously reported estimated blood losses with similar grade liver injuries in the swine model. No post-injury cardiopulmonary compromise or elevated abdominal compartment pressures were encountered, while hepatic parenchymal perfusion was maintained.
These data demonstrate the feasibility and utility of a perihepatic negative pressure device for the treatment of hemorrhage from severe liver injury in the porcine model.
KeywordsLiver trauma Negative-pressure therapy Swine model Hemorrhage
This is a proof-of-concept investigation using the swine model of grade V exsanguinating liver trauma. The aim of the investigation was to determine if the internal application of a modified vacuum-assisted closure device to the injured liver could control hemorrhage.
High grade, exsanguinating liver injury requires rapid control.
Application of a negative pressure device to exsanguinating liver injury is a variant of "packing" that may offer several advantages.
In this proof-of-concept investigation using an animal model of liver trauma, application of a negative pressure device rapidly controlled hemorrhage.
The liver is the most commonly injured intraperitoneal organ . Treatment of liver trauma has evolved significantly over the past thirty years and is now often managed non-operatively [2, 3]. Operative management, almost exclusively reserved for Grade IV and V injuries, has included such procedures as selective hepatic artery ligation, [4, 5] omental packing, anatomic and non-anatomic hepatic resection and deep liver suturing, some of which remain controversial [1, 3–6].
Short of formal resection, adequate debridement of non-viable hepatic parenchyma is generally advocated and performed, since it is thought to be vital in minimizing septic complications . Liver transplantation for trauma has been described , but largely abandoned and limited only to a few extraordinary cases, guided more by conjecture and circumstance than by evidence.
Perihepatic packing has been utilized to treat liver injury since the Second World War. Success in civilian trauma has revitalized this modality as a temporizing measure to control hemorrhage, particularly in cases complicated by the deadly triad of hypothermia, hypocoagulability and acidosis [8–11]. Similarly, “mesh-wrapping” of the liver to control bleeding, owing to its compressive effect, has been used with some success .
Adjuncts to this approach including angiography with selective vessel embolization, computed tomography directed drainage of abscess or biloma, and endoscopic retrograde cholangiopancreatography with biliary stenting have recently been integrated into the nonoperative management strategy of liver trauma with encouraging results .
Liver packing, although a life-saving maneuver is not without complications. Placing sponges between the liver and diaphragm to tamponade bleeding compromises venous return, impairing cardiopulmonary function in patients with already limited reserve. Re-bleeding and intraabdominal abscess formation after pack removal has also been described. In patients who require massive resuscitation, visceral edema and elevated intraabdominal pressures may lead to subsequent abdominal compartment syndrome with the use of perihepatic packing.
Abdominal compartment syndrome may cause compromise of cardiac performance and respiratory function, renal function, splanchnic perfusion, and may impair cerebral perfusion [14–17]. The concepts of damage control laparotomy, multiorgan failure, and abdominal compartment syndrome have lead to the use of temporary abdominal closures to allow rapid means of abdominal domain control, in anticipation of delayed, definitive intraabdominal injury repair [13, 18, 19].
Vacuum assisted closure (VAC), also referred to as negative pressure wound therapy, has gained wide acceptance for use in the management of a range of acute and chronic wounds as well as for temporary abdominal closures in cases of abdominal compartment syndrome and damage control laparotomy [20, 21]. VAC therapy combines several features conducive to wound healing including apposition, drainage and coverage. VAC has been successfully utilized to treat numerous and varied conditions including decubitus ulcers, skin grafts, enterocutaneous fistulae, animal and insect bites, osteomyelitis, urologic and perineal wounds, burns, and post-sternotomy sternal wound infections [22–30]. Temporary abdominal closure after damage control laparotomy for abdominal compartment syndrome has been successfully managed using VAC and this modality is now used routinely in our Level I trauma center for such cases.
The porcine or swine model has been used extensively to simulate, experimentally, human liver injury [31–38]. A reproducible Grade V liver injury has been consistently attained in a number of swine model liver trauma studies by the standardized use of a device well described in the trauma and military literature [31, 33, 34, 36–38].
Given the complications associated with traditional hepatic packing, the authors present a novel approach to nonresectional therapy in major hepatic trauma utilizing intraabdominal perihepatic vacuum assisted closure or Liver VAC (L-VAC) therapy in the porcine model. We propose this as a new method for control of hepatic hemorrhage without concomitant cardiopulmonary compromise or development of abdominal compartment syndrome.
Materials and methods
All experimental methods were conducted in accordance with standard and humane animal laboratory regulations. The study protocol was approved by the Institutional Animal Care and Use Committee at the Kansas University Medical Center.
A healthy, female, 32kg Chester White pig was fasted overnight. The animal was then sedated with intramuscular Telazol (5mg/kg) and Rompun (2mg/kg). General anesthesia was then maintained by inhalational Isoflurane after the animal was orotracheally intubated. The right femoral artery and vein were cannulated via cutdown technique and connected to a continuous monometer. Monitoring included heart rate, blood pressure, hemoglobin-oxygen saturation urine output, end-tidal carbon dioxide or partial pressure of carbon dioxide, respiratory rate, central venous pressure, blood pressure, core temperature, and bladder pressure. Baseline labs consisting of hemoglobin and hematocrit, arterial blood gases, and arterial lactate were obtained from the arterial line and measured at 30 minute intervals throughout the experiment. Intravenous infusion of Lactated Ringer’s crystalloid was used as needed (6mg/kg, titrated) to maintain hemodynamic stability.
The abdomen was temporarily closed with a second negative pressure device. The intraabdominal contents were covered with a large 10cm ×10cm plastic drape. A large black abdominal sponge was placed over the drape, followed by the suction pad. This negative pressure device was connected to 70cm of water suction (51 mmHg, Figure 3D). After 60 minutes the abdomen was opened and the device was removed and the animal was then euthanized.
Visual inspection of the liver parenchyma confirmed Grade V liver injury according to the solid organ injury scale with visible disrupted portal and hepatic veins (Figure 3A). Brisk, active bleeding consistent with this grade of injury was encountered with brief release of the Pringle maneuver.
Initial blood loss prior to L-VAC placement was 280 ml (8.75 ml/kg). At initial device placement there was 75ml of immediate blood return. Continued losses after applying the device to suction were negligible over the next 60 minutes. Immediate blood loss after removal of the device was 270 ml (8.4 ml/kg) for a total blood loss of 625ml (19.5 ml/kg) for the entire procedure. Hemoglobin counts were 12.2 g/dl, 11.5g/dl, and 9.6g/dl at 0, 30, and 60 minutes, respectively. No blood products were administered.
Presence of acidosis
Initial and serial arterial lactate levels were 1.1, 5.8, and 6.8mol/l at 0, 30, and 60 minutes, respectively.
The bladder pressure was 12, 17, and 12 cm H2O at 0, 30, and 60 minutes, respectively. Urine output was 73 ml (2.2ml/kg) at 60 minutes.
Continued advancements in the management of complex liver injuries have led to an improvement in patient mortality rates. The employment of a multidisciplinary approach encompassing operative and non-operative therapeutic modalities has been crucial to this success. Methods such as packing, hepatic angiography and embolization, and open resection have fallen under scrutiny as investigators seek to overcome the formidable challenge of controlling blood losses in patients in extremis while preventing abdominal compartment syndrome and cardiopulmonary compromise. This study proposes an additional therapeutic technique to the surgeon’s armamentarium by demonstrating the effectiveness of a perihepatic negative pressure device in controlling hemorrhage from severe liver injury in the porcine model.
The feasibility of device placement was demonstrated by maintenance of adequate vacuum suction pressures. Initial seal was obtained at 150 cm of water suction (110 mmHg) and maintained at 70 cm water (51 mmHg) without evidence of vacuum leak. The device was easily deployed with readily available materials, a strength of current therapeutic modalities including perihepatic packing with laparotomy sponges.
Application of this device in clinical practice may be affected by minor anatomic differences between the swine and humans. Specifically, mobilization of the phrenohepatic and triangular ligaments may be necessary to allow for adequate sealing of the device. The author’s personal experience in human cadavers has shown favorable results with no technical difficulties. Given the initial learning curve with this novel application of the L-VAC device, it is the author’s recommendation that clinicians practice in a cadaveric model prior to attempting operative placement in the acute traumatic setting. Careful patient selection is also warranted based on injury location. Injuries to the more medial portions of the liver may impair sealing of the device.
The device demonstrated successful control of ongoing hemorrhage. Significant bleeding was encountered after creation of the injury and prior to control of the porta hepatis, as well as after final removal of the device. Ongoing blood losses after application of the L-VAC device to suction were 75ml, initially, after which they became negligible over the remainder of the 60 minute experiment. Total blood loss was 625 ml (20ml/kg). This corresponds to class II hemorrhagic shock in humans. While no controls were performed comparing this novel method to traditional therapies, the amount of blood loss with the L-VAC compares favorably to that reported in the current literature. Reported mean estimated blood losses approach 3,700ml in swine with similar injures treated with packing and hemostatic bandages.
Hepatic parenchymal perfusion was maintained by keeping L-VAC pressures well below the mean and systolic blood pressure throughout the experiment (Figure 5). The liver appeared well perfused by gross inspection upon removal of the device. The L-VAC provides a theoretical advantage over perihepatic packing by the ability to regulate the amount of pressure applied to the hepatic parenchyma in real-time. To prevent hepatic ischemia, the vacuum setting can be adjusted to the lowest possible setting that allows for sealing and hemostasis. This may be accomplished in the clinical setting by following L-VAC suction canister output and titrating vacuum pressures accordingly.
No post-injury cardiopulmonary compromise was encountered during use of the L-VAC. Venous return to the heart was unaffected as central venous pressures and SBP remained within normal limits throughout the experiment and serum lactate levels elevated in proportion to the level of hemorrhage.
Traditional packing methods rely on compressing the liver between the abdominal wall and the spine for hemostasis. Pressure is also directed posteriorly toward the retroperitoneum and the retrohepatic vena cava. This impediment of venous return is poorly tolerated in the hypovolemic patient and may exacerbate already compromised cardiac output. Given the circular geometry of the L-VAC device, the force vectors are directed inward toward the liver parenchyma. This allows for pressure application to the injured organ without a concomitant decrease in venous return, a distinct advantage over traditional perihepatic packing.
Perihepatic packing has also been shown to result in pathologic intra-abdominal hypertension . In this study, abdominal compartment pressures remained low throughout the procedure. Urine output was commensurate with the level of hypovolemia, and end tidal CO2 levels remained constant. In addition, the bowel and bladder appeared well perfused upon device removal. With intraabdominal packing, temporary abdominal closure does not necessarily prevent the development of abdominal compartment syndrome. Prior investigators have demonstrated that unpacking the abdomen results in a significant improvement in cardiopulmonary function as well as renal and intestinal blood flow . Monitoring of bladder pressures, urine output, and end tidal carbon dioxide levels with subsequent titration of vacuum pressures on the abdominal device is recommended.
The applicability of the swine model for human liver injury has been well described in the literature. This model, however, is not without its limitations. The compression of the portal inflow during creation of the liver laceration minimized initial blood losses. In the clinical setting, uncompensated hypovolemic shock may result in the ‘bloody vicious cycle’ of hypothermia, acidosis, and coagulopathy. Obtaining hemostasis from bleeding viscera in the face of these physiologic derangements can be quite challenging. In this regard, the model used for this experiment was artificial given that the pig was well compensated hemodynamically, with functioning coagulation cascades. However, given the mechanism of action of the VAC device, the authors contend that L-VAC placement may be the ideal therapy for control of hemorrhage in such cases. Consideration is being given to repeating this experiment in animals that are hypothermic and coagulopathic.
Future areas of investigation should be directed toward comparing this innovative method to well-established therapies such as packing, mesh wrapping, and application of hemostatic agents.
In summary, these data demonstrate the feasibility and utility of a perihepatic negative pressure device for the treatment of hemorrhage from severe liver injury in the porcine model. This method is potentially applicable in the clinical setting and may afford advantages over traditional damage control procedures such as perihepatic packing.
This study was funded in part by funds from the Kansas University Medical Center, and the Wesley Medical Center Trauma Research Fund.
Institutional animal use and care committee approval
This study was approved for implementatin by the IACUC of the Kansas University Medical center.
- Pachter HL, Liang HG, Hofstetter SR: Liver and biliary tract trauma. Trauma. Edited by: Feliciano DV, Moore EE, Mattox KL. 1996, Stamford, CT: Appleton & Lange, 487-3
- Richardson JD, Franklin GA, Lukan JK, Carrillo EH, Spain DA, Miller FB, Wilson MA, Polk HC, Flint LM: Evolution in the management of hepatic trauma: a 25-year perspective. Ann Surg. 2000, 232: 324-330. 10.1097/00000658-200009000-00004.View Article
- Malhotra AK, Fabian TC, Croce MA, Gavin TJ, Kudsk KA, Minard G, Pritchard FE: Blunt hepatic injury: a paradigm shift from operative to nonoperative management in the 1990s. Ann Surg. 2000, 231: 804-813. 10.1097/00000658-200006000-00004.PubMed CentralView ArticlePubMed
- Moore EE, Shackford SR, Pachter HL, McAninch JW, Browner BD, Champion HR, Flint LM, Gennarelli TA, Malangoni MA, Ramenofsky ML, Trafton PG: Organ injury scaling: spleen, liver, and kidney. J Trauma. 1989, 29: 1664-1666. 10.1097/00005373-198912000-00013.View ArticlePubMed
- Aaron S, Fulton RL, Mays ET: Selective ligation of the hepatic artery for trauma of the liver. Surg Gynecol Obstet. 1975, 141: 187-189.PubMed
- Stone HH, Lamb JM: Use of pedicled omentum as an autogenous pack for control of hemorrhage in major injuries of the liver. Surg Gynecol Obstet. 1975, 141: 92-94.PubMed
- Ringe B, Pichlmayr R, Ziegler H, Grosse H, Kuse E, Oldhafer K, Bornscheuer A, Gubernatis G: Management of severe hepatic trauma by two-stage total hepatectomy and subsequent liver transplantation. Surgery. 1991, 109: 792-795.PubMed
- Beal SL: Fatal hepatic hemorrhage: an unresolved problem in the management of complex liver injuries. J Trauma. 1990, 30: 163-169.View ArticlePubMed
- Ivatury RR, Nallathambi M, Gunduz Y, Constable R, Rohman M, Stahl WM: Liver packing for uncontrolled hemorrhage: a reappraisal. J Trauma. 1986, 26: 744-753. 10.1097/00005373-198608000-00011.View ArticlePubMed
- Cué JI, Cryer HG, Miller FB, Richardson JD, Polk HC: Packing and planned reexploration for hepatic and retroperitoneal hemorrhage: critical refinements of a useful technique. J Trauma. 1990, 30: 1007-1013. 10.1097/00005373-199008000-00010.View ArticlePubMed
- Rotondo MF, Schwab CW, McGonigal MD, Phillips GR, Fruchterman TM, Kauder DR, Latenser BA, Angood PA: ‘Damage control’: an approach for improved survival in exsanguinating penetrating abdominal injury. J Trauma. 1993, 35: 375-383. 10.1097/00005373-199309000-00008.View ArticlePubMed
- Stevens SL, Maull KI, Enderson BL, Meadors JN, Elkins LW, Hopkins FM: Total mesh wrapping for parenchymal liver injuries–a combined experience and clinical study. J Trauma. 1991, 31: 1103-1009.View ArticlePubMed
- Asensio JA, Demetriades D, Chahwan S, Gomez H, Hanpeter D, Velmahos G, Murray J, Shoemaker W, Berne TV: Approach to the management of complex hepatic injuries. J Trauma. 2000, 48: 66-69. 10.1097/00005373-200001000-00011.View ArticlePubMed
- Harman PK, Kron IL, McLachlan HD, Freedlender AE, Nolan SP: Elevated intra-abdominal pressure and renal function. Ann Surg. 1982, 196: 594-597. 10.1097/00000658-198211000-00015.PubMed CentralView ArticlePubMed
- Ridings PC, Bloomfield GL, Blocher CR, Sugerman HJ: Cardiopulmonary effects of raised intra-abdominal pressure before and after intravascular expansion. J Trauma. 1995, 39: 1071-1075. 10.1097/00005373-199512000-00010.View ArticlePubMed
- Bongard F, Pianim N, Dubecz S, Klein SR: Adverse consequences of increased intra-abdominal pressure on bowel tissue oxygen. J Trauma. 1995, 39: 519-525.View ArticlePubMed
- Bloomfield GL, Dalton JM, Sugerman HJ, Ridings PC, DeMaria EJ, Bullock R: Treatment of increasing intracranial pressure secondary to the acute abdominal compartment syndrome in a patient with combined abdominal and head trauma. J Trauma. 1995, 39: 1168-1170. 10.1097/00005373-199512000-00028.View ArticlePubMed
- Burch JM, Ortiz V, Richardson RJ, Martin RR, Mattox KL, Jordan GL: Abbreviated laparotomy and planned reoperation for critically injured patients. Ann Surg. 1992, 215: 476-484. 10.1097/00000658-199205000-00010.PubMed CentralView ArticlePubMed
- Shapiro MB, Jenkins DH, Schwab CW, Rotondo MF: Damage control: collective review. J Trauma. 2000, 49: 969-978. 10.1097/00005373-200011000-00033.View ArticlePubMed
- Stone PA, Hass SM, Flaherty SK, DeLuca JA, Lucente FC, Kusminsky RE: Vacuum-assisted fascial closure for patients with abdominal trauma. J Trauma. 2004, 57: 1082-1086. 10.1097/01.TA.0000149248.02598.9E.View ArticlePubMed
- Suliburk JW, Ware DN, Balogh Z, McKinley BA, Cocanour CS, Kozar RA, Moore FA, Ivatury RR: Vacuum-assisted closure achieves early fascial closure of open abdomens after severe trauma. J Trauma. 2003, 55: 1155-1161. 10.1097/01.TA.0000100218.03754.6A.View ArticlePubMed
- Deva AK, Siu C, Nettle WJ: Vacuum-assisted closure of a sacral pressure sore. J Wound Care. 1997, 6: 311-312.PubMed
- Moisidis E, Heath T, Boorer C, Ho K, Deva AK: A prospective, blinded, randomized, controlled clinical trial of topical negative pressure use in skin grafting. Plast Reconstr Surg. 2004, 114: 971-922.View Article
- Alvarez AA, Maxwell GL, Rodriguez GC: Vacuum-assisted closure for cutaneous gastrointestinal fistula management. Gynecol Oncol. 2001, 80: 413-416. 10.1006/gyno.2000.6092.View ArticlePubMed
- Brown KM, Harper FV, Aston WJ, O’Keefe PA, Cameron CR: Vacuum-assisted closure in the treatment of a 9-year-old child with severe and multiple dog bite injuries of the thorax. Ann Thorac Surg. 2001, 72: 1409-1410. 10.1016/S0003-4975(01)02844-2.View ArticlePubMed
- Lam WL, Garrido A, Stanely PR: Use of topical negative pressure in the treatment of chronic osteomyelitis. A case report. J Bone Joint Surg Am. 2005, 87: 622-624. 10.2106/JBJS.C.01743.View ArticlePubMed
- Whelan C, Stewart J, Schwartz BF: Mechanics of wound healing and importance of vacuum assisted closure in urology. J Urol. 2005, 173: 1463-1470. 10.1097/01.ju.0000157339.05939.21.View ArticlePubMed
- Schaffzin DM, Douglas JM, Stahl TJ, Smith LE: Vacuum-assisted closure of complex perineal wounds. Dis Colon Rectum. 2004, 47: 1745-1748. 10.1007/s10350-004-0633-9.View ArticlePubMed
- Nugent N, Lannon D, O’Donnell M: Vacuum-assisted closure - a management option for the burns patient with exposed bone. Burns. 2005, 31: 390-393. 10.1016/j.burns.2004.10.019. Epub 2005 Jan 22View ArticlePubMed
- Sjögren J, Gustafsson R, Nilsson J, Malmsjö M, Ingemansson R: Clinical outcome after poststernotomy mediastinitis: vacuum-assisted closure versus conventional treatment. Ann Thorac Surg. 2005, 79: 2049-2055. 10.1016/j.athoracsur.2004.12.048.View ArticlePubMed
- Pusateri AE, Delgado AV, Dick EJ, Martinez RS, Holcomb JB, Ryan KL: Application of a granular mineral-based hemostatic agent (QuikClot) to reduce blood loss after grade V liver injury in swine. J Trauma. 2004, 57: 555-562. 10.1097/01.TA.0000136155.97758.CD.View ArticlePubMed
- Carrera RM, Pacheco AM, Caruso J, Mastroti RA: Intraosseous hypertonic saline solution for resuscitation of uncontrolled, exsanguinating liver injury in young Swine. Eur Surg Res. 2004, 36: 282-292. 10.1159/000079913.View ArticlePubMed
- Pusateri AE, Modrow HE, Harris RA, Holcomb JB, Hess JR, Mosebar RG, Reid TJ, Nelson JH, Goodwin CW, Fitzpatrick GM, McManus AT, Zolock DT, Sondeen JL, Cornum RL, Martinez RS: Advanced hemostatic dressing development program: animal model selection criteria and results of a study of nine hemostatic dressings in a model of severe large venous hemorrhage and hepatic injury in Swine. J Trauma. 2003, 55: 518-526. 10.1097/01.TA.0000075336.92129.27.View ArticlePubMed
- Pusateri AE, McCarthy SJ, Gregory KW, Harris RA, Cardenas L, McManus AT, Goodwin CW: Effect of a chitosan-based hemostatic dressing on blood loss and survival in a model of severe venous hemorrhage and hepatic injury in swine. J Trauma. 2003, 54: 177-182. 10.1097/00005373-200301000-00023.View ArticlePubMed
- Katz LM, Manning JE, McCurdy S, Pearce LB, Gawryl MS, Wang Y, Brown C: Carolina Resuscitation Group. HBOC-201 improves survival in a swine model of hemorrhagic shock and liver injury. Resuscitation. 2002, 54: 77-87. 10.1016/S0300-9572(02)00053-9.View ArticlePubMed
- Pusateri AE, Holcomb JB, Harris RA, MacPhee MJ, Charles NC, Beall LD, Hess JR: Effect of fibrin bandage fibrinogen concentration on blood loss after grade V liver injury in swine. Mil Med. 2001, 166: 217-222.PubMed
- Holcomb JB, Pusateri AE, Harris RA, Charles NC, Gomez RR, Cole JP, Beall LD, Bayer V, MacPhee MJ, Hess JR: Effect of dry fibrin sealant dressings versus gauze packing on blood loss in grade V liver injuries in resuscitated swine. J Trauma. 1999, 46: 49-57. 10.1097/00005373-199901000-00009.View ArticlePubMed
- Holcomb JB, Pusateri AE, Harris RA, Reid TJ, Beall LD, Hess JR, MacPhee MJ: Dry fibrin sealant dressings reduce blood loss, resuscitation volume, and improve survival in hypothermic coagulopathic swine with grade V liver injuries. J Trauma. 1999, 47: 233-242. 10.1097/00005373-199908000-00002.View ArticlePubMed
- Meldrum DR, Moore FA, Moore EE, Haenel JB, Cosgriff N, Burch JM, Jack A: Barney Resident Research Award. Cardiopulmonary hazards of perihepatic packing for major liver injuries. Am J Surg. 1995, 170: 537-542. 10.1016/S0002-9610(99)80011-7.View ArticlePubMed
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.