The world is scrutinizing every cohort and every outcome for patients with coronavirus disease (COVID-19), particularly the most critically ill who are receiving mechanical ventilation. The numbers that have been published are all over the place, and some of them—such as very high mortality—are causing panic. Two major issues are at play in these epidemiological studies. The first is when to intubate and assessment of the rates of intubation and mechanical ventilation for hospitalized patients in cohorts from across the world. The second is the reported mortality for patients who receive mechanical ventilation. Presentation and interpretation of the data for both of these issues is not straightforward and never has been. However, there are ways we can improve assessment of these cohort studies.
“He claimed that the Americans had put their patients in the respirators far too early—certainly they would not have been ventilated in Copenhagen. It’s no wonder they survived, he claimed, because they didn’t need treatment in the first place” (1). That is not a quote from 2020 but refers to Dr. Henry Lassen in 1952. He and his team were dealing with an overwhelming polio epidemic and a high rate of respiratory failure among his patients, and he was scrutinizing data from California. It turns out that the same debate we are now having regarding early versus late(r) use of mechanical ventilation and when patients need to receive mechanical ventilation has been going on since the birth of intensive care 70 years ago (1,2).
Conscientious writers and editors have always insisted on describing patients as having “received” mechanical ventilation rather than having a “need” for mechanical ventilation because we have never fully agreed on who is in need. What may have seemed like quibbling over semantics now has large repercussions. What we are seeing in the current publications on COVID-19 are different rates of invasive mechanical ventilation across the world that have always existed, but these differences are now writ large because it is a particularly high-stakes game of worldwide data interpretation and a desperation to learn as much as possible from the experiences of others. In a sampling of some of the larger epidemiologic studies of patients with COVID-19 to date, rates of invasive mechanical ventilation among patients admitted to ICUs range from 29.1% in one Chinese study (3) to 89.9% in a U.S. study (4) and anywhere from 2.3% of patients admitted to the hospital up to 33.1% (Table 1).
|Study||Location||Hospitalized (n)||ICU Admission (n)||Invasive Mechanical Ventilation|
|n||Percent of ICU Patients||Percent of Hospitalized Patients|
|Richardson (4)||New York City||5,700||1,281||1,151||89.9||20.2|
|Petrilli (17)||New York City||1,999||534*||445||83.3||22.3|
|Goyal (13)||New York City||393||NA||130||NA||33.1|
|Grasselli (15)||Lombardy, Italy||NA||1,300‡||1,150||88.5||NA|
|Zhou (18)||Wuhan, China||191||50||32||64.0||16.8|
|Wang (3)||Wuhan, China||NA||344||100||29.1||NA|
Many issues, unrelated to the virus itself, are embedded in these epidemiological reports. First is the clinical decision-making, which has always varied, even when dealing with “classic” acute respiratory distress syndrome. For example, in the Lung Safe study (of patients without COVID-19), despite everyone meeting inclusion criteria for acute respiratory distress syndrome, 15% of patients were receiving noninvasive ventilation on the first 2 days after enrolment in the cohort (5). In a study of variation by Mehta and colleagues looking at patients who had what were termed “strong evidence” conditions for receiving noninvasive ventilation, the authors found huge variability in use of this modality across California hospitals, ranging from 18.6% of patients in the lowest quartile of hospitals up to 42.0% in the highest quartile, with similar variability in receipt of invasive mechanical ventilation (6). We have never been able to agree on triggers for ventilatory support, even with diseases that are much better known and understood than COVID-19.
Second is availability of resources, which is a large concern right now. Availability of resources has always varied between countries (7), influencing thresholds for admission to ICU, perception of “need” for mechanical ventilation, and duration of continued invasive life-supporting therapies (8, 9). However, what is linked with variability in resources, and is perhaps the most important piece that gets little airtime, is the expectations and preferences for care that are often driven by cultural norms (10). This variability in preferences is intertwined with resources and always will be a huge factor in understanding the data coming out of different countries; for example, in 2008, Gray and colleagues published a large randomized controlled trial comparing noninvasive ventilation to conventional oxygen therapy for patients with acute cardiogenic pulmonary edema. The trial was “negative” for its primary outcome; there was no difference in 7-day mortality between the groups. But if you look more closely, it becomes apparent that among those who died within 7 days, a maximum of 30% were placed on a ventilator when their treatment began to fail (11). This study was done in the United Kingdom with about sevenfold fewer ICU beds than in the United States (7). As a practitioner in the United States, I have always found this trial difficult to interpret; what would have happened if patients had received mechanical ventilation? Is it possible there was a signal that was lost without the use of this rescue support? We cannot know. And we also do not know how many of those decisions not to place patients on ventilators were due to patient and family preference versus availability of ventilators at the time.
Transparency regarding resources, preferences, and clinical decision-making can aid the reader in interpretation of data. Basic information, such as the country or location of the study and the relative availability of ICU beds should be included wherever possible. For example, care patterns when only 1% of a hospital’s beds are ICU beds will likely be different than in a hospital where they constitute 20% of hospitals beds; providing such information in the methods of a study will help readers understand the data. Similarly, information on care preferences, such as how many patients preferred not to receive mechanical ventilation (because of age, comorbidity, or other personal preference) would aid in interpreting data, such as when reporting that only 20.2% of those who died with COVID-19 received this intervention (12). Furthermore, transparency regarding clinical practices such as the approach to the use of invasive mechanical ventilation matters. As an example, the recent paper by Goyal and colleagues provided the information that they used an “early intubation strategy” as an explanation for their high (33.1%) rate of mechanical ventilation among hospitalized patients (13); even more information regarding their thresholds for intubation would be helpful. In other words, the more contextualization for the reader, the better.
What is the mortality for the patients who receive mechanical ventilation with COVID-19? In the United Kingdom, newspaper headlines initially claimed that 65% of patients who receive mechanical ventilation are dying, and a paper published in the Journal of the American Medical Association on New York patients initially included an abstract stating that the mortality for mechanically ventilated patients was 88% (4). However, denominators being used matter. In data from the United Kingdom and from New York, the denominators excluded people who were still in the ICU on a ventilator (4, 14). In a study from Italy, those in the ICU were included in the denominator (15), and the abstract for the data by Richardson and colleagues has since been corrected to report the percentage of patients alive, dead, and still in the ICU to try to avoid this misinterpretation. We need to know the outcome for everyone before we can draw firm conclusions. Mortality may be higher than we hope, but excluding all those still receiving care is causing confusion to readers with less understanding of epidemiological principles. We need to ensure uncertainty is presented either in a form that clearly highlights the large pool of individuals still without clear outcomes or by presenting estimated mortality using the range of possible numbers assuming best- and worst-case scenarios; right now, those ranges look wide because of the large number of people still being cared for in ICUs (Table 2). What we can say from these data is that it appears that many patients who receive mechanical ventilation may receive it for a prolonged period of time, requiring extensive follow-up to know their ultimate outcomes.
|Study||Location||Total (n)||Died (n)||Survived to ICU Discharge (n)||Still Receiving Care (n)||Range of Possible Mortality (%)|
|Richardson (4)||New York City||1,151||282||38 (hospital)||831||24.5–96.7|
|Grasselli (15)‡||Lombardy, Italy||1,581||405||256||920||25.6–83.8|
Headlines extolling very high mortality have consequences beyond the shock value; doctors and nurses may read them and feel that what they are doing is futile. When 80% or 90% of the patients you are risking your life to take care of are dying, it’s harder to continue. Patients and families may panic; if you hear that someone you love has been moved to the ICU, appropriate concern turns into terror. Also, those individuals in countries with fewer resources will wonder whether they should even bother trying to procure ventilators to care for these patients. This sort of misinterpretation of the current data does no one any service.
It is not the job of the scientific community to police the press. However, epidemiological studies are being scrutinized by people without scientific backgrounds in a way that has rarely occurred. Therefore, it is important that we provide data that is as accurate as possible but also presented to limit the ability of readers to seize on a specific number that only tells part of the story. It may be more important than before to ask a “nonscientific reader” to look at an abstract or read a manuscript before it goes to press; and editors who have more expertise than most researchers in clear communication of data must help scientific writers ensure transparent presentation of results, setting aside any focus on generating headlines or publicity.
The goal of using invasive mechanical ventilation for patients with COVID-19 is universal: to save lives. Our goal is to reduce mortality to ensure it is low for everyone, irrespective of age, comorbidities, or frailty, with judicious implementation of invasive ventilation when it is deemed necessary (Figure 1, black line). However, some aspects of human physiology are also universal; the mortality for patients placed on ventilators who are in their 80s and 90s or with severe comorbidities has always been very high, even in the best of times and best of circumstances. In an epidemiological study from 2010, 50% of those age 85 and above who were ventilated in the United States died in the hospital (16). Certain patterns will start to replicate themselves across countries and cultures that will become most apparent when we ultimately combine all these data to look at averages, removing the extremes. There will likely be differential benefits from mechanical ventilation across age groups and those with different comorbidities or severe frailty; we are unlikely to be able to reduce mortality to the same flat rate for all with the use of mechanical ventilation (Figure 1, blue line).
The decision to place a patient with COVID-19 on a ventilator is not clear-cut and neither are the outcomes. We will never fully understand how or why these data from each country look so different. However, recognizing when patterns of care and outcomes reported fall outside of one’s own norms are essential to make the best use of these data for real-time care. So, while we scrutinize these reports and extract what is universal and can be applied to our understanding and care of patients locally, we need to recognize and report on the enormous drivers of differences and be vigilant in presentation of data to minimize confusion in interpretation. The variability of findings has always existed in studies of mechanical ventilation for critically ill patients. COVID-19 is not an exception, merely an amplifier of these differences.
|1.||Warwicker P. Polio: the story of the great polio epidemic in Copenhagen in 1952. Copenhagen, Denmark: Gyldendal; 2006.|
|2.||Gattinoni L, Chiumello D, Caironi P, Busana M, Romitti F, Brazzi L, et al. COVID-19 pneumonia: different respiratory treatments for different phenotypes? Intensive Care Med [online ahead of print] 14 Apr 2020; DOI: 10.1007/s00134-020-06033-2.|
|3.||Wang Y, Lu X, Chen H, Chen T, Su N, Huang F, et al. Clinical course and outcomes of 344 intensive care patients with COVID-19. Am J Respir Crit Care Med [online ahead of print] 8 Apr 2020; DOI: 10.1164/rccm.202003-0736LE.|
|4.||Richardson S, Hirsch JS, Narasimhan M, Crawford JM, McGinn T, Davidson KW, et al. Presenting characteristics, comorbidities, and outcomes among 5700 patients hospitalized with COVID-19 in the New York city area. JAMA 2020;323:2052–2059.|
|5.||Bellani G, Laffey JG, Pham T, Madotto F, Fan E, Brochard L, et al.; LUNG SAFE Investigators; ESICM Trials Group. Noninvasive ventilation of patients with acute respiratory distress syndrome: insights from the LUNG SAFE study. Am J Respir Crit Care Med 2017;195:67–77.|
|6.||Mehta AB, Douglas IS, Walkey AJ. Evidence-based utilization of noninvasive ventilation and patient outcomes. Ann Am Thorac Soc 2017;14:1667–1673.|
|7.||Wunsch H, Angus DC, Harrison DA, Collange O, Fowler R, Hoste EA, et al. Variation in critical care services across North America and Western Europe. Crit Care Med 2008;36:2787–2793, e1–e9.|
|8.||Wunsch H, Linde-Zwirble WT, Harrison DA, Barnato AE, Rowan KM, Angus DC. Use of intensive care services during terminal hospitalizations in England and the United States. Am J Respir Crit Care Med 2009;180:875–880.|
|9.||Wunsch H, Angus DC, Harrison DA, Linde-Zwirble WT, Rowan KM. Comparison of medical admissions to intensive care units in the United States and United Kingdom. Am J Respir Crit Care Med 2011;183:1666–1673.|
|10.||Yarnell CJ, Fu L, Manuel D, Tanuseputro P, Stukel T, Pinto R, et al. Association between immigrant status and end-of-life care in Ontario, Canada. JAMA 2017;318:1479–1488.|
|11.||Gray A, Goodacre S, Newby DE, Masson M, Sampson F, Nicholl J; 3CPO Trialists. Noninvasive ventilation in acute cardiogenic pulmonary edema. N Engl J Med 2008;359:142–151.|
|12.||Xie J, Tong Z, Guan X, Du B, Qiu H. Clinical characteristics of patients who died of coronavirus disease 2019 in China. JAMA Netw Open 2020;3:e205619.|
|13.||Goyal P, Choi JJ, Pinheiro LC, Schenck EJ, Chen R, Jabri A, et al. Clinical characteristics of covid-19 in New York City. N Engl J Med [online ahead of print] 17 Apr 2020; DOI: 10.1056/NEJMc2010419.|
|14.||ICNARC. ICNARC report on COVID-19 in critical care, 10 April 2020 [accessed 2020 Apr 15]. https://www.icnarc.org/.|
|15.||Grasselli G, Pesenti A, Cecconi M. Critical care utilization for the COVID-19 outbreak in Lombardy, Italy: early experience and forecast during an emergency response. JAMA 2020;323:1545–1546.|
|16.||Wunsch H, Linde-Zwirble WT, Angus DC, Hartman ME, Milbrandt EB, Kahn JM. The epidemiology of mechanical ventilation use in the United States. Crit Care Med 2010;38:1947–1953.|
|17.||Petrilli CM, Jones SA, Yang J, Rajagopalan H, O’’Donnell LF, Chernyak Y, et al. Factors associated with hospitalization and critical illness among 4,103 patients with COVID-19 disease in New York city [preprint]. medRxiv; 2020 [accessed 2020 Apr 15]. Available from: https://www.medrxiv.org/content/10.1101/2020.04.08.20057794v1.|
|18.||Zhou F, Yu T, Du R, Fan G, Liu Y, Liu Z, et al. Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort study. Lancet 2020;395:1054–1062.|
|19.||Guan WJ, Ni ZY, Hu Y, Liang WH, Ou CQ, He JX, et al.; China Medical Treatment Expert Group for Covid-19. Clinical characteristics of coronavirus disease 2019 in China. N Engl J Med 2020;382:1708–1720.|
*H.W. is Associate Editor of AJRCCM. Her participation complies with American Thoracic Society requirements for recusal from review and decisions for authored works.
Supported by a Canada Research Chair in Critical Care Organization and Outcomes, an Excellence in Research Award from the Department of Anesthesia at the University of Toronto, and the NIH (R01 DA042299; HL137816).
Originally Published in Press as DOI: 10.1164/rccm.202004-1385ED on May 13, 2020