Predicting in-hospital mortality in pulmonary embolism patients: development and external validation of the PATHOS score

Article information

Clin Exp Emerg Med. 2023;10(1):26-36
Publication date (electronic) : 2022 November 17
doi : https://doi.org/10.15441/ceem.22.369
1Department of Translational Medicine, University of Ferrara, Ferrara, Italy
2University of Ferrara School of Emergency Medicine, Ferrara, Italy
3Department of Emergency Medicine, Gemelli University Hospital, Catholic University of the Sacred Heart of Rome, Rome, Italy
4Department of Emergency Medicine, St. Anna Hospital, Ferrara, Italy
5Department of Internal Medicine, Gemelli University Hospital, Catholic University of the Sacred Heart of Rome, Rome, Italy
Correspondence to: Roberto De Giorgio Department of Translational Medicine, University of Ferrara, Via Aldo Moro 8, Ferrara 40127, Italy Email: dgrrrt@unife.it
*Michele Domenico Spampinato and Marcello Covino contributed equally to this study as co-first authors.
Received 2022 August 23; Revised 2022 October 6; Accepted 2022 October 27.

Abstract

Objective

According to the 2019 European Society of Cardiology (ESC) guidelines on pulmonary embolism (PE), prognosis is calculated using the Pulmonary Embolism Severity Index (PESI), a complex score with debated validity, or simplified PESI (sPESI). We have developed and validated a new risk score for in-hospital mortality (IHM) of patients with PE in the emergency department.

Methods

This retrospective, dual-center cohort study was conducted in the emergency departments of two third-level university hospitals. Patients aged >18 years with a contrast-enhanced computed tomography-confirmed PE were included. Clinical variables and laboratory tests were evaluated blindly to IHM. Multivariable logistic regression was performed to identify the new score’s predictors, and the new score was compared with the PESI, sPESI, and shock index.

Results

A total of 1,358 patients were included in this study: 586 in the derivation cohort and 772 in the validation cohort, with a global 10.6% of IHM. The PATHOS scores were developed using independent variables to predict mortality: platelet count, age, troponin, heart rate, oxygenation, and systolic blood pressure. The PATHOS score showed good calibration and high discrimination, with an area under the receiver operating characteristics curve of 0.83 (95% confidence interval [CI], 0.77–0.89) in the derivation population and 0.74 (95% CI, 0.68–0.80) in the validation cohort, which is significantly higher than the PESI, sPESI, and shock index in both cohorts (P<0.01 for all comparisons).

Conclusion

PATHOS is a simple and effective prognostic score for predicting IHM in patients with PE in an emergency setting.

INTRODUCTION

Pulmonary embolism (PE) is the migration of solid material through the bloodstream to the pulmonary circulation. PE is one of the leading causes of mortality in the USA and Europe, causing approximately 300,000 deaths per year in the USA [1]. PE has a complex pathophysiology: the occlusion of 30% to 50% of the total cross-sectional area of the pulmonary arterial bed causes a significant increase in pulmonary artery pressure and acute right ventricular (RV) afterloads [2]. An acute RV afterload leads to decreased RV and cardiac output, which is potentially responsible for obstructive shock, while pulmonary circulation worsens the exchange of oxygen due to a ventilation-perfusion mismatch [3]. However, the extent of pulmonary arterial bed involvement is highly variable, and the same clot migration could have different effects on pulmonary and systemic circulation depending on each patient’s cardiac and pulmonary status. Therefore, the symptoms, clinical signs, and laboratory data can be highly variable, but a timely diagnosis and prognostic assessment are nonetheless essential for correct management of this condition.

The most recent guidelines on PE were published in 2020 by the European Society of Cardiology (ESC) and recommend the use of a diagnostic and therapeutic strategy based on the predicted risk of either PE or short-term mortality. Patients with hemodynamic instability are at higher risk of early mortality, and patients without hemodynamic instability need further risk stratification according to the Pulmonary Embolism Severity Index (PESI) or simplified PESI (sPESI), RV dysfunction on bedside ultrasonography or computed tomography pulmonary angiography (CTPA), and elevated circulating biomarkers of myocardial injury [4]. Although the PESI is one of the best-validated risk scores in PE, it includes 11 items, which makes it unsuitable for a quick calculation at the bedside. Moreover, its use is recommended as a class IIa, level of evidence B, suggesting that there is still conflicting evidence on the accuracy of this score. Vamsidhar et al. [5] demonstrated no difference in PESI scores among patients with and without adverse events. A recent multicenter study [6] showed that PESI and sPESI scores yielded modest results in discriminating 7-day mortality, with an area under the receiver operating characteristic curve (AUROC) ranging from 0.62 to 0.67 and no difference from the ESC prognostic classification. Moreover, the 30-day all-cause mortality risk for PESI and sPESI scores derived from retrospective cohorts and their inconsistency in estimating shorter outcomes limits their clinical utility. Apart from a few exceptions (e.g., Barnes et al. [6]), there is a lack of published studies comparing the prognostic power of different risk scores [7]. Our objective in this study was to develop and validate a new, simple prognostic score for PE and compare its accuracy with that of the PESI, sPESI, and shock index (SI) in predicting all-cause in-hospital mortality (IHM) in an unselected, real-life population of patients admitted to the emergency department (ED) with a diagnosis of PE.

METHODS

Ethical statements

This study was conducted in accordance with the Declaration of Helsinki and approved by the Central Emilia Wide Area Ethical Committee of the Emilia-Romagna Region (CE-AVEC; No. 149/2022/ Oss/AOUFe). Informed consent was waived due to the study’s retrospective nature. The TRIPOD (transparent reporting of a multivariable prediction model for individual prognosis or diagnosis) statement [8] has been followed in preparing this manuscript (Supplementary Material 1).

Study design

This retrospective observational study was conducted in the EDs of two third-level university hospitals, each with more than 80,000 patient visits per year. The two EDs are in very different geographic areas with equally different demographic and sociocultural characteristics: a large, industrialized metropolis of almost 3 million people in central Italy and a city in northern Italy serving an area of 350,000 inhabitants. Both institutions are referral centers for cardiopulmonary emergencies in their respective districts. Clinical data were collected by analyzing the hospital data systems for vital signs, laboratory data, and demographic data. The clinical data used are those presented upon arrival in the ED. All variables are entered into the new model as dichotomous variables; for continuous variables, the best cutoff was identified as the one with the highest Youden index. The already proposed cutoff was maintained unless it differed clinically from the value with the highest Youden index. Platelet count was evaluated as abnormal when it was <100 or >400×103/μL, as already proposed [9]. Different troponin determination techniques have been used over time in the two hospitals with the following normal upper limits: (1) high sensitivity cardiac-Troponin I (hs-cTnI) <20 and <12 ng/L for male and female patients, respectively, in the derivation cohort in the years 2018–2021; and (2) hs-cTnI with a normal range of 0.04 ng/mL in the years 2018–2020 and hs-cTnI with a normal range of <57 and <37 ng/L for male and female patients, respectively, from May 3, 2020, to December 2021 in the validation cohort. Therefore, we decided to report the troponin levels only as above the normal limit provided by the laboratory for the given determination. Altered mental status was defined as the occurrence of disorientation, lethargy, stupor, or coma upon admission to the ED. PESI and sPESI were calculated for each patient according to the 2019 ESC guidelines on PE [4], and the SI was calculated as heart rate/systolic blood pressure and considered to be positive at values >0.7 (see Table 1 for score calculation).

Prognostic scores assessed in the derivation and validation cohorts under investigation

IHM was reported as all-cause in-hospital death following admission, regardless of the length of in-hospital stay (LoS). The occurrence of IHM and LoS were both evaluated by a second investigator, who checked the information system blinded to other clinical data. IHM was reported as secondary to all causes of inhospital death.

Study patients and enrollment criteria

All patients aged >18 years evaluated in the ED for acute PE as the main diagnosis from January 1, 2018 to May 30, 2021 were included. Patients with PE diagnoses were retrieved using a computerized search of ED discharge codes. The patients whose diagnosis of PE had been made using contrast chest CT were included in the study cohort.

Patients who were pregnant, did not receive a PE diagnosis in the ED, or had an inconsistent or incomplete set of data for calculating the evaluated scores were excluded from the final analysis.

Score derivation

To build a new prognostic score, we randomly chose one ED as the derivation cohort. We performed univariate regression analyses to identify predictors of IHM. Among those predictors, only items identified as independent predictors in the multivariable regression analysis were included in the final logistic model. To assign a value to each of the included variables, we created a simple linear regression model containing all the predictors, and points were attributed to each variable by considering the adjusted standardized coefficients of each item. The model was checked for multicollinearity via variance inflation factor analysis [10]. The internal validity of the score was confirmed using bootstrap analysis [11].

Score validation

ED patients in the other hospital were enrolled as the validation cohort. Clinical charts were retrospectively analyzed to extract the clinical data required to compute the PESI, sPESI, SI, new prognostic score, and IHM. The clinical data were extracted blindly to IHM, and all scores were calculated as reported in Table 1. The calibration and discrimination of the new score were assessed, and its diagnostic accuracy was compared with that of the PESI, sPESI, and SI. A multivariable logistic regression analysis was performed for each score to assess the predictive value of each item in terms of odds ratios (ORs) and 95% confidence interval (CIs).

Statistical analysis

Normally distributed data are described as the mean±standard deviation; non-normally distributed data are described as the median and interquartile range; and categorical data are reported as absolute numbers and percentages. Normally distributed data were compared via independent sample t-testing or Welch t-testing in cases of unequal variance between groups. Non-normally distributed data were compared via the Mann-Whitney U-test. The Pearson chi-square test was used to compare categorical dependent variables among at least two independent groups. Missing data not essential for score calculation were imputed via regression multiple imputation analysis [12].

The discrimination ability of each score was evaluated via the AUROC. The AUROCs of the scores were compared via the DeLong test [13] in the derivation, validation, and global cohorts. The best cutoff was identified according to the highest Youden index [14]. The category-based net reclassification improvement (NRI) was calculated according to Leening et al. [15] to evaluate the difference in risk stratification between the developed score and the PESI and sPESI. The newly developed score was compared to the five risk categories of the PESI (class I, <65; class II, 66–85; class III, 86–105; class IV, 106–125; and class V, >125) according to the ESC 2019 guidelines [4]. The newly developed score was compared to the sPESI by identifying a low-risk class for predicted IHM <5% and a high-risk class for predicted IHM >5%. The event NRI, non-event NRI, and overall NRI are reported for each comparison. Calibration of the developed model was assessed via the Hosmer-Lemeshow test in the derivation and validation groups [16].

Statistical analyses were performed using IBM SPSS ver. 25 (IBM Corp) and MedCalc ver. 17.6 (MedCalc Software).

RESULTS

During the study period, 2,117 patients were admitted for PE or suspected PE: 998 in the derivation cohort and 1,119 in the validation cohort. However, 307 and 251 patients were excluded from the derivation and validation cohorts, respectively, for incomplete data. One hundred and five patients from the derivation cohort and 92 patients from the validation cohort were excluded because of non-confirmed PE, and four patients from the validation cohort were excluded due to pregnancy (Fig. 1). Therefore, 1,358 patients were included in the study: 586 in the derivation cohort and 772 in the validation cohort. The patients had a mean age of 69.88 years, and 44.2% of them were male, with a median LoS of 7.5 days (interquartile range, 4.3–13.0 days). Overall, 10.5% of the included patients died in the hospital (10.2% in the derivation group and 10.6% in the validation group, P=0.818). Compared with the derivation cohort, the validation cohort was younger and presented to the ED with a higher respiratory rate, heart rate (HR), peripheral oxygen saturation (SpO2), and body temperature; lower systolic blood pressure (SBP); and less-frequent altered mental status. According to the lab values, the validation population presented with a higher platelet count and a higher rate of troponin above the given cutoff value. Patients in the validation cohort had a more frequent history of cancer, lower PESI and higher SI scores, and no difference in the sPESI and PATHOS (platelets, age, troponin, HR, oxygenation, and SBP) scores from patients in the derivation cohort. The LoS was higher in the validation population, with no difference in terms of IHM between the groups (Table 2). Patients with IHM were older and had lower SpO2, SBP, and diastolic BP; higher HR; a higher frequency of altered mental status, troponin value >cutoff, and abnormal platelet count; and higher PESI, sPESI, SI, and PATHOS scores than those who survived to discharge in both the derivation and validation cohorts (Table 3).

Fig. 1.

Flowchart of included and excluded patients. PE, pulmonary embolism; CTPA, computed tomography pulmonary angiography; ED, emergency department.

Comparison of demographic and clinical features between the derivation and validation cohorts

Comparison of general features in relation to in-hospital mortality in the derivation and validation cohorts

Among all the variables identified as potential predictors in the derivation cohort (Table 3), only HR demonstrated a different better cutoff than the previously published value (100 pulses per minute [ppm] instead of 110 ppm). In the end, platelet count <100 or >400×103/μL, age >80 years, troponin >the given cutoff, HR >100 ppm, SpO2 <90%, and SBP <100 mmHg were identified as independent predictors in the multivariable logistic regression and included in the PATHOS score (Tables 1, 4). All PATHOS score items were also shown to be independent predictors in the validation cohort, whereas only three of the 11 PESI items (HR, SBP, and SpO2) were independent predictors in both groups, with age and altered mental status found to be independent predictors only in the validation group. Among the sPESI items, a history of cancer was not an independent predictor in the derivation cohort, and chronic heart failure was not an independent predictor in either cohort (Table 4).

Characteristics of the analyzed prognostic scores: multivariable logistic regression analysis for in-hospital death

The linear regression model analysis of the PATHOS score showed a B standardized coefficient equal to 0.162 (P=0.001) for platelet count <100 or >400×103/μL, 0.103 (P=0.038) for age >80 years, 0.112 (P=0.031) for troponin >the cutoff, 0.131 (P=0.010) for HR >100 ppm, 0.145 (P=0.005) for SpO2 <90%, and 0.178 (P<0.001) for SBP <100 mmHg. Therefore, one point was assigned to each item. Moreover, each item showed a variance inflation factor of <2.001, excluding multicollinearity.

The PATHOS score showed good calibration, with a Hosmer-Lemeshow χ2=6.15 and P=0.52 in the derivation group and χ2=1.63 and P=0.977 in the validation group. In the derivation group, the PATHOS score had the highest global accuracy, with an AUROC of 0.827 (95% CI, 0.769–0.885), which was significantly higher than that of the PESI (AUROC, 0.786; 95% CI, 0.72–0.85; P<0.01), sPESI (AUROC, 0.791; 95% CI, 0.726–0.856; P=0.01), and SI (AUROC, 0.64; 95% CI, 0.543–0.750; P<0.001) (Fig. 2).

Fig. 2.

The receiver operating characteristic (ROC) curves of the included scores of the derivation cohort. The area under the ROC curve (AUROC) of the shock index is 0.64 (95% confidence interval [CI], 0.543–0.750), the AUROC of the simplified Pulmonary Embolism Severity Index (sPESI) is 0.791 (95% CI, 0.726–0.856), the AUROC of the PESI is 0.786 (95% CI, 0.720–0.850), the AUROC of the PATHOS (platelets, age, troponin, heart rate, oxygenation, and systolic blood pressure) score is 0.827 (95% CI, 0.769–0.885).

When applied to the validation group, the PATHOS score had an AUROC of 0.74 (95% CI, 0.68–0.80), which was also significantly higher than that of the PESI (AUROC, 0.68; 95% CI, 0.61–0.74; P=0.013), with no difference between the PESI and sPESI (AUROC, 0.71; 95% CI, 0.64–0.77; P=0.24) or between the PESI and SI (AUROC, 0.67; 95% CI, 0.61–0.74; P=0.94) (Fig. 3). In the global cohort, a PATHOS score >0 showed a negative predictive value of 98.9 and a negative likelihood ratio of 0.09; whereas a PATHOS score >4 showed a positive predictive value equal to 47% with a positive likelihood ratio of 7. The best cutoff is a PATHOS score >2, which had 60% sensitivity, 81% specificity, a 3.3 likelihood ratio, 30% positive predictive value, and 94% negative predictive value. Moreover, a PATHOS score of 0 is associated with an all-cause IHM risk of 1.8%, a PATHOS score of 6 to IHM risk of 85%, and scores of 2 to 5 are progressively associated with different probabilities due to the slightly different risks associated with each predictor (Table 5).

Fig. 3.

The receiver operating characteristic (ROC) curves of the included scores of the validation cohort. The area under the ROC curve (AUROC) of the shock index is 0.67 (95% confidence interval [CI], 0.61–0.74), the AUROC of the simplified Pulmonary Embolism Severity Index (sPESI) is 0.71 (95% CI, 0.64–0.77), the AUROC of the PESI is 0.68 (95% CI, 0.61–0.74), the AUROC of the PATHOS (platelets, age, troponin, heart rate, oxygenation, and systolic blood pressure) score is 0.74 (95% CI, 0.68–0.80).

Characteristics of the PATHOS score in the whole cohort

As illustrated in Table 5, seven IHM risk classes were identified for the PATHOS score (range, 0–6). Comparing the PATHOS score with the PESI, the event NRI was –0.09, the non-event NRI was 0.31, and the overall NRI was 0.22. To compare the PATHOS score with the sPESI, a low risk of IHM was defined as PATHOS 0 to 1 and high risk of IHM as PATHOS >1. Comparing those two PATHOS score risk classes with the sPESI, the event NRI was –0.08, the non-event NRI was 0.29, and the overall NRI was 0.21.

DISCUSSION

Risk stratification, along with the prompt diagnosis and stabilization of critically ill patients, remains a cornerstone of an emergency physician’s daily practice. Predicting which patients have a high or low risk of adverse events determines the most appropriate setting for patients and appropriate resource allocation. The PESI is a complex score that uses 11 clinical parameters to calculate the risk of all-cause 30-day and 6-month mortality [17]. The complexity of the PESI leads to high interoperator variability among users [18,19] and a lower propensity to use it in clinical practice [20,21]. Although PE can significantly affect morbidity and mortality, not every 30-day mortality event is likely to be caused by PE, and a higher 30-day or 6-month mortality risk might not necessarily reflect the short-term mortality risk or the need for intensive care. IHM is recognized as a strong outcome, and correct risk stratification is fundamental for choosing to admit patients to the hospital and determining the intensity of care needed. In this study, we evaluated the prognostic accuracy of the PESI, sPESI, and SI and validated a newly developed risk score for IHM among patients with suspected PE. As reported in Table 3, patients with IHM had worse vital signs and higher PESI, sPESI, and PATHOS scores in both cohorts. However, similar to the results of Jimenez et al. [22] and Vinson et al. [23], different clinical items in the PESI and sPESI, such as sex, respiratory rate, body temperature, history of cancer, and presence of a chronic pulmonary disease, did not appear to be related to IHM in either of our cohorts; thus, those items increased the complexity of calculating the PESI and sPESI scores without improving their accuracy [2427]. In contrast, PATHOS is a simple, easy-to-remember, operator-independent metric that is based on fixed cutoff values and includes only clinical items significantly predictive of IHM. PATHOS demonstrated better diagnostic accuracy than PESI, sPESI, and SI in both the populations evaluated in this study (Figs. 2, 3). Notably, our two cohorts are very different in terms of demographic and clinical characteristics due to their different locations and resident populations, so they reflect the actual variety of patients and the need for a simple and effective score in an emergency setting. Whereas the PESI and sPESI demonstrated the same limitations in our two unselected cohorts, PATHOS score is based on fundamental and easily available items used to assess circulatory shock, pulmonary dysfunction, acute cardiac damage, and platelet count (the latter being an independent predictor of IHM in more conditions than just PE) [8,2830]. According to our results, the positive overall NRIs in the comparisons between PATHOS and PESI and PATHOS and sPESI confirm that PATHOS has better discrimination accuracy than the older measures, showing that a net percentage of 31% (PATHOS vs. PESI) and 29% (PATHOS vs. sPESI) of patients without IHM were correctly reclassified by the new measure. Thus, compared with the other two scores, PATHOS has a higher ability to estimate patients at low risk for IHM than the PESI and sPESI. Moreover, the PATHOS score identified patients with very different risks of IHM with good calibration and the highest accuracy. As shown in Table 5, PATHOS identified patient subsets with low (score, 0–1; <6%), moderate (score, 2–3; 6%–34%), and high risks (score, >3; >34%) of IHM. Moreover, because each clinical item has a slightly different prognostic value, we developed a regression equation (Table 5) to calculate the IHM risk based on the clinical features exhibited by each patient. Markers of cardiac dysfunction, such as those shown in ultrasonographic or chest CT evaluations of RV function, brain natriuretic peptide, or troponin [3134], improve the stratification accuracy of clinical scores and are recommended for correct patient categorization [4]. Moreover, the inclusion of troponin in the clinical score has the advantage of underlining the importance of this biomarker, which could be a valid surrogate of RV dysfunction [35]. Therefore, the PATHOS score is a valuable tool to stratify patients even in settings with no prompt access to echocardiography.

As with any retrospective study, this study has limitations that should be acknowledged. The study cohort included only patients with CTPA-confirmed PE in the ED, which could have led to the exclusion of undiagnosed patients with PE, potentially leading to an incorrect estimation of the evaluated scores. Also, we did not include an echocardiographic or CTPA evaluation of RV dysfunction among the considered items; thus, we could not calculate the ESC risk class. Although that could reduce the risk stratification accuracy, we focused on clinical and easy-to-obtain laboratory parameters to increase the versatility of the new prognostic score in any ED setting. Moreover, due to the lack of generally accepted approaches for estimating the sample size needed for risk prediction models, we did not calculate a formal sample size. However, our study far exceeds the number of events needed for the six-item model developed; thus, it is expected to provide very robust estimates based on the recommended “rule of ten events per predictor” in multivariable logistic regression analyses [36]. Because the PESI and sPESI were derived and validated in large datasets [37], the possible superiority of PATHOS over the PESI and sPESI requires more evidence. Further studies are needed to indicate that PATHOS can be practically applied in daily clinical practice in an ED.

In conclusion, the new PATHOS measure incorporates elements of the ESC classification in a simple, unique score and should be useful for stratifying the risk of patients with PE in different ED settings. Although the PESI and ESC classification remain the most recommended risk stratification tools, PATHOS could turn out to be the easiest and most accurate score in daily ED clinical practice if it can be validated in further prospective cohorts.

SUPPLEMENTARY MATERIAL

Supplementary material is available at https://doi.org/10.15441/ceem.22.369.

Supplementary Material 1.

TRIPOD (transparent reporting of a multivariable prediction model for individual prognosis or diagnosis) checklist: prediction model development and validation.

ceem-22-369-supplementary-Supplementary-1.pdf

Notes

CONFLICT OF INTEREST

No potential conflict of interest relevant to this article was reported.

FUNDING

None.

AUTHOR CONTRIBUTIONS

Conceptualization: MDS, MC, A Passaro, AG, RDG, FF; Data curation: MB, LDA, GG, ISF, TP, A Portoraro, MG, RP, GT; Formal analysis: MDS, MC; Investigation: A Portoraro, AG, RDG, FF; Methodology: MDS, MC, A Passaro, AG, RDG, FF; Project administration: AG, RDG, FF; Resources: MDS, RP, A Passaro; Software: MDS, MC; Supervision: A Passaro, AG, RDG, FF; Validation: MDS, MC, A Passaro, AG, RDG, FF; Visualization: all authors; Writing–original draft: MDS, MC, RDG, FF, MB, LDA, GG, ISF, TP, A Portoraro, MG; Writing–review & writing: all authors. All authors read and approved the final manuscript.

Acknowledgements

The authors would like to thank all the technical and administrative staff of he University Hospital of Ferrara and Gemelli University Hospital for their support in retrieving data, with special thanks to Elena Forini. The authors also thank Professor Stanley Lemeshow (Division of Biostatistics, College of Public Health, The Ohio State University, Columbus, OH, USA) for his valuable course held in Milan in 2022 and for his advice on the statistical analysis performed for this manuscript.

References

1. Wendelboe AM, Raskob GE. Global burden of thrombosis: epidemiologic aspects. Circ Res 2016;118:1340–7.
2. McIntyre KM, Sasahara AA. The hemodynamic response to pulmonary embolism in patients without prior cardiopulmonary disease. Am J Cardiol 1971;28:288–94.
3. Konstantinides SV, Torbicki A, Agnelli G, et al. 2014 ESC guidelines on the diagnosis and management of acute pulmonary embolism. Eur Heart J 2014;35:3033–69.
4. Konstantinides SV, Meyer G, Becattini C, et al. 2019 ESC guidelines for the diagnosis and management of acute pulmonary embolism developed in collaboration with the European Respiratory Society (ERS). Eur Heart J 2020;41:543–603.
5. Vamsidhar A, Rajasekhar D, Vanajakshamma V, et al. Comparison of PESI, echocardiogram, CTPA, and NT-proBNP as risk stratification tools in patients with acute pulmonary embolism. Indian Heart J 2017;69:68–74.
6. Barnes GD, Muzikansky A, Cameron S, et al. Comparison of 4 acute pulmonary embolism mortality risk scores in patients evaluated by Pulmonary Embolism Response Teams. JAMA Netw Open 2020;3:e2010779.
7. Kabrhel C, Okechukwu I, Hariharan P, et al. Factors associated with clinical deterioration shortly after PE. Thorax 2014;69:835–42.
8. Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMJ 2015;350:g7594.
9. Maestre A, Trujillo-Santos J, Riera-Mestre A, et al. Identification of low-risk patients with acute symptomatic pulmonary embolism for outpatient therapy. Ann Am Thorac Soc 2015;12:1122–9.
10. Kim JH. Multicollinearity and misleading statistical results. Korean J Anesthesiol 2019;72:558–69.
11. Steyerberg EW, Harrell FE Jr, Borsboom GJ, Eijkemans MJ, Vergouwe Y, Habbema JD. Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. J Clin Epidemiol 2001;54:774–81.
12. Yu L, Liu L, Peace KE. Regression multiple imputation for missing data analysis. Stat Methods Med Res 2020;29:2647–64.
13. DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 1988;44:837–45.
14. Fluss R, Faraggi D, Reiser B. Estimation of the Youden Index and its associated cutoff point. Biom J 2005;47:458–72.
15. Leening MJ, Vedder MM, Witteman JC, Pencina MJ, Steyerberg EW. Net reclassification improvement: computation, interpretation, and controversies: a literature review and clinician’s guide. Ann Intern Med 2014;160:122–31.
16. Hosmer DW, Hosmer T, Le Cessie S, Lemeshow S. A comparison of goodness-of-fit tests for the logistic regression model. Stat Med 1997;16:965–80.
17. Norton L, Cooper G, Sheerins O, et al. Clinical and radiological characteristics of acute pulmonary embolus in relation to 28- day and 6-month mortality. PLoS One 2021;16:e0258843.
18. Chan CM, Woods C, Shorr AF. The validation and reproducibility of the pulmonary embolism severity index. J Thromb Haemost 2010;8:1509–14.
19. Fraga M, Taffe P, Mean M, et al. The inter-rater reliability of the Pulmonary Embolism Severity Index. Thromb Haemost 2010;104:1258–62.
20. Faller N, Stalder O, Limacher A, et al. Frequency of use and acceptability of clinical prediction rules for pulmonary embolism among Swiss general internal medicine residents. Thromb Res 2017;160:9–13.
21. Shafiq A, Lodhi H, Ahmed Z, Bajwa A. Is the Pulmonary Embolism Severity Index being routinely used in clinical practice? Thrombosis 2015;2015:175357.
22. Jimenez D, Aujesky D, Moores L, et al. Simplification of the pulmonary embolism severity index for prognostication in patients with acute symptomatic pulmonary embolism. Arch Intern Med 2010;170:1383–9.
23. Vinson DR, Ballard DW, Mark DG, et al. Risk stratifying emergency department patients with acute pulmonary embolism: does the simplified Pulmonary Embolism Severity Index perform as well as the original? Thromb Res 2016;148:1–8.
24. Tamizifar B, Fereyduni F, Esfahani MA, Kheyri S. Comparing three clinical prediction rules for primarily predicting the 30- day mortality of patients with pulmonary embolism: the “Simplified Revised Geneva Score,” the “Original PESI,” and the “Simplified PESI”. Adv Biomed Res 2016;5:137.
25. Chan CM, Woods CJ, Shorr AF. Comparing the pulmonary embolism severity index and the prognosis in pulmonary embolism scores as risk stratification tools. J Hosp Med 2012;7:22–7.
26. Gokcek K, Gokcek A, Demir A, Yildirim B, Acar E, Alatas OD. In-hospital mortality of acute pulmonary embolism: predictive value of shock index, modified shock index, and age shock index scores. Med Clin (Barc) 2022;158:351–5.
27. Yu S, Zhou H, Li Y, et al. PERFORM: pulmonary embolism risk score for mortality in computed tomographic pulmonary angiography-confirmed patients. EClinicalMedicine 2021;36:100897.
28. Msaouel P, Lam AP, Gundabolu K, et al. Abnormal platelet count is an independent predictor of mortality in the elderly and is influenced by ethnicity. Haematologica 2014;99:930–6.
29. Cato LD, Wearn CM, Bishop JR, Stone MJ, Harrison P, Moiemen N. Platelet count: a predictor of sepsis and mortality in severe burns. Burns 2018;44:288–97.
30. Wang D, Wang S, Wu H, et al. Association between platelet levels and 28-day mortality in patients with sepsis: a retrospective analysis of a large clinical database MIMIC-IV. Front Med (Lausanne) 2022;9:833996.
31. Burgos LM, Scatularo CE, Cigalini IM, et al. The addition of echocardiographic parameters to PESI risk score improves mortality prediction in patients with acute pulmonary embolism: PESI-Echo score. Eur Heart J Acute Cardiovasc Care 2021;10:250–7.
32. Darwish OS, Mahayni A, Patel M, Amin A. Cardiac troponins in low-risk pulmonary embolism patients: a systematic review and meta-analysis. J Hosp Med 2018;13:706–12.
33. Dentali F, Cei M, Mumoli N, Gianni M. How to predict short- and long-term mortality in patients with pulmonary embolism? Pol Arch Med Wewn 2015;125:82–8.
34. Vuilleumier N, Limacher A, Mean M, et al. Cardiac biomarkers and clinical scores for risk stratification in elderly patients with non-high-risk pulmonary embolism. J Intern Med 2015;277:707–16.
35. Daquarti G, March Vecchio N, Mitrione CS, et al. High-sensitivity troponin and right ventricular function in acute pulmonary embolism. Am J Emerg Med 2016;34:1579–82.
36. Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR. A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol 1996;49:1373–9.
37. Aujesky D, Obrosky DS, Stone RA, et al. Derivation and validation of a prognostic model for pulmonary embolism. Am J Respir Crit Care Med 2005;172:1041–6.

Article information Continued

Notes

Capsule Summary

What is already known

Pulmonary embolism has a broad spectrum of presentation; correct risk stratification for short-term mortality is fundamental to correct clinical decision-making.

What is new in the current study

This study presents a new risk stratification tool, the PATHOS (platelets, age, troponin, heart rate, oxygenation, and systolic blood pressure) score, which is simpler and more accurate than the Pulmonary Embolism Severity Index (PESI), simplified PESI, and shock index in predicting in-hospital mortality among patients with pulmonary embolism. It had an area under the receiver operating characteristics curve of 0.778 (95% confidence interval, 0.728–0.810), high calibration, and an ability to identify patients with 1.8% to 85.0% chances of in-hospital mortality.

Fig. 1.

Flowchart of included and excluded patients. PE, pulmonary embolism; CTPA, computed tomography pulmonary angiography; ED, emergency department.

Fig. 2.

The receiver operating characteristic (ROC) curves of the included scores of the derivation cohort. The area under the ROC curve (AUROC) of the shock index is 0.64 (95% confidence interval [CI], 0.543–0.750), the AUROC of the simplified Pulmonary Embolism Severity Index (sPESI) is 0.791 (95% CI, 0.726–0.856), the AUROC of the PESI is 0.786 (95% CI, 0.720–0.850), the AUROC of the PATHOS (platelets, age, troponin, heart rate, oxygenation, and systolic blood pressure) score is 0.827 (95% CI, 0.769–0.885).

Fig. 3.

The receiver operating characteristic (ROC) curves of the included scores of the validation cohort. The area under the ROC curve (AUROC) of the shock index is 0.67 (95% confidence interval [CI], 0.61–0.74), the AUROC of the simplified Pulmonary Embolism Severity Index (sPESI) is 0.71 (95% CI, 0.64–0.77), the AUROC of the PESI is 0.68 (95% CI, 0.61–0.74), the AUROC of the PATHOS (platelets, age, troponin, heart rate, oxygenation, and systolic blood pressure) score is 0.74 (95% CI, 0.68–0.80).

Table 1.

Prognostic scores assessed in the derivation and validation cohorts under investigation

Score Point
PESI
 Age +1/yr
 Male sex +10
 History of cancer +30
 Chronic heart failure +10
 Chronic lung disease +10
 HR > 110 ppm +20
 SBP < 100 mmHg +30
 Respiratory rate > 30 breaths/min +20
 Temperature < 36°C +20
 Altered mental status +60
 SpO2 < 90% +20
sPESI
 Age > 80 yr +1
 History of cancer +1
 Chronic heart failure +1
 HR > 110 ppm +1
 SBP < 100 mmHg +1
 SpO2 < 90% +1
Shock index Positive if HR/SBP is > 0.7
PATHOS score
 Platelet count < 100 or > 400 ×103/μL +1
 Age > 80 yr +1
 Troponin level > cutoff +1
 HR > 100 ppm +1
 SpO2 < 90% +1
 SBP < 100 mmHg +1

PESI, Pulmonary Embolism Severity Index; HR, heart rate; ppm, pulses per minute; SBP, systolic blood pressure; SpO2, peripheral oxygen saturation; sPESI, simplified Pulmonary Embolism Severity Index; PATHOS, platelets, age, troponin, heart rate, peripheral oxygen saturation, and systolic blood pressure.

Table 2.

Comparison of demographic and clinical features between the derivation and validation cohorts

Variable Total (n = 1,358) Derivation cohort (n = 586) Validation cohort (n = 772) P-value
Male sex 600 (44.2) 253 (43.2) 347 (44.9) 0.514
Age (yr) 69.88 ± 14.89 73.62 ± 15.00 69.54 ± 14.00 < 0.001
 > 80 456 (33.6) 243 (41.5) 213 (27.6) < 0.001
Respiratory rate (ppm) 25.2 ± 5.6 20.8 ± 6.6 25.6 ± 5.0 < 0.001
 > 30 235 (17.3) 16 (2.7) 219 (28.4) < 0.001
SpO2 (%) 95 (92–98) 94 (91–98) 95 (92–97) 0.947
 < 90 252 (18.6) 131 (22.4) 121 (15.4) 0.010
Heart rate (ppm) 96 ± 19 93 ± 21 96 ± 19 < 0.001
 > 100 517 (38.1) 180 (30.7) 337 (43.7) < 0.001
 > 110 310 (22.8) 104 (17.7) 206 (26.7) < 0.001
SBP (mmHg) 130 ± 24 139 ± 26 128 ± 23 < 0.001
 < 100 177 (13.0) 88 (15.0) 89 (11.5) 0.010
DBP (mmHg) 79.5 ± 15.9 80.0 ± 15.0 79.4 ± 15.0 0.010
Body temperature (°C) 37.05 ± 0.76 36.50 ± 0.78 37.10 ± 0.74 < 0.001
 < 36 15 (1.1) 2 (0.3) 13 (1.7) 0.231
Altered mental status 125 (9.2) 89 (15.2) 36 (4.7) < 0.001
Troponin > cutoff 608 (44.8) 202 (34.5) 312 (40.4) < 0.001
Platelets (×103/μL) 261 ± 129 222 ± 77 265 ± 133 < 0.001
 < 100 or > 400 191 (14.1) 54 (9.2) 137 (17.7) < 0.001
History of cancer 477 (35.1) 170 (29.0) 307 (39.8) < 0.001
Chronic heart failure 127 (9.4) 61 (10.4) 66 (8.5) 0.212
Chronic pulmonary disease 133 (9.8) 67 (11.4) 66 (8.5) 0.063
PESI 101 ± 33 116 ± 47 100 ± 31 < 0.001
sPESI 1.42 ± 1 1.33 ± 1 1.43 ± 1 0.570
Shock index 0.76 ± 0.22 0.70 ± 0.20 0.77 ± 0.22 < 0.001
 > 0.7 649 (47.8) 206 (35.2) 443 (57.4) < 0.001
PATHOS score 1.68 ± 1.17 1.63 ± 1.23 1.56 ± 1.11 0.490
Length of stay (day) 7.5 (4.3–13.0) 6.0 (3.0–11.0) 8.3 (5.3–14.3) < 0.001
In-hospital death 142 (10.5) 60 (10.2) 82 (10.6) 0.818

Values are presented as number (%), mean±standard deviation, or median (interquartile range).

ppm, pulses per minute; SpO2, peripheral oxygen saturation; SBP, systolic blood pressure; DBP, diastolic blood pressure; PESI, Pulmonary Embolism Severity Index; sPESI, simplified Pulmonary Embolism Severity Index; PATHOS, platelets, age, troponin, heart rate, peripheral oxygen saturation, and systolic blood pressure.

Table 3.

Comparison of general features in relation to in-hospital mortality in the derivation and validation cohorts

Variable Derivation cohort
Validation cohort
In-hospital mortality
P-value In-hospital mortality
P-value
No (n=519) Yes (n=60) No (n=690) Yes (n=82)
Male sex 227 (43.7) 24 (40.0) 0.580 314 (45.5) 33 (40.2) 0.360
Age (yr) 72.9 ± 15.6 78.9 ± 12.5 0.005 68.8 ± 15.0 74.7 ± 14.0 0.004
 > 80 yr 203 (39.1) 36 (60.0) < 0.010 171 (24.8) 42 (51.2) < 0.001
Respiratory rate (ppm) 21.4 ± 5.0 24.4 ± 6.0 < 0.010 25.5 ± 5.4 26.1 ± 4.5 0.400
 > 30 11 (2.1) 5 (8.3) < 0.010 193 (28.0) 26 (31.7) 0.470
SpO2 (%) 96 (92–98) 90 (80–95) < 0.001 96 (93–98) 93 (88–96) 0.004
 < 90 114 (22.0) 32 (53.3) < 0.010 39 (5.7) 28 (34.1) 0.001
Heart rate (ppm) 90.5 ± 20.2 101.0 ± 23.5 0.004 95.3 ± 18.0 103.6 ± 19.8 0.001
 > 100 73 (14.4) 24 (40.0) < 0.010 292 (42.3) 49 (59.8) 0.003
 > 110 77 (14.8) 26 (43.3) < 0.001 175 (25.4) 31 (37.8) 0.001
SBP (mmHg) 136.3 ± 26.6 115.4 ± 27.9 < 0.001 130.2 ± 22.7 114.0 ± 30.0 < 0.001
 < 100 62 (11.9) 23 (38.3) < 0.010 66 (9.6) 23 (28.0) < 0.001
DBP (mmHg) 77.2 ± 14.0 71.0 ± 15.8 0.003 80.5 ± 15.0 69.3 ± 19.3 < 0.001
Body temperature (°C) 36.6 ± 0.7 36.7 ± 0.8 0.350 37.1 ± 0.7 37.1 ± 0.7 0.730
 < 36 177 (34.1) 22 (36.7) 0.690 12 (1.7) 1 (1.2) 0.730
Altered mental status 70 (13.5) 19 (31.7) < 0.010 24 (3.5) 12 (14.6) < 0.001
Troponin level > cutoff 164 (31.6) 38 (63.3) < 0.001 346 (50.1) 54 (65.9) < 0.001
Platelets (×103/μL) 230 ± 85 210 ± 93 0.091 269 ± 131 237 ± 142 0.050
 < 100 or > 400 35 (6.7) 14 (23.3) < 0.010 109 (15.8) 28 (34.1) < 0.001
History of cancer 146 (28.1) 22 (36.7) 0.168 270 (39.1) 37 (45.1) 0.290
Chronic heart failure 52 (10.1) 9 (15.0) 0.200 54 (7.8) 12 (14.6) 0.040
Chronic pulmonary disease 57 (11.0) 10 (16.7) 0.160 61 (8.8) 5 (6.1) 0.400
PESI 107 ± 39 147 ± 44 < 0.001 97 ± 29 122 ± 42 < 0.001
sPESI 1.26 ± 1.0 2.45 ± 1.1 < 0.001 1.34 ± 0.9 2.20 ± 1.0 < 0.001
Shock index 0.62 ± 0.30 0.83 ± 0.41 0.002 0.75 ± 0.20 0.93 ± 0.30 0.002
 > 0.7 172 (33.1) 31 (51.7) 0.004 379 (54.9) 64 (78.0) < 0.001
PATHOS score 1.53 ± 1.10 3.00 ± 1.00 < 0.001 1.56 ± 1.00 2.73 ± 1.20 < 0.001
Length of stay (day) 6 (3–11) 6.5 (2.0–13.8) 0.913 8.4 (5.4–14.3) 8.2 (3.1–13.1) 0.720

Values are presented as number (%), mean±standard deviation, or median (interquartile range).

ppm, pulses per minute; SpO2, peripheral oxygen saturation; SBP, systolic blood pressure; DBP, diastolic blood pressure; PESI, Pulmonary Embolism Severity Index; sPESI, simplified Pulmonary Embolism Severity Index; PATHOS, platelets, age, troponin, heart rate, peripheral oxygen saturation, and systolic blood pressure.

Table 4.

Characteristics of the analyzed prognostic scores: multivariable logistic regression analysis for in-hospital death

Variable Derivation cohort
Validation cohort
OR (95% CI) P-value OR (95% CI) P-value
PESI
Age (yr) 1.03 (0.99–1.07) 0.110 1.03 (1.01–1.05) < 0.010
Male sex 0.73 (0.28–1.86) 0.510 0.98 (0.60–1.60) 0.950
History of cancer 1.08 (0.56–2.08) 0.810 1.46 (0.99–2.16) 0.530
Chronic heart failure 0.65 (0.19–2.26) 0.500 1.58 (0.75–3.33) 0.220
Chronic lung disease 1.48 (0.47–4.62) 0.490 0.41 (0.15–1.12) 0.840
HR > 110 ppm 4.48 (7.18–11.28) < 0.010 1.93 (1.14–3.27) 0.014
SBP < 100 mmHg 8.22 (3.47–22.48) < 0.010 2.39 (1.30–4.17) < 0.010
Respiratory rate > 30 ppm 3.56 (0.67–19.1) 0.299 1.26 (0.78–2.01) 0.860
Temperature < 36°C 0.89 (0.42–1.87) 0.760 0.56 (0.06–4.73) 0.590
Altered mental status 1.72 (0.66–4.47) 0.690 2.38 (1.02–5.51) 0.030
SpO2 < 90% 3.21 (1.31–7.84) < 0.010 2.43 (1.40–4.20) < 0.010
sPESI
Age > 80 yr 2.36 (1.24–4.52) 0.015 3.00 (1.81–4.97) < 0.001
History of cancer 1.43 (0.76–2.69) 0.260 1.70 (1.04–2.86) 0.040
Chronic heart failure 1.10 (0.45–2.63) 0.830 1.38 (0.65–2.92) 0.400
HR > 110 ppm 2.64 (1.40–4.80) < 0.001 2.06 (1.25–3.41) < 0.010
SBP < 100 mmHg 4.24 (2.17–8.20) < 0.001 2.92 (1.62–5.25) < 0.001
SpO2 < 90% 3.69 (2.00–6.74) < 0.001 2.47 (1.44–4.23) < 0.010
PATHOS score
Platelet count < 100 or > 400 ×103/μL 4.82 (1.60–14.11) < 0.010 2.68 (1.55–4.62) < 0.001
Age > 80 yr 2.34 (1.15–4.75) 0.020 3.07 (1.85–5.10) < 0.001
Troponin level > cutoff 2.56 (1.10–6.10) 0.030 1.78 (1.15–2.70) 0.020
HR > 100 ppm 2.90 (1.30–6.00) < 0.010 1.84 (1.10–3.05) 0.018
SpO2 < 90% 2.16 (1.06–4.41) 0.030 2.40 (1.40–4.16) 0.002
SBP < 100 mmHg 4.98 (2.27–0.09) < 0.010 2.54 (1.40–4.60) 0.002

OR, odds ratio; CI, confidence interval; PESI, Pulmonary Embolism Severity Index; HR, heart rate; ppm, pulses per minute; SBP, systolic blood pressure; SpO2, peripheral oxygen saturation; sPESI, simplified Pulmonary Embolism Severity Index; PATHOS, platelets, age, troponin, heart rate, peripheral oxygen saturation, and systolic blood pressure.

Table 5.

Characteristics of the PATHOS score in the whole cohort

Total score Sensitivity (95% CI) Specificity (95% CI) +LR (95% CI) –LR (95% CI) PPV NPV IHM probability (%)
0 98.44 (94.5–99.8) 17.24 (15.0–19.7) 1.19 (1.0–1.4) 0.091 (0.02–0.4) 13.1 98.9 1.8
1 86.72 (79.6–92.1) 50.94 (47.8–54.1) 1.77 (1.6–1.9) 0.26 (0.2–0.4) 18.3 96.8 3–6
2a) 60.94 (51.9–69.4) 81.67 (79.1–84.0) 3.32 (2.9–3.8) 0.48 (0.4–0.6) 29.7 94.3 6–15
3 31.25 (23.4–40.0) 94.15 (92.5–95.5) 5.34 (4.1–6.9) 0.73 (0.6–1.0) 40.4 91.5 15–34
4 6.25 (2.7–11.9) 99.11 (98.3–99.6) 7.01 (3.6–13.7) 0.95 (0.5–1.8) 47.1 89.3 32–60
5 0 (0–2.8) 99.90 (99.4–100) 0 1.00 (0.1–7.1) 0 88.7 60–74
6 0 (0–2.8) 100 (99.6–100) - 1.00 - 88.7 85

PATHOS score consists of platelets <100 or >400×103/μL, age >80 years, troponin>cutoff, heart rate >100 ppm, peripheral oxygen saturation <90%, and systolic blood pressure <100 mmHg. The predicted probability of IHM can be calculated as follows: P=1/[1+exp{–(–3.98 + 1.17×platelet count + 0.99×age>80 years + 0.56×troponin level>cutoff + 0.76×heart rate>100 ppm + 0.94×peripheral oxygen saturation<90% + 1.17×systolic blood pressure<100 mmHg)}]×100 (interceptor, –3.98; standard error, 0.23).

PATHOS, platelets, age, troponin, heart rate, peripheral oxygen saturation, and systolic blood pressure; CI, confidence interval; LR, likelihood ratio; PPV, positive predictive value; NPV, negative predictive value; IHM, in-hospital mortality.

a)

Best cutoff according to the Youden index.