Skip to main content

Development and validation of a nomogram for predicting critical respiratory events during early anesthesia recovery in elderly patients

Abstract

Background

Elderly patients undergoing recovery from general anesthesia face a heightened risk of critical respiratory events (CREs). Despite this, there is a notable absence of effective predictive tools tailored to this specific demographic. This study aims to develop and validate a predictive model (nomogram) to address this gap. CREs pose significant risks to elderly patients during the recovery phase from general anesthesia, making it an important issue in perioperative care. With the increasing aging population and the complexity of surgical procedures, it is crucial to develop effective predictive tools to improve patient outcomes and ensure patient safety during post-anesthesia care unit (PACU) recovery.

Methods

A total of 324 elderly patients who underwent elective general anesthesia in a grade A tertiary hospital from January 2023 to June 2023 were enrolled. Risk factors were identified using least absolute shrinkage and selection operator (LASSO) regression. A multivariate logistic regression model was constructed and represented as a nomogram. Internal validation of the model was performed using Bootstrapping. This study followed the TRIPOD checklist for reporting.

Results

The indicators included in the nomogram were frailty, snoring, patient-controlled intravenous analgesia (PCIA), emergency delirium and cough intensity at extubation. The diagnostic performance of the nomogram model was satisfactory, with AUC values of 0.990 and 0.981 for the training set and internal validation set, respectively. The optimal cutoff value was determined to be 0.22, based on a Youden index of 0.911. The F1-score was 0.927, and the MCC was 0.896. The calibration curve, Brier score (0.046), and HL test demonstrated acceptable consistency between the predicted and actual results. DCA revealed high net benefits of the nomogram prediction across all threshold probabilities.

Conclusions

This study developed and validated a nomogram to identify elderly patients in the PACU who are at higher risk of CREs. The identified predictive factors included frailty condition, snoring syndrome, PCIA, emergency delirium, and cough intensity at extubation. By identifying patients at higher risk of CREs early on, medical professionals can implement targeted strategies to mitigate the occurrence of complications and provide better postoperative care for elderly patients recovering from general anesthesia.

Peer Review reports

Introduction

With the rise in global life expectancy and improvements in surgical safety, an increasing number of elderly surgical patients are opting for radical surgery to achieve better curative effects and enhance their quality of life [1]. During the early stage of emergence from general anesthesia, the patient’s autonomous breathing gradually recovers. Due to residual neuromuscular block, respiratory depression caused by opioid drugs, incomplete metabolism of sedative drugs, and the combined effects of various other factors, some patients experience respiratory insufficiency, upper airway obstruction, diminished pharyngeal reflex, decreased muscle coordination, inadequate ventilation, increased risk of aspiration, and other critical respiratory events (CREs) after removal of the endotracheal tube [2, 3]. Elderly patients are at a heightened risk of experiencing CREs during the recovery phase following general anesthesia due to decreased respiratory reserves, impaired gas exchange, chest wall stiffness, weakened respiratory muscles, reduced lung elastic recoil, increased lung closing volume, diminished alveolar surface area, lower lung compliance, and reduced sensitivity of the respiratory center to hypoxia and hypercapnia. Additionally, multiple comorbidities and imbalances in perioperative stress responses further exacerbate this risk [4]. The incidence of respiratory-related complications in patients after general anesthesia in the post-anesthesia care unit (PACU) can reach 22.1%, the highest proportion being among elderly patients (≥ 65 years old) [5, 6]. Severe hypoxemia caused by CREs is an independent risk factor for prolonged postoperative hospital stay. It is closely associated with cerebral dysfunction adverse cardiovascular events and can even progress to respiratory and cardiac arrest [7].

Effective prevention of respiratory events during the recovery period requires assessing the risk factors for CREs and providing targeted interventions based on the risk level. Hence, there is an urgent need to construct a risk prediction model for adverse respiratory events that is suitable for clinical scenarios in the PACU. Existing models for predicting critical respiratory events (CREs) during the recovery period have several limitations. For example, the model developed by Wang et al. [8] is applicable only to patients extubated and then transferred to the PACU for recovery, without accounting for differences in distances between operating rooms and transport times. Additionally, the model’s definition of hypoxemia (SpO2 < 95% for more than 15 s) can often be corrected without pharmacological intervention in general patients, limiting its clinical relevance. Liu et al. [4] constructed a model based on electronic medical record data through retrospective study and validation, targeting all patients who developed hypoxemia in the PACU. However, this model may suffer from missing important variables from the electronic medical records, and missing data were not addressed during validation. Other studies focus on specific pulmonary complications such as postoperative pneumonia [9], respiratory failure [10], unplanned reintubation [11, 12], and adult respiratory distress syndrome [13, 14], making these models suitable only for specific diseases and clinical settings. Moreover, there are no specific models developed for CREs in patients during the recovery phase from general anesthesia. Some models also lack external data validation, which limits their reproducibility, generalizability, and applicability.

Thus, this study aimed to investigate the risk factors for CREs in elderly patients during the recovery period after general anesthesia and to establish a risk prediction model. On the basis of multiple regression analysis, the complex regression equation was transformed into a nomogram, a visual tool to help healthcare providers quickly screen high-risk patients for CREs. This nomogram will enable the early implementation of personalized interventions, ultimately reducing the incidence of CREs among elderly patients.

Aims

This study aims to identify risk factors associated with CREs in elderly patients during post-anesthesia recovery, develop a nomogram model, and assess its predictive performance.

Methods

This prospective cohort study was conducted in accordance with all relevant guidelines and regulations, including the Declaration of Helsinki. Additionally, the research adhered to the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD) checklist, ensuring comprehensive and transparent reporting of the methods and findings.

Study participants

A convenience sampling method was employed to select elderly patients who underwent elective surgery under general anesthesia in a comprehensive tertiary grade A hospital from January 2023 to June 2023. The inclusion criteria were as follows: (1) age ≥ 65 years; (2) intravenous inhalation combined anesthesia; (3) preoperative SpO2 ≥ 94% (oxygen inhalation); and (4) complete database data. Exclusion criteria were as follows: (1) surgery related to obstructive sleep apnea; (2) cardiac surgery; (3) tracheostomy; (4) hypoxia due to hemodynamic instability; (5) inability to communicate normally due to barriers such as dementia, severe hearing loss and language communication issues; (6) transfer to the intensive care unit (ICU) after surgery; and (7) transfer to the PACU after extubation. The sample size was estimated based on the overall rate [15]: \(n=\frac{{{{\rm Z}^2}_{{\alpha /2}}P(1 - P)}}{{{\delta ^2}}}\), where P is the overall rate, and δ is the allowable error. δ = 0.05, α = 0.05, and the incidence of CREs in elderly patients was 25% based on our preliminary studies. Accounting for a potential loss to follow-up of 15%, the final sample size was calculated to be 339 cases. Therefore, in this study, 339 elderly patients who had undergone general anesthesia were initially included.

Definition and identification of CREs

Based on the revised Murphy standard [16] and a literature review [17, 18], combined with clinical practice standards, the criteria for CREs in this study were as follows: (1) upper airway obstruction, patients need to receive the following interventions: oropharyngeal airway, nasopharyngeal airway, and airway opening. (2) mild–moderate hypoxemia (SpO2: 90–93%) under a nasal cannula or mask oxygen inhalation with no improvement after active interventions, such as increasing the oxygen flow, at least two verbal reminders to take deep breaths, tactile stimulation, and drug intervention (e.g., doxapram); (3) severe hypoxemia (SpO2 < 90%) under a nasal cannula or mask oxygen inhalation, with no improvement after active interventions, such as increasing the oxygen flow, ≥ 2 verbal reminder to take deep breaths, tactile stimulation, and drug intervention (e.g., doxapram); (4) hypoxemia accompanied by poor consciousness, inability to breathe deeply, and ineffective drug intervention, requiring Ambu-bags/manual resuscitation; and (5) ventilator-assisted ventilation, tracheal reintubation, or noninvasive positive pressure ventilation. Meeting any one criterion was defined as a CRE during recovery. Assessments for CREs were conducted immediately upon arrival at the PACU and monitored continuously for the first 30 min post-surgery. Subsequent evaluations were performed at 5-minute intervals until the patient was discharged from the PACU. All assessments were conducted by trained medical staff using standardized protocols and equipment to ensure consistency.

Instruments for data collection

Through a literature review and expert consultation, combined with clinical practice experience, a form for collecting information on risk factors for CREs in elderly patients was created. The form included the following content: (1) demographic data: age, sex, BMI, ASA grade, smoking history, frailty status (the FRAIL scale), etc.; (2) medical history: snoring, hypertension, diabetes, lung disease and hypohemia; (3) surgery-related factors: surgical site (e.g., oral and maxillofacial facial, neck, abdomen), surgical position (e.g., supine, lateral, lithotomy), and intraoperative irrigation; (4) anesthesia-related factors: artificial airway type, opioid dosage, type of muscle relaxant, anesthesia duration, drug antagonism before extubation; and (5) postoperative-related factors: patient-controlled intravenous analgesia (PCIA), emergence delirium (Nursing Delirium Screening Scale), cough intensity at extubation (Semiquantitative Cough Strength Score, SCSS, graded 0–5), and duration of tracheal intubation.

Data collection

All patients were given standardized anesthesia and analgesia. Anesthesia was induced with sufentanil citrate, propofol, cisatracurium/rocuronium bromide, sevoflurane, and remifentanil hydrochloride. Analgesia was administered via nerve block and/or analgesic pump guided by B-ultrasound. Intraoperative blood pressure was maintained at approximately ± 20% of the baseline level, and the depth of anesthesia was monitored with the bispectral index, which we kept at 40–60. Muscle relaxants were discontinued 20 min before the end of surgery. Inhalation of sevoflurane was stopped 15 min before skin suture. The propofol pump was ended after surgery. Tracheal extubation was performed strictly following extubation indications, that is, the patient could cooperate with commanded actions, such as opening the eyes, the patient’s vital signs were stable, the patient could lift his or her head off the bed surface for 5–10 s, and the patient had a strong fist as an evaluation of muscle strength and a tidal volume under spontaneous breathing of 6–8 ml/kg. The timing of extubation was determined jointly with the anesthesiologist. After extubation, a nasal cannula or mask was used to deliver oxygen to the patient.

All PACU nurses completed standardized training on the criteria for identifying CREs, screening for delirium during recovery, standardized extubation procedures, and the assessment of cough intensity. One day before the operation or in the preoperative preparation room, a researcher collected each patient’s general information and conducted frailty screening using the FRAIL scale, as well as an evaluation using the Charlson comorbidity index (CCI). After the operation, information related to surgery and anesthesia was obtained by reviewing electronic records. Cough intensity and delirium were assessed immediately after extubation, while respiration and oxygenation were assessed every 5 min. Any abnormalities were promptly assessed and addressed.

Statistical analyses

Strict quality control measures ensured that there were no missing data. Complete case analysis was employed. Data analyses were performed with RStudio software. Measurement data that did not conform to a normal distribution are expressed as median (P25, P75), and the nonparametric Mann-Whitney U test was used for intergroup comparisons. Count data are presented as frequency (percentages), and the chi-squared test was applied for intergroup comparisons. For the univariate analysis (UA), age, BMI, ASA grade, frailty condition, and intraoperative opioid dosage were included as ordinal variables. CCI, fluid balance, anesthesia duration, cough intensity at extubation, and duration of tracheal intubation were included as continuous variables. All other factors were included as nominal variables. Least absolute shrinkage and selection operator (LASSO) regression was employed to screen for variables that were statistically significant in the UA. This approach helps address the issue of multiple cross-correlated covariates and reduces the risk of overfitting the data. To further ensure the robustness of our model, we used 10-fold cross-validation to select the optimal lambda parameter, considering the minimum standard error.

We employed Bootstrap resampling for internal validation. This technique helps in estimating the accuracy of the model and reduces the risk of overfitting by repeatedly sampling from the dataset with replacement and evaluating the model on these samples. Model discrimination was evaluated in the form of the area under the receiver operating characteristic (ROC) curve (AUC), F1 score, and Matthews correlation coefficient (MCC). The optimal AUC cutoff was determined by maximizing the Youden index. Calibration curves, the Hosmer‒Lemeshow goodness-of-fit test, and the Brier score were used to assess the agreement between the observed and predicted results. The net clinical benefit was evaluated using decision curve analysis (DCA).

Results

Study population

Fifteen were excluded for not meeting the criteria, including preexisting hypoxemia with SpO2 < 94% (four), postoperative transfer to the ICU (four), post-extubation admission to the PACU (five), and severe hearing impairment preventing communication (two). Ultimately, 324 patients were included in the study, 95 (29.32%) of whom experienced CREs during emergence from anesthesia. The subjects included in the study were between 65 and 91 years of age, with an average age of 71.09 ± 5.444. The average age in the CRE group was 72.62 ± 6.637 years, and the average age in the non-CRE group was 70.45 ± 4.736 years. The time of appearance of CREs was between 3 and 25 min, with an average time of 5.83 ± 2.872 min. Among the 95 patients with CREs, 2 (2.11%) had upper airway obstruction, 32 (33.68%) had mild to moderate hypoxemia, 48 (50.53%) had severe hypoxemia, 9 (9.47%) required Ambu-bags/manual resuscitation, and 4 (4.21%) received secondary tracheal intubation.

To avoid missing important variables, the test level in the UA was set to 0.10. The results of UA (Table 1) showed that there were significant differences between non-CRE patients and CRE patients in age, BMI, ASA grade, CCI, smoking, frailty, snoring, hypertension, lung disease or other complications, anemia, surgical position, fluid balance, artificial airway type, intraoperative opioid dosage, anesthesia duration, drug antagonism before extubation, PCIA, emergence delirium, cough intensity at extubation, and duration of tracheal intubation (P < 0.1).

Table 1 Comparison of risk factors associated with CREs between the groups

Predictor variable filtering by LASSO regression

The 20 risk factors that exhibited significant differences in the initial analysis were further analyzed using LASSO regression to reduce dimensionality and identify the most important predictors. The optimal parameter (lambda) for the LASSO model was chosen through 10-fold cross-validation, considering the minimum standard error. The number of variables with non-zero regression coefficients was determined and depicted in Fig. 1. The results of the LASSO regression revealed that frailty, snoring, anemia, intraoperative opioid dosage, PCIA, emergence delirium, and cough intensity at extubation were identified as risk factors for CREs in elderly patients during recovery from general anesthesia.

Fig. 1
figure 1

The LASSO regression model was used to select characteristic impact factors: (A) LASSO coefficients of 28 features; (B) selection of the tuning parameter (λ). The left and right dotted vertical lines, respectively, represented the optimal lambda values when using the minimum error criterion and one standard error (1se) of the minimum criterion (lambda.1se = 0.02420579)

Multivariate logistic regression model construction

Logistic regression was employed to verify these risk factors. The occurrence of CREs was considered the dependent variable, while the seven risk factors screened by LASSO regression were input as the independent variables for multiple logistic regression analysis. The independent variables were assigned as follows: frailty: 1= “no frailty”, 2= “prefrailty”, and 3= “frailty”; intraoperative opioid dosage and cough intensity at extubation (continuous variables): original values; and other variables: 0 = no, and 1 = yes. The results indicated that five variables, namely frailty, snoring, PCIA, emergence delirium and cough intensity at extubation, were independent risk factors for CREs in elderly patients during recovery from general anesthesia (P < 0.05, Table 2). The model was constructed as follows: Logit (P) = 0.153 + 4.107×(frailty) + 3.006×(snoring) + 1.999×(PCIA) + 1.956×(emergence delirium)-2.679×(cough intensity at extubation).

Table 2 Multivariate logistic regression analysis of the risk of CREs in elderly patients during recovery from general anesthesia

To facilitate prediction, a nomogram was developed based on these predictors, representing a prediction model for CREs in elderly patients during recovery from general anesthesia (Fig. 2). By utilizing the variable classifications in the nomogram, one can obtain scores corresponding to each index. These scores are summed to calculate the total score, and the predicted probability corresponding to the total score represents the likelihood of CREs occurring in elderly patients during PACU resuscitation. As an example, taking an elderly patient after general anesthesia who exhibits a cough intensity of 1 point at extubation, positive delirium during recovery, PCIA, no history of snoring, and pre-frailty, the predicted probability that such a patient will have a CREs is 94.5%.

Fig. 2
figure 2

A nomogram prediction model for CREs in elderly patients during recovery from general anesthesia

Nomogram model validation

The nomogram model’s concordance index, also known as the C-index (equivalent to the area under the ROC curve AUC), was 0.990 (95% CI: 0.982–0.997), accompanied by a sensitivity of 0.943 (95% CI: 0.933-1.000) and a specificity of 0.968 (95% CI: 0.913–0.973) (Fig. 3). The optimal cutoff value of the nomogram score was determined to be 0.22, when the Youden index was 0.911. Internal verification through Bootstrapping with 1,000 resamples confirmed the robustness of the model, with a C-index of 0.981 (95% CI: 0.953–0.996), sensitivity of 0.961 (95% CI: 0.912-1.000), and specificity of 0.910 (95% CI: 0.784-1.000), demonstrating excellent model calibration. The detailed results are shown in Table 3. Furthermore, the F1-score was calculated to be 0.927 (95% CI: 0.882–0.969), and the MCC was 0.896 (95% CI: 0.882–0.969), both indicating the model’s strong discriminating ability. The Hosmer‒Lemeshow goodness-of-fit test yielded a result of χ2 = 1.160, P = 0.997, suggesting that the nomogram model was well-suited for predicting CREs in elderly patients during their PACU recovery after general anesthesia.

Table 3 Summary of model performance metrics
Fig. 3
figure 3

Receiver operating characteristic (ROC) curve of the nomogram

The Bootstrap resampling calibration curve (Fig. 4) illustrated that the probabilities of CREs predicted by the nomogram aligned well with the observed probabilities, and the model calibration curve closely resembled that of an ideal model. The Brier value of 0.046 (95% CI: 0.024–0.055) indicated that the nomogram model effectively predicted the occurrence of CREs in elderly patients during recovery from general anesthesia, exhibiting strong internal sampling calibration and reliable correlations.

Fig. 4
figure 4

Calibration curves of the nomogram. Note: The X-axis represented the predicted possible risk of severe respiratory events(CREs)after extubation. The Y-axis represented the actual diagnosed CREs. The dashed line represents the original performance, and the solid dashed line represents the performance during internal validation by Bootstrapping (B = 1,000 repetitions)

Clinical utility of the nomogram

The DCA of the nomogram is presented in Fig. 5. The horizontal axis represents the threshold probability, while the vertical axis represents the net benefit. The interventions mentioned here referred to any behavioral or external factors taken into account when the model identified high-risk patients. The black line in the graph, parallel to the X-axis, represents the scenario where no clinical intervention is performed for any patients. The red line represents the model’s decision curve. A high-quality predictive model should ensure that within a certain threshold probability range, or at least at a specific threshold probability level, the net benefit is higher than the net benefits associated with the two reference lines of “full intervention” and “no intervention.” As observed in Fig. 5, the net benefit of the model’s decision curve consistently surpassed the net benefits of the two null lines for all threshold probabilities. This suggests that the nomogram model exhibits good clinical applicability and can be a valuable tool in identifying high-risk patients and aiding in clinical decision-making.

Fig. 5
figure 5

Decision curve analysis for the nomogram model

Discussion

Hypoxemia caused by CREs is the most common postoperative complication observed in the PACU. In this study, the incidence of CREs in elderly patients was found to be 29.32%, which was higher than the rates reported by Liu et al. (17.5%) [4] and Zhu et al. (21.19%) [19]. This discrepancy can be attributed to differences in study populations and outcome measurement criteria. Specifically, this study focused on elderly patients, a high-risk group for CREs, and used SpO2% as an indicator, which is more sensitive and accessible than the oxygenation index used in previous studies.

In our research, a nomogram was developed to predict CREs in elderly patients during recovery from general anesthesia. The model showed good discrimination and calibration. Unlike traditional logistic regression, this study used LASSO regression to reduce dimensionality and multicollinearity, effectively selecting variables by balancing variance and bias. Nomograms combine multiple predictors, offering higher predictive sensitivity and specificity compared to single predictors. This makes them more scientific and practical for predicting CREs in elderly patients during the PACU recovery period. Specifically, several variables were identified as strong predictors of CREs in elderly patients in the PACU, including frailty, snoring, PCIA, emergence delirium, and cough intensity at extubation.

Frailty is a clinical syndrome characterized by a decline in the multiorgan system reserve capacity, mainly related to decreases in strength, endurance, physical function, and maintenance of homeostasis [20]. It has been significantly correlated with both short-term and long-term surgical outcomes [21, 22]. A recent study also manifested that frail elderly patients undergoing thoracoscopic lobectomy had a 2- to 3-fold-higher risk of postoperative pulmonary complications than non-frailty elderly patients [23]. This finding was further supported in the present study, which showed that preoperative frailty not only correlated with long-term lung disease but also strongly predicted the risk of CREs in the early postoperative period. Another finding of this study is that patients who snored had a higher likelihood of developing CREs after surgery. Snoring often described as a rough and vibrating sound caused by partial obstruction of inspiration in the oropharynx during sleep [24], can be considered the initial stage of a spectrum of sleep-disordered breathing, which encompasses a range from partial airway collapse to mildly increased upper airway resistance to complete airway collapse and severe obstructive sleep apnea (OSA) lasting for 60 s or longer [25]. The intermittent vibrations due to turbulent air cause local inflammation and edema around the uvula, soft palate, and upper airway, thereby increasing airflow resistance and potentially causing or worsening airway obstruction during recovery from anesthesia [26].

Interestingly, the final regression model did not include intraoperative opioid dosage as a significant factor, even though PCIA drugs containing opioids were identified as a risk factor for CREs in elderly patients during recovery. This may be due to standardized intraoperative opioid doses and the lack of tracking total PCIA opioid use. In clinical practice, preemptive analgesia is often applied, where analgesics are administered through PCIA before the patient wakes up. Elderly patients, with reduced cerebral blood flow and metabolic function, are at high risk for emergence delirium [27]. Post-extubation excitement and restlessness, sometimes attributed to pain, may lead to the addition of opioids to the PCIA pump, which can impair respiratory control and upper airway function, causing central apnea, airway obstruction, and hypoxemia. This risk is particularly pronounced in patients with OSA, who are more susceptible to opioid-induced respiratory depression. Cognitive dysfunction in emergence delirium can hinder cooperation with medical staff, leading to decreased airway protection and subsequent hypoxemia. A recent study showed that intraoperative hypoxemia and hypocapnia increase the risk of postoperative delirium [28]. In addition to PCIA-related factors, cough intensity is a crucial indicator of a patient’s ability to maintain airway patency after tracheal extubation. Successful gas exchange relies on the patient’s capacity to keep an unobstructed airway and breathe independently. Inadequate cough strength, combined with excessive secretions, can lead to bronchial blockage, atelectasis, and aspiration pneumonia, contributing to CREs [25]. Khamiees et al. [29] used the SCSS (range, 0–5) to predict extubation success, finding that patients with SCSS ≤ 2 had a significantly higher risk of extubation failure. Wang [8] used SCSS to predict hypoxemia after extubation, consistent with this study’s findings that SCSS is a protective factor against CREs.

The nomogram developed in this study provides several improvements over existing practices by integrating multiple predictors into a comprehensive risk assessment tool. This model enables clinicians to identify high-risk patients preoperatively and implement tailored perioperative management strategies. Upon identifying high-risk patients through the nomogram, healthcare providers can take several steps to improve patient outcomes. In the preoperative phase, comprehensive patient data should be collected. Perioperatively, multifactor interventions targeting exercise, cognition, and nutrition can help delay or reverse frailty. Complete sleep apnea monitoring is advisable for patients who snore, with appropriate treatment provided for those diagnosed with severe OSA before elective surgeries [26]. Preemptive analgesia should be used judiciously, ensuring standardized intraoperative opioid administration while closely monitoring PCIA opioid use. Postoperatively, enhancing airway protection awareness and monitoring for high-risk patients is crucial. Extubation may need to be delayed if necessary, and muscle relaxant monitoring devices should be used to accurately assess muscle strength and avoid postoperative CREs [30]. For patients with emergence delirium, adherence to standard PCIA protocols, prompt pain assessment, and appropriate adjustments in analgesic dosages are essential to minimize respiratory complications [28]. Additionally, assessing cough intensity through the SCSS post-extubation provides valuable insights into airway patency, helping to predict and prevent CREs. Educating patients on effective coughing techniques and ensuring timely clearance of secretions can further reduce CREs in high-risk patients. By integrating these steps into clinical practice, the nomogram model not only identifies high-risk patients but also guides specific interventions to enhance patient safety and outcomes during the postanesthesia recovery period.

It is important to pay attention to other potential risk factors that have shown promise in early warning systems, such as age, BMI, hyperlipidemia, intraoperative application of lavage fluid, prone position, hypertension, diabetes, postoperative hypothermia, and ASA grade [4, 8, 19]. Although these factors were not included in the current predictive model, they have been identified as potential indicators of complications during anesthesia recovery in previous studies. To establish a more comprehensive understanding of these risk factors and their significance in predicting complications, further verification is necessary through large-sample, multicenter studies. Such studies can yield more robust and reliable evidence regarding the role of these indicators in early warning systems. This will contribute to improving patient care and ensuring the safety of anesthesia procedures.

Limitations

This study has several limitations. The study population was derived from a single tertiary hospital, which may introduce selection bias and limit the generalizability of our findings to the broader population. The relatively small sample size may not capture the full variability in patient characteristics and outcomes. The variables used in our model were based on routine clinical measurements and records, which may be subject to inaccuracies and inconsistencies. Additionally, important variables such as intraoperative ventilator parameters and total opioid use in PCIA were not included, potentially introducing measurement bias. Although we employed multivariable logistic regression to adjust for known confounders, residual confounding factors could bias the observed associations between risk factors and CREs. Furthermore, the model’s generalizability is a concern as it was developed using data from elderly patients undergoing elective general anesthesia in a tertiary care setting. This specific context may limit its applicability to other populations, such as different age groups, emergency surgeries, or various healthcare settings. The data were collected over a six-month period, and changes in clinical practices, patient management strategies, or healthcare policies over time could affect the model’s performance. Continuous monitoring and periodic recalibration are necessary to maintain accuracy. Although internal validation through Bootstrapping confirmed the model’s robustness, external validation in different clinical settings and populations is required to fully establish its generalizability. Future research should focus on validating the model in multiple centers with diverse patient populations.

Conclusions

In this study, several independent risk factors for complications during recovery from general anesthesia in elderly patients were identified frailty, snoring, PCIA, emergence delirium, and cough intensity at extubation. Based on these risk factors, a risk prediction nomogram for CREs in elderly patients in the PACU was developed. The nomogram demonstrated good discrimination, calibration, and clinical validity, making it a valuable tool for early clinical prediction of CREs in surgical elderly patients during postoperative recovery from general anesthesia. Thise nomogram can give medical personnel a scientific approach to CREs prevention and control, as well as precise interventions, based on individual risk factors. By identifying patients at higher risk of CREs early on, medical professionals can implement targeted strategies to mitigate the occurrence of complications and provide better postoperative care for elderly patients recovering from general anesthesia. This approach will improve patient outcomes and enhance the overall quality of care in surgical settings for the elderly population.

Data availability

The data that support the findings of this study are available from the corresponding author upon reasonable request.

Abbreviations

CREs:

Critical respiratory events

PACU:

Post-anesthesia care unit

ICU:

Intensive Care Unit

BMI:

Body Mass Index

CCI:

Charlson Comorbidity Index

PCIA:

Patient-Controlled Intravenous Analgesia

ASA:

American Society of Anesthesiologists

SCSS:

Semiquantitative Cough Strength Score.

LASSO:

Least absolute shrinkage and selection operator

ROC:

Receiver Operating Characteristic

MCC:

Matthews correlation coefficient

DCA:

Decision Curve Analysis

SE:

Standard Error

OSA:

Obstructive Sleep Apnea

References

  1. Inouye SK, WRGJ, Saczynski JS. Delirium in elderly people. Lancet. 2014;383(9920):911–22.

    Article  PubMed  Google Scholar 

  2. Mann-Farrar J, Egan E, Higgins A, Wysocki L, Vaux A, Arndell E, et al. Are postoperative clinical outcomes influenced by length of stay in the Postanesthesia Care Unit? J Perianesth Nurs. 2019;34(2):386–93. https://doi.org/10.1016/j.jopan.2018.07.004.

    Article  PubMed  Google Scholar 

  3. Epstein RH, Dexter F, Lopez MG, Ehrenfeld JM. Anesthesiologist staffing considerations consequent to the temporal distribution of hypoxemic episodes in the postanesthesia care unit. Anesth Analg. 2014;119(6):1322–33. https://doi.org/10.1213/ane.0000000000000410.

  4. Liu Y, Zhang Y, Tang Y, Huang D, Wen O, Yan X. Development and validation of the predictive model for hypoxemia in postanesthesia care unit. J Clin Anesthesiology. 2021;37(1):55–8. https://doi.org/10.12089/jca.2021.01.012.

    Article  Google Scholar 

  5. Bruins SD, Leong PM, Ng SY. Retrospective review of critical incidents in the post-anaesthesia care unit at a major tertiary hospital. Singap Med J. 2017;58(8):497–501. https://doi.org/10.11622/smedj.2016126.

    Article  Google Scholar 

  6. Laporta ML, Sprung J, Weingarten TN. Respiratory depression in the post-anesthesia care unit: Mayo Clinic experience. Bosnian J Basic Med Sci. 2021;21(2):221–8. https://doi.org/10.17305/bjbms.20204816.

  7. Liu K, Scott JB, Jing G, Li J. Management of postoperative hypoxemia. Respir Care. 2021;66(7):1136–49. https://doi.org/10.4187/respcare.08929.

    Article  PubMed  Google Scholar 

  8. Wang S. Development and application of the prediction model of oxygen desaturation of patients after general anesthesia in PACU [Master]. Shanghai: Naval Medical University of the People’s Liberation Army; 2018.

    Google Scholar 

  9. Arozullah AM, Khuri SF, Henderson WG, Daley J. Development and validation of a multifactorial risk index for predicting postoperative pneumonia after major noncardiac surgery. Ann Intern Med. 2001;135(10):847–57. https://doi.org/10.7326/0003-4819-135-10-200111200-00005.

    Article  CAS  PubMed  Google Scholar 

  10. Arozullah AM, Daley J, Henderson WG, Khuri SF. Multifactorial risk index for predicting postoperative respiratory failure in men after major noncardiac surgery. The National Veterans Administration Surgical Quality Improvement Program. Ann Surg. 2000;232(2):242–53. https://doi.org/10.1097/00000658-200008000-00015.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  11. Brueckmann B, Villa-Uribe JL, Bateman BT, Grosse-Sundrup M, Hess DR, Schlett CL, et al. Development and validation of a score for prediction of postoperative respiratory complications. Anesthesiology. 2013;118(6):1276–85. https://doi.org/10.1097/ALN.0b013e318293065c.

  12. Lukannek C, Shaefi S, Platzbecker K, Raub D, Santer P, Nabel S, et al. The development and validation of the score for the prediction of postoperative respiratory complications (SPORC-2) to predict the requirement for early postoperative tracheal re-intubation: a hospital registry study. Anaesthesia. 2019;74(9):1165–74. https://doi.org/10.1111/anae.14742.

  13. Gupta H, Gupta PK, Fang X, Miller WJ, Cemaj S, Forse RA, et al. Development and validation of a risk calculator predicting postoperative respiratory failure. Chest. 2011;140(5):1207–15. https://doi.org/10.1378/chest.11-0466.

  14. Stocking JC, Drake C, Aldrich JM, Ong MK, Amin A, Marmor RA, et al. Outcomes and risk factors for delayed-onset postoperative respiratory failure: a multi-center case-control study by the University of California Critical Care Research Collaborative (UC(3)RC). BMC Anesthesiol. 2022;22(1):146. https://doi.org/10.1186/s12871-022-01681-x.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Pate A, Riley RD, Collins GS, van Smeden M, Van Calster B, Ensor J, et al. Minimum sample size for developing a multivariable prediction model using multinomial logistic regression. Stat Methods Med Res. 2023;32(3):555–71. https://doi.org/10.1177/09622802231151220.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Murphy GS, Szokol JW, Marymont JH, Greenberg SB, Avram MJ, Vender JS. Residual neuromuscular blockade and critical respiratory events in the postanesthesia care unit. Anesth Analg. 2008;107(1):130–7. https://doi.org/10.1213/ane.0b013e31816d1268.

  17. Stewart PA, Liang SS, Li QS, Huang ML, Bilgin AB, Kim D, et al. The impact of residual neuromuscular blockade, oversedation, and hypothermia on adverse respiratory events in a Postanesthetic Care Unit: a prospective study of prevalence, predictors, and outcomes. Anesth Analg. 2016;123(4):859–68. https://doi.org/10.1213/ane.0000000000001513.

    Article  PubMed  Google Scholar 

  18. Alenezi FK, Alnababtah K, Alqahtani MM, Olayan L, Alharbi M. The association between residual neuromuscular blockade (RNMB) and critical respiratory events: a prospective cohort study. Perioper Med (Lond). 2021;10(1):14. https://doi.org/10.1186/s13741-021-00183-7.

    Article  PubMed  Google Scholar 

  19. Zhu H, Xu W. Establishment of a early warning model for early postoperative hypoxemia in patients with spinal cord injury⁃type thoracolumbar fractures. Chin Nurs Res. 2023;37(8):1338–43. https://doi.org/10.12102/j.issn.1009-6493.2023.08.004.

    Article  Google Scholar 

  20. Hoogendijk EO, Afilalo J, Ensrud KE, Kowal P, Onder G, Fried LP. Frailty: implications for clinical practice and public health. Lancet (London England). 2019;394(10206):1365–75. https://doi.org/10.1016/s0140-6736(19)31786-6.

  21. Traven SA, Reeves RA, Slone HS, Walton ZJ. Frailty predicts medical complications, length of Stay, Readmission, and mortality in revision hip and knee arthroplasty. J Arthroplast. 2019;34(7):1412–6. https://doi.org/10.1016/j.arth.201902060.

  22. Cooper L, Dezube AR, De León LE, Fox S, Bravo-Iñiguez CE, Mazzola E, et al. Polypharmacy and frailty in older adults evaluated at a multidisciplinary geriatric-thoracic clinic prior to surgery. J Geriatric Oncol. 2022;13(2):249–52. https://doi.org/10.1016/j.jgo.2021.07.012.

    Article  CAS  Google Scholar 

  23. Chen D, Fang T, Ding Y, Zhu W, Yuan F, Wang Z, et al. Relationship between preoperative frailty and postoperative pulmonary complications in elderly patients undergoing thoracoscopic lobectomy. Chin J Anesthesiology. 2021;41(8):928–32. https://doi.org/10.3760/cma.j.cn131073.20210618.00808.

    Article  Google Scholar 

  24. Chung JW, Kim N, Wee JH, Lee J, Lee J, Kwon S, et al. Clinical features of snoring patients during sedative endoscopy. Korean J Intern Med. 2019;34(2):305–14. https://doi.org/10.3904/kjim.2017.110.

    Article  PubMed  Google Scholar 

  25. Brunetto DP, Moschik CE, Dominguez-Mompell R, Jaria E, Sant’Anna EF, Moon W. Mini-implant assisted rapid palatal expansion (MARPE) effects on adult obstructive sleep apnea (OSA) and quality of life: a multi-center prospective controlled trial. Prog Orthodont. 2022;23(1):3. https://doi.org/10.1186/s40510-021-00397-x.

    Article  Google Scholar 

  26. Prasad B, Nyenhuis SM, Imayama I, Siddiqi A, Teodorescu M. Asthma and obstructive sleep apnea overlap: what has the evidence taught us? Am J Respir Crit Care Med. 2020;201(11):1345–57. https://doi.org/10.1164/rccm.201810-1838TR.

  27. Huang J, Qi H, Lv K, Chen X, Zhuang Y, Yang L. Emergence delirium in Elderly patients as a potential predictor of subsequent postoperative delirium: a descriptive correlational study. J Perianesthesia Nursing: Official J Am Soc PeriAnesthesia Nurses. 2020;35(5):478–83. https://doi.org/10.1016/j.jopan.2019.11.009.

    Article  Google Scholar 

  28. Ahrens E, Tartler TM, Suleiman A, Wachtendorf LJ, Ma H, Chen G, et al. Dose-dependent relationship between intra-procedural hypoxaemia or hypocapnia and postoperative delirium in older patients. Br J Anaesth. 2023;130(2):e298–306. https://doi.org/10.1016/j.bja.2022.08.032.

    Article  CAS  PubMed  Google Scholar 

  29. Khamiees M, Raju P, DeGirolamo A, Amoateng-Adjepong Y, Manthous CA. Predictors of extubation outcome in patients who have successfully completed a spontaneous breathing trial. Chest. 2001;120(4):1262–70. https://doi.org/10.1378/chest.120.4.1262.

  30. Apfelbaum JL, Hagberg CA, Connis RT, Abdelmalak BB, Agarkar M, Dutton RP, et al. 2022 American Society of Anesthesiologists practice guidelines for management of the difficult airway. Anesthesiology. 2022;136(1):31–81.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Thanks are due to Dr. Fan (Shanghai Maritime University) for assistance with the data analysis and valuable discussion. We sincerely thank all of the investigation nurses who participated in this survey. The authors would like to express their gratitude for the funding provided, which enabled the completion of this study.

Funding

This work was supported by the Department of Zhejiang Health Science and Technology Project Science and Technology (Grant No. 2024KY101) and the Scientific research project of Education Department of Zhejiang Province (Grant No. Y202351310). The funding bodies played no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

Jingying Huang: Conceptualization, Methodology, Writing-Original draft preparation; Haiou Qi: Supervision, Writing-Reviewing and Editing; Xin Xu: Project administration.; Jin Yang and Yiting Zhu: Data collection; Miaomiao Xu:Data collection; Yuting Wang: Data curation.

Corresponding author

Correspondence to Haiou Qi.

Ethics declarations

Ethics approval and consent to participate

The study was carried out in strict adherence to the principles outlined in the Declaration of Helsinki. All procedures involving human participants were approved by the by the Institutional Review Board of Sir Run Run Shaw Hospital Affiliated to Zhejiang University School of Medicine (No. 2023539-01, Date: January 25, 2023)., and written informed consent was obtained from all participants prior to their inclusion in the study. Confidentiality and privacy of participants were rigorously maintained throughout the research process.

Consent for publication

Not Applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Huang, J., Yang, J., Qi, H. et al. Development and validation of a nomogram for predicting critical respiratory events during early anesthesia recovery in elderly patients. BMC Med Inform Decis Mak 24, 257 (2024). https://doi.org/10.1186/s12911-024-02671-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12911-024-02671-4

Keywords