ABSTRACT
This study aimed to develop a computed tomography (CT)-based radiomics model capable of precisely predicting hyperprogression and pseudoprogression (PP) in patients with non-small cell lung cancer (NSCLC) treated with immunotherapy. We retrospectively analyzed 105 patients with NSCLC, from three institutions, treated with immune checkpoint inhibitors (ICIs) and categorized them into training and independent testing set. Subsequently, we processed CT scans with a series of image-preprocessing techniques, and 6008 radiomic features capturing intra- and peritumoral texture patterns were extracted. We used the least absolute shrinkage and selection operator logistic regression model to select radiomic features and construct machine learning models. To further differentiate between progressive disease (PD) and hyperprogressive disease (HPD), we developed a new radiomics model. The logistic regression (LR) model showed optimal performance in distinguishing PP from HPD, with areas under the receiver operating characteristic curve (AUC) of 0.95 (95% confidence interval [CI]: 0.91-0.99) and 0.88 (95% CI: 0.66-1) in the training and testing sets, respectively. Additionally, the support vector machine model showed optimal performance in distinguishing PD from HPD, with AUC of 0.97 (95% CI: 0.93-1) and 0.87 (95% CI: 0.72-1) in the training and testing sets, respectively. Kaplan‒Meier survival curves showed clear stratification between PP predicted by the radiomics model and true progression (HPD and PD) (hazard ratio = 0.337, 95% CI: 0.200–0.568, p < 0.01) in overall survival. Our study demonstrates that radiomic features extracted from baseline CT scans are effective in predicting PP and HPD in patients with NSCLC treated with ICIs.
Introduction
The introduction of immune checkpoint inhibitors (ICIs) has transformed the treatment paradigm for various malignancies, including non-small cell lung cancer (NSCLC). Immunotherapy, distinct from other therapeutic modalities, elicits atypical responses, including pseudoprogression (PP) and hyperprogressive disease (HPD). This has led to the development of immune-related response evaluation criteria, including the immune-related Response Criteria (irRC),Citation1 immune-related Response Evaluation Criteria in Solid Tumors (irRECIST),Citation2 and immune-based Response Evaluation Criteria in Solid Tumors (iRECIST).Citation3 Pseudoprogression, characterized by a transient increase in the tumor burden due to delayed tumor shrinkage, should be distinguished from true tumor progression, encompassing hyperprogression and progression. Accurate identification of pseudoprogression is critical because it directly affects clinical decision making in patients who may benefit from ICI therapy. The incidence of pseudoprogression ranges from 0.6% to 9.96%,Citation1,Citation4–6 depending on tumor type and the criteria employed for assessment. HPD is characterized by an accelerated rate of tumor growth, which typically results in the deterioration of the patient’s condition after immunotherapy.Citation7 The incidence of HPD varies from 5.0% to 37.0%,Citation8–11 with variations attributed to tumor histology and the applied diagnostic criteria.
The underlying biological and clinical causes of PP development in response to ICIs are poorly understood. Based on published findings, PP can be linked to the presence of immune cells, such as CD103+ tissue-resident memory cells and T cells.Citation12,Citation13 Another mechanism could involve the delayed establishment of an adaptive immune response, resulting in sustained tumor growth until a sufficient immune response is mounted.Citation14 The pathogenesis of HPD may be associated with the amplification of EGFR or MDM2/4,Citation15 while IFNγ signaling might also contribute to tumor hyperprogression.Citation16 Various molecular changes, such as circulating tumor DNA (ctDNA),Citation17 Interleukin-8 (IL-8),Citation18 CXC motif chemokine ligand 2 (CXCL2),Citation19 and neutrophil-to-lymphocyte ratio (NLR)Citation20,Citation21 can serve as potential indicators for evaluating atypical responses. However, these approaches have not been consistently replicated in all studies. Biopsy is an important diagnostic tool for pseudoprogression. Accumulating evidence indicates that pseudoprogression may result from lymphocyte infiltration into the tumor, leading to a transient increase in tumor size instead of actual neoplastic cell growth.Citation6 However, biopsies are frequently limited by inadequate tissue samples, spatial heterogeneity, and procedural risks.
Computed tomography (CT) is a routine examination tool that provides a large amount of valuable information. CT imaging-based radiomics is the process of separating a region of interest (ROI), extracting quantitative features using artificial intelligence algorithms, and conducting subsequent data analysis to provide decision support.Citation22 Radiomic features have been applied to guide clinical decision-making, including differential diagnosisCitation23,Citation24 and treatment response prediction for various cancers.Citation25,Citation26 However, investigations utilizing radiomic features to predict atypical responses to cancer immunotherapy are lacking. Studies have demonstrated the efficacy of 18F-fluoro-ethyl-tyrosine PET imaging in accurately identifying the progression disease (PD) and PP of brain metastases in patients with NSCLC undergoing immunotherapy and radiotherapy.Citation27 Baseline CT scans can serve as a predictive tool for assessing the risk of HPD in patients with NSCLC treated with immunotherapy.Citation28 However, differentiating between PP and HPD in patients with NSCLC post-immunotherapy lacks investigation, necessitating a noninvasive and instant predictive method.
This study aimed to develop and evaluate a radiomics model capable of accurately predicting PP and HPD in patients with NSCLC.
Materials and methods
Study design
This retrospective observational study adhered to the principles outlined in the Declaration of Helsinki and 2008 Declaration of Istanbul. The study was approved by the Ethics Committee for Clinical Research of the Shandong Cancer Hospital and Institute (SDTHEC2023010013), and the requirement for informed consent was waived.
Patients
We retrospectively collected data from 1,146 patients with NSCLC who were treated with ICIs between May 2019 and October 2022. Subsequently, radiomics models were constructed using datasets from three distinct hospitals: the training set from Shandong Cancer Hospital and the external testing set from both Shandong Provincial Hospital and Shandong Proton Center. The inclusion criteria included (1) all tumors pathologically confirmed as NSCLC, (2) at least two cycles of ICIs administered, and (3) age ˃18 years. The exclusion criteria were (1) no previous, baseline, or follow-up CT scans; (2) CT showing inflammatory lung cancer or non-measurable lesions; (3) obvious artifacts on CT images; and (4) variable response to treatment. Finally, 105 patients were included in the study. The overall work design is illustrated in .
Figure 1. Workflow and pipeline overview. Tumor identification and annotation were performed before immunotherapy using the PyRadimocs package based on python (version 3.7.1) to extract intra-tumoral and peri-tumoral radiomic features. Subsequently, LASSO regression was employed to select relevant features from the training set, followed by the construction of radiomics models using LR and SVM classifiers. These models were validated using an independent testing set.
CT image acquisition
All patients underwent standard contrast-enhanced computed tomography (CECT). CT examinations were conducted using various devices, including Philips, Siemens, Toshiba, and GE CT scanners. The adopted scanning protocol utilized a tube voltage of 120 kV, a tube current ranging from 160–300 mA, an in-plane pixel resolution between 0.68–0.87 mm, and operated in the helical scanning mode.
Identifying PP, HPD, and PD
Patient responses were assessed by two thoracic radiologists with 10 and 8 years of clinical experience, respectively. These radiologists were blinded to the patients’ clinical histories and performed evaluations based on baseline and post-immunotherapy CT scans (within 6 months) in accordance with RECIST version 1.1. PP was defined as a ≥ 25% increase in tumor burden at week 12 that was not confirmed as a progressive disease at the next assessmentCitation29 (). Meanwhile, in order to determine the HPD, we defined HPD as the first evaluation of tumor progression following immunotherapy, characterized by a rate of progression exceeding twice the baseline and a tumor size greater than 50% (). The criterion for PD was defined as a minimum increase of ≥ 20% in the total sum of tumor target diameters ().
Figure 2. CECT scans: (a) Pseudoprogression, (b) Progression, and (c) Hyperprogression. Baseline CECT was performed when the patient was receiving immunotherapy, pre-treatment CT was performed more than 2 weeks before immunotherapy, and the first and second evaluations were within 6 months.
Segmentation and feature extraction
Two expert thoracic radiologists separately mapped the ROI on the tumor’s contour in pretreatment CECT images using ITK-SNAP software (version 3.8.0, available at https://www.itksnap.org). Subsequently, an expanded morphological approach was employed to delineate a 5 mm-wide ring that extended radially from 0 to 15 mm beyond the tumor nodule, enabling comprehensive characterization of peritumoral features while excluding adjacent healthy tissues or organs. To evaluate consistency, both intra- and interobserver reliabilities were tested by having the two radiologists repeat the segmentation for 30 randomly chosen patients after 1-month interval. We employed specific preprocessing steps in our imaging analysis, focusing on voxel resampling and gray-intensity normalization. Voxel resampling standardized the pixel spacing across all images to ensure consistent voxel dimensions of 1 × 1 × 1 mm. Additionally, we implemented gray intensity normalization to standardize the range of intensity values, reducing variations unrelated to tissue properties. The PyRadiomics package in Python (version 3.7.1) was used to extract 1502 radiomic features from each region.Citation30 In total, 6008 radiomic features were extracted from the peritumoral (0–5 mm, 5–10 mm, and 10–15 mm) and intratumoral areas. The Z-score normalization method was employed to standardize radiomic features in the training set, and the same method was used to normalize features in the testing set using the mean and standard deviation values derived from the training set.
Radiomics model building
To evaluate and analyze patients in the dataset, unsupervised clustering of radiomic features was performed using heat maps to distinguish between patients with different treatment responses.
Intra-class correlation coefficient (ICC) was computed to assess both intra- and inter-observer consistency. Features demonstrating strong intra- and inter-observer reliability (ICC >0.8) were selected for further analysis. The Mann‒Whitney U test or t-test was employed to identify radiomic features with P-value ˂0.05. To eliminate redundant variables, Spearman’s correlation analysis was applied, removing features displaying a high correlation (Spearman’s coefficient > 0.90) from the dataset.
A synthetic minority oversampling technique (SMOTE) was implemented to address class imbalance in the training set. This expanded the sample size of the patients with PP, achieving a more balanced dataset. Subsequently, the least absolute shrinkage and selection operator (LASSO) regression algorithm was employed with 10-fold cross-validation to identify the top-performing features with nonzero coefficients (Figure S1). Machine learning-based models were developed using classifiers, such as support vector machine (SVM) and logistic regression (LR), and evaluated on an independent testing set. The same radiomics modeling strategy was employed for the HPD group to distinguish between HPD and PD. The model’s predictive efficacy was assessed using various metrics, including the area under the receiver operating curve (AUC) with a 95% confidence interval (CI), accuracy (ACC), sensitivity (SEN), specificity (SPE), positive predictive value (PPV), negative predictive value (NPV), and F1 score.
In our radiomics model, employing SVM and LR algorithms, the cutoff value for distinguishing between low- and high-score cases is determined by the natural decision thresholds inherent in these models.Citation31 Progression-free survival (PFS) and overall survival (OS) were compared between the two groups. PFS was defined as the duration from the initiation of ICIs treatment to either disease progression or death due to any cause, and OS was defined as the duration between the initiation of ICIs treatment and death. To assess PFS and OS, we employed the Kaplan‒Meier method and evaluated the differences in Kaplan‒Meier curves using the log-rank test.
Statistical analyses
Statistical analyses were performed using SPSS (version 26.0; IBM Corp., Armonk, NY, USA) and R software (version 4.2.2). Blood variables did not follow a normal distribution and were reported as medians (interquartile ranges). The Kruskal‒Wallis test was used to compare blood variables across different groups. Associations between radiomic features and clinical variables were assessed using the unpaired, two-tailed chi-square test or Fisher’s exact test for categorical variables and the Student’s t-test or Mann–Whitney U-test for continuous variables. Statistical significance was defined as a two-sided p<0.05.
Results
Patient dataset
We retrospectively collected data of 1146 patients who underwent immunotherapy, of whom 105 met the predefined inclusion criteria, with 16 exhibiting PP, 44 exhibiting HPD, and 45 exhibiting PD. The distribution of patients in the training and testing sets is presented in Table S1. summarizes the clinicopathological characteristics of the patients. The patients who received immunochemotherapy demonstrated a significantly lower incidence of HPD compared to those treated with ICIs monotherapy (P<0.001). No statistically significant differences (P>0.05) were observed in sex, age, smoking history, ECOG performance status, number of prior lines of systemic cancer therapy, combined targeted therapy, histology, PD-L1 expression status, EGFR mutation status, liver metastasis, or number of metastases among the three groups. Moreover, no statistically significant differences were observed in lymphocytes, neutrophils, LDH (lactate dehydrogenase), NLR, dNLR (derived neutrophil-to-lymphocyte ratio), and SII (Systemic Immune Inflammation Index) (Table S2).
Table 1. Clinical characteristics of the dataset.
PP radiomics model development and testing
A heatmap analysis of intratumoral and 0–5 mm peritumoral radiomic features revealed that cluster 1 encompassed 81.3% of patients with PP (). Similarly, heatmap analysis of 5–15 mm peritumoral radiomic features demonstrated clustering of patients with PP (), potentially indicating that these specific patient groups had distinct radiomic features than that of patients with true progression.
Figure 3. Radiomic feature selection. (a) Heat maps of unsupervised clustering analysis for intratumoral and 0–5 mm peritumoral radiomic features with 81.3% PP clustered together in cluster 1. (b) Heat maps of unsupervised clustering analysis for 5–15 mm peritumoral radiomic features of the PP group. (c) Heat maps of unsupervised clustering analysis for intratumoral and 0–5 mm peritumoral radiomic features with 65.9% HPD clustered together in cluster 2. (d) Heat maps of unsupervised clustering analysis for 5–15 mm peritumoral radiomic features of the HPD group.
Seven radiomic features, including four intratumoral and three peritumoral (Table S3), were selected using LASSO regression analysis. The selected radiomic features did not exhibit any significant correlation with clinical variables, as determined by Pearson’s correlation coefficient. (Figure S2A).
The LR model exhibited a superior performance. The radiomics model score was significantly higher in the PP group than in the true progression group, both in the training (mean, 0.84 ± 0.17 vs. 0.15 ± 0.27, p<0.0005) and testing (mean, 0.79 ± 0.40 vs. 0.10 ± 0.28, p<0.05) sets (). In the training set (n = 75), the LR radiomics model achieved an AUC of 0.95 (95% CI, 0.91–0.99) () and demonstrated a predictive accuracy of 0.88 for distinguishing PP from other response patterns, with sensitivity and specificity of 0.92 and 0.86, respectively. In the independent testing set (n = 30), the LR model exhibited an AUC of 0.88 (95% CI, 0.66–1) (), with a model accuracy, sensitivity, and specificity of 0.90, 0.83, and 0.92, respectively; the F1 score was observed to be 0.77, while the positive and negative predictive rates were 0.71 and 0.96, respectively (Table S5).
Figure 4. Performance analysis of the models. The ROC curve of LR and SVM model in the PP training set (a) and the testing set (b). The ROC curve of LR and SVM model in the HPD training set (c) and the testing set (d).
Figure 5. Prognostic performance of radiomics models for predicting response to immunotherapy. The difference in radiomics model scores between the training set (a) and the testing set (b) in the PP group, and between the training set (c) and the testing set (d) in the HPD group. (e) Kaplan – Meier analysis of progression-free survival was performed according to the binary radiomics model score for patients with PP and true progression. (f) Kaplan – Meier analysis of progression-free survival was performed according to the binary radiomics model score for patients with HPD and PD. (g) Kaplan – Meier analysis of overall survival was performed according to the binary radiomics model score for patients with PP and true progression. (f) Kaplan – Meier analysis of overall survival was performed according to the binary radiomics model score for patients with HPD and PD.
HPD radiomics model development and testing
Our results indicated that patients with HPD were more likely to cluster together in the unsupervised clustering analysis of patients with true progression (PD and HPD), suggesting that they had a distinct radiomic signature compared to those with PD (). Subsequently, LASSO regression analysis was performed on the radiomic features, resulting in the selection of seven features: four intratumoral and three peritumoral (Table S3). Pearson’s correlation analysis was conducted on the selected radiomic and clinical features; however, no significant correlations were identified (Figure S2B).
The SVM radiomics model demonstrated optimal classifier performance. In the training (0.87 ± 0.47 vs −0.74 ± 0.62, p<0.0005) and testing (0.58 ± 0.70 vs. 0.44 ± 0.71, p<0.005) sets (), the radiomics model scores of the PD group were higher than those of the HPD group. In the training set, the AUC for distinguishing HPD responders was 0.97 (95% CI, 0.93–1) (), with an accuracy of 0.92 and a sensitivity and specificity of 0.88 and 0.97, respectively. In the testing set, the model achieved an AUC of 0.87 (95% CI, 0.72–1) (), with an accuracy of 0.83, and a sensitivity and specificity of 0.92 and 0.75, respectively. The F1 score is 0.85 (Table S5).
In the univariate analysis, patients receiving immunotherapy without chemotherapy demonstrated a significantly higher risk of HPD than that of those receiving combination chemotherapy (p = 0.03) (Table S4). By incorporating this factor into the radiomics model score, a clinical-radiomic model was created, demonstrating enhanced predictive capability on both the training and testing sets, achieving AUCs of 0.97 and 0.90, respectively (Figure S3).
Radiomics model to predict the outcome of NSCLC immunotherapy
Patients with PP demonstrated significantly prolonged PFS than that of patients with true progression (hazard ratio [HR] = 0.246, 95% CI: 0.167–0.362, p<0.01) (). Furthermore, patients with PD had a significantly longer PFS than that of patients with HPD (HR = 0.397, 95% CI: 0.250–0.631; p<0.01) (). The radiomics model for PP revealed that patients with high scores in the model experienced extended PFS that that of patients with low scores (HR = 0.430, 95% CI: 0.291–0.635, p<0.01) (). Similarly, the HPD radiomics model also indicated that patients with high scores had a longer PFS than that of patients with low scores (HR = 0.458, 95% CI: 0.291–0.721; p<0.01) ().
Furthermore, we conducted a comprehensive analysis of the OS. We observed that patients with PP had a significantly longer OS than that of patients with true progression (HR = 0.280, 95% CI: 0.161–0.486, p<0.01) (). Similarly, patients with PD had a markedly longer OS than those with HPD (HR = 0.412, 95% CI: 0.244–0.696, p<0.01) (). In the predictive model for PP, patients with high scores demonstrated a substantially longer OS than those with low scores (HR = 0.337, 95% CI: 0.200–0.568, p<0.01) (). A parallel trend was observed in the HPD predictive model, where patients with high scores also exhibited a significantly extended OS compared to those with low scores (HR = 0.506, 95% CI: 0.300-0.853, p<0.01) ().
Discussion
The utilization of a noninvasive and widely employed technique to prognosticate the risk of PP and HPD after immunotherapy holds paramount significance, while CT radiomics models exhibit inadequate development and validation for predicting the risk of PP and HPD. We developed CT radiomics models based on machine learning for noninvasive prediction of PP and HPD in patients with NSCLC undergoing immunotherapy, specifically using SVM and LR models known for their strong generalization capabilities. In the PP group, the LR model outperformed, achieving an AUC of 0.95 and 0.88 in the training and testing sets, respectively. The SVM model demonstrated a slightly lower efficacy, with AUCs of 0.95 and 0.84 for the training and testing sets, respectively. In the HPD group, the SVM model outperformed, achieving an AUC of 0.97 and 0.87 in the training and testing sets, respectively, whereas the LR model showed comparatively lower performance with AUCs of 0.96 and 0.80 for the training and testing sets, respectively.
The incidence of pseudoprogressive disease was 1.7%, aligning with the findings of previous studies.Citation6 Existing literature demonstrates promising diagnostic potential for differentiating PP using NLR, ctDNA, IL-8, and CXCL2,Citation17–20 although these tests, conducted only on small sample sizes, require further validation through larger-scale studies. Repeated pathological examinations of the primary or metastatic site can similarly facilitate an accurate diagnosis; however, biopsies carry inherent invasiveness and associated risks. Radiomics has emerged as a significant digital biopsy method for predicting the biological features of tumors and has demonstrated potential for noninvasive assessment of immunotherapy efficacy.Citation32 Tian et al. used radiomic features to predict the expression of PDL1 in NSCLC and inferred the clinical outcome of immunotherapy.Citation33 Existing evidence suggests that the pattern of PP may be attributed to immune cell infiltration, such as T lymphocytes and CD103+ tissue-resident memory cells, which exhibit distinct CT radiomic features compared to tumor cells, leading to a transient increase in tumor burden.Citation1,Citation12,Citation13,Citation34–36 Additionally, the underlying pathogenesis of PP is linked to delayed activation of the adaptive immune systemCitation14,Citation29 and vascular changes surrounding the tumor.Citation37,Citation38 Both factors are intricately linked to the tumor microenvironment (TME), and numerous studies have shown that the TME exerts a profound influence on tumor response following treatment. The peritumoral area plays a crucial role in the TME,Citation39–41 Sun et al. predicted CD8 cells with peritumoral radiomic features and used these features to predict the immunotherapy response.Citation41 He et al. demonstrated that the selection of the largest lesion as a measure for assessing treatment response offers enhanced accuracy and convenience,Citation42 thus, we selected the largest lesion for delineation. Our analysis revealed excellent performance of the radiomics model, incorporating intratumoral and peritumoral radiomic features, in predicting PP and true progression.
In this study, the incidence of HPD was 5%, consistent with previous reports.Citation11,Citation43 Several reports have indicated a potential association between HPD and various factors, such as age, sex, EGFR, and metastatic burden;Citation44,Citation45 however, findings are mostly contradictory across studies. In our study, compared to patients receiving ICIs monotherapy, those receiving immunochemotherapy exhibited a significantly lower incidence of HPD, suggesting that combination chemotherapy may mitigate the risk of developing HPD after ICIs treatment.Citation43,Citation46 The pathogenesis of HPD is closely associated with the TME, and several studies have demonstrated that the interaction between the immune checkpoint antibodies, Fc/FcR, and macrophages serves as a mechanism of HPD following PD-1/PD-L1 blockade. An imbalance between effector and regulatory T cells within the TME is also implicated in HPD after PD-1 blockade.Citation47 Furthermore, the main mechanism underlying ICI-related HPD involves the immunogenicity, metabolism, and cancer pathways through the IFNγ PKM2-β-catenin cascade in preclinical models.Citation16 The pathogenesis of HPD is closely associated with TME, and the predictive performance of intratumoral and peritumoral radiomics models surpasses that of a single peritumoral model.Citation48 Therefore, we extracted the intratumoral and peritumoral radiomic features to construct the radiomics model that demonstrated excellent performance in our analysis.
Deep learning, an advanced subset of machine learning, excels in autonomously extracting hierarchical features from raw data, showing remarkable proficiency and diagnostic versatility. This is exceptionally relevant in oncology because of its critical role in cancer diagnosis, monitoring treatment response, and predicting patient outcomes.Citation49–52 By using deep learning, we can substantially increase the accuracy of predictive models for PP and HPD through comprehensive analysis of complex, high-dimensional datasets that integrate radiomics, genomic, and clinical data, optimizing patient outcomes and minimizing ineffective therapies. Although our current research employed traditional machine-learning techniques owing to dataset limitations, the accumulation of larger datasets allows us to transition to deep-learning techniques for a more sophisticated analysis. This application of deep learning is set to transform our predictive capabilities, offering a nuanced understanding of the relationship between radiomic changes and immune response, thus enabling a more precise identification of patients requiring an alternative therapeutic approach for HPD compared to those with PP, where continued immunotherapy may be beneficial.
This study has several limitations. First, the retrospective nature of the study and low incidence of PP and HPD resulted in a limited number of cases available for analysis. Second, as this was a multicenter study, CT parameters varied across different institutions; therefore, we standardized the images before feature extraction. Finally, although PDL1 and EGFR expression have demonstrated predictive values for PP and HPD in other studies, their absence from our clinical factors hindered our ability to fully assess their predictive power.
Conclusion
In conclusion, our study used a radiomics model to predict PP and HPD following immunotherapy in NSCLC. Intratumoral and peritumoral radiomic features based on noninvasive CT can be used to detect atypical tumor responses before immunotherapy, aiding clinicians in effectively managing patients and tailoring personalized treatment options.
Supplemental Material
Download MS Word (682.9 KB)Disclosure statement
No potential conflict of interest was reported by the author(s).
Supplementary material
Supplemental data for this article can be accessed online at https://doi.org/10.1080/2162402X.2024.2312628.
Additional information
Funding
References
- Wolchok JD, Hoos A, O’Day S, Weber JS, Hamid O, Lebbé C, Maio M, Binder M, Bohnsack O, Nichol G. et al. Guidelines for the evaluation of immune therapy activity in solid tumors: immune-related response criteria. Clin Cancer Res. 2009;15(23):7412–10. doi: 10.1158/1078-0432.CCR-09-1624.
- Nishino M, Giobbie-Hurder A, Gargano M, Suda M, Ramaiya NH, Hodi FS. Developing a common language for tumor response to immunotherapy: immune-related response criteria using unidimensional measurements. Clin Cancer Res. 2013;19(14):3936–3943. doi: 10.1158/1078-0432.CCR-13-0895.
- Seymour L, Bogaerts J, Perrone A, Ford R, Schwartz LH, Mandrekar S, Lin NU, Litière S, Dancey J, Chen A. et al. iRECIST: guidelines for response criteria for use in trials testing immunotherapeutics. Lancet Oncol. 2017;18(3):e143–e152. doi: 10.1016/S1470-2045(17)30074-8.
- Borghaei H, Paz-Ares L, Horn L, Spigel DR, Steins M, Ready NE, Chow LQ, Vokes EE, Felip E, Holgado E. et al. Nivolumab versus Docetaxel in Advanced Nonsquamous Non-Small-Cell Lung Cancer. N Engl J Med. 2015;373(17):1627–1639. doi: 10.1056/NEJMoa1507643.
- Chiou VL, Burotto M. Pseudoprogression and Immune-Related Response in Solid Tumors. J Clin Oncol. 2015;33(31):3541–3543. doi: 10.1200/JCO.2015.61.6870.
- Chen MY, Zeng YC. Pseudoprogression in lung cancer patients treated with immunotherapy. Crit Rev Oncol Hematol. 2022;169:103531. doi: 10.1016/j.critrevonc.2021.103531.
- Champiat S, Dercle L, Ammari S, Massard C, Hollebecque A, Postel-Vinay S, Chaput N, Eggermont A, Marabelle A, Soria J-C. et al. Hyperprogressive disease is a new pattern of progression in cancer patients treated by anti-PD-1/PD-L1. Clin Cancer Res. 2017;23(8):1920–1928. doi: 10.1158/1078-0432.CCR-16-1741.
- Ferrara R, Mezquita L, Texier M, Lahmar J, Audigier-Valette C, Tessonnier L, Mazieres J, Zalcman G, Brosseau S, Le Moulec S. et al. Hyperprogressive disease in patients with advanced non–small cell lung cancer treated with PD-1/PD-L1 inhibitors or with single-agent chemotherapy. JAMA Oncol. 2018;4(11):1543–1552. doi: 10.1001/jamaoncol.2018.3676.
- Kim CG, Kim KH, Pyo KH, Xin CF, Hong MH, Ahn BC, Kim Y, Choi SJ, Yoon HI, Lee JG. et al. Hyperprogressive disease during PD-1/PD-L1 blockade in patients with non-small-cell lung cancer. Ann Oncol. 2019;30(7):1104–1113. doi: 10.1093/annonc/mdz123.
- Ruiz-Patiño A, Arrieta O, Cardona AF, Martín C, Raez LE, Zatarain-Barrón ZL, Barrón F, Ricaurte L, Bravo-Garzón MA, Mas L. et al. Immunotherapy at any line of treatment improves survival in patients with advanced metastatic non-small cell lung cancer (NSCLC) compared with chemotherapy (quijote-CLICaP). Thorac Cancer. 2020;11(2):353–361. doi: 10.1111/1759-7714.13272.
- Sehgal K. Hyperprogression in patients with cancer receiving immune checkpoint inhibitors. JAMA Netw Open. 2021;4(3):e211839. doi: 10.1001/jamanetworkopen.2021.1839.
- Ito K, Hataji O, Katsuta K, Kobayashi T, Gabazza EC, Yatabe Y, Taguchi O, Yamamoto N. “Pseudoprogression” of pulmonary pleomorphic carcinoma during nivolumab therapy. J Thorac Oncol. 2016;11(10):e117–e119. doi: 10.1016/j.jtho.2016.05.002.
- Rocha P, Hardy-Werbin M, Naranjo D, Taus Á, Rodrigo M, Zuccarino F, Roth R, Wood O, Ottensmeier CH, Arriola E. CD103+CD8+ lymphocytes characterize the immune infiltration in a case with pseudoprogression in squamous NSCLC. J Thorac Oncol. 2018;13(10):e193–e196. doi: 10.1016/j.jtho.2018.05.008.
- Gainor JF, Longo DL, Chabner BA. Pharmacodynamic biomarkers: falling short of the mark? Clin Cancer Res. 2014;20(10):2587–2594. doi: 10.1158/1078-0432.Ccr-13-3132.
- Kato S, Goodman A, Walavalkar V, Barkauskas DA, Sharabi A, Kurzrock R. Hyperprogressors after immunotherapy: analysis of genomic alterations associated with accelerated growth rate. Clin Cancer Res. 2017;23(15):4242–4250. doi: 10.1158/1078-0432.CCR-16-3133.
- Li G, Choi JE, Kryczek I, Sun Y, Liao P, Li S, Wei S, Grove S, Vatan L, Nelson R. et al. Intersection of immune and oncometabolic pathways drives cancer hyperprogression during immunotherapy. Cancer Cell. 2023;41(2):304–322.e307. doi: 10.1016/j.ccell.2022.12.008.
- Stadler JC, Belloum Y, Deitert B, Sementsov M, Heidrich I, Gebhardt C, Keller L, Pantel K. Current and future clinical applications of ctDNA in immuno-oncology. Cancer Res. 2022;82(3):349–358. doi: 10.1158/0008-5472.Can-21-1718.
- Sanmamed MF, Perez-Gracia JL, Schalper KA, Fusco JP, Gonzalez A, Rodriguez-Ruiz ME, Oñate C, Perez G, Alfaro C, Martín-Algarra S. et al. Changes in serum interleukin-8 (IL-8) levels reflect and predict response to anti-PD-1 treatment in melanoma and non-small-cell lung cancer patients. Ann Oncol. 2017;28(8):1988–1995. doi: 10.1093/annonc/mdx190.
- Matsuo N, Azuma K, Hattori S, Ohtake J, Kawahara A, Ishii H, Tokito T, Yamada K, Shibata Y, Shimokawaji T. et al. Association between soluble immune mediators and tumor responses in patients with nonsmall cell lung cancer treated with anti-PD-1 inhibitor. Int J Cancer. 2019;144(5):1170–1179. doi: 10.1002/ijc.31923.
- Kiriu T, Yamamoto M, Nagano T, Hazama D, Sekiya R, Katsurada M, Katsurada N, Tachihara M, Kobayashi K, Nishimura Y. Pseudo-progression and the neutrophil-to-lymphocyte ratio in non-small cell lung cancer treated with immune checkpoint inhibitors: a case-control study. Onco Targets Ther. 2019;12:10559–10568. doi: 10.2147/OTT.S228138.
- Choi WM, Kim JY, Choi J, Lee D, Shim JH, Lim YS, Lee HC, Yoo C, Ryu MH, Ryoo BY. et al. Kinetics of the neutrophil-lymphocyte ratio during PD-1 inhibition as a prognostic factor in advanced hepatocellular carcinoma. Liver Int. 2021;41(9):2189–2199. doi: 10.1111/liv.14932.
- Guiot J, Vaidyanathan A, Deprez L, Zerka F, Danthine D, Frix AN, Lambin P, Bottari F, Tsoutzidis N, Miraglio B. et al. A review in radiomics: making personalized medicine a reality via routine imaging. Med Res Rev. 2022;42(1):426–440. doi: 10.1002/med.21846.
- Khorrami M, Bera K, Thawani R, Rajiah P, Gupta A, Fu P, Linden P, Pennell N, Jacono F, Gilkeson RC. et al. Distinguishing granulomas from adenocarcinomas by integrating stable and discriminating radiomic features on non-contrast computed tomography scans. Eur J Cancer. 2021;148:146–158. doi: 10.1016/j.ejca.2021.02.008.
- Li Y, Liu J, Yang X, Wang A, Zang C, Wang L, He C, Lin L, Qing H, Ren J. et al. An ordinal radiomic model to predict the differentiation grade of invasive non-mucinous pulmonary adenocarcinoma based on low-dose computed tomography in lung cancer screening. Eur Radiol. 2023;33(5):3072–3082. doi: 10.1007/s00330-023-09453-y.
- Jazieh K, Khorrami M, Saad A, Gad M, Gupta A, Patil P, Viswanathan VS, Rajiah P, Nock CJ, Gilkey M. et al. Novel imaging biomarkers predict outcomes in stage III unresectable non-small cell lung cancer treated with chemoradiation and durvalumab. J Immunother Cancer. 2022;10(3):e003778. doi: 10.1136/jitc-2021-003778.
- Zhu Z, Chen M, Hu G, Pan Z, Han W, Tan W, Zhou Z, Wang M, Mao L, Li X. et al. A pre-treatment CT-based weighted radiomic approach combined with clinical characteristics to predict durable clinical benefits of immunotherapy in advanced lung cancer. Eur Radiol. 2023;33(6):3918–3930. doi: 10.1007/s00330-022-09337-7.
- Akhoundova D, Hiltbrunner S, Mader C, Förster R, Kraft J, Schwanhäusser B, Bankel L, Kollias S, Treyer V, Rushing EJ. et al. 18F-FET PET for diagnosis of pseudoprogression of brain metastases in patients with non-small cell lung cancer. Clin Nucl Med. 2020;45(2):113–117. doi: 10.1097/RLU.0000000000002890.
- Vaidya P, Bera K, Patil PD, Gupta A, Jain P, Alilou M, Khorrami M, Velcheti V, Madabhushi A. Novel, non-invasive imaging approach to identify patients with advanced non-small cell lung cancer at risk of hyperprogressive disease with immune checkpoint blockade. J Immunother Cancer. 2020;8(2). doi: 10.1136/jitc-2020-001343.
- Hodi FS, Hwu W-J, Kefford R, Weber JS, Daud A, Hamid O, Patnaik A, Ribas A, Robert C, Gangadhar TC. et al. Evaluation of immune-related response criteria and RECIST v1.1 in patients with advanced melanoma treated with Pembrolizumab. J Clin Oncol. 2016;34(13):1510–1517. doi: 10.1200/JCO.2015.64.0391.
- Mu W, Schabath MB, Gillies RJ. Images are data: challenges and opportunities in the clinical translation of radiomics. Cancer Res. 2022;82(11):2066–2068. doi: 10.1158/0008-5472.Can-22-1183.
- Zhou Z-H. Machine learning. Singapore: Springer Nature; 2021.
- Chen Q, Zhang L, Mo X, You J, Chen L, Fang J, Wang F, Jin Z, Zhang B, Zhang S. Current status and quality of radiomic studies for predicting immunotherapy response and outcome in patients with non-small cell lung cancer: a systematic review and meta-analysis. Eur J Nucl Med Mol Imaging. 2021;49(1):345–360. doi: 10.1007/s00259-021-05509-7.
- Tian P, He B, Mu W, Liu K, Liu L, Zeng H, Liu Y, Jiang L, Zhou P, Huang Z. et al. Assessing PD-L1 expression in non-small cell lung cancer and predicting responses to immune checkpoint inhibitors using deep learning on computed tomography images. Theranostics. 2021;11(5):2098–2107. doi: 10.7150/thno.48027.
- Di Giacomo AM, Danielli R, Guidoboni M, Calabrò L, Carlucci D, Miracco C, Volterrani L, Mazzei MA, Biagioli M, Altomonte M. et al. Therapeutic efficacy of ipilimumab, an anti-CTLA-4 monoclonal antibody, in patients with metastatic melanoma unresponsive to prior systemic treatments: clinical and immunological evidence from three patient cases. Cancer Immunol Immunother. 2009;58(8):1297–1306. doi: 10.1007/s00262-008-0642-y.
- Tanizaki J, Hayashi H, Kimura M, Tanaka K, Takeda M, Shimizu S, Ito A, Nakagawa K. Report of two cases of pseudoprogression in patients with non-small cell lung cancer treated with nivolumab-including histological analysis of one case after tumor regression. Lung Cancer. 2016;102:44–48. doi: 10.1016/j.lungcan.2016.10.014.
- Dercle L, Sun S, Seban RD, Mekki A, Sun R, Tselikas L, Hans S, Bernard-Tessier A, Mihoubi Bouvier F, Aide N. et al. Emerging and evolving concepts in cancer immunotherapy imaging. Radiology. 2023;306(1):32–46. doi: 10.1148/radiol.210518.
- Digernes I, Grøvik E, Nilsen LB, Saxhaug C, Geier O, Reitan E, Sætre DO, Breivik B, Reese T, Jacobsen KD. et al. Brain metastases with poor vascular function are susceptible to pseudoprogression after stereotactic radiation surgery. Adv Radiat Oncol. 2018;3(4):559–567. doi: 10.1016/j.adro.2018.05.005.
- Walker AJ, Ruzevick J, Malayeri AA, Rigamonti D, Lim M, Redmond KJ, Kleinberg L. Postradiation imaging changes in the CNS: how can we differentiate between treatment effect and disease progression? Future Oncol (London, England). 2014;10(7):1277–1297. doi: 10.2217/fon.13.271.
- Baxevanis CN, Fortis SP, Perez SA. The balance between breast cancer and the immune system: challenges for prognosis and clinical benefit from immunotherapies. Semin Cancer Biol. 2021;72:76–89. doi: 10.1016/j.semcancer.2019.12.018.
- Perrone M, Raimondi E, Costa M, Rasetto G, Rizzati R, Lanza G, Gafà R, Cavallesco G, Tamburini N, Maniscalco P. et al. Inflammatory microenvironment in early non-small cell lung cancer: exploring the predictive value of radiomics. Cancers Basel. 2022;14(14). doi: 10.3390/cancers14143335.
- Sun R, Limkin EJ, Vakalopoulou M, Dercle L, Champiat S, Han SR, Verlingue L, Brandao D, Lancia A, Ammari S. et al. A radiomics approach to assess tumour-infiltrating CD8 cells and response to anti-PD-1 or anti-PD-L1 immunotherapy: an imaging biomarker, retrospective multicohort study. Lancet Oncol. 2018;19(9):1180–1191. doi: 10.1016/S1470-2045(18)30413-3.
- He LN, Chen T, Fu S, Jiang Y, Zhang X, Chen C, Du W, Luo L, Li A, Wang Y. et al. Tumor response assessment by measuring the single largest lesion per organ in advanced non-small cell lung cancer patients treated with PD-1/PD-L1 inhibitor. Ther Adv Med Oncol. 2023;15:17588359231200463. doi: 10.1177/17588359231200463.
- Li LX, Cappuzzo F, Matos I, Socinski MA, Hopkins AM, Sorich MJ. Low risk of hyperprogression with first-line chemoimmunotherapy for advanced non-small cell lung cancer: pooled analysis of 7 clinical trials. Oncologist. 2023;28(4):e205–e211. doi: 10.1093/oncolo/oyad043.
- Lin M, Vanneste BGL, Yu Q, Chen Z, Peng J, Cai X. Hyperprogression under immunotherapy: a new form of immunotherapy response?-a narrative literature review. Transl Lung Cancer Res. 2021;10(7):3276–3291. doi: 10.21037/tlcr-21-575.
- Liu J, Wu Q, Wu S, Xie X. Investigation on potential biomarkers of hyperprogressive disease (HPD) triggered by immune checkpoint inhibitors (ICIs). Clinical & translational oncology: official publication of the Federation of Spanish oncology societies and of the national cancer institute of Mexico. 2021;23(9):1782–1793. doi: 10.1007/s12094-021-02579-9.
- Li J, Zhang H, Zhu H, Li H. Clinical outcomes and immunological evaluation of toripalimab combination for cancer treatment: a systematic review and meta-analysis of randomized controlled trials. Int Immunopharmacol. 2023;125(Pt B):111176. doi: 10.1016/j.intimp.2023.111176.
- Wakiyama H, Kato T, Furusawa A, Okada R, Inagaki F, Furumoto H, Fukushima H, Okuyama S, Choyke PL, Kobayashi H. Treg-dominant tumor microenvironment is responsible for hyperprogressive disease after PD-1 blockade therapy. Cancer Immunol Res. 2022;10(11):1386–1397. doi: 10.1158/2326-6066.Cir-22-0041.
- Jiang T, Song J, Wang X, Niu S, Zhao N, Dong Y, Wang X, Luo Y, Jiang X. Intratumoral and peritumoral analysis of mammography, Tomosynthesis, and multiparametric MRI for predicting ki-67 level in breast cancer: a radiomics-based study. Mol Imaging Biol. 2022;24(4):550–559. doi: 10.1007/s11307-021-01695-w.
- Tran KA, Kondrashova O, Bradley A, Williams ED, Pearson JV, Waddell N. Deep learning in cancer diagnosis, prognosis and treatment selection. Genome Med. 2021;13(1):152. doi: 10.1186/s13073-021-00968-x.
- Painuli D, Bhardwaj S, Köse U. Recent advancement in cancer diagnosis using machine learning and deep learning techniques: A comprehensive review. Comput Biol Med. 2022;146:105580. doi: 10.1016/j.compbiomed.2022.105580.
- Feng Z, Li H, Liu Q, Duan J, Zhou W, Yu X, Chen Q, Liu Z, Wang W, Rong P. CT radiomics to predict macrotrabecular-massive subtype and immune status in hepatocellular carcinoma. Radiology. 2023;307(1):e221291. doi: 10.1148/radiol.221291.
- Huang S, Yang J, Shen N, Xu Q, Zhao Q. Artificial intelligence in lung cancer diagnosis and prognosis: Current application and future perspective. Semin Cancer Biol. 2023;89:30–37. doi: 10.1016/j.semcancer.2023.01.006.