切换至 "中华医学电子期刊资源库"

中华肝脏外科手术学电子杂志 ›› 2023, Vol. 12 ›› Issue (03) : 272 -277. doi: 10.3877/cma.j.issn.2095-3232.2023.03.005

所属专题: 临床研究

临床研究

基于卷积神经网络的肝细胞癌复发预警数字病理学模型研究
孟锦雯1, 刘治坤2, 顾钰峰3, 王建国2, 杨帆2, 郑树森4, 徐骁1,()   
  1. 1. 310058 杭州,浙江大学医学院;310006 杭州,浙江省肿瘤融合研究与智能医学重点实验室
    2. 310006 杭州,浙江省肿瘤融合研究与智能医学重点实验室;310006 杭州,浙江大学医学院附属杭州市第一人民医院肝胆胰外科
    3. 310053 杭州,浙江中医药大学第四临床医学院
    4. 310006 杭州,浙江大学医学院附属第一医院肝胆胰外科
  • 收稿日期:2023-01-04 出版日期:2023-06-10
  • 通信作者: 徐骁
  • 基金资助:
    国家自然科学基金重大研究计划(92159202); 浙江省自然科学基金(LZ22H180003); 浙江省教育厅一般科研项目(Y202148349)

Study of digital pathological model based on convolutional neural network for early warning of recurrence of hepatocellular carcinoma

Jinwen Meng1, Zhikun Liu2, Yufeng Gu3, Jianguo Wang2, Fan Yang2, Shusen Zheng4, Xiao Xu1,()   

  1. 1. Zhejiang University School of Medicine, Hangzhou 310058, China; Key Laboratory of Integrated Oncology Research and Intelligent Medicine of Zhejiang Province, Hangzhou 310006, China
    2. Key Laboratory of Integrated Oncology Research and Intelligent Medicine of Zhejiang Province, Hangzhou 310006, China; Department of Hepatobiliary and Pancreatic Surgery, Affiliated Hangzhou First People's Hospital, Zhejiang University School of Medicine, Hangzhou 310006, China
    3. The Fourth School of Clinical Medicine, Zhejiang Chinese Medical University, Hangzhou 310053, China
    4. Department of Hepatobiliary and Pancreatic Surgery, the First Affiliated Hospital of Zhejiang University School of Medicine, Hangzhou 310006, China
  • Received:2023-01-04 Published:2023-06-10
  • Corresponding author: Xiao Xu
引用本文:

孟锦雯, 刘治坤, 顾钰峰, 王建国, 杨帆, 郑树森, 徐骁. 基于卷积神经网络的肝细胞癌复发预警数字病理学模型研究[J]. 中华肝脏外科手术学电子杂志, 2023, 12(03): 272-277.

Jinwen Meng, Zhikun Liu, Yufeng Gu, Jianguo Wang, Fan Yang, Shusen Zheng, Xiao Xu. Study of digital pathological model based on convolutional neural network for early warning of recurrence of hepatocellular carcinoma[J]. Chinese Journal of Hepatic Surgery(Electronic Edition), 2023, 12(03): 272-277.

目的

探讨基于卷积神经网络(CNN)的数字病理学模型在肝癌复发预警中的预测价值。

方法

本研究包含4个肝癌队列,队列1和队列3为训练集,队列2和队列4为验证集。队列1、2、3分别有202、179、738例患者,来源于2012年1月至2017年1月浙江大学医学院附属第一医院1 119例肝癌患者。队列4是来自美国的癌症基因组图谱(TCGA)数据库361例患者。首先,在队列1运用7种CNNs(AlexNet、Squeezenet、InceptionV3、GoogleNet、DenseNet201、VGG19和ResNet18)训练肝癌病理切片病灶自动识别模型,区分肿瘤区域与正常组织;选择最佳的神经网络模型,通过迁移学习构建肿瘤区域成分抽提模型,解析肿瘤区域5种不同成分(肿瘤细胞、淋巴细胞、间质、坏死及背景),并在队列2上验证;在队列3上探索这5种成分与肝癌术后复发的相关性,并联合临床特征构建肝癌术后复发预警模型,在队列4进行独立的外部验证。生存分析采用Kaplan-Meier法和Log-rank检验,生存预后影响因素分析采用LASSO-Cox比例风险回归模型。

结果

在队列1中,AlexNet、DenseNet201、VGG19和ResNet18鉴别肝癌病灶的准确率均高于95.0%。在队列2中,神经网络VGG19的准确率最佳,达96.4%,选择VGG19迁移至肿瘤区域成分抽提模型,其分割5种成分的准确率达99.0%。在队列3中,多因素Cox分析显示,高淋巴细胞神经网络评分(LYM)和低间质神经网络评分(STR)与患者术后复发明显相关(HR=0.70,1.38;P<0.05);基于LYM、STR、AFP、美国癌症联合委员会(AJCC)分期构建术后复发风险的预警模型,在训练集和验证集中,模型可对患者术后复发风险精准分层(χ2=45.06,15.49;P<0.05)。在独立队列4中,肝癌复发预警模型进一步验证,LYM、STR病理特征综合评分可提高AJCC分期的无复发生存预测能力。

结论

基于CNN的肝癌病灶自动识别模型和肿瘤区域成分抽提模型可智能化分割肝癌数字病理切片,实现肝癌术后复发预警,LYM、STR为术后复发相关的新型病理预测因子。

Objective

To evaluate the predictive value of digital pathological model based on convolutional neural network (CNN) in the early warning of recurrence of hepatocellular carcinoma (HCC).

Methods

This study consisted of 4 HCC cohorts. Cohort 1 and 3 were taken as the training sets, and cohort 2 and 4 as the validation sets. 1 119 HCC patients admitted to the First Affiliated Hospital of Zhejiang University from January 2012 to January 2017 were enrolled and assigned into cohort 1 (n=202), 2 (n=179) and 3 (n=738), respectively. 361 patients from The Cancer Genome Atlas (TCGA) were allocated incohort 4. First, 7 CNNs (AlexNet, Squeezenet, InceptionV3, GoogleNet, DenseNet201, VGG19 and ResNet18) were used to train the automatic recognition model of pathological sections of HCC to distinguish tumor region from normal tissues. The optimal neural network model was chosen. The component extraction model for tumor region was constructed through transfer learning, and 5 different components (tumor cells, lymphocytes, stroma, necrosis and background) in the tumor region were analyzed and were validated by cohort 2. The correlation between these 5 components and postoperative recurrence of HCC was analyzed in cohort 3. A warning model of postoperative recurrence of HCC was constructed based on clinical features, which was subjected to independent external validation in cohort 4. Survival analysis was conducted by Kaplan-Meier method and Log-rank test. Prognostic factors were analyzed by Cox proportional hazards regression model with LASSO method.

Results

In cohort 1, the accuracy rates of AlexNet, DenseNet201, VGG19 and ResNet18 in distinguishing HCC lesions were all above 95.0%. In cohort 2, the accuracy rate of neural network VGG19 was the highest up to 96.4%. When VGG19 was transferred to the component extraction model in the tumor region, the accuracy rate of segmenting 5 components reached 99.0%. Incohort 3, multivariate Cox analysis showed that high lymphocyte (LYM) neural network score and low stroma (STR) neural network score were significantly correlated with postoperative recurrence (HR=0.70, 1.38; P<0.05). Based on LYM, STR, AFP and American Joint Committee on Cancer (AJCC) staging, the early warning model of the risk of postoperative recurrence was constructed. In the training and validation sets, the models could accurately classify the risk of postoperative recurrence risk of patients (χ2=45.06, 15.49; P<0.05). In the independent cohort 4, the early warning model of HCC recurrence was further validated, and the comprehensive scores of LYM and STR pathological features could improve the prediction capability of AJCC staging for recurrence-free survival.

Conclusions

The CNN-based automatic recognition model for HCC lesions and the component extraction model in tumor region can deliver intelligent segmentation of digital pathological sections of HCC and provide early warning of postoperative recurrence of HCC. LYM and STR are novel pathological predictors for postoperative recurrence.

图1 肝癌区域自动分割模型鉴别五类组织注:a~e分别为队列1和2中5类组织的代表性病理切片的背景、坏死、淋巴细胞、间质、肝癌细胞(HE染色128×128像素);f~j为DeepDream可视化5类组织
图2 基于队列3构建肝癌复发风险预警模型注:a为淋巴细胞神经网络评分(LYM)Kaplan-Meier生存曲线;b为间质神经网络评分(STR)Kaplan-Meier生存曲线;c为基于神经网络评分的4种肝癌亚型Kaplan-Meier生存曲线;d为肝癌术后复发多因素生存分析森林图;e为训练集肝癌复发风险预警模型Kaplan-Meier生存曲线;f为验证集肝癌复发风险预警模型Kaplan-Meier生存曲线;AJCC为美国癌症联合委员会
图3 神经网络评分在TCGA队列中的应用注:a为不同危险因素预警肝癌复发的净重新分类改善指数(NRI);b为不同危险因素预警肝癌复发的决策分析曲线;c为不同危险因素预警肝癌复发的时间依赖性曲线的曲线下面积(AUC);AJCC为美国癌症联合委员会,LYM为淋巴细胞神经网络评分,STR为间质神经网络评分,TCGA为癌症基因组图谱
[1]
Sung H, Ferlay J, Siegel RL, et al. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries[J]. CA Cancer J Clin, 2021, 71(3):209-249.
[2]
Llovet JM, Montal R, Villanueva A. Randomized trials and endpoints in advanced HCC: role of PFS as a surrogate of survival[J].J Hepatol, 2019, 70(6):1262-1277.
[3]
Bera K, Schalper KA, Rimm DL, et al. Artificial intelligence in digital pathology-new tools for diagnosis and precision oncology[J]. Nat Rev Clin Oncol, 2019, 16(11):703-715.
[4]
Niazi MKK, Parwani AV, Gurcan MN. Digital pathology and artificial intelligence[J]. Lancet Oncol, 2019, 20(5):e253-261.
[5]
杨鑫, 章真. 基于深度学习的人工智能在数字病理学中的进展[J]. 中国癌症杂志, 2021, 31(2):151-155.
[6]
Tam A, Barker J, Rubin D. A method for normalizing pathology images to improve feature extraction for quantitative pathology[J]. Med Phys, 2016, 43(1):528.
[7]
Liao L, Zhao Y, Wei S, et al. Parameter distribution balanced CNNs[J]. IEEE Trans Neural Netw Learn Syst, 2020, 31(11):4600-4609.
[8]
Lee HJ, Ullah I, Wan W, et al. Real-time vehicle make and model recognition with the residual squeeze net architecture[J]. Sensors, 2019, 19(5):982.
[9]
Friedman J, Hastie T, Tibshirani R. Regularization paths for generalized linear models via coordinate descent[J]. J Stat Softw, 2010, 33(1):1-22.
[10]
Pencina MJ, D'Agostino RB Sr, Steyerberg EW. Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers[J]. Stat Med, 2011, 30(1):11-21.
[11]
Vickers AJ, van Calster B, Steyerberg EW. A simple, step-by-step guide to interpreting decision curve analysis[J]. Diagn Progn Res, 2019(3):18.
[12]
Berardi G, Morise Z, Sposito C, et al. Development of a nomogram to predict outcome after liver resection for hepatocellular carcinoma in Child-Pugh B cirrhosis[J]. J Hepatol, 2020, 72(1):75-84.
[13]
Kather JN, Pearson AT, Halama N, et al. Deep learning can predict microsatellite instability directly from histology in gastrointestinal cancer[J]. Nat Med, 2019, 25(7):1054-1056.
[14]
Skrede OJ, De Raedt S, Kleppe A, et al. Deep learning for prediction of colorectal cancer outcome: a discovery and validation study[J]. Lancet, 2020, 395(10221):350-360.
[15]
van der Laak J, Litjens G, Ciompi F. Deep learning in histopathology: the path to the clinic[J]. Nat Med, 2021, 27(5):775-784.
[16]
Campanella G, Hanna MG, Geneslaw L, et al. Clinical-grade computational pathology using weakly supervised deep learning on whole slide images[J]. Nat Med, 2019, 25(8):1301-1309.
[17]
Price WN. Big data and black-box medical algorithms[J]. Sci Transl Med, 2018, 10(471):eaao5333.
[18]
van der Velden BHM, Kuijf HJ, Gilhuijs KGA, et al. Explainable artificial intelligence (XAI) in deep learning-based medical image analysis[J]. Med Image Anal, 2022(79):102470.
[19]
Ding X, He M, Chan AWH, et al. Genomic and epigenomic features of primary and recurrent hepatocellular carcinomas[J]. Gastroenterology, 2019, 157(6):1630-1645, e6.
[20]
Boehm KM, Khosravi P, Vanguri R, et al. Harnessing multimodal data integration to advance precision oncology[J]. Nat Rev Cancer, 2022, 22(2):114-126.
[1] 阿冲罗布, 陈颖, 谢德坤. 腹腔镜外囊完整剥离术治疗肝包虫病效果及对患者肝功能、预后的影响[J]. 中华普外科手术学杂志(电子版), 2023, 17(06): 666-669.
[2] 崔占斌, 乔军利, 张丽丽, 韩明强. 尿碘水平与甲状腺乳头状癌患者术后复发危险度分层的相关性[J]. 中华普外科手术学杂志(电子版), 2023, 17(06): 615-618.
[3] 邢晓伟, 刘雨辰, 赵冰, 王明刚. 基于术前腹部CT的卷积神经网络对腹壁切口疝术后复发预测价值[J]. 中华疝和腹壁外科杂志(电子版), 2023, 17(06): 677-681.
[4] 姜明, 罗锐, 龙成超. 闭孔疝的诊断与治疗:10年73例患者诊疗经验总结[J]. 中华疝和腹壁外科杂志(电子版), 2023, 17(06): 706-710.
[5] 杜锡林, 谭凯, 贺小军, 白亮亮, 赵瑶瑶. 肝细胞癌转化治疗方式[J]. 中华肝脏外科手术学电子杂志, 2023, 12(06): 597-601.
[6] 魏小勇. 原发性肝癌转化治疗焦点问题探讨[J]. 中华肝脏外科手术学电子杂志, 2023, 12(06): 602-607.
[7] 张其坤, 商福超, 李琪, 栗光明, 王孟龙. 联合脾切除对肝癌合并门静脉高压症患者根治性切除术后的生存获益分析[J]. 中华肝脏外科手术学电子杂志, 2023, 12(06): 613-618.
[8] 严庆, 刘颖, 邓斐文, 陈焕伟. 微血管侵犯对肝癌肝移植患者生存预后的影响[J]. 中华肝脏外科手术学电子杂志, 2023, 12(06): 624-629.
[9] 张文华, 陶焠, 胡添松. 不同部位外生型肝癌临床病理特点及其对术后肝内复发和预后影响[J]. 中华肝脏外科手术学电子杂志, 2023, 12(06): 651-655.
[10] 韩宇, 张武, 李安琪, 陈文颖, 谢斯栋. MRI肝脏影像报告和数据系统对非肝硬化乙肝患者肝细胞癌的诊断价值[J]. 中华肝脏外科手术学电子杂志, 2023, 12(06): 669-673.
[11] 张维志, 刘连新. 基于生物信息学分析IPO7在肝癌中的表达及意义[J]. 中华肝脏外科手术学电子杂志, 2023, 12(06): 694-701.
[12] 陈安, 冯娟, 杨振宇, 杜锡林, 柏强善, 阴继凯, 臧莉, 鲁建国. 基于生物信息学分析CCN4在肝细胞癌中表达及其临床意义[J]. 中华肝脏外科手术学电子杂志, 2023, 12(06): 702-707.
[13] 叶文涛, 吴忠均, 廖锐. 癌旁组织ALOX15表达与肝癌根治性切除术后预后的关系[J]. 中华肝脏外科手术学电子杂志, 2023, 12(06): 708-712.
[14] 吴晨瑞, 廖锐, 贺强, 潘龙, 黄平, 曹洪祥, 赵益, 王永琛, 黄俊杰, 孙睿锐. MDT模式下肝动脉灌注化疗联合免疫靶向治疗肝细胞癌多处转移一例[J]. 中华肝脏外科手术学电子杂志, 2023, 12(06): 713-716.
[15] 张政赢, 鞠阳, 刘晓宁. 二甲双胍对2型糖尿病患者大肠腺瘤术后复发的影响[J]. 中华消化病与影像杂志(电子版), 2023, 13(06): 485-488.
阅读次数
全文


摘要