切换至 "中华医学电子期刊资源库"

中华腔镜泌尿外科杂志(电子版) ›› 2026, Vol. 20 ›› Issue (04) : 399 -406. doi: 10.3877/cma.j.issn.1674-3253.2026.04.005

临床研究

深度学习模型在膀胱镜下膀胱肿瘤分割中的应用
叶子兴1, 李红运2, 李英杰1, 王娟1, 孙玉姣1, 王惠珍1, 贺蕾1, 吕建阳3, 张洪波4, 张彤彤1, 陈雯雯1, 杨晓宇5, 申川5, 纪志刚1,()   
  1. 1100730 北京,中国医学科学院北京协和医院泌尿外科
    2310051 浙江,杭州海康威视数字技术有限公司
    3100007 北京市第六医院泌尿外科
    4102218 北京隆福医院泌尿外科
    5310051 浙江,杭州海康慧影科技有限公司
  • 收稿日期:2025-11-10 出版日期:2026-08-01
  • 通信作者: 纪志刚
  • 基金资助:
    中国医学科学院医学与健康科技创新工程项目(2024-I2M-C&T-B-020)

Application of deep learning models in segmentation of bladder tumors under cystoscopy

Zixing Ye1, Hongyun Li2, Yingjie Li1, Juan Wang1, Yujiao Sun1, Huizhen Wang1, Lei He1, Jianyang Lu3, Hongbo Zhang4, Tongtong Zhang1, Wenwen Chen1, Xiaoyu Yang5, Chuan Shen5, Zhigang Ji1,()   

  1. 1Department of Urology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Beijing 100730, China
    2Hangzhou Hikvision Digital Technology Co., Ltd., Hangzhou 310051, China
    3Department of Urology, Beijing Sixth Hospital, Beijing 100007, China
    4Department of Urology, Beijing Longfu Hospital, Beijing 102218, China
    5Hangzhou Hikvision Healthcare Technology Co., Ltd., Hangzhou 310051, China
  • Received:2025-11-10 Published:2026-08-01
  • Corresponding author: Zhigang Ji
引用本文:

叶子兴, 李红运, 李英杰, 王娟, 孙玉姣, 王惠珍, 贺蕾, 吕建阳, 张洪波, 张彤彤, 陈雯雯, 杨晓宇, 申川, 纪志刚. 深度学习模型在膀胱镜下膀胱肿瘤分割中的应用[J/OL]. 中华腔镜泌尿外科杂志(电子版), 2026, 20(04): 399-406.

Zixing Ye, Hongyun Li, Yingjie Li, Juan Wang, Yujiao Sun, Huizhen Wang, Lei He, Jianyang Lu, Hongbo Zhang, Tongtong Zhang, Wenwen Chen, Xiaoyu Yang, Chuan Shen, Zhigang Ji. Application of deep learning models in segmentation of bladder tumors under cystoscopy[J/OL]. Chinese Journal of Endourology(Electronic Edition), 2026, 20(04): 399-406.

目的

膀胱镜是膀胱肿瘤的重要检查方法,但是检查效果受病变特点、检查者水平等影响大,容易出现误诊、漏诊。深度学习模型的应用将有助于提高膀胱镜下肿瘤的识别能力。本研究将探讨深度学习模型对膀胱镜下不同大小、不同清晰度肿瘤的分割性能。

方法

回顾性纳入北京协和医院、北京市第六医院和北京隆福医院2022年6月1日至2024年6月1日接受经尿道膀胱肿瘤切除术的患者共198例。应用语义分割模型Mask2Former和DeepLabV3+对膀胱镜图像中的肿瘤进行分割。分别以171例和27例患者的视频资料作为训练集和测试集。观察指标包括交并比、准确率、召回率和平均Dice系数。应用R 4.0.2软件进行分析,所有的计数资料均以绝对数或百分比进行表示。

结果

DeepLabV3+模型(参数量21.75 M)对低清晰度膀胱肿瘤的分割准确率和召回率均为83.3%;Mask2Former模型(参数量197 M)对低清晰度膀胱肿瘤的分割准确率和召回率分别为92.1%和88.9%;两种模型对高清晰度膀胱肿瘤的分割准确率和召回率均高于98.0%。当应用Mask2Former模型时,随着训练集病例由10例增加至171例,模型对膀胱肿瘤的分割准确率由94.0%升高至97.7%、召回率由73.3%升高至93.5%,mDice由62.3%升高至85.5%,其中低清晰度组的提升尤为明显。应用Mask2Former模型对不同大小膀胱肿瘤进行分割,肿瘤占视野面积<0.02组与>0.1组的准确率分别为90.9%和98.1%;召回率分别为83.3%和99.8%。

结论

深度学习模型Mask2Former对膀胱镜下膀胱肿瘤的分割性能良好,尤其对低清晰度、肿瘤占视野面积大的图像具有较好的分割能力。

Objective

Cystoscopy is an essential diagnostic procedure for bladder tumors. However, the effectiveness of the examination is greatly influenced by the characteristics of the lesion and the proficiency of the examiner, leading to possible misdiagnosis and missed diagnosis. The application of deep learning models can help improve the identification of tumors under cystoscopy. This study explores the performance of deep learning models in segmenting tumors of different sizes and clarity under cystoscopy.

Methods

A retrospective study included 198 patients who underwent transurethral bladder tumor resection in Peking Union Medical College Hospital, Beijing Sixth Hospital, and Beijing Longfu Hospital from June 1, 2022, to June 1, 2024. Semantic segmentation models Mask2Former and DeepLabV3+ were used to identify bladder tumors. Video data from 171 patients and 27 patients were used as the training set and test set, respectively. Observational indicators included intersection over union (IOU), accuracy, recall rate, and mean Dice coefficient. Analysis was performed using R 4.0.2 software, and all count data were expressed as numbers or percentages.

Results

The DeepLabV3+ model (with 21.75 Mparameters) achieved an accuracy and recall of 83.3% for segmenting low-clarity bladder tumors. The Mask2Former model (with 197 M parameters) achieved an accuracy and recall rate of 92.1% and 88.9%, respectively, for low-clarity bladder tumors. Both models achieved an accuracy and recall rate of over 98.0% for high-clarity bladder tumors. When applying the Mask2Former model, as the number of cases in the training set increased from 10 to 171, the model's accuracy rate for segmenting bladder tumors increased from 94.0% to 97.7%, recall rate increased from 73.3% to 93.5%, and mDice increased from 62.3% to 85.5%, with a particularly noticeable improvement in the low-clarity group. When using the Mask2Former model to segment bladder tumors of different sizes, the accuracy rate for tumors occupying less than 0.02 of the screen and more than 0.1 was 90.9% and 98.1%, respectively; the recall rate was 83.3% and 99.8%, respectively.

Conclusion

The deep learning model Mask2Former demonstrates excellent performance in the segmentation of bladder tumors under cystoscopy, particularly exhibiting robust segmentation capabilities for low-clarity images and tumors occupying a significant portion of the visual field.

图1 膀胱镜采集视频中膀胱肿瘤标注示例
图2 膀胱镜采集视频中提取的膀胱肿瘤图片不同清晰度分组情况注:a、b为高清晰度组,膀胱肿瘤与周围组织区分度高,边界清楚;c、d为低清晰度组,膀胱肿瘤显示欠清,通过前后视频片段确定为膀胱肿瘤
图3 用于分割膀胱肿瘤的Mask2Former模型结构注:Mask2Former读取图片送入BackBone得到抽象的语义特征向量,并将特征向量送入Pixel Decoder。为提升模型对小目标的检出能力,模型在多个尺度将Pixel Decoder的内部特征送入TransFormer Decoder用于捕捉高分辨率特征,得到语义mask后,Mask2Former将语义mask、图像特征与query特征输入采用aasked attention的分割头模块中,得到最终的语义分割mask
表1 两种模型分割膀胱肿瘤性能对比
图4 Mask2Former模型分割膀胱肿瘤的准确率和召回率随训练集病例量增加而提高
表2 不同训练量的Mask2Former模型用于分割不同清晰度图片的性能
图5 Mask2Former模型对不同大小膀胱肿瘤进行分割的准确率和召回率
表3 Mask2Former模型对不同大小膀胱肿瘤的分割性能
[1]
Kausch I, Sommerauer M, Montorsi F, et al. Photodynamic diagnosis in non–muscle-invasive bladder cancer: a systematic review and cumulative analysis of prospective studies[J]. Eur Urol, 2010, 57(4): 595-606. DOI: 10.1016/j.eururo.2009.11.041.
[2]
Guldhammer CS, Vásquez JL, Kristensen VM, et al. Cystoscopy accuracy in detecting bladder tumors: a prospective video-confirmed study[J]. Cancers, 2023, 16(1): 160. DOI: 10.3390/cancers16010160.
[3]
Yeo L, Jain S. Good quality white-light transurethral resection of bladder tumours (GQ-WLTURBT) with experienced surgeons performing complete resections and obtaining detrusor muscle reduces early recurrence in new non-muscle-invasive bladder cancer: validation across time and place and recommendation for benchmarking[J]. BJU Int, 2012, 109(8): E27. DOI: 10.1111/j.1464-410X.2012.11011_3.x.
[4]
Vianello A, Costantini E, Del Zingaro M, et al. Repeated white light transurethral resection of the bladder in nonmuscle-invasive urothelial bladder cancers: systematic review and meta-analysis[J]. J Endourol, 2011, 25(11): 1703-1712. DOI: 10.1089/end.2011.0081.
[5]
Hwang WK, Jo SB, Han DE, et al. Artificial intelligence-based classification and segmentation of bladder cancer in cystoscope images[J]. Cancers, 2024, 17(1): 57. DOI: 10.3390/cancers17010057.
[6]
Jia X, Shkolyar E, Laurie MA, et al. Tumor detection under cystoscopy with transformer-augmented deep learning algorithm[J]. Phys Med Biol, 2023, 68(16). DOI: 10.1088/1361-6560/ace499.
[7]
Shkolyar E, Jia X, Chang TC, et al. Augmented bladder tumor detection using deep learning[J]. Eur Urol, 2019, 76(6): 714-718. DOI: 10.1016/j.eururo.2019.08.032.
[8]
Iwaki T, Akiyama Y, Nosato H, et al. Deep learning models for cystoscopic recognition of hunner lesion in interstitial cystitis[J]. Eur Urol Open Sci, 2023, 49: 44-50. DOI: 10.1016/j.euros.2022.12.012.
[9]
Mutaguchi J, Morooka K, Kobayashi S, et al. Artificial intelligence for segmentation of bladder tumor cystoscopic images performed by U-Net with dilated convolution[J]. J Endourol, 2022, 36(6): 827-834. DOI: 10.1089/end.2021.0483.
[10]
Elemento O. Towards artificial intelligence-driven pathology assessment for hematological malignancies[J]. Blood Cancer Discov, 2021, 2(3): 195-197. DOI: 10.1158/2643-3230.BCD-21-0048.
[11]
Pan Y, Gou F, Xiao C, et al. Semi-supervised recognition for artificial intelligence assisted pathology image diagnosis[J]. Sci Rep, 2024, 14(1): 21984. DOI: 10.1038/s41598-024-70750-7.
[12]
Zhou A, Li Z, Paul W, et al. Estimating visual acuity with spectacle correction from fundus photos using artificial intelligence[J]. JAMA Netw Open, 2025, 8(1): e2453770. DOI: 10.1001/jamanetworkopen.2024.53770.
[13]
Kim JH, Oh SI, Han SY, et al. An optimal artificial intelligence system for real-time endoscopic prediction of invasion depth in early gastric cancer[J]. Cancers, 2022, 14(23): 6000. DOI: 10.3390/cancers14236000.
[14]
Zhang Y, Li F, Yuan F, et al. Diagnosing chronic atrophic gastritis by gastroscopy using artificial intelligence[J]. Dig Liver Dis, 2020, 52(5): 566-572. DOI: 10.1016/j.dld.2019.12.146.
[15]
Shkolyar E, Zhou SR, Carlson CJ, et al. Optimizing cystoscopy and TURBT: enhanced imaging and artificial intelligence[J]. Nat Rev Urol, 2025, 22(1): 46-54. DOI: 10.1038/s41585-024-00904-9.
[16]
Chen LC, Papandreou G, Kokkinos I, et al. DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs[J]. IEEE Trans Pattern Anal Mach Intell, 2018, 40(4): 834-848. DOI: 10.1109/TPAMI.2017.2699184.
[17]
Xiao C, Zhou Z, Hu Y. A lightweight semantic segmentation model for underwater images based on DeepLabv3[J]. J Imaging, 2025, 11(5): 162. DOI: 10.3390/jimaging11050162.
[18]
Xiang S, Wei L, Hu K. Lightweight colon polyp segmentation algorithm based on improved DeepLabV3[J]. J Cancer, 2024, 15(1): 41-53. DOI: 10.7150/jca.88684.
[19]
Memon MM, Hashmani MA, Junejo AZ, et al. Unified DeepLabV3+ for semi-dark image semantic segmentation[J]. Sensors (Basel), 2022, 22(14): 5312. DOI: 10.3390/s22145312.
[20]
Zhang B, Zhao W, Huang C, et al. Optimized segmentation of overlapping cervical cells based on Mask2Former and denoising[J]. Sci Rep, 2025, 15(1): 17715. DOI: 10.1038/s41598-025-02379-z.
[21]
Guo Y, Li C, Zhang S, et al. U-net-based assistive identification of bladder cancer: a promising approach for improved diagnosis[J]. Urol Int, 2024, 108(2): 100-107. DOI: 10.1159/000535652.
[22]
Sharma P, Sharma B, Yadav DP, et al. Bladder lesion detection using EfficientNet and hybrid attention transformer through attention transformation[J]. Sci Rep, 2025, 15(1): 18042. DOI: 10.1038/s41598-025-02767-5.
[23]
Ikeda A, Nosato H, Kochi Y, et al. Support system of cystoscopic diagnosis for bladder cancer based on artificial intelligence[J]. J Endourol, 2020, 34(3): 352-358. DOI: 10.1089/end.2019.0509.
[24]
Yoo JW, Koo KC, Chung BH, et al. Deep learning diagnostics for bladder tumor identification and grade prediction using RGB method[J]. Sci Rep, 2022, 12(1): 17699. DOI: 10.1038/s41598-022-22797-7.
[25]
Li L, Jiang L, Yang K, et al. A novel artificial intelligence segmentation model for early diagnosis of bladder tumors[J]. Abdom Radiol, 2025, 50(7): 3092-3099. DOI: 10.1007/s00261-024-04715-9.
[26]
Chang TC, Shkolyar E, del Giudice F, et al. Real-time detection of bladder cancer using augmented cystoscopy with deep learning: a pilot study[J]. J Endourol, 2023. DOI: 10.1089/end.2023.0056.
[27]
Varnyú D, Szirmay-Kalos L. A comparative study of deep neural networks for real-time semantic segmentation during the transurethral resection of bladder tumors[J]. Diagnostics (Basel), 2022, 12(11): 2849. DOI: 10.3390/diagnostics12112849.
[1] 程妹, 金亚彬, 马丁瑞, 程昊, 詹玉莲, 周丹. 基于深度学习的MRI图像分析在乳腺癌诊疗中的应用[J/OL]. 中华乳腺病杂志(电子版), 2026, 20(03): 169-173.
[2] 冼明桦, 刘华章, 欧阳兰飞, 谢珍艳, 钟国庆, 林金鹏, 黄星, 黄帅, 谢可乐, 曾东禹, 黄文汉, 李丽萍, 王旭平, 梁会营, 张余. 6自由度步态床旁预测老年患者跌倒风险的应用[J/OL]. 中华关节外科杂志(电子版), 2026, 20(02): 194-205.
[3] 谢海波, 王志文, 李恒. 早期膝骨关节炎影像学检查与深度学习融合应用[J/OL]. 中华关节外科杂志(电子版), 2026, 20(01): 97-103.
[4] 陈泽涛, 邱龙诗语, 龚卓弘, 刘恒毅, 曾培生, 施梦汝. 口腔种植定量测量人工智能化的难点解析与解决策略[J/OL]. 中华口腔医学研究杂志(电子版), 2026, 20(01): 1-8.
[5] 李婷, 郭超, 李晨曦, 李柔演, 张一涵, 张雨晗, 陈琰, 斯琴高娃, 龚忠诚. 基于深度学习的上颌阻生尖牙自动分割与体积量化研究[J/OL]. 中华口腔医学研究杂志(电子版), 2026, 20(01): 9-16.
[6] 孟笑菲, 龚卓弘, 万耀文, 李沛达, 胡琪琪, 邱龙诗语, 刘恒毅, 谢伟丽. 深度学习与多模态大语言模型在笑线分类任务中的应用初探[J/OL]. 中华口腔医学研究杂志(电子版), 2026, 20(01): 17-24.
[7] 吕思怡, 王琰琪, 仇珺, 陈宇江, 高洁. 人工智能图像处理技术在口腔医学中的应用[J/OL]. 中华口腔医学研究杂志(电子版), 2026, 20(01): 40-46.
[8] 黄楚曦, 吴卓. 人工智能在膀胱癌影像中的应用进展[J/OL]. 中华腔镜泌尿外科杂志(电子版), 2026, 20(03): 241-247.
[9] 宋再桪, 胡锦中, 殷秋萍, 陈艺凌, 党天安, 牟泽中, 徐晨阳, 姜昊文. 凝血酶原时间与膀胱癌患者接受内镜下冷冻消融治疗后复发的相关性分析[J/OL]. 中华腔镜泌尿外科杂志(电子版), 2026, 20(02): 147-153.
[10] 贺慷, 杨诚, 李建雄, 夏明, 陈明坤, 刘存东, 夏慧. 膀胱低级别平滑肌肉瘤一例报告并文献复习[J/OL]. 中华腔镜泌尿外科杂志(电子版), 2026, 20(02): 221-225.
[11] 梅昊楠, 杨瑞, 刘修恒. 人工智能辅助病理学图像分析在前列腺癌诊断中的研究进展[J/OL]. 中华腔镜泌尿外科杂志(电子版), 2026, 20(01): 1-7.
[12] 张忠, 王喆, 黄其日麦拉图, 齐岩松. 人工智能在肘关节骨关节炎诊疗中的应用进展[J/OL]. 中华肩肘外科电子杂志, 2026, 14(02): 109-114.
[13] 陈小坤, 杜顺达. 影像组学在肝细胞癌中的应用进展及挑战[J/OL]. 中华消化病与影像杂志(电子版), 2026, 16(02): 97-100.
[14] 赵云云, 杜晨, 李惠凯, 庞吉超, 徐鸿昊, 宗琦, 陈倩倩, 令狐恩强. 基于深度学习、影像组学特征及联合特征的超声内镜模型对胃间质瘤与平滑肌瘤的鉴别价值[J/OL]. 中华胃肠内镜电子杂志, 2026, 13(02): 101-107.
[15] 徐林, 简讯, 刘道权, 易东, 鄢华. 人工智能在心脑血管内介入诊疗中的应用进展——从单一影像模式到多模态影像融合[J/OL]. 中华脑血管病杂志(电子版), 2026, 20(03): 334-341.
阅读次数
全文


摘要


AI


AI小编
你好!我是《中华医学电子期刊资源库》AI小编,有什么可以帮您的吗?