Identification and Localization of Breast Tumor Components via a Convolutional Neural Network Based on High-Frequency Ultrasound Combined With Histopathologic Registration: Prospective Study

doi:10.2196/81181

CSpace

	Identification and Localization of Breast Tumor Components via a Convolutional Neural Network Based on High-Frequency Ultrasound Combined With Histopathologic Registration: Prospective Study
	Yao, Jia-Qian 1; Zhou, Wen-Wen 1,2; Chai, Zhi-Fei 3; Ren, Fei 3; Huang, Tong-Yi 1; Zhen, Tian-Tian 4; Shi, Hui-Juan 4; Xie, Xiao-Yan 1; Zhao, Ze 3; Xu, Ming 1
	2026
发表期刊	JMIR MEDICAL INFORMATICS
卷号	14 页码:12
摘要	Background: Given the highly heterogeneous biology of breast cancer, a more effective noninvasive diagnostic tool that unravels microscopic histopathology patterns is urgently needed. Objective: This study aims to identify cancerous regions in ultrasound images of breast cancer via convolutional neural network based on registered grayscale ultrasound images and readily accessible biopsy whole slide images (WSIs). Methods: This single-center study prospectively included participants undergoing ultrasound-guided core needle biopsy procedures for Breast Imaging Reporting and Data System category 4 or 5 breast lesions for whom breast cancer was pathologically confirmed from July 2022 to February 2023 consecutively. The basic information, ultrasound image data, biopsy tissue specimens, and corresponding WSIs were collected. After core needle biopsy procedures, the stained breast tissue specimens were sliced and coregistered with an ultrasound image of a needle tract. Convolutional neural network models for identifying breast cancer cells in ultrasound images were developed using FCN-101 and DeepLabV3 networks. The image-level predictive performance was evaluated and compared quantitatively by pixel accuracy, Dice similarity coefficient, and recall. Pixel-level classification was illustrated through confusion matrices. The cancerous region in the testing dataset was further visualized in ultrasound images. Potential clinical applications were qualitatively assessed by comparing the automatic segmentation results and the actual pathological tissue distributions. Results: A total of 105 participants with 386 ultrasound images of breast cancer were included, with 270 (70%), 78 (20.2%), and 38 (9.8%) images in the training, validation, and test datasets, respectively. Both models performed well in predicting the cancerous regions in the biopsy area, whereas the FCN-101 model was superior to the DeepLabV3 model in terms of pixel accuracy (86.91% vs 69.55%; P=.002) and Dice similarity coefficient (77.47% vs 69.90%; P<.001). The two models yielded recall values of 54.64% and 58.46%, with no significant difference between them (P=.80). Furthermore, the FCN-101 model had an advantage in predicting cancerous regions, while the DeepLabV3 model achieved more accurate predictive pixels in normal tissue (both P<.05). Visualization of cancerous regions on grayscale ultrasound images demonstrated high consistency with those identified on WSIs. Conclusions: The technique for spatial registration of breast WSIs and ultrasound images of a needle tract was established. Breast cancer regions were accurately identified and localized on a pixel level in high-frequency ultrasound images via an advanced convolutional neural network with histopathologic WSI as the reference standard.
关键词	breast neoplasms biopsy ultrasonography registration
DOI	10.2196/81181
收录类别	SCI
语种	英语
WOS研究方向	Medical Informatics
WOS类目	Medical Informatics
WOS记录号	WOS:001682076500002
出版者	JMIR PUBLICATIONS, INC
引用统计
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/42802
专题	中国科学院计算技术研究所
通讯作者	Xu, Ming
作者单位	1.Sun Yat Sen Univ, Affiliated Hosp 1, Dept Med Ultrason, 58 Zhongshan 2nd Rd, Guangzhou 510080, Peoples R China 2.Nanjing Med Univ, Dept Med Ultrason, Suzhou Municipal Hosp, Suzhou, Peoples R China 3.Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China 4.Sun Yat Sen Univ, Affiliated Hosp 1, Dept Pathol, Guangzhou, Peoples R China
推荐引用方式 GB/T 7714	Yao, Jia-Qian,Zhou, Wen-Wen,Chai, Zhi-Fei,et al. Identification and Localization of Breast Tumor Components via a Convolutional Neural Network Based on High-Frequency Ultrasound Combined With Histopathologic Registration: Prospective Study[J]. JMIR MEDICAL INFORMATICS,2026,14:12.
APA	Yao, Jia-Qian.,Zhou, Wen-Wen.,Chai, Zhi-Fei.,Ren, Fei.,Huang, Tong-Yi.,...&Xu, Ming.(2026).Identification and Localization of Breast Tumor Components via a Convolutional Neural Network Based on High-Frequency Ultrasound Combined With Histopathologic Registration: Prospective Study.JMIR MEDICAL INFORMATICS,14,12.
MLA	Yao, Jia-Qian,et al."Identification and Localization of Breast Tumor Components via a Convolutional Neural Network Based on High-Frequency Ultrasound Combined With Histopathologic Registration: Prospective Study".JMIR MEDICAL INFORMATICS 14(2026):12.