PMS-GAN: Parallel Multi-Stream Generative Adversarial Network for Multi-Material Decomposition in Spectral Computed Tomography

• Published in: IEEE transactions on medical imaging Vol. 40; no. 2; pp. 571 - 584
• Main Authors: Geng, Mufeng, Tian, Zifeng, Jiang, Zhe, You, Yunfei, Feng, Ximeng, Xia, Yan, Yang, Kun, Ren, Qiushi, Meng, Xiangxi, Maier, Andreas, Lu, Yanye
• Format: Journal Article
• Language: English
• Published: United States IEEE 01-02-2021; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Biopsy; Bone marrow; Bones; Computed tomography; Contrast agents; Decomposition; Deep learning; Differential map; Generative adversarial networks; Generators; image disentanglement; Nonlinear systems; Roads; Similarity; Spectra; spectral X-ray imaging; Tomography; Torso; X-ray CT; X-ray imaging
• ISSN: 0278-0062; 1558-254X
• DOI: 10.1109/TMI.2020.3031617

Spectral computed tomography is able to provide quantitative information on the scanned object and enables material decomposition. Traditional projection-based material decomposition methods suffer from the nonlinearity of the imaging system, which limits the decomposition accuracy. Inspired by the generative adversarial network, we proposed a novel parallel multi-stream generative adversarial network (PMS-GAN) to perform projection-based multi-material decomposition in spectral computed tomography. By designing the differential map and incorporating the adversarial network into loss function, the decomposition accuracy was significantly improved with robust performance. The proposed network was quantitatively evaluated by both simulation and experimental study. The results show that PMS-GAN outperformed the reference methods with certain robustness. Compared with Pix2pix-GAN, PMS-GAN increased the structural similarity index by 172% on the contrast agent Ultravist370, 11% on bones, and 71% on bone marrow, respectively, in a simulated test scenario. In an experimental test scenario, 9% and 38% improvements of the structural similarity index on the biopsy needle and on a torso phantom were observed, respectively. The proposed network demonstrates its capability of multi-material decomposition and has certain potential toward clinical applications.