Researchers’ deep dictionary network-based foundation model for ultra-low-dose CT denoising; outperforms across multi-organ benchmarks.
A deep dictionary network-based foundation model for ultra-low-dose CT denoising
1 A deep dictionary network-based foundation model for ultra-low-dose CT denoising Baoshun Shi, Shuangyi Yang, Ke Jiang, Bin Zhu, Zhanli Hu, and Huazhu Fu Abstract— Ultra-low-dose computed tomography (ULDCT) reduces radiation exposure but suffers from severe noise that degrades diagnostic image quality. Existing deep learning-based denoising methods are typically trained in an organ-specific fashion, resulting in limited generalization across heterogeneous multi- organ imaging scenarios. Foundation models present a promising all-in-one paradigm for unified multi-organ denoising. However, their architectures suffer from poor interpretability and rely on heuristic training strategies. To address these limitations, we propose an architecture- interpretable foundation model based on the deep dictionary network (DDN) for unified multi-organ ULDCT denoising. Inspired by multilayer sparse representation theory, DDN cascades convolutional sparse coding layers with iterative soft-thresholding, providing inherent architectural interpretability. Furthermore, a dynamic dictionary module and a threshold generation module are embedded within each layer to enhance representation ability. We conduct DDN pre-training on more than one million multi-organ normal-dose CT images by recovering clean images from Gaussian-noised inputs. Sparse regularization is additionally imposed on latent feature representations, guiding the network to learn compact and noise-robust priors. The complete architecture is jointly fine-tuned on multi-organ ULDCT datasets, enabling a single unified model to perform denoising across diverse anatomical regions. Extensive experiments validate that our proposed method achieves state-of-the- art performance and consistently surpasses competing ULDCT methods across all multi-organ benchmarks under the few-shot learning setting. This work was supported by the National Natural Science Foundation of China under Grant No. 62371414, by the Hebei Natural Science Foundation under Grant No. F2025203070, by the Beijing Natural Sci- ence Foundation–Haidian Original Innovation Joint Fund, Key Research Program under Grant L242067, by the General Open Fund Project of State Key Laboratory of Medical Imaging Science and Technology Systems, and by the Scientific Research Cultivation Project (Science and Engineering)-Basic Innovation Research Cultivation Project (Sci- ence and Engineering, Post-2021) under Grant No. 2025LGZD002. (Corresponding author: Baoshun Shi, e-mail: shibaoshun@ysu.edu.cn.) Baoshun Shi, Shuangyi Yang, and Ke Jiang are with the School of Information Science and Engineering, Yanshan University, Qinhuangdao 066004, Hebei, China, and also with the Hebei Key Laboratory of Information Transmission and Signal Processing, Yanshan University, Qinhuangdao 066004, Hebei, China. Bin Zhu is with the Department of Orthopedics, Beijing Friendship Hospital, Capital Medical University, Beijing, China. Zhanli Hu is with the Lauterbur Research Center for Biomedical Imag- ing, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China. Huazhu Fu is with the Institute of Advanced Intelligence and Com- puting (IAIC), Agency for Science, Technology and Research (A*STAR), Singapore 138632. Index Terms— Ultra-low-dose CT, foundation model, deep dictionary network, model interpretability. I. INTRODUCTION C OMPUTED tomography (CT) is an indispensable imag- ing modality for clinical diagnosis and disease screening. However, the associated X-ray exposure may increase the risk of cancer and other adverse health effects [1]. Ultra-low-dose CT (ULDCT) can reduce radiation exposure by lowering the tube current or incident photon flux [2], but the reduced photon count introduces severe quantum noise into the projection data. After the filtered back-projection (FBP) operator, the reconstructed images often contain strong noise and streak- like artifacts that obscure fine anatomical structures and reduce diagnostic reliability. Effective ULDCT denoising methods should be developed to suppress severe noise while retaining clinically relevant details. In recent years, deep learning-based methods have achieved promising performance in ULDCT image denoising by learn- ing the mapping from noisy images to normal-dose CT images [3]–[5]. Despite their effectiveness, most existing methods are still trained in an organ-specific manner, where a separate model is built for each anatomical region. Such a paradigm has two main limitations: storing multiple organ-specific models increases storage and deployment costs of deep neural net- works (DNNs), while each model learns only from its own anatomical data, making it difficult to fully exploit general CT image priors shared across organs. As a result, the gen- eralization capability of existing denoising methods remains limited in heterogeneous multi-organ ULDCT scenarios. Foundation models improve the generalization of DNNs through large-scale pre-training and downstream adaptation [6]. Representative visual foundation models include self- distillation approaches [7] and masked image modeling meth- ods [8]. From the perspective of network architecture, most existing methods adopt ViT- or Transformer-based backbones [7], [8] and recent methods focus on state space model (SSM), which can effectively model long-range dependencies with linear computational complexity [9]. From the perspective of application, these advances have also extended founda- tion models to medical applications, including computational pathology and scalable medical image encoding. However, most network architectures of existing foundation models remain difficult to interpret and primarily target generic visual representation learning or medical image understanding, rather arXiv:2609.16031v1 [eess.IV] 11 Sep 2026
2 10 datasets 1,126,182 CT images TotalSegmentator 312400 CQ500 156882 MSD Hepatic Vessel 31668 MSD Lung Tumours 26545 MSD Spleen 5277 MSD Colon Cancer 20102 KiTS19 153884 VerSe 140405 LIDC-IDRI 238756 MSD Pancreas Tumour 40263 DDN-based Foundation Model Pre-training 32 34 36 38 40 42 0.62 0.66 0.70 0.74 0.78 0.82 0.86 0.90 0.94 0.98 33 35 37 39 41 Multi-organ Generalization DDN + Decoder … Lung Head Colon Spleen Hepatic Vessel PSNR (dB) SSIM Few-shot Learning ULDCT Denoising EDCNN (ICSP, 2020) CNN10 (MATH, 2018) CAPTNet (TCSVT, 2024) PromptIR (NeurIPS, 2023) MoCE-IR (CVPR, 2025) DDN (Ours) TAMP-S (NC, 2026) REDCNN (TMI, 2017) FoundDiff (TMI, 2026) (a) (b) X-ray source Low photon flux Fig. 1. Overview of the proposed DDN-based pre-training framework and few-shot denoising performance. (a) DDN is pretrained on more than one million multi-organ CT images from ten datasets and then combined with a decoder for multi-organ ULDCT denoising, cross-organ generalization, and few-shot learning. (b) Average PSNR and SSIM comparison of different methods on test datasets under the few-shot setting, where only 20 training images are used for each organ. DDN achieves the highest PSNR and SSIM among the compared methods, indicating better denoising performance under limited training data. than unified multi-organ ULDCT denoising, which requires effective noise suppression while preserving fine anatomical details. Deep unfolding networks improve model interpretability by unrolling iterative optimization algorithms into trainable layers [10], [11]. However, existing unfolding networks are mostly designed for specific inverse problems, such as CT and magnetic resonance imaging reconstructions [12], [13]. Their task-dependent formulations limit their suitability for building generalizable foundation models. In contrast, sparse representation-based unfolding offers a more flexible image- domain prior that can describe common structural patterns shared across CT images. However, convolutional sparse coding (CSC) unfolding networks are usually derived from single-layer sparse representation, limiting their capacity to characterize the complex multi-organ anatomical structures required for unified ULDCT denoising [10], [14]. To address these limitations, we propose an architecture- interpretable foundation model based on what we call the deep dictionary network (DDN). By extending single-layer sparse representation unfolding into a multilayer deep dictio- nary architecture, DDN combines the generalization ability of foundation models with the structural interpretability of sparse representation unfolding. A denoising objective and sparse regularization are further used during pre-training to learn compact and noise-robust CT priors from large-scale multi- organ data. The contributions are summarized as follows: • We propose an architecture-interpretable foundation model based on DDN for unified multi-organ ULDCT denois- ing. In contrast to existing foundation models with limited architectural interpretability, DDN is derived from multilayer sparse representation theory and unfolds convolutional sparse coding into cascaded dictionary layers with iterative soft- thresholding, providing a transparent and principled backbone for CT denoising. • We design a dynamic dictionary module (DDM) and a threshold generation module (TGM) to enhance DDN’s repre- sentation while preserving sparse-coding interpretability. The DDM generates input-dependent dictionary atoms from image features to replace fixed kernels, while the TGM fuses features from local, large, non-local, and global sub-modules to predict spatially adaptive thresholds. This allows soft-thresholding to better handle heterogeneous anatomical structures and spa- tially varying noise. We also verify the effectiveness of these sub-modules within TGM through ablation studies. • We develop a denoising-oriented pre-training strategy with sparse representation regularization for the DDN-based foundation model. DDN is pretrained on more than one mil- lion multi-organ normal-dose CT images by recovering clean images from Gaussian-noised inputs, while an ℓ1 constraint is imposed on latent sparse representation. This strategy pro- motes compact, noise-robust, and transferable CT denoising priors, providing effective initialization for downstream multi- organ ULDCT denoising. • As depicted in Fig. 1, the proposed framework inte- grates large-scale multi-organ pre-training with downstream ULDCT denoising. Extensive experiments on synthetic multi- organ ULDCT datasets and real experimental CT data show that DDN consistently outperforms existing methods across anatomical regions, demonstrating strong cross-organ gener- alizability. Furthermore, under the few-shot setting with only 20 training images per organ, DDN achieves the best average PSNR and SSIM values among the compared methods, con- firming the effectiveness of the pretrained DDN priors under limited training data. The remainder of this paper is organized as follows. Section II reviews the existing ULDCT denoising methods. Section III presents the architecture of the proposed deep dictionary network. Section IV describes the proposed foundation model training strategy. Section V reports experimental results and
3 performance analysis, and Section VI concludes the paper. II. EXISTING ULTRA-LOW-DOSE CT DENOISING METHODS Ultra-low-dose CT (ULDCT) denoising aims to reduce severe noise and artifacts while preserving fine anatomical structures. Traditional methods commonly formulate CT de- noising as a regularization problem with handcrafted regulariz- ers. Although these methods can improve image quality, they often require careful parameter tuning and suffer from high computational cost, which limits their practical efficiency. With the development of deep learning, learning-based methods have become dominant solutions for ULDCT denoising. According to the domain in which the net- work is applied, existing methods can be roughly divided into sinogram-domain, image-domain, and dual-domain ap