---
title: "Researchers' deep dictionary network-based foundation model for ultra-low-dose CT denoising; outperforms across multi-organ benchmarks."
sdDatePublished: "2026-09-16T04:09:00Z"
source: "https://arxiv.org/pdf/2609.16031"
topics:
  - name: "health"
    identifier: "medtop:07000000"
  - name: "science and technology"
    identifier: "medtop:13000000"
locations:
  - "Beiyuan"
  - "Shenzhen"
  - "Hebei"
  - "Qinhuangdao"
  - "Singapore"
  - "China"
---


Researchers' deep dictionary network-based foundation model for ultra-low-dose CT denoising; outperforms across multi-organ benchmarks.

A deep dictionary network-based foundation model for ultra-low-dose CT denoising

1
A deep dictionary network-based foundation
model for ultra-low-dose CT denoising
Baoshun Shi, Shuangyi Yang, Ke Jiang, Bin Zhu, Zhanli Hu, and Huazhu Fu
Abstract— Ultra-low-dose
computed
tomography
(ULDCT) reduces radiation exposure but suffers from
severe noise that degrades diagnostic image quality.
Existing
deep
learning-based
denoising
methods
are
typically trained in an organ-specific fashion, resulting
in
limited
generalization
across
heterogeneous
multi-
organ imaging scenarios. Foundation models present
a promising all-in-one paradigm for unified multi-organ
denoising. However, their architectures suffer from poor
interpretability and rely on heuristic training strategies.
To address these limitations, we propose an architecture-
interpretable
foundation
model
based
on
the
deep
dictionary network (DDN) for unified multi-organ ULDCT
denoising. Inspired by multilayer sparse representation
theory,
DDN
cascades
convolutional
sparse
coding
layers with iterative soft-thresholding, providing inherent
architectural
interpretability.
Furthermore,
a
dynamic
dictionary module and a threshold generation module are
embedded within each layer to enhance representation
ability. We conduct DDN pre-training on more than one
million multi-organ normal-dose CT images by recovering
clean
images
from
Gaussian-noised
inputs.
Sparse
regularization is additionally imposed on latent feature
representations, guiding the network to learn compact
and
noise-robust
priors.
The
complete
architecture
is
jointly
fine-tuned
on
multi-organ
ULDCT
datasets,
enabling a single unified model to perform denoising
across diverse anatomical regions. Extensive experiments
validate that our proposed method achieves state-of-the-
art performance and consistently surpasses competing
ULDCT methods across all multi-organ benchmarks under
the few-shot learning setting.
This work was supported by the National Natural Science Foundation
of China under Grant No. 62371414, by the Hebei Natural Science
Foundation under Grant No. F2025203070, by the Beijing Natural Sci-
ence Foundation–Haidian Original Innovation Joint Fund, Key Research
Program under Grant L242067, by the General Open Fund Project
of State Key Laboratory of Medical Imaging Science and Technology
Systems, and by the Scientific Research Cultivation Project (Science
and Engineering)-Basic Innovation Research Cultivation Project (Sci-
ence and Engineering, Post-2021) under Grant No. 2025LGZD002.
(Corresponding author: Baoshun Shi, e-mail: shibaoshun@ysu.edu.cn.)
Baoshun Shi, Shuangyi Yang, and Ke Jiang are with the School of
Information Science and Engineering, Yanshan University, Qinhuangdao
066004, Hebei, China, and also with the Hebei Key Laboratory of
Information Transmission and Signal Processing, Yanshan University,
Qinhuangdao 066004, Hebei, China.
Bin Zhu is with the Department of Orthopedics, Beijing Friendship
Hospital, Capital Medical University, Beijing, China.
Zhanli Hu is with the Lauterbur Research Center for Biomedical Imag-
ing, Shenzhen Institute of Advanced Technology, Chinese Academy of
Sciences, Shenzhen 518055, China.
Huazhu Fu is with the Institute of Advanced Intelligence and Com-
puting (IAIC), Agency for Science, Technology and Research (A*STAR),
Singapore 138632.
Index
Terms— Ultra-low-dose
CT,
foundation
model,
deep dictionary network, model interpretability.
I. INTRODUCTION
C
OMPUTED tomography (CT) is an indispensable imag-
ing modality for clinical diagnosis and disease screening.
However, the associated X-ray exposure may increase the risk
of cancer and other adverse health effects [1]. Ultra-low-dose
CT (ULDCT) can reduce radiation exposure by lowering the
tube current or incident photon flux [2], but the reduced photon
count introduces severe quantum noise into the projection
data. After the filtered back-projection (FBP) operator, the
reconstructed images often contain strong noise and streak-
like artifacts that obscure fine anatomical structures and reduce
diagnostic reliability. Effective ULDCT denoising methods
should be developed to suppress severe noise while retaining
clinically relevant details.
In recent years, deep learning-based methods have achieved
promising performance in ULDCT image denoising by learn-
ing the mapping from noisy images to normal-dose CT images
[3]–[5]. Despite their effectiveness, most existing methods are
still trained in an organ-specific manner, where a separate
model is built for each anatomical region. Such a paradigm has
two main limitations: storing multiple organ-specific models
increases storage and deployment costs of deep neural net-
works (DNNs), while each model learns only from its own
anatomical data, making it difficult to fully exploit general
CT image priors shared across organs. As a result, the gen-
eralization capability of existing denoising methods remains
limited in heterogeneous multi-organ ULDCT scenarios.
Foundation models improve the generalization of DNNs
through large-scale pre-training and downstream adaptation
[6]. Representative visual foundation models include self-
distillation approaches [7] and masked image modeling meth-
ods [8]. From the perspective of network architecture, most
existing methods adopt ViT- or Transformer-based backbones
[7], [8] and recent methods focus on state space model (SSM),
which can effectively model long-range dependencies with
linear computational complexity [9]. From the perspective
of application, these advances have also extended founda-
tion models to medical applications, including computational
pathology and scalable medical image encoding. However,
most network architectures of existing foundation models
remain difficult to interpret and primarily target generic visual
representation learning or medical image understanding, rather
arXiv:2609.16031v1 [eess.IV] 11 Sep 2026

2
10 datasets
1,126,182
CT images
TotalSegmentator
312400
CQ500
156882
MSD Hepatic Vessel
31668
MSD Lung Tumours
26545
MSD Spleen
5277
MSD Colon Cancer
20102
KiTS19
153884
VerSe
140405
LIDC-IDRI
238756
MSD Pancreas Tumour
40263
DDN-based
Foundation Model
Pre-training
32
34
36
38
40
42
0.62
0.66
0.70
0.74
0.78
0.82
0.86
0.90
0.94
0.98
33
35
37
39
41
Multi-organ
Generalization
DDN +
Decoder
...
Lung
Head
Colon
Spleen
Hepatic
Vessel
PSNR (dB)
SSIM
Few-shot
Learning
ULDCT
Denoising
EDCNN (ICSP, 2020)
CNN10 (MATH, 2018)
CAPTNet (TCSVT, 2024)
PromptIR (NeurIPS, 2023)
MoCE-IR (CVPR, 2025)
DDN (Ours)
TAMP-S (NC, 2026)
REDCNN (TMI, 2017)
FoundDiff (TMI, 2026)
(a)
(b)
X-ray source
Low photon flux
Fig. 1. Overview of the proposed DDN-based pre-training framework and few-shot denoising performance. (a) DDN is pretrained on more than one
million multi-organ CT images from ten datasets and then combined with a decoder for multi-organ ULDCT denoising, cross-organ generalization,
and few-shot learning. (b) Average PSNR and SSIM comparison of different methods on test datasets under the few-shot setting, where only 20
training images are used for each organ. DDN achieves the highest PSNR and SSIM among the compared methods, indicating better denoising
performance under limited training data.
than unified multi-organ ULDCT denoising, which requires
effective noise suppression while preserving fine anatomical
details.
Deep unfolding networks improve model interpretability
by unrolling iterative optimization algorithms into trainable
layers [10], [11]. However, existing unfolding networks are
mostly designed for specific inverse problems, such as CT
and magnetic resonance imaging reconstructions [12], [13].
Their task-dependent formulations limit their suitability for
building generalizable foundation models. In contrast, sparse
representation-based unfolding offers a more flexible image-
domain prior that can describe common structural patterns
shared across CT images. However, convolutional sparse
coding (CSC) unfolding networks are usually derived from
single-layer sparse representation, limiting their capacity to
characterize the complex multi-organ anatomical structures
required for unified ULDCT denoising [10], [14].
To address these limitations, we propose an architecture-
interpretable foundation model based on what we call the
deep dictionary network (DDN). By extending single-layer
sparse representation unfolding into a multilayer deep dictio-
nary architecture, DDN combines the generalization ability of
foundation models with the structural interpretability of sparse
representation unfolding. A denoising objective and sparse
regularization are further used during pre-training to learn
compact and noise-robust CT priors from large-scale multi-
organ data. The contributions are summarized as follows:
• We propose an architecture-interpretable foundation
model based on DDN for unified multi-organ ULDCT denois-
ing. In contrast to existing foundation models with limited
architectural interpretability, DDN is derived from multilayer
sparse representation theory and unfolds convolutional sparse
coding into cascaded dictionary layers with iterative soft-
thresholding, providing a transparent and principled backbone
for CT denoising.
• We design a dynamic dictionary module (DDM) and a
threshold generation module (TGM) to enhance DDN’s repre-
sentation while preserving sparse-coding interpretability. The
DDM generates input-dependent dictionary atoms from image
features to replace fixed kernels, while the TGM fuses features
from local, large, non-local, and global sub-modules to predict
spatially adaptive thresholds. This allows soft-thresholding to
better handle heterogeneous anatomical structures and spa-
tially varying noise. We also verify the effectiveness of these
sub-modules within TGM through ablation studies.
• We develop a denoising-oriented pre-training strategy
with sparse representation regularization for the DDN-based
foundation model. DDN is pretrained on more than one mil-
lion multi-organ normal-dose CT images by recovering clean
images from Gaussian-noised inputs, while an ℓ1 constraint
is imposed on latent sparse representation. This strategy pro-
motes compact, noise-robust, and transferable CT denoising
priors, providing effective initialization for downstream multi-
organ ULDCT denoising.
• As depicted in Fig. 1, the proposed framework inte-
grates large-scale multi-organ pre-training with downstream
ULDCT denoising. Extensive experiments on synthetic multi-
organ ULDCT datasets and real experimental CT data show
that DDN consistently outperforms existing methods across
anatomical regions, demonstrating strong cross-organ gener-
alizability. Furthermore, under the few-shot setting with only
20 training images per organ, DDN achieves the best average
PSNR and SSIM values among the compared methods, con-
firming the effectiveness of the pretrained DDN priors under
limited training data.
The remainder of this paper is organized as follows. Section
II reviews the existing ULDCT denoising methods. Section
III presents the architecture of the proposed deep dictionary
network. Section IV describes the proposed foundation model
training strategy. Section V reports experimental results and

3
performance analysis, and Section VI concludes the paper.
II. EXISTING ULTRA-LOW-DOSE CT DENOISING
METHODS
Ultra-low-dose CT (ULDCT) denoising aims to reduce
severe noise and artifacts while preserving fine anatomical
structures. Traditional methods commonly formulate CT de-
noising as a regularization problem with handcrafted regulariz-
ers. Although these methods can improve image quality, they
often require careful parameter tuning and suffer from high
computational cost, which limits their practical efficiency.
With the development of deep learning, learning-based
methods
have
become
dominant
solutions
for
ULDCT
denoising. According to the domain in which the net-
work is applied, existing methods can be roughly divided
into sinogram-domain, image-domain, and dual-domain ap