---
title: "Weiying Chen et al. present UBone3D for anatomical 3D bone completion from ultrasound Edmonton, Canada; significant improvements in reconstruction accuracy and fidelity"
sdDatePublished: "2026-09-11T05:09:00Z"
source: "https://arxiv.org/pdf/2609.11506"
topics:
  - name: "health"
    identifier: "medtop:07000000"
  - name: "science and technology"
    identifier: "medtop:13000000"
locations:
  - "Edmonton"
  - "British Columbia"
  - "Shanghai"
  - "Canada"
  - "China"
---


Weiying Chen et al. present UBone3D for anatomical 3D bone completion from ultrasound Edmonton, Canada; significant improvements in reconstruction accuracy and fidelity

UBone3D: Physics-Rectified Conditional Flow Matching for Anatomical 3D Shape Completion from Ultrasound

UBone3D: Physics-Rectified Conditional Flow
Matching for Anatomical 3D Shape Completion
from Ultrasound
Weiying Chen1 , Yuchong Gao2 , Siyuan Li1 , Marek Reformat1 , Rui
Zheng2 , and Edmond Lou1
1 University of Alberta, Edmonton, AB, Canada
{weiying3,elou}@ualberta.ca
2 ShanghaiTech University, Shanghai, China
Abstract. Three-dimensional ultrasound (US) is a safe, radiation-free
complementary modality to CT and X-rays for longitudinal monitoring,
yet its segmentation-derived partial point clouds are extremely artifact-
laden. Consequently, it is challenging to recover a clean and complete
anatomical structure from such US point clouds. In this paper, we present
UBone3D, a novel framework based on physics-rectified conditional flow
matching (CFM) that performs point cloud completion directly from par-
tial US observations. UBone3D models deterministic physics artifacts
(e.g., surface thickening, streaking, dropouts) via a simulated physics
proxy, and introduces test-time physics rectification to steer the shape
completion. At inference, the completion is jointly steered by two decou-
pled forces: (1) anatomical plausibility enforced by a CT-trained gen-
erative shape prior, BoneFM, and (2) physics consistency enforced by
USimNet in the ultrasound formation space. Extensive experiments
on simulated and in-vivo data demonstrate significant improvements in
reconstruction accuracy and anatomical fidelity over existing baselines.
Project page: https://answerrtx.github.io/UBone3D-Proj/.
Keywords: 3D Shape Completion · Physics-Guided Generation · Con-
ditional Flow Matching · Ultrasound Bone Reconstruction
1
Introduction
Reconstructing accurate three-dimensional (3D) bone geometry directly from
ultrasound scans remains a fundamental unsolved challenge in medical imaging.
A robust solution would enable the next generation of radiation-free, real-time
3D applications, from intraoperative navigation to affordable long-term monitor-
ing of skeletal deformities. This is especially important for adolescent idiopathic
scoliosis (AIS), where patients often need repeated CT or X-rays over years,
resulting in high cumulative radiation exposure. In current clinical practice, 3D
spine models are typically generated by aggregating tracked 2D B-mode ultra-
sound frames according to their spatial poses and volumetrically interpolating
the data using Voxel Nearest Neighbor (VNN) [7] for downstream assessment.
arXiv:2609.11506v1 [cs.CV] 10 Sep 2026

2
W. Chen et al.
Anatomically Consistent Geometry
Ultrasound (US) Scan of the Spine
            : Mesh of the High Fidelity
CT Scan from Spine1K
B-Mode
Images
Pose
3D Aggregation
Active US
Observation Area
Artifact-Laden & Partial US Point Cloud
UBone3D: Conditional Flow Matching
with Physics Rectification
Hallucination
Fig. 1: Physics-rectified shape completion bridges the gap between ultra-
sound (US) observations and complete anatomy. (Left) Segmentation-derived
in-vivo US point clouds suffer from severe acoustic artifacts and only partially cover
the underlying bone anatomy. (Middle) UBone3D leverages conditional flow match-
ing (CFM) with a differentiable physics proxy to steer the generative trajectory, con-
straining completion within the physical bounds of ultrasound formation. (Right) The
reconstructed anatomical completion (PAC) achieves global structural integrity while
maintaining high local fidelity to the observed ultrasound signals (red regions).
VNN voxel stacking is a lossy discretization that blurs thin cortical surfaces
and propagates physics-induced dropouts and reverberation into large empty or
spurious regions, further obscuring the true bone geometry.
Ideally, the complete skeletal structure could be recovered from cleanly seg-
mented partial structures; however, achieving perfect segmentation is often im-
practical in real clinical settings. In this paper, we choose the point-cloud repre-
sentation to directly model and recover the underlying geometry from imperfect
segmentation-derived ultrasound input. Recovering an anatomically clean
and complete 3D structure from such input is inherently challenging: beyond
the missing topology common to any partial observation, the artifact-laden ul-
trasound point cloud extracted from upstream segmentation exhibits a large
gap relative to the desired anatomically complete geometry, as shown in Fig. 1.
Importantly, this gap is not merely one of random noise, but one of determin-
istic physics: finite beamwidth, reverberation, and signal dropout caused by the
probe’s limited aperture (FOV) together distort the observed signals, leading to
incomplete and highly nonuniform point clouds.
Recent 3D reconstruction techniques for ultrasound imaging [9, 16, 37, 38]
focused on recovering a clean bone surface of the superficial bone boundaries,
assuming access to clean geometric or intensity data, neglecting that in-vivo
ultrasound scans do not meet this standard. On the other hand, general 3D
completion models were trained on idealized, clean geometric data [36, 42, 45,
48]. The foundational knowledge, or priors, used by these generative methods

UBone3D
3
often comes from datasets like ShapeNet [6] or natural images, giving them no
understanding of the acoustic physics inherent to ultrasound.
In this paper, we introduce UBone3D, a novel physics-rectified conditional
flow matching framework that casts the recovery of complete anatomical ge-
ometry from partial ultrasound as an observation-guided denoising and shape
completion problem. The key insight is to decouple two complementary objec-
tives, anatomical plausibility and physical consistency, which are respectively
handled by BoneFM and USimNet and synergized during test-time inference.
Our main contributions include:
– UBone3D enables the recovery of anatomically consistent complete 3D struc-
tures from artifact-laden, partial ultrasound observations by synergizing the
generative anatomy prior (BoneFM) with test-time physical rectification,
without relying on clean or perfectly segmented inputs.
– We introduce USimNet, a differentiable physics proxy that models acoustic
artifacts (e.g., bone shadowing and streaks), supporting an explicit, gradient-
based rectification mechanism that aligns the evolving generative trajectory
with physical observation constraints during inference.
– Our approach demonstrates strong generalization to unseen viewing angles
on simulated data, and remains robust on zero-shot in-vivo data, where pure
geometric baselines fail.
2
Literature Review
2.1
3D Point Cloud Completion and Generation
Early 3D point cloud completion methods largely followed encoder–decoder de-
signs. Representative works such as PCN [43] and GRNet [40] employed coarse-
to-fine generation to progressively recover missing geometry. Transformer-based
models later advanced this field by encoding partial inputs into point proxy se-
quences and leveraging geometry-aware attention to capture long-range depen-
dencies for complete shape decoding [42]. Subsequent methods further refined
this paradigm through hierarchical point-wise deconvolution [39], view-structure
disentanglement [48], or specialized guidance mechanisms like seed expansion [47]
and proxy-based alignment [23]. On the other hand, generative approaches (e.g.,
ContextualCompletion [10], PCDreamer [36]) formulated completion as condi-
tional sampling from prior distributions. Recent works also extended completion
to cross-modal settings [13,14,27,29,35], which took auxiliary inputs to provide
explicit guidance and alleviate the ill-posed nature of shape recovery. Notably,
SuperPC [13] unified completion from partial observations with other restoration
tasks, including upsampling, denoising, and colorization.
In clinical ultrasound scenarios, however, acquiring perfectly aligned data is
highly impractical due to tissue deformation, probe pressure, and respiratory mo-
tion during scanning. Driven by similar practical constraints, some works have
explored unpaired point cloud completion, e.g., USSPA [28] and UOT-UPC [21].
However, in ultrasound-to-anatomical comprehensive bone completion, the key

4
W. Chen et al.
challenge lies in the deterministic, physics-driven ultrasound artifacts that sys-
tematically distort the observations.
2.2
Physics-Guided Generation and Neural Surrogates
Recent physics-guided frameworks have used learnable models with real-world
physics simulations to enhance the generation quality. For example, PIDM [4]
imposed governing laws as the training-time regularizer to ensure that predic-
tions remain physically self-consistent. In contrast, PhysDiff [44] incorporated
a human motion simulator at inference time as guidance, progressively refining
generated samples to enforce physical consistency. Such physics-guided strategies
have been extended to different domains, including geometrical design [17,18,46],
and animation [41]. In our practice, the physics prior, USimNet, serves as a
lightweight learned surrogate that captures physics effects while maintaining the
gradient flow necessary for test-time rectification.
2.3
Medical Shape Reconstruction for Bone
Traditionally, Statistical Shape Models (SSMs) [3, 11, 32, 34] were used to per-
form 3D reconstruction by learning a parametric shape representation. More
recently, the 3D medical shape reconstruction has shifted toward using Implicit
Neural Representations (INRs), e.g., Signed Distance Functions (SDFs) and oc-
cupancy fields for the surface reconstruction [2,8,9,38]. Although these works ex-
celled at capturing complex topologies, they typically rely on clean and relatively
complete observations. In the context of ultrasound bone imaging, volumetric
representations were often reconstructed via Voxel Nearest Neighbor (VNN) [7]
interpolation according to spatial poses in clinical practice. Alternatively, point-
cloud-based approaches have been proposed to register ultrasound with CT for
intraoperative navigation in spine surgery [22]. While these methods do not
provide global anatomy, Gafencu et al. [15,16] explored leveraging ultrasound-
physics-aware ray-casting to generate synthetic partial vertebrae point clouds
for vertebral shape completion. Although accounting for basic ultrasound arti-
facts, their method was based on a variational autoencoder (VAE) [19], which
inherently maps uncurated, complex real-world artifacts directly into the latent
space. This may lead to shape collapse on in-vivo data, whose distribution differs
from that of the simulated data. In contrast, our work formulates US 3D com-
pletion as a conditional generative task. By leveraging a large-scale CT dataset
(Spine1K [12]) to form the anatomy prior, UBone3D recovers globally consistent
geometry while accounting for physics-induced artifacts.
3
Methodology
3.1
Preliminary: Optimal Transport Flow Matching
In this work, we build our generative prior BoneFM based on Optimal Trans-
port Flow Matching (OT-FM) [24,25], which provides a gradient path to trans-
port a simple base distribution to a complex data distribution.

UBone3D
5
Let x ∈R3N denote the vectorized representation of a point cloud P =
{pi}N
i=1 ⊂R3, and t ∈[0, 1] be the continuous time variable. We define the
distributions as:
  x _0 \s i m p_ 0(x
) = \math
cal { N}(0, \mathbf {I}), \qquad x_1 \sim p_1(x), \quad \text {where } p_1(x) \approx p_{\text {AC}}(x),
(1)
where p0(x) is a standard Gaussian noise distribution and pAC(x) represents the
target distribution of clean and anatomically consistent bone geometries.
To obtain a highly efficient transport path, OT-FM constructs a path under
the OT coupling that connects x0 and x1 via linear interpolation [1]:
  x( t ) = t x _1 + (1 - t) x_0. \label {eq:ot_path}
(2)
Taking the time derivative of Eq. 2 yields the optimal transport velocity:
  u(x(t ), t) = x_1-x_0 \label {eq:ot_velocity}
(3)
Such straight-trajectory formulatio