Weiying Chen et al. present UBone3D for anatomical 3D bone completion from ultrasound Edmonton, Canada; significant improvements in reconstruction accuracy and fidelity

Weiying Chen et al. present UBone3D for anatomical 3D bone completion from ultrasound Edmonton, Canada; significant improvements in reconstruction accuracy and fidelity

UBone3D: Physics-Rectified Conditional Flow Matching for Anatomical 3D Shape Completion from Ultrasound

UBone3D: Physics-Rectified Conditional Flow Matching for Anatomical 3D Shape Completion from Ultrasound Weiying Chen1 , Yuchong Gao2 , Siyuan Li1 , Marek Reformat1 , Rui Zheng2 , and Edmond Lou1 1 University of Alberta, Edmonton, AB, Canada {weiying3,elou}@ualberta.ca 2 ShanghaiTech University, Shanghai, China Abstract. Three-dimensional ultrasound (US) is a safe, radiation-free complementary modality to CT and X-rays for longitudinal monitoring, yet its segmentation-derived partial point clouds are extremely artifact- laden. Consequently, it is challenging to recover a clean and complete anatomical structure from such US point clouds. In this paper, we present UBone3D, a novel framework based on physics-rectified conditional flow matching (CFM) that performs point cloud completion directly from par- tial US observations. UBone3D models deterministic physics artifacts (e.g., surface thickening, streaking, dropouts) via a simulated physics proxy, and introduces test-time physics rectification to steer the shape completion. At inference, the completion is jointly steered by two decou- pled forces: (1) anatomical plausibility enforced by a CT-trained gen- erative shape prior, BoneFM, and (2) physics consistency enforced by USimNet in the ultrasound formation space. Extensive experiments on simulated and in-vivo data demonstrate significant improvements in reconstruction accuracy and anatomical fidelity over existing baselines. Project page: https://answerrtx.github.io/UBone3D-Proj/. Keywords: 3D Shape Completion · Physics-Guided Generation · Con- ditional Flow Matching · Ultrasound Bone Reconstruction 1 Introduction Reconstructing accurate three-dimensional (3D) bone geometry directly from ultrasound scans remains a fundamental unsolved challenge in medical imaging. A robust solution would enable the next generation of radiation-free, real-time 3D applications, from intraoperative navigation to affordable long-term monitor- ing of skeletal deformities. This is especially important for adolescent idiopathic scoliosis (AIS), where patients often need repeated CT or X-rays over years, resulting in high cumulative radiation exposure. In current clinical practice, 3D spine models are typically generated by aggregating tracked 2D B-mode ultra- sound frames according to their spatial poses and volumetrically interpolating the data using Voxel Nearest Neighbor (VNN) [7] for downstream assessment. arXiv:2609.11506v1 [cs.CV] 10 Sep 2026

2 W. Chen et al. Anatomically Consistent Geometry Ultrasound (US) Scan of the Spine : Mesh of the High Fidelity CT Scan from Spine1K B-Mode Images Pose 3D Aggregation Active US Observation Area Artifact-Laden & Partial US Point Cloud UBone3D: Conditional Flow Matching with Physics Rectification Hallucination Fig. 1: Physics-rectified shape completion bridges the gap between ultra- sound (US) observations and complete anatomy. (Left) Segmentation-derived in-vivo US point clouds suffer from severe acoustic artifacts and only partially cover the underlying bone anatomy. (Middle) UBone3D leverages conditional flow match- ing (CFM) with a differentiable physics proxy to steer the generative trajectory, con- straining completion within the physical bounds of ultrasound formation. (Right) The reconstructed anatomical completion (PAC) achieves global structural integrity while maintaining high local fidelity to the observed ultrasound signals (red regions). VNN voxel stacking is a lossy discretization that blurs thin cortical surfaces and propagates physics-induced dropouts and reverberation into large empty or spurious regions, further obscuring the true bone geometry. Ideally, the complete skeletal structure could be recovered from cleanly seg- mented partial structures; however, achieving perfect segmentation is often im- practical in real clinical settings. In this paper, we choose the point-cloud repre- sentation to directly model and recover the underlying geometry from imperfect segmentation-derived ultrasound input. Recovering an anatomically clean and complete 3D structure from such input is inherently challenging: beyond the missing topology common to any partial observation, the artifact-laden ul- trasound point cloud extracted from upstream segmentation exhibits a large gap relative to the desired anatomically complete geometry, as shown in Fig. 1. Importantly, this gap is not merely one of random noise, but one of determin- istic physics: finite beamwidth, reverberation, and signal dropout caused by the probe’s limited aperture (FOV) together distort the observed signals, leading to incomplete and highly nonuniform point clouds. Recent 3D reconstruction techniques for ultrasound imaging [9, 16, 37, 38] focused on recovering a clean bone surface of the superficial bone boundaries, assuming access to clean geometric or intensity data, neglecting that in-vivo ultrasound scans do not meet this standard. On the other hand, general 3D completion models were trained on idealized, clean geometric data [36, 42, 45, 48]. The foundational knowledge, or priors, used by these generative methods

UBone3D 3 often comes from datasets like ShapeNet [6] or natural images, giving them no understanding of the acoustic physics inherent to ultrasound. In this paper, we introduce UBone3D, a novel physics-rectified conditional flow matching framework that casts the recovery of complete anatomical ge- ometry from partial ultrasound as an observation-guided denoising and shape completion problem. The key insight is to decouple two complementary objec- tives, anatomical plausibility and physical consistency, which are respectively handled by BoneFM and USimNet and synergized during test-time inference. Our main contributions include: – UBone3D enables the recovery of anatomically consistent complete 3D struc- tures from artifact-laden, partial ultrasound observations by synergizing the generative anatomy prior (BoneFM) with test-time physical rectification, without relying on clean or perfectly segmented inputs. – We introduce USimNet, a differentiable physics proxy that models acoustic artifacts (e.g., bone shadowing and streaks), supporting an explicit, gradient- based rectification mechanism that aligns the evolving generative trajectory with physical observation constraints during inference. – Our approach demonstrates strong generalization to unseen viewing angles on simulated data, and remains robust on zero-shot in-vivo data, where pure geometric baselines fail. 2 Literature Review 2.1 3D Point Cloud Completion and Generation Early 3D point cloud completion methods largely followed encoder–decoder de- signs. Representative works such as PCN [43] and GRNet [40] employed coarse- to-fine generation to progressively recover missing geometry. Transformer-based models later advanced this field by encoding partial inputs into point proxy se- quences and leveraging geometry-aware attention to capture long-range depen- dencies for complete shape decoding [42]. Subsequent methods further refined this paradigm through hierarchical point-wise deconvolution [39], view-structure disentanglement [48], or specialized guidance mechanisms like seed expansion [47] and proxy-based alignment [23]. On the other hand, generative approaches (e.g., ContextualCompletion [10], PCDreamer [36]) formulated completion as condi- tional sampling from prior distributions. Recent works also extended completion to cross-modal settings [13,14,27,29,35], which took auxiliary inputs to provide explicit guidance and alleviate the ill-posed nature of shape recovery. Notably, SuperPC [13] unified completion from partial observations with other restoration tasks, including upsampling, denoising, and colorization. In clinical ultrasound scenarios, however, acquiring perfectly aligned data is highly impractical due to tissue deformation, probe pressure, and respiratory mo- tion during scanning. Driven by similar practical constraints, some works have explored unpaired point cloud completion, e.g., USSPA [28] and UOT-UPC [21]. However, in ultrasound-to-anatomical comprehensive bone completion, the key

4 W. Chen et al. challenge lies in the deterministic, physics-driven ultrasound artifacts that sys- tematically distort the observations. 2.2 Physics-Guided Generation and Neural Surrogates Recent physics-guided frameworks have used learnable models with real-world physics simulations to enhance the generation quality. For example, PIDM [4] imposed governing laws as the training-time regularizer to ensure that predic- tions remain physically self-consistent. In contrast, PhysDiff [44] incorporated a human motion simulator at inference time as guidance, progressively refining generated samples to enforce physical consistency. Such physics-guided strategies have been extended to different domains, including geometrical design [17,18,46], and animation [41]. In our practice, the physics prior, USimNet, serves as a lightweight learned surrogate that captures physics effects while maintaining the gradient flow necessary for test-time rectification. 2.3 Medical Shape Reconstruction for Bone Traditionally, Statistical Shape Models (SSMs) [3, 11, 32, 34] were used to per- form 3D reconstruction by learning a parametric shape representation. More recently, the 3D medical shape reconstruction has shifted toward using Implicit Neural Representations (INRs), e.g., Signed Distance Functions (SDFs) and oc- cupancy fields for the surface reconstruction [2,8,9,38]. Although these works ex- celled at capturing complex topologies, they typically rely on clean and relatively complete observations. In the context of ultrasound bone imaging, volumetric representations were often reconstructed via Voxel Nearest Neighbor (VNN) [7] interpolation according to spatial poses in clinical practice. Alternatively, point- cloud-based approaches have been proposed to register ultrasound with CT for intraoperative navigation in spine surgery [22]. While these methods do not provide global anatomy, Gafencu et al. [15,16] explored leveraging ultrasound- physics-aware ray-casting to generate synthetic partial vertebrae point clouds for vertebral shape completion. Although accounting for basic ultrasound arti- facts, their method was based on a variational autoencoder (VAE) [19], which inherently maps uncurated, complex real-world artifacts directly into the latent space. This may lead to shape collapse on in-vivo data, whose distribution differs from that of the simulated data. In contrast, our work formulates US 3D com- pletion as a conditional generative task. By leveraging a large-scale CT dataset (Spine1K [12]) to form the anatomy prior, UBone3D recovers globally consistent geometry while accounting for physics-induced artifacts. 3 Methodology 3.1 Preliminary: Optimal Transport Flow Matching In this work, we build our generative prior BoneFM based on Optimal Trans- port Flow Matching (OT-FM) [24,25], which provides a gradient path to trans- port a simple base distribution to a complex data distribution.

UBone3D 5 Let x ∈R3N denote the vectorized representation of a point cloud P = {pi}N i=1 ⊂R3, and t ∈[0, 1] be the continuous time variable. We define the distributions as: x 0 \s i m p 0(x ) = \math cal { N}(0, \mathbf {I}), \qquad x_1 \sim p_1(x), \quad \text {where } p_1(x) \approx p_{\text {AC}}(x), (1) where p0(x) is a standard Gaussian noise distribution and pAC(x) represents the target distribution of clean and anatomically consistent bone geometries. To obtain a highly efficient transport path, OT-FM constructs a path under the OT coupling that connects x0 and x1 via linear interpolation [1]: x( t ) = t x _1 + (1 - t) x_0. \label {eq:ot_path} (2) Taking the time derivative of Eq. 2 yields the optimal transport velocity: u(x(t ), t) = x_1-x_0 \label {eq:ot_velocity} (3) Such straight-trajectory formulatio