Dynamic Neural Surfaces for Elastic 4D Shape Representation and Analysis

Abstract

We propose a novel framework for the statistical analysis of genus-zero 4D surfaces, i.e, 3D surfaces that deform and evolve overtime. This problem is particularly challenging due to the arbitrary parameterizations of these surfaces and their varying deformation speeds, necessitating effective spatiotemporal registration. Traditionally, 4D surfaces are discretized, in space and time, before computing their spatiotemporal registrations, geodesics and statistics. However, this approach may result in suboptimal solutions and, as we demonstrate in this paper, is not necessary. In contrast, we treat 4D surfaces as continuous functions in both space and time. We introduce Dynamic Spherical Neural Surfaces (D-SNS), an efficient smooth and continuous spatiotemporal representation for genus-0 4D surfaces. We then demonstrate how to perform core 4D shape analysis tasks such as spatiotemporal registration, geodesics computation, and mean 4D shape estimation, directly on these continuous representations without upfront discretization and meshing. By integrating neural representations with classical Riemannian geometry and statistical shape analysis techniques, we provide the building blocks for enabling full functional shape analysis. We demonstrate the efficiency of the framework on 4D human and face datasets.

Dynamic Spherical Neural Surfaces

D-SNS Quality

Examples of Figure. 6 of the main manuscript and Figure. 12 of the Supplementary Material. The video shows the pointwise error between the proposed D-SNS and the ground truth discrete 4D surfaces. Here, we show the videos with the error plotted as a heatmap.

Interpolation results

Video of Figure. 13 of the Supplementary Material and Table. 2 of the main manuscript. The video shows the interpolation quality of D-SNS. We train D-SNS on a subset of 30 temporal samples and visualize the time intervals as a heatmap. We compare the D-SNS 4D surface as a heatmap and the ground truth 4D surfaces in orange.

MY ALT TEXT

Illustration of Dynamic Spherical Neural Surface.

4D Human

4D Faces

4D Geodesics

Co-registration and mean

Approach

BibTeX

TBA