GAMMA · Zero-Shot Shape Matching

Geometry-Grounded Articulation and Test-Time Adaptation for Zero-Shot, Scalable Shape Matching in the Wild

Qilong Liu1,*, Qinfeng Xiao1,*, Chenyuan Yi1, Yongsheng Lin1, Liying Zhang1, Kit-lun Yick1,2,†

1Hong Kong Polytechnic University, HK SAR
2Artificial Intelligence in Design, HK SAR

*Equal contribution. Corresponding author.

GAMMA transfers textures across raw FAUST resolutions, grounds a shared template in each scan, and reuses it for dense correspondence.
Zero-shot dense correspondence from 5k vertices to original 160k–200k-vertex FAUST scans. Articulation is performed once per shape and reused across pair queries; the primary matcher requires no input LBO eigenbasis.

Abstract

Dense correspondence on in-the-wild 3D scans must handle severe non-isometric deformation, partial observations, topology artifacts, irregular discretization, and extreme resolution. Together, these conditions make shape matching both a robustness and scalability problem. Existing methods typically handle only part of this regime and often require expensive spectral or dense feature processing, repeated pairwise optimization, or dataset-specific training. To address the above issues, we present GAMMA, a zero-shot framework based on Geometry-Grounded Articulation. For each scan, GAMMA renders multiple views and uses a pretrained estimator with a category-specific parametric model to produce one template estimate per view. Because these estimates share a fixed vertex ordering, confidence-weighted consensus fuses them into one canonical template and establishes sparse matches across scans. We refine these matches on the input geometry to recover accurate dense correspondences. All core matching steps run at inference time and require neither target-dataset correspondence training nor costly Laplace–Beltrami operator (LBO) computation on the input scans. Each fused template is cached, so additional pair queries reuse the canonicalization. GAMMA obtains average geodesic errors of 2.9 on TOPKIDS and 2.4 on remeshed SMAL, reducing error relative to URSSM by 67% and 60%, respectively. Complementary evaluations report lower aggregate errors than the evaluated baselines on BeCoS-processed partial subsets and demonstrate stable matching accuracy from decimated FAUST meshes to raw scans with 160k–200k vertices. These results demonstrate accurate correspondence across complementary settings and collection-level scalability after per-shape caching.

Highlights

Geometry-grounded, zero-shot

Frozen category-specific estimators provide articulation priors. Test-time optimization fits each scan without target-benchmark correspondence training.

Robust correspondence

Confidence-weighted template consensus and sparse soft composition handle non-isometric deformation, partial observations, and irregular scans.

Reusable per-shape processing

Cached articulations serve additional pair queries. The primary matcher needs no input Laplace–Beltrami eigenbasis; spectral refinement is optional.

Method Overview

GAMMA pipeline: multi-view prediction, geometry grounding, confidence-weighted fusion, and sparse map composition.
GAMMA uses SAM 3D Body for humans and PRIMA for four-legged animals. Multi-view predictions are aligned and refined against scan geometry, then fused in shared template indexing. Sparse evidence-weighted assignments compose into dense correspondences.

Qualitative Results

Texture transfers on TOPKIDS, SMAL, FAUST, and SCAPE.
Selected texture transfers on TOPKIDS, SMAL, FAUST, and SCAPE, showing coherent GAMMA transfers and representative baseline failures.
Texture transfers on FAUST at 5k, 20k, 40k, and raw resolution.
Texture transfer on original FAUST scans at 5k, 20k, 40k, and the original 160k–200k vertices.
Selected texture transfers on ray-cropped partial scans.
Selected texture-transfer examples on ray-cropped partial scans.

Benchmark Comparisons

Lower error is better. Bold and underlined entries mark the best and second-best results, including ties. Curated and partial benchmarks report target-domain mean geodesic error ×100; raw scans use a separate template-domain metric and are comparable only within that table.

Non-Isometric Shape Matching

SMAL contains animal shapes; TOPKIDS contains human shapes with strong non-isometric variation. “No Corr. Tr.” means no target-benchmark correspondence training. Baselines follow UniMatch’s common protocol, except Synchronous Diffusion.

MethodUnsup.No Corr. Tr.Zero-ShotSMALTOPKIDS
Axiomatic Methods
ZoomOut38.433.7
Smooth Shells36.111.8
DiscreteOp38.135.5
Functional Map Methods
UnsupFMNet-38.5
SURFMNet-48.6
AttentiveFMaps5.423.4
URSSM6.08.9
Synchronous Diff.3.65.4
Semantic Methods
Diff3F28.431.0
DenseMatcher4.76.2
Template-based Methods
GAMMA (ours)2.42.9
GAMMA (+Spec.-ICP)3.72.3
GAMMA (+ZoomOut)6.03.3

Near-Isometric Shape Matching

Remeshed human benchmarks. The main GAMMA row uses no input LBO eigenbasis; +Spec.-ICP and +ZoomOut are optional spectral refinements. Baselines follow UniMatch’s common protocol, except Synchronous Diffusion.

MethodFAUSTSCAPESHREC19
Axiomatic Methods
BCICP6.411.08.0
ZoomOut6.17.57.8
Smooth Shells2.54.77.6
Functional Map Methods
UnsupFMNet4.89.611.1
SURFMNet2.56.04.8
URSSM1.61.95.7
Synchronous Diff.1.51.83.4
Semantic Methods
Diff3F20.722.126.3
DenseMatcher1.62.03.1
UniMatch1.61.93.2
Template-based Methods
3D-CODED2.59.87.7
GAMMA (ours)1.51.83.0
GAMMA (+Spec.-ICP)1.31.73.1
GAMMA (+ZoomOut)1.51.93.2

High-Resolution Raw Scans

Template-domain mean geodesic error ×100 over the same 400 directed pair queries from 20 test scans at every resolution. Raw scans have 160k–200k vertices. ZoomOut uses chunked nearest search; URSSM’s OOM denotes an out-of-memory failure of the evaluated implementation.

Method5k10k20k40k80k120kRaw
ZoomOut (ch.)20.9220.5420.2420.5720.3120.2119.89
URSSM (xyz)14.3013.7011.60OOMOOMOOMOOM
URSSM (wks)10.3020.8015.90OOMOOMOOMOOM
GAMMA (ours)2.422.252.182.162.162.132.11

Partial Shape Matching

BeCoS-processed FAUST and KIDS subsets. P-F: partial-to-full; P-P: partial-to-partial. URSSM is trained for 30 epochs on each corresponding training split. These results report correspondence error; the fraction of queries receiving a match is not reported.

MethodFAUST P-FFAUST P-PKIDS P-FKIDS P-P
ZoomOut42.268.730.040.1
URSSM(xyz)22.420.640.241.4
URSSM(wks)31.927.342.747.6
GAMMA (ours)2.73.36.75.4

Scalability Through Caching

Across the raw-FAUST resolution sweep, articulation takes about 64.9–69.1 seconds per shape. Cached map composition takes 0.024–3.33 seconds per directed pair.

At raw resolution, processing 20 shapes and all 400 directed queries takes approximately 45.3 minutes, compared with 666 minutes for chunked ZoomOut. A single uncached pair takes about 141.5 seconds for GAMMA versus 99.9 seconds for chunked ZoomOut: the measured advantage comes from reusing articulations across a collection.

Runtime by vertex count, separating articulation per shape from GAMMA composition and chunked ZoomOut per directed pair.
Articulation is measured per shape; composition and chunked ZoomOut are measured per directed pair. These timings have different amortization units.

Citation

@article{liu2026gamma,
  title = {Geometry-Grounded Articulation and Test-Time Adaptation for Zero-Shot, Scalable Shape Matching in the Wild},
  author = {Qilong Liu and Qinfeng Xiao and Chenyuan Yi and Yongsheng Lin and Liying Zhang and Kit-lun Yick},
  journal = {arXiv preprint arXiv:2606.29167},
  year = {2026}
}