skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Merge-Swap Optimization Framework for Supervoxel Generation from Three-Dimensional Point Clouds
Surpervoxels are becoming increasingly popular in many point cloud processing applications. However, few methods have been devised specifically for generating compact supervoxels from unstructured three-dimensional (3D) point clouds. In this study, we aimed to generate high quality over-segmentation of point clouds. We propose a merge-swap optimization framework that solves any supervoxel generation problem formulated in energy minimization. In particular, we tailored an energy function that explicitly encourages regular and compact supervoxels with adaptive size control considering local geometric information of point clouds. We also provide two acceleration techniques to reduce the computational overhead. The performance of the proposed merge-swap optimization approach is superior to that of previous work in terms of thorough optimization, computational efficiency, and practical applicability to incorporating control of other properties of supervoxels. The experiments show that our approach produces supervoxels with better segmentation quality than two state-of-the-art methods on three public datasets.  more » « less
Award ID(s):
1804929
PAR ID:
10147830
Author(s) / Creator(s):
; ; ; ; ; ;
Date Published:
Journal Name:
Remote Sensing
Volume:
12
Issue:
3
ISSN:
2072-4292
Page Range / eLocation ID:
473
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; (, ACM Transactions on Graphics)
    We present SHRED, a method for 3D SHape REgion Decomposition. SHRED takes a 3D point cloud as input and uses learned local operations to produce a segmentation that approximates fine-grained part instances. We endow SHRED with three decomposition operations: splitting regions, fixing the boundaries between regions, and merging regions together. Modules are trained independently and locally, allowing SHRED to generate high-quality segmentations for categories not seen during training. We train and evaluate SHRED with fine-grained segmentations from PartNet; using its merge-threshold hyperparameter, we show that SHRED produces segmentations that better respect ground-truth annotations compared with baseline methods, at any desired decomposition granularity. Finally, we demonstrate that SHRED is useful for downstream applications, out-performing all baselines on zero-shot fine-grained part instance segmentation and few-shot finegrained semantic segmentation when combined with methods that learn to label shape regions. 
    more » « less
  2. ; ; ; ; ; ; (, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition)
    null (Ed.)
    We present MultiBodySync, a novel, end-to-end trainable multi-body motion segmentation and rigid registration framework for multiple input 3D point clouds. The two non-trivial challenges posed by this multi-scan multibody setting that we investigate are: (i) guaranteeing correspondence and segmentation consistency across multiple input point clouds capturing different spatial arrangements of bodies or body parts; and (ii) obtaining robust motion-based rigid body segmentation applicable to novel object categories. We propose an approach to address these issues that incorporates spectral synchronization into an iterative deep declarative network, so as to simultaneously recover consistent correspondences as well as motion segmentation. At the same time, by explicitly disentangling the correspondence and motion segmentation estimation modules, we achieve strong generalizability across different object categories. Our extensive evaluations demonstrate that our method is effective on various datasets ranging from rigid parts in articulated objects to individually moving objects in a 3D scene, be it single-view or full point clouds. 
    more » « less
  3. ; ; ; ; ; (, Advances in Computational Science and Engineering)
    Cardiovascular disease (CVD) remains one of the leading causes of mortality worldwide. Computational medicine and digital twins hold promise in mitigating the impact and prevalence of CVD. Recent advances in image-based computational methods have enabled the quantification of functional and biologically important metrics that would otherwise be difficult to obtain from the standard of care. However, significant challenges remain due to the manual/semi-automated nature of the processes and the domain expertise required to perform them. This paper addresses these challenges by proposing a novel framework that builds on our recently developed direct point cloud-to-CFD approach using immersogeometric analysis. The proposed method leverages advanced auto-segmentation techniques to extract medically relevant geometries as point clouds, which are then directly used for CFD simulations. The framework is validated using benchmark flow problems with analytical and computational solutions and is subsequently applied to patient-specific images to demonstrate its capabilities. The results highlight the method's ability to facilitate rapid CFD simulations directly on point clouds derived from patient scans, underscoring its potential to accelerate the image-to-simulation pipeline and enable the tractability of cardiovascular digital twins. 
    more » « less
  4. ; ; (, Computer aided geometric design)
    This paper introduces a new unified particle-based formulation for resamplings with specific patterns from original point clouds. Given the input point clouds, the proposed Lp-Gaussian kernel function is defined to simulate the inter-particle energy and force to form the isotropic/adaptive/anisotropic hexagonal and quadrilateral sampling patterns. Then, the particle-based optimization can be easily formulated and computed in parallel scheme with the high-efficiency and the fast convergence, without any control of particle population. Finally, based on the optimized particle distribution, the high-quality surface meshes are reconstructed by computing the restricted Voronoi diagram and its dual mesh with the parallel implementation. The experimental results are demonstrated by using extensive examples and evaluation criteria as well as compared with the state-of-the-art in the point cloud resampling and reconstruction. 
    more » « less
  5. ; ; (, IEEE Conference on Computer Vision and Pattern Recognition (CVPR))
    Analyzing the geometric and semantic properties of 3D point clouds through the deep networks is still challenging due to the irregularity and sparsity of samplings of their geometric structures. This paper presents a new method to define and compute convolution directly on 3D point clouds by the proposed annular convolution. This new convolution operator can better capture the local neighborhood geometry of each point by specifying the (regular and dilated) ring-shaped structures and directions in the computation. It can adapt to the geometric variability and scalability at the signal processing level. We apply it to the developed hierarchical neural networks for object classification, part segmentation, and semantic segmentation in large-scale scenes. The extensive experiments and comparisons demonstrate that our approach outperforms the state-of-the-art methods on a variety of standard benchmark datasets (e.g., ModelNet10, ModelNet40, ShapeNetpart, S3DIS, and ScanNet). 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email