More Like this

1. Point Cloud Attribute Compression Via Chroma Subsampling

   https://doi.org/10.1109/ICASSP43922.2022.9746352  

   Sridhara, Shashank N.; Pavez, Eduardo; Ortega, Antonio; Watanabe, Ryosuke; Nonaka, Keisuke (May 2022, 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP))

   We introduce chroma subsampling for 3D point cloud attribute compression by proposing a novel technique to sample points irregularly placed in 3D space. While most current video compression standards use chroma subsampling, these chroma subsampling methods cannot be directly applied to 3D point clouds, given their irregularity and sparsity. In this work, we develop a framework to incorporate chroma subsampling into geometry-based point cloud encoders, such as region adaptive hierarchical transform (RAHT) and region adaptive graph Fourier transform (RAGFT). We propose different sampling patterns on a regular 3D grid to sample the points at different rates. We use a simple graph-based nearest neighbor interpolation technique to reconstruct the full resolution point cloud at the decoder end. Experimental results demonstrate that our proposed method provides significant coding gains with negligible impact on the reconstruction quality. For some sequences, we observe a bitrate reduction of 10-15% under the Bjontegaard metric. More generally, perceptual masking makes it possible to achieve larger bitrate reductions without visible changes in quality. 

   more » « less
2. Motion Estimation And Filtered Prediction For Dynamic Point Cloud Attribute Compression

   https://doi.org/10.1109/PCS56426.2022.10018071  

   Hong, Haoran; Pavez, Eduardo; Ortega, Antonio; Watanabe, Ryosuke; Nonaka, Keisuke (December 2022, Proc. of Picture Coding Symposium, PCS 2022)

   In point cloud compression, exploiting temporal redundancy for inter predictive coding is challenging because of the irregular geometry. This paper proposes an efficient block-based inter-coding scheme for color attribute compression. The scheme includes integer-precision motion estimation and an adaptive graph based in-loop filtering scheme for improved attribute prediction. The proposed block-based motion estimation scheme consists of an initial motion search that exploits geometric and color attributes, followed by a motion refinement that only minimizes color prediction error. To further improve color prediction, we propose a vertex-domain low-pass graph filtering scheme that can adaptively remove noise from predictors computed from motion estimation with different accuracy. Our experiments demonstrate significant coding gain over state-of-the-art coding methods. 

   more » « less
3. Multi-level 3D CNN for Learning Multi-scale Spatial Features

   Ghadai, Sambit; Yeow Lee, Xian; Balu, Aditya; Sarkar, Soumik; Krishnamurthy, Adarsh (January 2019, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops)

   3D object recognition accuracy can be improved by learning the multi-scale spatial features from 3D spatial geometric representations of objects such as point clouds, 3D models, surfaces, and RGB-D data. Current deep learning approaches learn such features either using structured data representations (voxel grids and octrees) or from unstructured representations (graphs and point clouds). Learning features from such structured representations is limited by the restriction on resolution and tree depth while unstructured representations creates a challenge due to non-uniformity among data samples. In this paper, we propose an end-to-end multi-level learning approach on a multi-level voxel grid to overcome these drawbacks. To demonstrate the utility of the proposed multi-level learning, we use a multi-level voxel representation of 3D objects to perform object recognition. The multi-level voxel representation consists of a coarse voxel grid that contains volumetric information of the 3D object. In addition, each voxel in the coarse grid that contains a portion of the object boundary is subdivided into multiple fine-level voxel grids. The performance of our multi-level learning algorithm for object recognition is comparable to dense voxel representations while using significantly lower memory. 

   more » « less
4. Cylindrical Coordinates for Lidar Point Cloud Compression

   https://doi.org/10.1109/ICIP42928.2021.9506448  

   Sridhara, Shashank N.; Pavez, Eduardo; Ortega, Antonio (September 2021, 2021 IEEE International Conference on Image Processing (ICIP))

   We present an efficient voxelization method to encode the geometry and attributes of 3D point clouds obtained from autonomous vehicles. Due to the circular scanning trajectory of sensors, the geometry of LiDAR point clouds is inherently different from that of point clouds captured from RGBD cameras. Our method exploits these specific properties to representing points in cylindrical coordinates instead of conventional Cartesian coordinates. We demonstrate that Region Adaptive Hierarchical Transform (RAHT) can be extended to this setting, leading to attribute encoding based on a volumetric partition in cylindrical coordinates. Experimental results show that our proposed voxelization outperforms conventional approaches based on Cartesian coordinates for this type of data. We observe a significant improvement in attribute coding performance with 5-10% reduction in bitrate and octree representation with 35-45% reduction in bits. 

   more » « less
5. Nonparametric regression for 3D point cloud learning

   Li, Xinyi; Yu, Shan; Wang, Yueying; Wang, Guannan; Wang, Li; Lai, Ming-Jun (January 2024, Journal of machine learning research)

   Shen, Xiaotong (Ed.)

   In recent years, there has been an exponentially increased amount of point clouds collected with irregular shapes in various areas. Motivated by the importance of solid modeling for point clouds, we develop a novel and efficient smoothing tool based on multivariate splines over the triangulation to extract the underlying signal and build up a 3D solid model from the point cloud. The proposed method can denoise or deblur the point cloud effectively, provide a multi-resolution reconstruction of the actual signal, and handle sparse and irregularly distributed point clouds to recover the underlying trajectory. In addition, our method provides a natural way of numerosity data reduction. We establish the theoretical guarantees of the proposed method, including the convergence rate and asymptotic normality of the estimator, and show that the convergence rate achieves optimal nonparametric convergence. We also introduce a bootstrap method to quantify the uncertainty of the estimators. Through extensive simulation studies and a real data example, we demonstrate the superiority of the proposed method over traditional smoothing methods in terms of estimation accuracy and efficiency of data reduction. 

   more » « less