Skip to main navigation Skip to search Skip to main content

Progressive Coding for Deep Learning based Point Cloud Attribute Compression

  • Michael Rudolph
  • , Aron Riemenschneider
  • , Amr Rizk

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Abstract

Progressive coding is a valuable technique for networked immersive media. As users approach objects in an immersive environment, progressive coding enables a gradual improvement of content quality. This effectively reduces bandwidth consumption compared to non-progressive methods that require to fully exchange a content representation by an independent, new representation. In this work, we introduce an approach to progressively code point cloud attributes in a learned manner by compressing quantization residuals of each preceding representation through a learned, lightweight transformation in the entropy bottleneck. This allows to progressively reduce quantization errors using a single model in an end-to-end learning manner given the quantization residuals. In contrast to the state of the art that conditions the compression on a fixed rate-distortion, i.e. it requires an ensemble of models to build an adaptive streaming system, our approach requires only a single model during compression and decompression. We present preliminary results of our method, showing bandwidth savings for the scenario of a user approaching an object and gradually transitioning from low to high quality representations.

Original languageEnglish
Title of host publicationMMVE 2024 - Proceedings of the 2024 16th International Workshop on Immersive Mixed and Virtual Environment Systems
Pages78 - 84
Number of pages7
ISBN (Electronic)9798400706189
DOIs
Publication statusPublished - 15 Apr 2024

Keywords

  • 6DOF
  • Adaptive Streaming
  • Point Cloud
  • Virtual Reality

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

Cite this