GenIcoNet: Generative Icosahedral Mesh Convolutional Network


Hardik Jain and Olaf Hellwich


In the past few decades, the computer vision domain has achieved outstanding success in learning 3D shapes for classification, segmentation and image-based reconstruction. However, deep networks are less explored for the generative task of obtaining new 3D shapes from the learned representation. This problem becomes more prominent for 3D shapes represented as surface meshes, mainly because the mesh structure lacks regularity, an essential property for training deep generative networks. In this work, we remedy this problem by proposing a generative icosahedral mesh convolutional network (GenIcoNet) that learns data distribution of surface meshes. Our end-to-end trainable network learns semantic representations using 2D convolutional filters on the regularized icosahedral meshes. During inference, GenIcoNet can be used to generate new geometrically valid shapes directly as surface meshes. Our experiments for interpolation of latent space demonstrate that GenIcoNet is able to outperform networks trained on intermediate surface mesh representations. The variational autoencoder architecture of GenIcoNet learns meaningful representation which is numerically stable w.r.t. small perturbations, allows performing exploration and combination of surface meshes to generate new meaningful shapes, while maintaining the essential property of mesh manifoldness.

PDF (protected)

  Important Dates

All deadlines are 23:59 Pacific Time (PT). No extensions will be granted.

Paper registration July 23 30, 2021
Paper submission July 30, 2021
Supplementary August 8, 2021
Tutorial submission August 15, 2021
Tutorial notification August 31, 2021
Rebuttal period September 16-22, 2021
Paper notification October 1, 2021
Camera ready October 15, 2021
Demo submission July 30 Nov 15, 2021
Demo notification Oct 1 Nov 19, 2021
Tutorial November 30, 2021
Main conference December 1-3, 2021