Università della Svizzera italiana Faculty of Informatics

Publications


A continuous, editable representation for deforming mesh
sequences with separate signals for time, pose and shape

Tom Cashman and Kai Hormann

Abstract

It is increasingly popular to represent non-rigid motion using a deforming mesh sequence: a discrete sequence of frames, each of which is given as a mesh with a common graph structure. Such sequences have the flexibility to represent a wide range of mesh deformations used in practice, but they are also highly redundant, expensive to store, and difficult to edit in a time-coherent manner. We address these limitations with a continuous representation that extracts redundancy in three separate phases, leading to separate editable signals in time, pose and shape. The representation can be applied to any deforming mesh sequence, in contrast to previous domain-specific approaches. By modifying the three signal components, we demonstrate time-coherent editing operations such as local repetition of part of a sequence, frame rate conversion and deformation transfer. We also show that our representation makes it possible to design new deforming sequences simply by sketching a curve in a 2D pose space.

Video

Implementation and sample data

For questions and/or feedback on this implementation, please do not hesitate to contact me.

Binaries for Windows (32 bit, 8.2 MB)
We use CHOLMOD for solving sparse linear systems in certain shape spaces. CHOLMOD can be compiled with the graph partitioning software METIS to give better performance, but can not be distributed in this form under the terms of the GNU GPL. The version of CHOLMOD in this implementation has therefore been compiled without METIS, but you may gain better performance by compiling, from source, against CHOLMOD linked with METIS and/or a version of the BLAS which has been optimized for your processor.

Source code (97 KB)

Sample 'flying squirrel' mesh sequence from Big Buck Bunny (8.3 MB)