MoReLab: a software for user-assisted 3D reconstruction

Siddique A., Banterle F., Corsini M., Cignoni P., Sommerville D., Joffe C.

Atomic and Molecular Physics  3D modeling  Video-based 3D reconstruction  Electrical and Electronic Engineering  Analytical Chemistry  and Optics  Instrumentation  Biochemistry  Image-based 3D reconstruction  Structure from Motion  User-assisted 3D reconstruction  HCI 

We present MoReLab, a tool for user-assisted 3D reconstruction. This reconstruction requires an understanding of the shapes of the desired objects. Our experiments demonstrate that existing Structure from Motion (SfM) software packages fail to estimate accurate 3D models in low-quality videos due to several issues such as low resolution, featureless surfaces, low lighting, etc. In such scenarios, which are common for industrial utility companies, user assistance becomes necessary to create reliable 3D models. In our system, the user first needs to add features and correspondences manually on multiple video frames. Then, classic camera calibration and bundle adjustment are applied. At this point, MoReLab provides several primitive shape tools such as rectangles, cylinders, curved cylinders, etc., to model different parts of the scene and export 3D meshes. These shapes are essential for modeling industrial equipment whose videos are typically captured by utility companies with old video cameras (low resolution, compression artifacts, etc.) and in disadvantageous lighting conditions (low lighting, torchlight attached to the video camera, etc.). We evaluate our tool on real industrial case scenarios and compare it against existing approaches. Visual comparisons and quantitative results show that MoReLab achieves superior results with regard to other user-interactive 3D modeling tools.

Source: Sensors (Basel) 23 (2023). doi:10.3390/s23146456

Publisher: Molecular Diversity Preservation International (MDPI),, Basel

Metrics