Skip to content

SBCV/Blender-Addon-Photogrammetry-Importer

Repository files navigation

Blender Photogrammetry Importer

This repository contains a Blender addon to import results of several reconstruction libraries. In addition it allows to perform novel view synthesis using Neural Radiance Fields (NeRF).

Compatibility

The latest release of the addon is currently compatible with Blender 4.0.2 onwards. For older Blender versions you might find a suitable release here.

Supported Reconstruction Libraries and Point Cloud Data Formats

Supported photogrammetry libraries (data formats):

Supported view synthesis libraries (data formats):

In addition, the addon supports some common point cloud data formats:

1 Requires Pillow to read image sizes from disk. 2 Requires Pyntcloud for parsing. 3 Requires Laspy for parsing. 4 Requires Lazrs for parsing.

Getting Started

Paper

If you use this library for scientific purposes, please consider to cite the following paper.

[paper]  [arxiv]

@article{PhotogrammetryForModeling2021,
title={A Photogrammetry-based Framework to Facilitate Image-based Modeling and Automatic Camera Tracking},
author={Bullinger, Sebastian and Bodensteiner, Christoph and Arens, Michael},
booktitle={International Conference on Computer Graphics Theory and Applications},
year={2021}
}

View Synthesis Examples

This addon allows to peform novel view synthesis for arbitrary cameras using NeRF (e.g. Instant NGP). The left image shows a plain NeRF result and the right image an overlay with the corresponding point cloud.

Reconstruction Examples

This repository contains an example Colmap model. The following image shows the imported camera poses, image planes and point cloud in Blender's 3D view. alt text The input images of the Colmap model are located here: https://github.com/openMVG/ImageDataset_SceauxCastle.

The addon computes an animated camera with corresponding background images from the reconstructed camera poses. alt text

There is also an import option that allows to interpolate the reconstructed camera poses. alt text

In addition, the addon allows to import meshes contained in the workspaces of specific libraries. Manually imported meshes can also be aligned with the corresponding reconstruction by following the instructions here. alt text

The addon offers two options to represent the point clouds (OpenGL and Geometry Nodes). The addon provides different panels to adjust the appearance and to render these point clouds - see Point Cloud Visualization and Rendering. The following images show an example represented with OpenGL (top) and Geometry Nodes (bottom).

alt text alt text

In addition, the addon allows to visualize depth maps (reconstructed with Colmap or MVE) as point clouds.