For an optical instrument manufacturer, we developed 3DCG tools and systems for image processing and proposed workflows, with the aim of creating a new business.

Compositing realistic 3D furniture into 360° photos of vacant rooms

So that real estate brokerages could show customers images of vacant properties with furniture in place to improve their closing rates, we developed the following solutions for compositing realistic 3D furniture into 360° photos of vacant rooms.

Compositing pipeline

Blending 3D images and 360° photos automatically and naturally requires processing beyond what 3D software (such as Blender) can normally do, so we built a compositing pipeline that performs image processing in multiple stages.

Model management server

To classify 3D models properly and place them appropriately according to the type of interior photo, we developed a web app that efficiently manages 3D models and their information.

Model management add-on

To make model management simpler, we developed a local model management add-on (a plugin for the 3DCG software Blender) designed for use with shared storage.

Generating machine learning training data from specified floor plans

As training data for a machine learning model that estimates floor plan structure from interior 360° photos, we developed a system that generates 3D interior models, rendered images and segmentation images (image region recognition information) from specified floor plans.

Recreating vacant rooms from photos of occupied interiors

For real estate brokerages, we researched and developed the following systems, which recreate the appearance of a vacant room by removing furniture and other items from 360° photos of occupied interiors and changing the wallpaper.

Generating 3D interior models from 360° images

We developed an add-on (a plugin for the 3DCG software Blender) that generates a 3D interior model in just a few steps by pointing to various spots in a 360° photo. After the 3D model is generated, the wallpaper, flooring and other elements can be changed.

Image compositing workflow

We proposed a Photoshop-based 2D workflow for compositing the generated 3D images with the original 360° images.