Synthetic Simbotic Plugin

Real human face inside a synthetic 3D model

Introduction

Synthetic is a plugin that creates synthetic datasets using Simbotic Engine. With this tool is possible to deliver labeled data images or segmented data images with out any effort.

At this moment, Synthetic supports two types of workflows

Label Images

Generating synthetic data, using PASCAL VOC and YOLO annotation formats.

Segmentation

Synthetic uses an automatic workflow to generate segmented captures like the following.

Set Up

Install Simbotic Engine

git clone -b Simbotic/4.24 git@github.com:Simbotic/SimboticEngine.git
cd SimboticEngine
./Setup.sh
./GenerateProjectFiles.sh
make

Usage

Labeling

Segmentation

To use the segmentation worflow, we need the following:

1. Activate Enabled with Stencils inside Simbotic Engine: Project Settings -> Rendering -> Post Processing -> Custom Depth-Stencil Pass.

2. At this moment, the segmentation workflow needs only static meshes actors inside your scene. So, for every actor you need to enable Render CustomDepth Pass inside Rendering options.

3. After that, we need to drag our BP_SegmentationCamera inside the current scene.

4. Now, we need to update the following properties as we want.

5. Inside the segmentation camera blueprint, there is a SceneCaptureComponent that we need to modify: In the section PostProcessing Material, we need to select our PP_SegmentationMaterial material.

6. Takes capture pressing P inside your scene. Configure the camera blueprint as you wish.