Virtual production prototype

This is a proof of concept for a virtual production environment in the Unity engine.

In 2017, when this video was recorded, Unity was lacking any native virtual production features, but I was determined to use a high end game engine with proper lighting during the motion capture phase, especially for the virtual camera.

I ended up capturing the motion of the character and the camera work separately. The character capture and retargeting was done in OptiTrack Motive and Motion Builder and it was then imported in Unity via FBX.

For the camera movement I streamed the camera position in real time from Motive to Unity and I used a custom script to record it to an animation track.

This way I was able to see final pixels, directly in my virtual camera viewfinder and make adjustments to the lighting and blocking in real time.