Mixed Reality Framework for Interactive Simulations

Introduction

This framework enables the development of interactive simulations in Mixed Reality (MR) environments using projection systems and physical object detection. It integrates projection technology with camera systems for real-time interaction with tangible objects.

The framework contains multiple steps to create the MR simulation: calibration, initialization and detection. These steps are also separated in the source files. A demo simulation using the framework can be found here.

Requirements

• Unity version 2022.3.16f1 (latest LTS version as of writing)
• OpenCV plus Unity package
• Chequerboard calibration image

Example video

https://youtu.be/rx8KwephDO0?si=HU_tgy5QHcYv1XS_

License

This project is licensed under the MIT License - see the LICENSE file for details.

Acknowledgements

Thanks to Dr R.G. Belleman for supervising me throughout this project and J. van der Kaaij for the continued help.