This project was a big challenge since AR tracking is still at its infancy. The goal was to make a 3D model follow its correspondence in the real world when a 360 camera is moved around. We used many techniques, including SURF (Speeded Up Robust Features) to detect feature points in a video frame and match them in the next frame. Then, using RANSAC, we can find the position of the camera in the 3D model by projecting the feature points into the 3D model.

Bentley Systems, Incorporated, is a software development company that develops and sells computer software and services for the design, construction, and operation of infrastructure. I worked for their applied research team in Quebec City during summer 2012.