TUM AI Lecture Series - HoloLens, Mixed Reality and Spatial Computing (Marc Pollefeys)

Title: HoloLens, Mixed Reality and Spatial Computing

Abstract:
Mixed Reality (MR) allows to blend virtual information with the real world. In this talk I will discuss how Microsoft HoloLens works and in particular how computer vision is one of the key enabling technologies to deliver convincing immersive Mixed Reality experiences and enable intuitive interaction with digital content. We will cover some of the key applications today as well as look into the future and see how HoloLens can be a great platform for egocentric computer vision research. Then, we?ll see how Mixed Reality relates to Spatial Computing and in particular explore some applications related to robotics.

Bio: Marc Pollefeys is a Professor of Computer Science at ETH Zurich and the Director of the Microsoft Mixed Reality and AI Lab in Zurich where he works with a team of scientist and engineers to develop advanced perception capabilities for HoloLens and Mixed Reality. He was elected Fellow of the IEEE in 2012. He obtained his PhD from the KU Leuven in 1999 and was a professor at UNC Chapel Hill before joining ETH Zurich. He is best known for his work in 3D computer vision, having been the first to develop a software pipeline to automatically turn photographs into 3D models, but also works on robotics, graphics and machine learning problems. Other noteworthy projects he worked on are real-time 3D scanning with mobile devices, a real-time pipeline for 3D reconstruction of cities from vehicle mounted-cameras, camera-based self-driving cars and the first fully autonomous vision-based drone. Most recently his academic research has focused on combining 3D reconstruction with semantic scene understanding.

TUM AI Lecture Series previous lectures: