Author: Yu Hang He, Email: hey6@unlv.nevada.edu
Date Last Modified: 11/04/2019

I have been focusing on development with HoloLens during this week. First, I learn how to develop with Unity and C# since Hololens SDK has the strongest support for Unity engine. The Unity Engine is also used by Dylan in his third person view of DRC-Hubo project. Therefore, I think it is import for me to learn how to use and program in Unity and C#.

Afterward, I familiarize myself with HoloLens SDK, which MicroSoft called Mixed Reality Development Kit (MRDK). The MRDK is a SDK that contains resources for building application for HoloLens 1 and 2. Since the BIM team have multiple HoloLens set. I have the opportunity to borrow a headset and play around with it. I was able to follow through the different tutorials and created some sample applications in HoloLens.

Finally, I started working to integrate Spot and HoloLens. The API provided by BD is written in Python while HoloLens SDK is based in C#. Therefore, to control Spot directly from HoloLens would require me to rewrite the BD's API in C#, which is unrealistic given the time frame. The approach that I decided is to use the Desktop GUI that I developed for Spot as an intermediate/server, that would receive inputs from HoloLens and send them to Spot and vice versa.

Since AutoDesk University will be happening next month. Matt want to push for integration between HoloLense and Spot. The goal is to be able to control Spot functionality using HoloLense's interface. Originally, this was Matt's project. However, since Matt does not have access to Spot, he is limited to what he can accomplish. I am going to start to look into software development for HoloLense.