User Tools

Site Tools


tesla_journal14

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
tesla_journal14 [2019/11/04 09:57] yuhanghetesla_journal14 [2019/11/12 11:40] (current) yuhanghe
Line 16: Line 16:
 I have been focusing on development with HoloLens during this week. First, I learn how to develop with Unity and C# since Hololens SDK has the strongest support for Unity engine. The Unity Engine is also used by Dylan in his third person view of DRC-Hubo project. Therefore, I think it is import for me to learn how to use and program in Unity and C#. I have been focusing on development with HoloLens during this week. First, I learn how to develop with Unity and C# since Hololens SDK has the strongest support for Unity engine. The Unity Engine is also used by Dylan in his third person view of DRC-Hubo project. Therefore, I think it is import for me to learn how to use and program in Unity and C#.
  
-Afterward, I familiarize myself with HoloLens SDK, which MicroSoft called Mixed Reality Development Kit (MRDK). The MRDK is a SDK that contains resources for building application for HoloLens 1 and 2. Since the BIM team have multiple HoloLens set. I have the opportunity to borrow a headset and play around with it. I was able to follow through the different tutorials and created some sample applications in HoloLens.+Afterward, I familiarize myself with HoloLens SDK, which MicroSoft called Mixed Reality Toolkit (MRTK). The MRTK is a SDK that contains resources for building application for HoloLens 1 and 2. Since the BIM team have multiple HoloLens set. I have the opportunity to borrow a headset and play around with it. I was able to follow through the different tutorials and created some sample applications in HoloLens.
  
 Finally, I started working to integrate Spot and HoloLens. The API provided by BD is written in Python while HoloLens SDK is based in C#. Therefore, to control Spot directly from HoloLens would require me to rewrite the BD's API in C#, which is unrealistic given the time frame. The approach that I decided is to use the Desktop GUI that I developed for Spot as an intermediate/server, that would receive inputs from HoloLens and send them to Spot and vice versa. Basically, the Desktop GUI would setup a websocket server to communicate with HoloLens. The messages would then be relayed to Spot through BD's API. Finally, I started working to integrate Spot and HoloLens. The API provided by BD is written in Python while HoloLens SDK is based in C#. Therefore, to control Spot directly from HoloLens would require me to rewrite the BD's API in C#, which is unrealistic given the time frame. The approach that I decided is to use the Desktop GUI that I developed for Spot as an intermediate/server, that would receive inputs from HoloLens and send them to Spot and vice versa. Basically, the Desktop GUI would setup a websocket server to communicate with HoloLens. The messages would then be relayed to Spot through BD's API.
tesla_journal14.1572890241.txt.gz · Last modified: by yuhanghe