Geospatial Video

During this lab exercise, we worked with geospatial video to demonstrate how the location of a UAV can be tied to a map as well as the video that the aircraft is seeing at that time. Oftentimes in the UAS industry, we deal with nadir (straight down shots). These shots are then tied to GPS coordinates for mapping purposes. However, there are instances when we need shots obtained from a different angle so as to capture the surrounding areas gathering more information. While reviewing the captured video, either post flight or during flight, it is important to know where the UAV is and where it is looking. This information can be very beneficial for operations such as search and rescue, firefighting, surveillance, etc. Geospatial video allows us to see this data.

The idea for the lab was simple: take the data we were given and turn it into the final product. The process however, was not as concrete. In previous labs, our instructor has either given us step-by step instructions or walked us through the appropriate course of action for completing the tasks, but in this case it was up to us as a class to figure it out. My colleague Thomas and I worked together using the help video provided in the software to complete the task. Our process, and difficulties encountered, are outlined below:

The data set was loaded from a flight performed at Dr. Hupy's house. The blue dots represent points along the flight where GPS data and time stamps are matched together. On the left side of the screen is where we see the file names. It is important to match up the video and GPS files, as these are saved separately. 

The next step is to begin the geotagging process, in this example we are working with a controlled burn video. To do this, you must match up the point in the video where the mission starts to the correct point on the map of the first known location. This is the first section where Thomas and I encountered trouble. Because the video began before the flight mission was started, the video was longer than the registered flight mission loaded into the esri software. To solve this, I watched the video until what appeared to be the beginning of the flight mission, then I would stop the video and tag the first point as shown below. 

By geotagging that first point, you are telling the software this is where to begin. after that you must go to the end of the video and find where the flight stops. This created another problem for us. Since it was not our mission, we were not exactly sure when the mission ended and when the landing sequence was initiated . So for the purposes of lab practice, we guessed to the best of our ability. After a few attempts the proper ending was figured out and  we were able to geotag the points. 

Notice in this image the points are now red and there is a teal cross-haired marker. This indicates that the points have been properly tagged. Now, when the video plays, the teal marker will move along the flight path displaying where the UAV is at a certain time. This is extremely helpful in this controlled burn situation because as you watch the video on the left, you are able to pause and identify where exactly the are of concern is on the map. 

This exercise helped me understand the importance of geospatial data, an area that I had no experience in. In my hopes of working with accident reconstruction and scene investigation I can see this technique being extremely helpful. For example: if an airplane were to crash in the middle of a field and parts were scattered across a hundred yard stretch, using this software to locate parts and geotag them respective to the body of the air frame will allow me to understand the accident better. I believe this can compliment naidr surveys well and provide an extra set of data to work in the lab. As is shown in the controlled burn example above, firefighters and rescue teams can utilize this technology to understand how to combat these fires in real-time, conducting a 20 minute flight, downloading the data, processing, and analyzing all in the field to provide guidance for crew members to effectively and efficiently put out the fires.