Late Tuesday morning on July 7, a U.S. Air Force F-16 fighter jet and a small, single-engine Cessna 150 collided mid-air over South Carolina – forcing the jet pilot to eject and sending the two Cessna pilots to their deaths.
The situation was grim. Debris was spread over an 11 km (6.84 mile) range, the majority of it underwater in swampy, alligator- and snake-infested waters. Fuel from the crash was either leaked or burning from the fuel tanks, and temperatures outside were sizzling at nearly 39 degrees C (102.2 degrees F). Over 150 personnel from at least 20 local, federal and state agencies were called out to locate, document and recover both the debris from the airplanes and the victims’ bodies.
Bill Salsbury, Berkeley County coroner and incident commander for the search-and-recovery, had already dealt with more than six airplane crashes, but never one of this size and scope.
He called drone-service company SkyView Aerial Solutions and asked CEO Tom Fernandez, CEO, and Tom Lucey, chief business development officer, to come to the crash site the next day and gather aerial photographs with their drone.
The two were happy to volunteer in the recovery efforts and met with several authorities to explain that they could not only help document debris by taking photographs, but they could also map the area by using image-processing software Pix4Dmapper from Pix4D.“The expectation was that we were going to go 100-200 feet in the air and take pictures so they could zoom in on them,” says Fernandez. “We explained that with the drone and Pix4Dmapper, we could map the entire area they wanted, but at a lower altitude and at higher resolution.”
Fernandez and Lucey first mapped a former rice paddy with 1.8 meters of standing water, where most of the large debris from the Cessna had fallen. The two flew their DJI Phantom Vision 2+ at 30 meters, using the Pix4Dmapper Capture App of their Android to handle the flight plan and image acquisition. In approximately six minutes, the flight was complete – at which point the 87 acquired images were processed in the cloud with Pix4D technology. Orthomosaic rendering and full-resolution processing took only one hour.
The emergency responders had a helicopter on-site but were unable to use it for visual identification of debris due to the ripple effect placed on the water surface by the beating chopper blades.
“When we finished mapping the rice paddy, we were approached by the dive team,” says Fernandez. “They knew that we would be able to provide them with information before anyone else.”
Fernandez and Lucey took a screenshot of the resulted orthomosaic in the browser of their laptop then put the .jpg and original, geo-tagged photos onto a thumb drive for the North Charleston Police Department Dive Team, who viewed the information from their laptop on-site.
With a ground resolution of under 2 cm per pixel, close examination of the orthomosaic revealed many pieces of wreckage and other items, submerged at the bottom of the paddy but visible in the map. The dive team took the data with them on their airboat but, even then, had difficulty seeing debris on the bottom due to the silt kicked up by the boat. Fortunately, by using the coordinates on the orthomosaic, they were still able to recover debris as small as half a meter, despite the low visibility. There was also an additional problem for the divers, says Lucey:
“While they went to each coordinate, there were officers on shore with binoculars, calling out to warn the divers of alligators!”
After the first successful mapping, authorities requested more images and orthomosaics, and Fernandez and Lucey teamed with the National Transportation Safety Board (NTSB) to map farther away under a forest canopy.
Traditionally, in a case like this, the NTSB documents all of the debris by hand by using an iPhone, pen and pad of paper. Each piece must be geotagged and logged, so staff take a picture of the items, find the geolocation using Google Maps and record it on paper. For the forest mapping, the Phantom was particularly useful, as it could spot debris resting on the treetops – something a traditional means of documenting would not be able to see except by helicopter.
By the end of the day, seven flights had been conducted over three areas to assist emergency workers with their arduous task. In total, the recovery of the debris and bodies took more than three days, and estimates from various authorities claim the maps and images saved approximately three additional days of work.
The mapping was not planned in advance as part of the emergency workflow but emerged as a practical and innovative solution to a crash of unexpected scale. In addition, the application brings up questions of other such applications in both emergency response and a variety of other industries. At the end of the ordeal, workers were simply happy to have a tool that enabled them to do their jobs more efficiently.
“It’s so enlightening to have a tool that can make their job more efficient – not only for the emergency responders, but also for the families of the victims,” says Lucey.
Krista Montgomery serves as a content writer and PR for Lausanne, Switzerland-based Pix4D.