Creation of Annotated Synthetic UAV Video Dataset for Object Detection and Tracking

Abstract

In order for object detection and tracking in videos obtained from unmanned aerial vehicles (UAVs) by deep convolutional neural networks (DCNN), extensive ground truth optical flow, occlusion and segmentation datasets, of various objects or vehicles, are required during the training and testing processes. The mentioned ground truth informations are not widely available in the literature due to the difficulty of labeling or extracting them from real-life recorded UAV video images. In this study, ground truth optical flow, occlusion and segmentation datasets were produced synthetically for the first time with the UAV point of view in a novel way, so as to fill the gap in literature. The ground truth datasets were created for each vehicle by subjecting the triangles (mesh) automatically generated by the Unity engine to the homography method. With this method, 1920x1080 and 250x250 sized synthetic datasets consisting of 100 scenarios were obtained.