Out the Window

by Gregory CastanonCC-BY

Out the Window

The Out the Window (OTW) dataset is a crowdsourced activity dataset containing 5,668 instances of 17 activities from the NIST Activities in Extended Video (ActEV) challenge. These videos are crowdsourced from workers on the Amazon Mechanical Turk using a novel scenario acting strategy, which collects multiple instances of natural activities per scenario. Turkers are instructed to lean their mobile device against an upper story window overlooking an outdoor space, walk outside to perform a scenario involving people, vehicles and objects, and finally upload the video to us for annotation. Performance evaluation for activity classification on VIRAT Ground 2.0 shows that the OTW dataset provides an 8.3% improvement in mean classification accuracy, and a 12.5% improvement on the most challenging activities involving people with vehicles.

Dataset Attributes

Label SVG
TasksEvent Detection
Label SVG
CategoriesSecurity, Home Security, Front Door, Daily Life
Label SVG
SensorRGB Camera

Class Labels

Going To The Grocery StoreReturning A Heavy Item To A StoreGoing To Sports PracticeTexting To Meet Up With FriendsGoing On VacationLoading A Bike Into The TrunkTaking The Baby For A Walk In A StrollerTexting And Talking On The PhoneHaving A Face To Face ConversationWheeling A Wheeled Cart To The CarRiding A Bike