20bn-Something-Something

by No License

20bn-Something-Something

The 20BN-SOMETHING-SOMETHING dataset is a large collection of densely-labeled video clips that show humans performing pre-defined basic actions with everyday objects. The dataset was created by a large number of crowd workers. It allows machine learning models to develop fine-grained understanding of basic actions that occur in the physical world. It is available free of charge for academic research. Commercial licenses are available upon request.DATA FORMATThe video data is provided as one large TGZ archive, split into parts of 1 GB max. The total download size is 25.2 GB. The archive contains directories numbered from 1 to 108499. Each directory corresponds to one video and contains JPG images with height 100px and variable width. The JPG images were extracted from the original videos at 12 frames per seconds. The filenames of the JPGs start at 00001.jpg. The number of JPGs varies as the length of the original videos varies.https://arxiv.org/abs/1706.0426120BN-SOMETHING-SOMETHING-DATASETTotal number of videos 108,499Training Set 86,017Validation Set 11,522Test Set (w/o labels) 10,960Labels 174986 Holding something979 Turning something upside down924 Turning the camera left while filming something914 Stacking number of something914 Turning the camera right while filming something888 Opening something885 Approaching something with your camera877 Picking something up873 Pushing something so that it almost falls off but doesnt864 Folding something863 Moving something away from the camera858 Closing something850 Moving away from something with your camera845 Turning the camera downwards while filming something841 Pushing something so that it slightly moves839 Turning the camera upwards while filming something838 Pretending to pick something up838 Showing something to the camera833 Moving something up830 Plugging something into something830 Unfolding something828 Putting something onto something827 Showing that something is empty825 Pretending to put something on a surface825 Taking something from somewhere824 Putting something next to something821 Moving something towards the camera820 Showing a photo of something to the camera815 Pushing something with something808 Throwing something802 Pushing something from left to right801 Something falling like a feather or paper801 Throwing something in the air and letting it fall796 Throwing something against something793 Lifting something with something on it788 Taking one of many similar things on the table785 Showing something behind something781 Putting something into something780 Tearing something just a little bit779 Moving something away from something778 Tearing something into two pieces777 Holding something next to something777 Pushing something from right to left776 Putting something, something and something on the table775 Moving something closer to something775 Pretending to take something from somewhere774 Pretending to put something next to something773 Uncovering something772 Pouring something into something772 Putting something and something on the table772 Something falling like a rock769 Moving something down769 Pulling something from right to left767 Throwing something in the air and catching it763 Tilting something with something on it until it falls off762 Putting something in front of something760 Pretending to turn something upside down759 Putting something on a surface757 Pretending to throw something756 Covering something with something756 Showing something on top of something753 Squeezing something752 Putting something similar to other things that are already on the table751 Lifting up one end of something, then letting it drop down749 Taking something out of something747 Moving part of something745 Pulling something from left to right744 Lifting something up completely without letting it drop down743 Attaching something to something743 Holding something in front of something743 Moving something and something closer to each other743 Putting something behind something742 Pushing something so that it falls off the table735 Holding something over something734 Pretending to open something without actually opening it732 Removing something, revealing something behind729 Hitting something with something727 Moving something and something away from each other727 Touching (without moving) part of something724 Pretending to put something into something724 Showing that something is inside something721 Lifting something up completely, then letting it drop down720 Pretending to take something out of something709 Holding something behind something707 Laying something on the table on its side, not upright700 Poking something so it slightly moves699 Pretending to close something without actually closing it698 Putting something upright on the table690 Dropping something in front of something687 Dropping something behind something685 Lifting up one end of something without letting it drop down682 Rolling something on a flat surface677 Throwing something onto a surface671 Showing something next to something668 Dropping something onto something668 Stuffing something into something662 Dropping something into something662 Piling something up660 Letting something roll along a flat surface658 Twisting something643 Spinning something that quickly stops spinning636 Putting number of something onto something634 Moving something across a surface without it falling down634 Putting something underneath something628 Plugging something into something but pulling it right out as you remove your hand627 Dropping something next to something606 Poking something so that it falls over593 Spinning something so it continues spinning588 Poking something so lightly that it doesnt or almost doesnt move585 Wiping something off of something582 Moving something across a surface until it falls down580 Pretending to poke something570 Putting something that cannot actually stand upright upright on the table, so it falls on its side566 Pulling something out of something565 Scooping something up with something562 Pretending to be tearing something that is not tearable543 Burying something in something542 Tipping something over533 Tilting something with something on it slightly so it doesnt fall down528 Pretending to put something onto something522 Bending something until it breaks512 Letting something roll down a slanted surface509 Trying to bend something unbendable so nothing happens505 Bending something so that it deforms503 Digging something out of something502 Pretending to put something underneath something497 Putting something on a flat surface without letting it roll479 Putting something on the edge of something so it is not supported and falls down471 Pretending to put something behind something471 Spreading something onto something466 Sprinkling something onto something463 Something colliding with something and both come to a halt462 Pushing something off of something453 Putting something that cant roll onto a slanted surface, so it stays where it is451 Lifting a surface with something on it until it starts sliding down433 Pretending or failing to wipe something off of something433 Trying but failing to attach something to something because it doesnt stick427 Pulling something from behind of something423 Pushing something so it spins420 Pouring something onto something416 Pulling two ends of something but nothing happens413 Moving something and something so they pass each other413 Pretending to sprinkle air onto something405 Putting something that cant roll onto a slanted surface, so it slides down395 Something colliding with something and both are being deflected386 Pretending to squeeze something367 Pulling something onto something362 Putting something onto something else that cannot support it so it falls down358 Lifting a surface with something on it but not enough for it to slide down358 Pouring something out of something346 Moving something and something so they collide with each other341 Tipping something with something in it over, so something in it falls out339 Letting something roll up a slanted surface, so it rolls back down318 Pretending to scoop something up with something311 Pretending to pour something out of something, but something is empty294 Pulling two ends of something so that it gets stretched290 Failing to put something into something because something does not fit288 Pretending or trying and failing to twist something282 Trying to pour something into something, but missing so it spills next to it277 Something being deflected from something273 Poking a stack of something so the stack collapses267 Spilling something onto something245 Pulling two ends of something so that it separates into two pieces229 Pouring something into something until it overflows220 Pretending to spread air onto something219 Twisting (wringing) something wet until water comes out217 Poking a hole into something soft207 Spilling something next to something206 Poking a stack of something without the stack collapsing183 Putting something onto a slanted surface but it doesnt glide down170 Pushing something onto something141 Poking something so that it spins around121 Spilling something behind something77 Poking a hole into some substance

Dataset Attributes