We present a dataset for 6D pose estimation that covers the above-mentioned challenges, mainly targeting training from 3D models (both textured and textureless), scalability, occlusions, and changes in light conditions and object appearance. The dataset features 33 objects (17 toy, 8 household and 8 industry-relevant objects) over 13 scenes of various difficulty. We also present a set of benchmarks to test various desired detector properties, particularly focusing on scalability with respect to the number of objects and resistance to changing light conditions, occlusions and clutter. We also set a baseline for the presented benchmarks using a state-of-the-art DPOD detector. Considering the difficulty of making such datasets, we plan to release the code allowing other researchers to extend this dataset or make their own datasets in the future.
The dataset feature 33 objects of different purpose (toys, household objects, industrial objects). The reconstructed 3D models are stored as .ply files with associated per-vertex colors. The models are stored in millimeters, with surface normal vectors already precomputed.
The dataset features 13 scenes of varying complexity. Each scene was captured with two sensors: PrimeSense Carmine and Kinect 2. For each scene there are 340 validation RGBD frames captured on a rotating turntable and 1000 test RGBD frames captured in a handheld mode. The pose labels are provided for each of the objects in each frame.
The dataset is composed of two versions:
For questions, concerns and general feedback, please contact Slobodan Ilic.