Conference paper
Generalized framework for the parallel semantic segmentation of multiple objects and posterior manipulation
The end-to-end approach presented in this paper deals with the recognition, detection, segmentation and grasping of objects, assuming no prior knowledge of the environment nor objects. The proposed pipeline is as follows: 1) Usage of a trained Convolutional Neural Net (CNN) that recognizes up to 80 different classes of objects in real time and generates bounding boxes around them. 2) An algorithm to derive in parallel the pointclouds of said regions of interest (ROI). 3) Eight different segmentation methods to remove background data and noise from the pointclouds and obtain a precise result of the semantically segmented objects. 4) Registration of the object's pointclouds over time to generate the best possible model. 5) Utilization of an algorithm to detect an array of grasping positions and orientations based mainly on the geometry of the object's model. 6) Implementation of the system on the humanoid robot MyBot, developed in the RIT Lab at KAIST. 7) An algorithm to find the bounding box of the object's model in 3D to then create a collision object and add it to the octomap.
The collision checking between robot's hand and the object is removed to allow grasping using the MoveIt libraries. 8) Selection of the best grasping pose for a certain object, plus execution of the grasping movement. 9) Retrieval of the object and moving it to a desired final position.
Language: | English |
---|---|
Publisher: | IEEE |
Year: | 2017 |
Pages: | 561-8 |
Proceedings: | 2017 IEEE International Conference on Robotics and Biomimetics |
ISBN: | 1538637413 , 1538637421 , 153863743X , 153863743x , 9781538637418 , 9781538637425 and 9781538637432 |
Types: | Conference paper |
DOI: | 10.1109/ROBIO.2017.8324476 |
ORCIDs: | Llopart, Adrian , Ravn, Ole and Andersen, Nils Axel |
Convolutional neural nets Grasping Humanoid robot Object detection Pointcloud processing Semantic segmentation
Geometry Humanoid robots MoveIt libraries Pipelines RIT Lab Real-time systems Semantics background data bounding box collision avoidance collision object convolutional neural nets end-to-end approach feedforward neural nets grasping grasping movement grasping positions humanoid robot humanoid robot MyBot humanoid robots image retrieval image segmentation learning (artificial intelligence) manipulators mobile robots motion control multiple objects object detection parallel semantic segmentation pointcloud processing pointclouds posterior manipulation regions of interest semantic segmentation semantically segmented objects trained Convolutional Neural Net