Extracting Data from Human Manipulation of Objects Towards Improving Autonomous Robotic Grasping

Title:

Extracting Data from Human Manipulation of Objects Towards Improving Autonomous Robotic Grasping

Authors:

Diego R. Faria [ website | social ]

Ricardo Martins [ website | social ]

Jorge Lobo [ website | social ]

Jorge Dias [ website | social ]

Abstract:

Humans excel in manipulation tasks, a basic skill for our survival and a key feature in our manmade world of artefacts and devices. In this work, we study how humans manipulate simple daily objects, and construct a probabilistic representation model for the tasks and objects useful for autonomous grasping and manipulation by robotic hands. Human demonstrations of predefined object manipulation tasks are recorded from both the human hand and object points of view.The multimodal data acquisition system records human gaze, hand and fingers 6D pose, finger flexure, tactile forces distributed on the inside of the hand, colour images and stereo depth map, and also object 6D pose and object tactile forces using instrumented objects. From the acquired data, relevant features are detected concerning motion patterns, tactile forces and hand-object states. This will enable modelling a class of tasks from sets of repeated demonstrations of the same task, so that a generalised probabilistic representation is derived to be used for task planning in artificial systems. An object centred probabilistic volumetric model is proposed to fuse the multimodal data and map contact regions, gaze, and tactile forces during stable grasps. This model is refined by segmenting the volume into components approximated by superquadrics, and overlaying the contact points used taking into account the task context.Results show that the features extracted are sufficient to distinguish key patterns that characterise each stage of the manipulation tasks, ranging from simple object displacement, where the same grasp is employed during manipulation (homogeneous manipulation) to more complex interactions such as object reorientation, fine positioning, and sequential in-hand rotation (dexterous manipulation). The framework presented retains the relevant data from human demonstrations, concerning both the manipulation and object characteristics, to be used by future grasp planning in artificial systems performing autonomous grasping.

Publisher:

Robotics and Autonomous Systems, Elsevier

Date Published:

01-03-2012

Publisher website:

http://www.sciencedirect.com/science/article/pii/S0921889011001527

DOI:

10.1016/j.robot.2011.07.020

Alternative full-text PDF:

download full-text PDF via University of Coimbra

Keywords:

robotics, artificial perception, Bayesian modelling, probabilistic grid maps, grasping, robotic manipulation, learning by imitation, haptic perception, touch

Thumbnail:

image

Extracting Data from Human Manipulation of Objects Towards Improving Autonomous Robotic Grasping

Scholarly Lite is a free theme, contributed to the Drupal Community by More than Themes.