Abstract-Robots which are supposed to replace a human worker need sophisticated manipulation capabilities. Such capabilities are required for demanding everyday tasks as well as for specialized operations. This includes, e.g., dexterous manipulations in robot-assisted minimally invasive surgery.Sophisticated manipulation tasks require not only appropriate physical capabilities from the hardware, but also advanced knowledge about the dexterous manipulation task itself. Hence, we propose an abstract representation of dexterous manipulation knowledge. It is based on a contact state perspective of the environment. Objects in the environment are described relative to their specific type of contact with the environment. This enables a robot-independent reuse and adaption. The task can even be processed if the environment changes (e.g., due to occurrence of obstacles) of if another robot has to be used.Our experiments illustrate the flexibility which the representation provides. Obstacle avoidance and efficiency of the manipulator's motion are taken into account in the scenarios.
I. MOTIVATIONSophisticated manipulation capabilities are an important step towards daily use suitability for robots. This poses not only requirements on the physical capabilities of the involved robotic hand and arm. Advanced knowledge about dexterous manipulation is necessary as well. We focus on the representation of such knowledge in this paper. The representation has to enable a successful reuse of the knowledge even if the environment changes. Hence, it should be possible to build up alternative procedures to achieve the desired goal. Moreover, the knowledge representation should be independent of the robot to allow a knowledge usage on different robotic systems. The representation should be easy to use, since a human should be able to command the robot without programming the exact path. The required knowledge for the representation should be extractable from observation. To conclude, a representation at an abstract level is required rather than, e.g., a record of observations from demonstrations.The aim of a task is usually a desired goal state of objects in the environment. The performance of the task requires, then, a modification of the current state of the environment. In general, a state could be related to a physical state of an object. For example, a cup can be empty or it can be filled with coffee. Hence, its physical state (weight) is different. Moreover, the handling properties of an object can differ figure). Of course, one could use a tool, e.g., a can inbetween to achieve the desired contact state (bottom row). The final choice depends on several factors like efficiency (usage of an additional tool requires time capacities) or further tasks (e.g., refilling of the cup).(e.g., tilting of a cup filled with coffee should be avoided). A representation of such properties has already been presented in [1]. We want to go a step further in this paper. We focus on more dexterous tasks, which require a much more detailed knowledge ...