“…As a novel contribution, we extend hybrid conditional planning (HCP) [17] to include commonsense reasoning and a richer set of communication actions for collaborative tasks: (i) robot asking for confirmation (e.g., whether the human will assemble the part she is holding), (ii) requesting human to perform some action (e.g., human to unhold a part), (iii) asking for help (e.g., human to assemble a part that is not reachable to the robot), (iv) offering help (e.g., when the assembly part is too heavy or needs precision, or when the task is too tedious for the human), and (v) initiating/ending a conversation (e.g., greeting/acknowledging) and providing explanations. With such a general HCP framework, with sensing actions, robots can identify which assembly part the human workmate is holding; with commonsense reasoning, robots can conclude that a heavy assembly part cannot be moved by a human; and with communication skills, robots can communicate with humans in different ways for safer and effective collaborations.…”