2004
DOI: 10.1109/tsmcb.2004.823327
|View full text |Cite
|
Sign up to set email alerts
|

Mental Imagery for a Conversational Robot

Abstract: Abstract-To build robots that engage in fluid face-to-face spoken conversations with people, robots must have ways to connect what they say to what they see. A critical aspect of how language connects to vision is that language encodes points of view. The meaning of my left and your left differs due to an implied shift of visual perspective. The connection of language to vision also relies on object permanence. We can talk about things that are not in view. For a robot to participate in situated spoken dialog,… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
1
1
1

Citation Types

0
61
0

Year Published

2004
2004
2016
2016

Publication Types

Select...
6
2
2

Relationship

0
10

Authors

Journals

citations
Cited by 92 publications
(61 citation statements)
references
References 28 publications
0
61
0
Order By: Relevance
“…There is a separate body of work on qualitative models of action effects on objects, rooted in naive physics (Hayes 1995) and qualitative physics (Kuipers 1986). In a similar spirit, there is work on using physics engines to learn qualitative action effects (Mugan and Kuipers 2012), and on high level planning of manipulation (Stilman and Kuffner 2008;Roy et al 2004) using qualitative action models. Some early ideas on push planning have reappeared in recent robots, which plan pushes to enable grasps in clutter (Dogar and Srinivasa 2010).…”
Section: Related Workmentioning
confidence: 99%
“…There is a separate body of work on qualitative models of action effects on objects, rooted in naive physics (Hayes 1995) and qualitative physics (Kuipers 1986). In a similar spirit, there is work on using physics engines to learn qualitative action effects (Mugan and Kuipers 2012), and on high level planning of manipulation (Stilman and Kuffner 2008;Roy et al 2004) using qualitative action models. Some early ideas on push planning have reappeared in recent robots, which plan pushes to enable grasps in clutter (Dogar and Srinivasa 2010).…”
Section: Related Workmentioning
confidence: 99%
“…It is worth noting that proximity problems also arise in cognitive robotics, where a robot may need to anticipate whether it will be next to an object (e.g., a person, food tray or book) it plans to interact with, after one or more moves or other actions. The "next-to" problem was analyzed in (Schubert 1990(Schubert , 1994, and recent robotics research recognizes that cognitive robots need to construct three-dimensional spatial models of their environment (e.g., Roy et al 2004).…”
Section: The Need For Imagistic Modelingmentioning
confidence: 99%
“…Joly et al applied this concept to logo retrieval in large image collection [13] and Jiang et al did this to bagof-visual-words [14]. As visual representational aspects, a visual mental imagery is used as inner representation of cognitive processes of humans [16], AIs [17] and even robots [18].…”
Section: Related Workmentioning
confidence: 99%