Modeling embodied visual behaviors

Sprague, Nathan; Ballard, Dana H.; Robinson, Al

doi:10.1145/1265957.1265960

Cited by 92 publications

(142 citation statements)

References 39 publications

Supporting

Mentioning

132

Contrasting

Order By: Relevance

“…Thus, in hybrid exemplar models, production targets can be generated on the basis of phonemic categories alone, but will normally be influenced also by larger units, especially for experienced speakers. This idea accords fairly well with the principles of adaptive resonance theory (Grossberg, 2003), of task dynamics (Saltzman, 1995), where control of behaviour becomes more global as skill develops (for an embodied formulation, see Simko and Cummins, 2010), and indeed of perception-action robotics models (e.g., Sprague, Ballard and Robinson, 2007;Roy, 2005).…”

Section: Discussionsupporting

confidence: 66%

Production and perception of speaker-specific phonetic detail at word boundaries

Smith

Hawkins

2012

Journal of Phonetics

View full text Add to dashboard Cite

Experiments show that learning about familiar voices affects speech processing in many tasks. However, most studies focus on isolated phonemes or words and do not explore which phonetic properties are learned about or retained in memory. This work investigated inter-speaker phonetic variation involving word boundaries, and its perceptual consequences. A production experiment found significant variation in the extent to which speakers used a number of acoustic properties to distinguish junctural minimal pairs e.g. So he diced them-So he'd iced them. A perception experiment then tested intelligibility in noise of the junctural minimal pairs before and after familiarisation with a particular voice. Subjects who heard the same voice during testing as during the familiarisation period showed significantly more improvement in identification of words and syllable constituents around word boundaries than those who heard different voices. These data support the view that perceptual learning about the particular pronunciations associated with individual speakers helps listeners to identify syllabic structure and the location of word boundaries.

show abstract

Section: Discussionsupporting

confidence: 66%

Production and perception of speaker-specific phonetic detail at word boundaries

Smith

Hawkins

2012

Journal of Phonetics

View full text Add to dashboard Cite

show abstract

“…Some of this work makes use of advances in dynamic camera placement in 3D scenes [395] to extend the idea of "virtual vision" [396] or "embodied vision" [397] to "human animats" [398,399].…”

Section: Visionmentioning

confidence: 99%

Computational Streetscapes

Torrens

2016

Computation

View full text Add to dashboard Cite

Abstract:Streetscapes have presented a long-standing interest in many fields. Recently, there has been a resurgence of attention on streetscape issues, catalyzed in large part by computing. Because of computing, there is more understanding, vistas, data, and analysis of and on streetscape phenomena than ever before. This diversity of lenses trained on streetscapes permits us to address long-standing questions, such as how people use information while mobile, how interactions with people and things occur on streets, how we might safeguard crowds, how we can design services to assist pedestrians, and how we could better support special populations as they traverse cities. Amid each of these avenues of inquiry, computing is facilitating new ways of posing these questions, particularly by expanding the scope of what-if exploration that is possible. With assistance from computing, consideration of streetscapes now reaches across scales, from the neurological interactions that form among place cells in the brain up to informatics that afford real-time views of activity over whole urban spaces. For some streetscape phenomena, computing allows us to build realistic but synthetic facsimiles in computation, which can function as artificial laboratories for testing ideas. In this paper, I review the domain science for studying streetscapes from vantages in physics, urban studies, animation and the visual arts, psychology, biology, and behavioral geography. I also review the computational developments shaping streetscape science, with particular emphasis on modeling and simulation as informed by data acquisition and generation, data models, path-planning heuristics, artificial intelligence for navigation and way-finding, timing, synthetic vision, steering routines, kinematics, and geometrical treatment of collision detection and avoidance. I also discuss the implications that the advances in computing streetscapes might have on emerging developments in cyber-physical systems and new developments in urban computing and mobile computing.

show abstract

“…Sprague and Ballard [5] developed a reward-based perceptual coordination mechanism for a simulated humanagent. The agent performs a set of behaviours concurrently (where each behaviour has a separate goal), by sharing the set of actions amongst them.…”

Section: B Related Workmentioning

confidence: 99%

Where do i look now? Gaze allocation during visually guided manipulation

Nuñez-Varela

Ravindran

Wyatt

2012

2012 IEEE International Conference on Robotics and Automation

View full text Add to dashboard Cite

Abstract-In this work we present principled methods for the coordination of a robot's oculomotor system with the rest of its body motor systems. The problem is to decide which physical actions to perform next and where the robot's gaze should be directed in order to gain information that is relevant to the success of its physical actions. Previous work on this problem has shown that a reward-based coordination mechanism provides an efficient solution. However, that approach does not allow the robot to move its gaze to different parts of the scene, it considers the robot to have only one motor system, and assumes that the actions have the same duration. The main contributions of our work are to extend that previous reward-based approach by making decisions about where to fixate the robot's gaze, handling multiple motor systems, and handling actions of variable duration. We compare our approach against two common baselines: random and round robin gaze allocation. We show how our method provides a more effective strategy to allocate gaze where it is needed the most.

show abstract

Modeling embodied visual behaviors

Cited by 92 publications

References 39 publications

Production and perception of speaker-specific phonetic detail at word boundaries

Production and perception of speaker-specific phonetic detail at word boundaries

Computational Streetscapes

Where do i look now? Gaze allocation during visually guided manipulation

Contact Info

Product

Resources

About