Using Sensor Inputs to Affect Virtual and Real Environments

Coleman, Beth

doi:10.1109/mprv.2009.60

Cited by 31 publications

(14 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Recent efforts to approach this problem theorized cross-reality environments, where ubiquitous sensor networks would interact with pervasively shared virtual worlds [6], [7]. These efforts focused on the point of exchange between physical and virtual environments, and hinged on the concept of massively multiplayer virtual worlds, like Second Life.…”

Section: Related Workmentioning

confidence: 99%

DoppelLab: Tools for exploring and harnessing multimodal sensor network data

Dublon

Pardue

Mayton

et al. 2011

2011 IEEE SENSORS Proceedings

View full text Add to dashboard Cite

show abstract

Section: Related Workmentioning

confidence: 99%

DoppelLab: Tools for exploring and harnessing multimodal sensor network data

Dublon

Pardue

Mayton

et al. 2011

2011 IEEE SENSORS Proceedings

View full text Add to dashboard Cite

show abstract

“…The Unity game engine for example has been used for visualization of building sensors and controls [Furst et al 2014]. Prior work on Cross_Reality, or 'x-reality', [Dublon & Paradiso 2014;Lifton et al 2009;Coleman 2009] and Blended Reality [Pena-Rios et al2014] for example, has demonstrated online, interactive 3D visualization of real buildings including thermostats and optical and infrared cameras. One notable example is the MIT Media Lab's DoppelLab [Dublon et al 2011] project.…”

Section: Sensor Systems and Smart Buildingsmentioning

confidence: 99%

Fusality

Polys

Knapp

Bock

et al. 2015

Proceedings of the 20th International Conference on 3D Web Technology

View full text Add to dashboard Cite

As computing and displays become more pervasive and wireless networks are increasing the connections between people and things, humans inhabit both digital and physical realities. In this paper we describe our prototype Mirror Worlds framework, which is designed to fuse these realities: Fusality. Our goal for Fusality is to support innovative research and exhibitions in presence and collaboration, sensors and smart buildings and mixed reality in applications from engineering to art. By fusing live sensor data from the building and its occupants with online 3D environments and participants, we demonstrate a firstprinciples approach to online multi-entity messaging communication. This demonstration shows how the variety of Mirror Worlds clients can be supported through the open Web architecture. These technologies enable new possibilities for collaboration as well as directions for interoperability. Finally, we layout out our research agenda for the framework and discuss its transformative applications.

show abstract

“…The concept of XR is more extensive than virtual reality (VR), augmented reality (AR) and mixed reality (MR). XR technology mixes the perceived reality as MR does, but it is also capable of directly modifying real components [8,9]. This technology enables intelligence on the shop floor, where data sensing is taking place.…”

Section: Introductionmentioning

confidence: 99%

X-Reality System Architecture for Industry 4.0 Processes

Simões

Amicis

Barandiarán

et al. 2018

MTI

View full text Add to dashboard Cite

Information visualization has been widely adopted to represent and visualize data patterns as it offers users fast access to data facts and can highlight specific points beyond plain figures and words. As data comes from multiple sources, in all types of formats, and in unprecedented volumes, the need intensifies for more powerful and effective data visualization tools. In the manufacturing industry, immersive technology can enhance the way users artificially perceive and interact with data linked to the shop floor. However, showcases of prototypes of such technology have shown limited results. The low level of digitalization, the complexity of the required infrastructure, the lack of knowledge about Augmented Reality (AR), and the calibration processes that are required whenever the shop floor configuration changes hinders the adoption of the technology. In this paper, we investigate the design of middleware that can automate the configuration of X-Reality (XR) systems and create tangible in-site visualizations and interactions with industrial assets. The main contribution of this paper is a middleware architecture that enables communication and interaction across different technologies without manual configuration or calibration. This has the potential to turn shop floors into seamless interaction spaces that empower users with pervasive forms of data sharing, analysis and presentation that are not restricted to a specific hardware configuration. The novelty of our work is due to its autonomous approach for finding and communicating calibrations and data format transformations between devices, which does not require user intervention. Our prototype middleware has been validated with a test case in a controlled digital-physical scenario composed of a robot and industrial equipment.

show abstract

Using Sensor Inputs to Affect Virtual and Real Environments

Cited by 31 publications

References 9 publications

DoppelLab: Tools for exploring and harnessing multimodal sensor network data

DoppelLab: Tools for exploring and harnessing multimodal sensor network data

Fusality

X-Reality System Architecture for Industry 4.0 Processes

Contact Info

Product

Resources

About