Published by the IEEE CS n 1536-1268/09/$25.00 © 2009 IEEE C r o s s -r e a l i t y e n v i r o n m e n t s A t the University of South Australia, we've been developing and evaluating technologies to support through-walls collaboration, in which users in an intelligent meeting room can work in real time with field operatives to view and manipulate data. The users in the field have first-hand knowledge of the current problem, whereas the indoor users have access to reference materials, a global picture, and more advanced technology-putting the two together in near real time should immensely improve collaboration between all parties. We use augmented reality (AR), the registration of projected computer-generated images over a user's view of the physical world, as a core technology to convey information (see Figure 1). With this extra information, users can enhance or augment the physical world beyond their normal experience.Spatially located information relative to a user's context or situation can improve their understanding of the world at hand. The goal of this project is to bring collaboration tools into the hands of people working under very demanding conditions. These tools will provide a much better understanding of the complex circumstances that require people both in a control center and in the field.
Disaster relief scenarios?Imagine a cyclone inflicts extensive damage on Queensland's coast. Two immediate actions take place: first responders deploy to the affected areas and set up a command-and-control center, with people in the field providing information to the center. Control center personnel will use this data to direct resources to the appropriate places.If the field operatives come equipped with AR wearable computer technology, they can more accurately provide their commanders a picture of the affected area's current state. AR wearable computer technology can provide digital images, videos, and voice information that are geospatially mapped to the recording point, all of which will give control center personnel better situational awareness. Using mobile AR systems, the field operatives can define annotated regions on the ground, denoting dangerous areas, completed searches, and areas that require immediate attention. The field operatives can also quickly edit 3D representations of buildings to show which portions have been damaged. Control center personnel can then direct field operatives to investigate particular areas by marking a digital 3D map that reflects the physical world viewed by the user in the field through AR technology.As another example, suppose an expert needs to shut down a chemical plant in reaction to an emergency and can't get there in time. To walk a field operative through the procedure, the video camera mounted on his helmet will let the control center-based expert see what the field operative sees. The expert can then speak and provide diagrams, images, and highlight regions of importance over the field operative's view. If he or she sees 12 levers, the expert merely circles ...