Real 3D interaction behind mobile phones for augmented environments

Kondori, Farid Abedan; Yousefi, Shahrouz; Li, Haibo

doi:10.1109/icme.2011.6012155

Cited by 4 publications

(10 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, the main idea is to use physical space for 3D manipulation on 2D devices. By using the six degrees of freedom motion analysis, problems of 2D interaction will be handled in most cases [3,4,7,9]. The important feature of the proposed system is bare-hand, marker-less gesture detection and tracking from 2D video input.…”

Section: Vision-based Motion Tracking In 3d Spacementioning

confidence: 99%

“…In order to support the main concept of this work, we have focused on two major problems: first, interaction with mobile devices based on motion analysis in 3D space [3,4,7,9], and second, 3D visualization on ordinary 2D displays [8,10,11]. Our interactive systems are based on detection, tracking, and analysis of the human's 3D motion from the visual input.…”

Section: Enabling Media Technologiesmentioning

confidence: 99%

“…[1], present novel techniques for 3D reconstruction and exploration of a scene by arrangement and visualization of the massive collection of photos on the map. Since the available photo browsing systems pose challenging issues in interaction and visualization, by introducing the 3D interactive photo browser we aim to: 1-Turn the interaction environment from 2D touchscreen to 3D space [3,9]. 2-Organize the sea of images on a 3D map.…”

Section: Design Of the 3d Photo Browsermentioning

confidence: 99%

See 2 more Smart Citations

3D photo browsing for future mobile devices

Yousefi

2012

Proceedings of the 20th ACM International Conference on Multimedia

Self Cite

View full text Add to dashboard Cite

By introducing the interactive 3D photo/video browsing and exploration system, we propose novel approaches for handling the limitations of the current 2D mobile technology from two aspects: interaction design and visualization. Our contributions feature an effective interaction that happens in the 3D space behind the mobile device's camera. 3D motion analysis of the user's gesture captured by the device's camera is performed to facilitate the interaction between users and multimedia collections in various applications. This approach will solve a wide range of problems with the current input facilities such as miniature keyboards, tiny joysticks and 2D touch screens. The suggested interactive technology enables users to control, manipulate, organize, and re-arrange their photo/video collections in 3D space using bare-hand, marker-less gesture. Moreover, with the proposed techniques we aim to visualize the 2D photo collection, in 3D, on normal 2D displays. This process is automatically done by retrieving the 3D structure from single images, finding the stereo/multiple views of a scene or using the geo-tagged meta-data from huge photo collections. By using the design and implementation of the contributions of this work, we aim to achieve the following goals: Solving the limitations of the current 2D interaction facilities by 3D gestural interaction; Increasing the usability of the multimedia applications on mobile devices; Enhancing the quality of user experience with the digital collections.Mobile devices have been found to be extremely useful in the modern world. In addition to the ordinary tasks, they are being used by people for various purposes in scientific areas, entertainment, education, medical applications, gaming, etc. New mobile devices feature advanced capabilities in computing, communication, data storage and visualization. Furthermore, embedded sensors such as high quality cameras, accelerometer, gyro, proximity, compass and GPS have turned them into powerful portable devices. However, the rapid growth in the market of mobile devices reveals that in the near future we will be faced with a substantial amount of digital data such as photos, videos and the corresponding meta-data obtained by other sensors. Here, the major issue is how to organize this enormous amount of data in an efficient and effective way to be accessible, searchable and useful. How should users interact with the sea of images and videos and how should the visualization happen? Currently, people interact with their mobile devices through the touchscreen displays. The latest and probably the best available technology, such as what we experience with the iPhone or iPad, offers single or multi-touch gestural interaction on 2D touchscreens. This approach is designed to give users a more natural feeling when they are operating their mobile devices. Although this technology has solved many limitations in human mobile device interaction, the recent trend in the digital world reveals that people always prefer to have natural experiences with ...

show abstract

Section: Vision-based Motion Tracking In 3d Spacementioning

confidence: 99%

Section: Enabling Media Technologiesmentioning

confidence: 99%

Section: Design Of the 3d Photo Browsermentioning

confidence: 99%

See 1 more Smart Citation

3D photo browsing for future mobile devices

Yousefi

2012

Proceedings of the 20th ACM International Conference on Multimedia

Self Cite

View full text Add to dashboard Cite

show abstract

“…In this experiment, grab gesture is used for object manipulation. The grab gesture is one of the most natural and frequently used gestures to manipulate objects in 3D space, and has been used to perform gesture-based interaction for mobile applications (Kondori et al, 2011a) (Yousefi et al, 2013). As shown in Fig.…”

Section: Gestural Interaction For Mobile Applicationsmentioning

confidence: 99%

Direct hand pose estimation for immersive gestural interaction

Kondori

Yousefi

Kouma

et al. 2015

Pattern Recognition Letters

Self Cite

View full text Add to dashboard Cite

“…Kondori proposed an idea similar to ours in the sense that the system allows the user to manipulate his/her hand behind the mobile phone for character pose authoring in AR environments [9]. While the pose estimation method based on rotational symmetries enables the accurate extraction of relative rotation and translation of the hand, motion in the depth direction was not considered.…”

Section: Introductionmentioning

confidence: 99%

Authoring Animations of Virtual Objects in Augmented Reality-Based 3D Space

Eitsuka

Hirakawa

2013

2013 Second IIAI International Conference on Advanced Applied Informatics

View full text Add to dashboard Cite

Although three-dimensional computer graphics (3DCG) is a powerful means to express ideas in a lively manner, it is difficult and time-consuming to create 3DCG content. One of the reasons is the gap between the two-dimensional (2D) manipulation space and the 3D modeling space. Meanwhile, the development of augmented reality (AR) applications has grown, with the mobile phone-based approach showing much promise. In this paper, we present a system for authoring animations of virtual objects in AR-based 3D space. The manipulation of the virtual character being superimposed on a marker is carried out by a finger in front of a camera on the backside of the mobile phone. This approach provides the user with the feeling of direct manipulation within the augmented 3D space. User testing has shown the effectiveness of our ARbased 3D animation authoring method, although we need to conduct further studies on the system implementation, including improvements to system response and finger motion detection in the depth direction.

show abstract

Real 3D interaction behind mobile phones for augmented environments

Cited by 4 publications

References 8 publications

3D photo browsing for future mobile devices

3D photo browsing for future mobile devices

Direct hand pose estimation for immersive gestural interaction

Authoring Animations of Virtual Objects in Augmented Reality-Based 3D Space

Contact Info

Product

Resources

About