Bare hand natural interaction with augmented objects

Figueiredo, Lucas; Anjos, Ronaldo Dos; Lindoso, Jorge Eduardo Falcao; Neto, Edvar Vilar; Roberto, Rafael; Silva, Manoela; Teichrieb, Verônica

doi:10.1109/ismar.2013.6671836

Cited by 8 publications

(5 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Teachers could create learning strategies to develop skills, such as: attention and concentration; associating words and symbols with objects; sight-word recognition; and phonics. Teachers could also help introduce and develop new vocabulary; perception and discrimination; identifying similarity and differences; classifying objects; seeing order or relationships; developing concepts like space, size, and shape; and exploring, manipulating, and using creative imagination [ 34 , 47 ].…”

Section: Discussionmentioning

confidence: 99%

Creating TUIs Using RFID Sensors—A Case Study Based on the Literacy Process of Children with Down Syndrome

Jadán-Guerrero

Guerrero

López

et al. 2015

Sensors

View full text Add to dashboard Cite

Teaching children with intellectual disabilities is a big challenge for most parents and educators. Special education teachers use learning strategies to develop and enhance motivation for complex learning tasks. Literacy acquisition is an essential and life-long skill for a child with intellectual disabilities. In this context, technology can support specific strategies that will help children learn to read. This paper introduces a Tangible User Interface (TUI) system based on Radio Frequency Identification (RFID) technology to support literacy for children with Down syndrome. Our proposed system focuses on the integration of RFID tags in 3D printed objects and low cost toys. The paper describes the experience of using some materials covering the tags and the different problems related to the material and distance of radio wave propagation. The results of a preliminary evaluation in a special education institution showed that the system helps to improve the interaction between teachers and children. The use of a TUI seems to give a physical sensory experience to develop literacy skills in children with Down syndrome.

show abstract

Section: Discussionmentioning

confidence: 99%

Creating TUIs Using RFID Sensors—A Case Study Based on the Literacy Process of Children with Down Syndrome

Jadán-Guerrero

Guerrero

López

et al. 2015

Sensors

View full text Add to dashboard Cite

show abstract

“…Each assembly operation in ARAAT contains several actions in a standard order, concluded as follows (refer to Figure 9): Inserting: grasping (the workpieces) → moving → rotating/scaling →releasing (the workpieces), that is, Inserting = grasping ⊕ moving ⊕ rotating/scaling ⊕ releasing (18) Fastening: grasping (the wrench) → moving → moving around →releasing (the wrench), that is, Fastening = grasping ⊕ moving ⊕ moving around ⊕ releasing (19) Screwing: grasping (the screwdriver) → moving → rotating → releasing (the screwdriver), that is Screwing = grasping ⊕ moving ⊕ rotating ⊕ releasing (20) We can evaluate the performance of actions and operations by recognizing the gestures and predicting the action order which the trainee is performing. Furthermore, when the trainee carries out an operation in ARAAT, the virtual object needs to give the corresponding reaction.…”

Section: Action and Operation Predictionmentioning

confidence: 99%

“…The interface provided a natural interaction benefit from the hand detection, palm pose estimation, and finger gesture recognition. Figueiredo et al [20] evaluated interactions on tabletop applications with virtual objects by hand tracking and gesture recognition. During the interaction, they applied the "grasping" and "releasing" gestures and used the Kinect device for hand tracking.…”

Section: Introductionmentioning

confidence: 99%

Augmented Reality Assisted Assembly Training Oriented Dynamic Gesture Recognition and Prediction

2021

View full text Add to dashboard Cite

Augmented reality assisted assembly training (ARAAT) is an effective and affordable technique for labor training in the automobile and electronic industry. In general, most tasks of ARAAT are conducted by real-time hand operations. In this paper, we propose an algorithm of dynamic gesture recognition and prediction that aims to evaluate the standard and achievement of the hand operations for a given task in ARAAT. We consider that the given task can be decomposed into a series of hand operations and furthermore each hand operation into several continuous actions. Then, each action is related with a standard gesture based on the practical assembly task such that the standard and achievement of the actions included in the operations can be identified and predicted by the sequences of gestures instead of the performance throughout the whole task. Based on the practical industrial assembly, we specified five typical tasks, three typical operations, and six standard actions. We used Zernike moments combined histogram of oriented gradient and linear interpolation motion trajectories to represent 2D static and 3D dynamic features of standard gestures, respectively, and chose the directional pulse-coupled neural network as the classifier to recognize the gestures. In addition, we defined an action unit to reduce the dimensions of features and computational cost. During gesture recognition, we optimized the gesture boundaries iteratively by calculating the score probability density distribution to reduce interferences of invalid gestures and improve precision. The proposed algorithm was evaluated on four datasets and proved to increase recognition accuracy and reduce the computational cost from the experimental results.

show abstract

“…R tracking of the game components, we us techniques in the project: Inertial markers [17 and free body [18] for natural user interaction 1) Vehicle with marker As mentioned above, a marker was attache which identifies the position and orientation o the test track. Stressing that the capture of the a webcam, one of the most important aspect tracking is the identification marker on t necessary to realize a processing in the image camera.…”

Section: B Trackingmentioning

confidence: 99%

KinardCar: Auxiliary Game in Formation of Young Drivers, Utilizing Kinect and Arduino Integration

Vaz

Silva

Santos

2014

2014 XVI Symposium on Virtual and Augmented Reality

View full text Add to dashboard Cite

Applications of Virtual and Augmented Reality with a focus in the welfare of society are becoming recurrent and there are many advantages on doing this. An important concern is the good formation of citizens for life in society, especially when such improvement can help mitigate accidents, and consequently save lives. Therefore, the aim of this article is to describe the development of a system to support training of young drivers to make the learning of the traffic rules more friendly and exciting. To achieve this, we developed a game called KinardCar, where we use the Microsoft Kinect sensor integrated with an Arduino microcontroller. The environment consists of a small remotely operated vehicle by the user's movements, which are tracked by the sensor. In the vehicle, there is a marker attached which identifies the position and orientation of the car in the virtual test track, and thus there is an interaction between multiple virtual vehicles and the real one. Considering these results, we can conclude that the game goes beyond its educational nature, as this also provides a new perspective on life in society.

show abstract

Bare hand natural interaction with augmented objects

Cited by 8 publications

References 14 publications

Creating TUIs Using RFID Sensors—A Case Study Based on the Literacy Process of Children with Down Syndrome

Creating TUIs Using RFID Sensors—A Case Study Based on the Literacy Process of Children with Down Syndrome

Augmented Reality Assisted Assembly Training Oriented Dynamic Gesture Recognition and Prediction

KinardCar: Auxiliary Game in Formation of Young Drivers, Utilizing Kinect and Arduino Integration

Contact Info

Product

Resources

About