Human Machine Interface HMI using Kinect sensor to control a SCARA Robot

Pillajo, Carlos; Sierra, Javier E.

doi:10.1109/colcomcon.2013.6564822

Cited by 14 publications

(6 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…However, the ever growing popularity and adoption of RGB-D sensors, especially the Microsoft Kinect sensor, recently motivated its introduction in the development of vision-guided robotic systems. Numerous examples of application for the Kinect technology recently appeared in the literature [17][18][19]. For the development of the system presented here, the extreme acquisition speed of the Kinect technology and its low cost have been major selection criteria for this sensor to be used, given that rapidly acquiring color and 3D data over large volumes is instrumental.…”

Section: Related Workmentioning

confidence: 99%

Surface Following With An Rgb-D Vision-Guided Robotic System For Automated And Rapid Vehicle Inspection

Nakhaeinia

Payeur

Chávez-Aragón

et al. 2016

International Journal on Smart Sensing and Intelligent Systems

View full text Add to dashboard Cite

This paper presents the design and integration of a vision-guided robotic system for automated and rapid vehicle inspection. The main goal of this work is to scan and explore regions of interest over an automotive vehicle while a manipulator's end effector operates in close proximity of the vehicle and safely accommodates its curves and inherent surface obstacles, such as outside mirrors or door handles, in order to perform a series of close inspection tasks. The project is motivated by applications in automated vehicle inspection, cleaning, and security screening. In order to efficiently navigate the robotic manipulator along the vehicle's surface within regions of interest that are selectively identified, an efficient and accurate integration of information from multiple RGB-D sensors and robotic components is proposed. The main components of the proposed approach include: automated vehicle category recognition from visual information; RGB-D sensors calibration; extraction of specific areas to inspect over the vehicle body, and path planning from an efficiently

show abstract

Section: Related Workmentioning

confidence: 99%

Surface Following With An Rgb-D Vision-Guided Robotic System For Automated And Rapid Vehicle Inspection

Nakhaeinia

Payeur

Chávez-Aragón

et al. 2016

International Journal on Smart Sensing and Intelligent Systems

View full text Add to dashboard Cite

show abstract

“…Existen brazos robóticos utilizados en líneas de ensamblaje conocidos como robots SCARA, estos robots generalmente son programados para realizar una tarea repetitiva, pero igual que a un brazo robótico común, se le pueden integrar sensores de movimiento como el utilizado en este proyecto (Kinect) para obtener un sistema embebido en búsqueda de una respuesta en tiempo real [2]. Gracias al relativamente compacto tamaño de estos sensores pueden ser fácilmente empotrados en un dispositivo que pueda moverse, como una de las características buscadas en los robots móviles, es que puedan desplazarse de una manera segura por su ambiente; se puede utilizar un sensor para dotar de "vista" a un robot móvil [3] permitiéndole detectar obstáculos, la autonomía en los robots es otro campo de desarrollo en el que se puede implementar sensores utilizados en este proyecto, dado que este es capaz de crear campos de profundidad gracias a la serie de puntos infrarrojos que proyecta para estimar la proximidad de los objetos, Kinect resulta un aditamento barato y bastante preciso para añadirlo a un robot autónomo [4] .…”

Section: Antecedentesunclassified

Control de seguridad industrial, no invasivo

Quintero-Rosas

Higareda²,

Rodríguez³

2016

idata

View full text Add to dashboard Cite

La industria en la actualidad cuenta con una gran gama de procesos que funcionan con una precisión y exactitud lograda tras años de desarrollo en tecnología, comúnmente los algoritmos que controlan la maquinaria industrial buscan emular la eficacia de la mano de obra humana pero a su vez aumentar la rapidez y exactitud de los procesos, un algoritmo o un robot pese a ser programado y creado en esencia por el ser humano no posee conciencia propia, sus actos están definidos por lineamientos establecidos por el operador, dentro de esto se incluye todo lo relacionado con seguridad, debido a la gran penetración que tienen los equipos automatizados en diferentes campos laborales, principalmente en la asistencia para realizar tareas que resultan de alto riesgo para una persona y requieren de la destreza humana para llevarse a cabo, la integridad de los operadores de este tipo de equipos se considera un punto de mucha importancia a desarrollar. Aplicar técnicas de seguridad en elementos automatizados utilizando sensores de reconocimiento corporal nos acerca un poco más a algo que parece imposible, concientizar a las maquinas.

show abstract

“…Csaba [4] et al made use of the depth-map provided by the Kinect sensor to speed up the calculations for obstacle avoidance of mobile robots. Pillajo [5] presented an alternative of a Human Machine Interface (HMI) using the Kinect sensor to control HMI real-time SCARA robot arm by estimating movement upper extremity of the operator using depth images and assuming a starting position. Machida [6] et al presented a tracking control system of human motion with Kinect set up on a mobile robot, which can obtain the 3D position information of human to control the velocity and posture of the mobile robot directly.…”

Section: Introductionmentioning

confidence: 99%

Indoor environment applications for mobile robots using Kinect2.0

Zhang

et al. 2014

Proceeding of the 11th World Congress on Intelligent Control and Automation

View full text Add to dashboard Cite

The second generation of Kinect sensor is a revolutionary multiple cameras including RGB camera, infrared camera to differentiate depth, infrared camera and audio array. In this paper, we first introduce the differences between the Kinect and Kinect2.0 sensor. Then a system of Kinect2.0 based human interaction system for mobile robot is presented. The function of skeleton tracking of Kinect2.0 is used to identify a specific person in the depth image. Finally, people's heart rate detection method is proposed using RGB camera of Kinect2.0. Preliminary experiments verify that the designed measurement system is effective.

show abstract

Human Machine Interface HMI using Kinect sensor to control a SCARA Robot

Cited by 14 publications

References 8 publications

Surface Following With An Rgb-D Vision-Guided Robotic System For Automated And Rapid Vehicle Inspection

Surface Following With An Rgb-D Vision-Guided Robotic System For Automated And Rapid Vehicle Inspection

Control de seguridad industrial, no invasivo

Indoor environment applications for mobile robots using Kinect2.0

Contact Info

Product

Resources

About