Real-Time Pen Input System for Writing Utilizing Stereo Vision

Abstract

A system that captures handwritten words on a piece of paper utilizing two cameras which observe and track a pen's tip lateral movement is presented. The system tracks the pen's tip in real-time based on the two images vision using colored markers. The stereo camera is calibrated for accurate threedimensional (3D) positioning of the pen's tip. Pen's tip 3D coordinates are then being used to reconstruct the handwritten input into computer image. Experimental results show that the system can detect and track handwriting within 1mm accuracy on the y-axis and 7 mm accuracy on the x-axis (depth).

Predicting Group Work Performance from Physical Handwriting Features in a Smart English Classroom

“…From the early 80s, research aimed to provide user-friendly input solutions for handwriting and drawing recognition, which do not rely on a sensor-based tablet, has been developed [17]. In this regard, previous work on the estimation of students' attention has shown that Kinect features, such as handwriting signals or the RightEye-Closed indicator, clearly correlate to the attention level [41].…”

GPU Accelerated Stereo Vision System to Capture Handwriting Information

“…Stereo vision systems which capture handwriting has been previously investigated such as systems by M. Moriya et al [1], Dave Jay et al [2]and Fadi Imad et al. [3] Yet these systems were challenged by the inability of CPU to process stereo HD frames at a high frame rate for accurate real-time tracking. This can be visible in the data points being sparse thus the generated writing becomes unclear.…”