Assessment and rehabilitation of patients with unilateral visual neglect has been one of the fields that require assistive technology. Paper-and-pencil tests, including the LBT (Line Bisection Test), have been one of the most commonly used visual neglect assessment methods used in a clinical setting. The key motivation of this study was to establish a computer-based real-time assessment system for the hemi-neglect patients without altering the conventional paper-and-pencil based user tools. A digital penbased assessment and rehabilitation system, the ePen System, could eliminate the manual assessment time while maintaining measurement accuracy. As a result, the proposed system may assist rehabilitation specialists to assess and diagnose patients with unilateral visual neglect. This system can be applied to a range assessment and rehabilitation modalities based on a pen and paper. It can also be applied to various patients such as those with Parkinson's disease, stroke sufferers, or those who have experienced different forms of brain lesions.