A novel pan‐tilt user‐interface (UI) robot system uses a scanning MEMS projection head in combination with a depth sensor. The UI robot system can detect and track a hand, then project a virtual‐remote‐controller (VRC) image onto the top of a palm or table.