Inter-screen interaction for session recognition and transfer based on cloud centric media network

Abstract

Recently, there is a growing trend that people tend to consume media over multi-screens simultaneously. This paper proposes an efficient and convenient inter-screen interaction approach based on our cloud centric media network, where all the ongoing sessions on the client side are always synchronized with the media cloud. This approach realizes the session recognition and transfer over different devices in a three-step manner. First, the users are required to use the mobile device camera to scan the main screen. Second, after the screen edge detection and image correction, users are allowed to choose one or more ongoing session on the corrected image via touch screen to request the transfer. Finally, the selected sessions are identified by the cloud, and those sessions are delivered to the mobile devices to complete the session transfer. The algorithms and strategies involved are discussed in detail. We also implement a testbed on top of a private cloud at NTU. The results prove our proposed method is robust and easy to use.