User reliance on real-time applications is continuously increasing as the use of smartphone devices has tremendously increased in day to day life within the past few years. Smartphone devices computation power has significantly increased as well, however, there are still some scalability, performance challenges and some complications with real-time application such as limited computation capabilities and battery life of mobile devices. In this paper, we propose a cloud-based object recognition through task offloading to a high-speed server. We explore this design extensively and demonstrate a real-time solution for object recognition framework on mobile devices using a Convolution neural network (CNN) leveraging the ImageNet dataset and by optimizing the offloading process to minimize the time and energy needed. This framework use the emerging the Android operating system as a platform to connect with an object recognition server where the CNN deep learning resides and process received images. Using this method will overcome the design limited capacity of mobile devices since object recognition algorithms require high-speed calculations.