One of the fundamental challenges faced by an inexperienced user in portable unmanned aerial vehicle (UAV) such as quadcopters is flight control, often leading to crashes. Addressing this challenge, and leveraging upon the technological advancement in perceptual computing and computer vision, this research presents a modular system that allows for hand gesture based flight control of UAV, alongside a transport mechanism for portable objects. In addition to ascertain smooth flight control by avoiding obstacles in navigation path, real-time video feedback is relayed from the UAV to user, thus allowing him/her to take appropriate actions. This paper presents the design implementation by discussing the various sub-systems involved, inter system communication, and field tests to ascertain operation. As presented from testing results, the proposed system provides efficient communication between the subsystems for smooth flight control, while allowing for safe transport of portable objects.