As global energy regulations are strengthened, improving energy efficiency while maintaining performance of electronic appliances is becoming more important. Especially in air conditioning, energy efficiency can be maximized by adaptively controlling the airflow based on detected human locations; however, several limitations such as detection areas, the installation environment, and sensor quantity and real-time performance which come from the constraints in the embedded system make it a challenging problem. In this study, by using a low resolution cost effective vision sensor, the environmental information of living spaces and the real-time locations of humans are learned through a deep learning algorithm to identify the living area from the entire indoor space. Based on this information, we improve the performance and the energy efficiency of air conditioner by smartly controlling the airflow on the identified living area. In experiments, our deep learning based spatial classification algorithm shows error less than ± 5 ° . In addition, the target temperature can be reached 19.8% faster and the power consumption can be saved up to 20.5% by the time the target temperature is achieved.