According to the report by the World Health Organization, depression, as the leading disabling disease in the world, has aroused widespread social concern. However, the shortage of medical and nursing staff in psychiatry conflicts with the rising nursing needs of depressed patients. First, depression is a chronic mental illness, its cure course is relatively long, and stable drug treatment and healthy living habits are keys to the curing process. Second, the disease feature where depression patients have stronger emotional needs and more sensitive mental states is ignored in existing health monitoring systems. In consideration of the above two aspects, a health management assistant is proposed in this paper, called MEMO box system, that focuses on emotion and with smart medicine box as carrier. Specifically, the MEMO box system is composed of electronic medicine box and smart applications on mobile device, and electronic medicine box can collect the multi-mode data of patients, including their medication behaviors, daily activities, physical exercise data, and so on, which provide data basis for the health assistant. Emotion recognition and exercise recommend algorithms are deployed in the edge cloud, which can quickly respond to health service requests from patients. With the cooperation of hardware and software in this system, patients are urged to take medicines on time to effectively control their conditions, and emotion cognition and exercise adjustment recommendation can be realized for depression patients, thus providing patients with empathic sports recommendations.