With the recent technological developments, auxiliary smart systems have started to be used in many issues that are important in people's lives. One of these issues is that parents ensure the safety of their toddlers. Toddlers tend to reach objects that may be dangerous to them at home because of their natural curiosity. For this reason, parents' inability to pay enough attention to their toddlers while doing their daily work can cause irreversible accidents. On account of all these situations, it is clear that there is a need to develop a toddler tracking system. In this article, a toddler tracking system based on deep neural network has been proposed. For experimental studies, videos in 10 different scenarios were collected from different toddlers aged between 1.5 and 4.The system includes FaceNet for face recognition and YOLOv3 for object tracking.First, desired toddler's face is recognized, and the system tracks the movements of that toddler. If the toddler gets close to dangerous objects in the house, the parents will be warned by the system. As a result of experimental studies, the system accuracy rate was increased from 80.7% to 93.3% with the changes in the previous system.