The authors have been developing a smartphone app to support for visually impaired walking when they go out. This app has functions to detect obstacles from RGB camera image that hinder walking and to alert dangerous situation to the visually impaired. It uses CNN, a kind of deep learning technique, to detect obstacles, but it can detect only one obstacle from the image. Now we are trying to implement a multiple obstacles detect function into this app. This paper deals with a method to obtain the distance to the obstacles detected from the multiple obstacles detection.