Root distribution in the soil determines plants’ nutrient and water uptake capacity. Therefore, root distribution is one of the most important factors in crop production. The trench profile method is used to observe the root distribution underground by making a rectangular hole close to the crop, providing informative images of the root distribution compared to other root phenotyping methods. However, much effort is required to segment the root area for quantification. In this study, we present a promising approach employing a convolutional neural network for root segmentation in trench profile images. We defined two parameters, Depth50 and Width50, representing the vertical and horizontal centroid of root distribution, respectively. Quantified parameters for root distribution in rice (Oryza sativa L.) predicted by the trained model were highly correlated with parameters calculated by manual tracing. These results indicated that this approach is useful for rapid quantification of the root distribution from the trench profile images. Using the trained model, we quantified the root distribution parameters among 60 rice accessions, revealing the phenotypic diversity of root distributions. We conclude that employing the trench profile method and a convolutional neural network is reliable for root phenotyping and it will furthermore facilitate the study of crop roots in the field.