Large amounts of waste rock are produced during mining operations and often disposed of in large piles. Particle size segregation usually occurs during waste rock disposal, which can lead to high variations of particle size distribution (PSD) along the pile slope, increasing the risk for hydrogeotechnical instabilities. Determining segregation in situ is, therefore, critical to implement control measures and optimize deposition plans. However, characterizing PSD at field scale remains challenging because of the large dimensions of the pile, the instability of the blocks and the steep slopes. In this study, images, covering a 1400 m wide and 10 m high section of a waste rock pile, were taken and analyzed using image analysis to characterize segregation along the slope of the pile. PSD curves in different sections along the slope were determined and the segregation degree and characteristic diameters (e.g., D10, D50, D80,D95) were quantitatively compared. Results allowed to quantify segregation along the vertical direction of the pile, showing that segregation degree increased from − 0.77 ± 0.39 in the top (finer zone) to + 0.4 ± 0.14 in the bottom (coarser zone). Significant lateral heterogeneity was also observed with maximum diameters varying between 80 and 180 cm in the bottom section. Such segregation and lateral heterogeneity could induce significant variations of waste rock properties, with, for example, hydraulic conductivities varying by more than 2 orders of magnitude within the pile.