Rice (Oryza sativa L.) seed serves as a major food source for over half of the global population. Though it has been long recognized that phosphorylation plays an essential role in rice seed development, the phosphorylation events and dynamics in this process remain largely unknown so far. Here, we report the first large scale identification of rice seed phosphoproteins and phosphosites by using a quantitative phosphoproteomic approach. Thorough proteomic studies in pistils and seeds at 3, 7 days after pollination resulted in the successful identification of 3885, 4313 and 4135 phosphopeptides respectively. A total of 2487 proteins were differentially phosphorylated among the three stages, including Kip related protein 1, Rice basic leucine zipper factor 1, Rice prolamin box binding factor and numerous other master regulators of rice seed development. Moreover, differentially phosphorylated proteins may be extensively involved in the biosynthesis and signaling pathways of phytohormones such as auxin, gibberellin, abscisic acid and brassinosteroid. Our results strongly indicated that protein phosphorylation is a key mechanism regulating cell proliferation and enlargement, phytohormone biosynthesis and signaling, grain filling and grain quality during rice seed development. Overall, the current study enhanced our understanding of the rice phosphoproteome and shed novel insight into the regulatory mechanism of rice seed development.