Grass inflorescences produce grains, which are directly connected to our food. In grass crops, yields are mainly affected by grain number and weight; thus, understanding inflorescence shape is crucially important for cereal crop breeding. In the last two decades, several key genes controlling inflorescence shape have been elucidated, thanks to the availability of rich genetic resources and powerful genomics tools. In this review, we focus on the inflorescence architecture of Triticeae species, including the major cereal crops wheat and barley. We summarize recent advances in our understanding of the genetic basis of spike branching, and spikelet and floret development in the Triticeae. Considering our changing climate and its impacts on cereal crop yields, we also discuss the future orientation of research.