Poaceae represent the most important group of crops susceptible to abiotic stress. This large family of monocotyledonous plants, commonly known as grasses, counts several important cultivated species, namely wheat (Triticum aestivum), rice (Oryza sativa), maize (Zea mays), and barley (Hordeum vulgare). These crops, notably, show different behaviors under abiotic stress conditions: wheat and rice are considered sensitive, showing serious yield reduction upon water scarcity and soil salinity, while barley presents a natural drought and salt tolerance. During the green revolution (1940–1960), cereal breeding was very successful in developing high-yield crops varieties; however, these cultivars were maximized for highest yield under optimal conditions, and did not present suitable traits for tolerance under unfavorable conditions. The improvement of crop abiotic stress tolerance requires a deep knowledge of the phenomena underlying tolerance, to devise novel approaches and decipher the key components of agricultural production systems. Approaches to improve food production combining both enhanced water use efficiency (WUE) and acceptable yields are critical to create a sustainable agriculture in the future. This paper analyzes the latest results on abiotic stress tolerance in Poaceae. In particular, the focus will be directed toward various aspects of water deprivation and salinity response efficiency in Poaceae. Aspects related to cell wall metabolism will be covered, given the importance of the plant cell wall in sensing environmental constraints and in mediating a response; the role of silicon (Si), an important element for monocots' normal growth and development, will also be discussed, since it activates a broad-spectrum response to different exogenous stresses. Perspectives valorizing studies on landraces conclude the survey, as they help identify key traits for breeding purposes.