Agricultural systems in the EU have become more vulnerable and less sustainable due to an overreliance on herbicides and the tremendous increase in herbicide-resistant weeds. The EU Green Deal aims to reduce the use and risk of chemical pesticides by 50% by 2030, although it is still undefined whether a reduction in herbicide use could be feasible in different farming systems and situations. This review aims to provide a holistic framework for sustainable crop and weed management to reduce the herbicide input and ensure crop protection. Current and future dilemmas and policies that need to be handled to ensure the agroecological transition of the EU’s agricultural systems are also discussed. The integration of non-chemical alternatives for integrated weed management is feasible and includes novel cultivation techniques (e.g., intercropping, false seedbed, reduced tillage, crop rotation and diversification, adjustments on sowing densities and dates), non-chemical tools (e.g., flaming, seed coating, beneficial microorganisms, mechanical weeding, biocontrol agents and natural herbicides), competitive plant material (hybrids and cultivars, cover crops, service crops), and new technologies and precision agriculture tools (e.g., Decision Support Systems, robots, remote sensing, UAVs, omics and nanotechnology). A special focus should be appointed to agroecology and biodiversity conservation.