The Jerusalem artichoke is a perennial plant that belongs to the sunflower family. As a non-grain crop, Jerusalem artichoke possesses a number of desirable characteristics that make it a valuable feedstock for biorefinery, such as inulin content, rapid growth, strong adaptability, and high yields. This review provides a comprehensive introduction to renewable Jerusalem artichoke-based biomass resources and recent advances in bio-based product conversion. Furthermore, we discuss the latest in the development of inulinase-producing microorganisms and enhanced inulin hydrolysis capacity of microbes by genetic engineering, which lead to a more cost-effective Jerusalem artichoke biorefinery. The review is aimed at promoting Jerusalem artichoke industry and new prospects for higher value-added production.