Comprehensive genomic profiling has an emerging role in cancer therapeutics. As treatment options remain needed for advanced cancers, patients are relying increasingly more on tumor genomic alterations as possible targets for cancer treatment. Frequent tumor fibroblast growth factor receptor (FGFR) alterations are seen in many cancers, and include genetic amplifications, mutations, rearrangements and fusions. FGFR inhibitors target these receptor alterations and show promise as a drug class. Currently 2 medications are currently FDA approved: erdafitinib and pemigatinib. Through the FDA accelerated approval process, erdafitinib is indicated to treat metastatic urothelial carcinoma with FGFR2 and FGFR3 alterations, whereas pemigatinib is indicated to treat unresectable cholangiocarcinoma with FGFR2 alterations. Despite growing knowledge about such advanced cancers, treatment is usually palliative. With multiple FGFR inhibitors in the pipeline, further FDA approvals are possible, and it is likely their role in therapy will extend to other cancer types. This review outlines erdafitinib, pemigatinib, their role in cancer, as well as outlining the possible future use of other FGFR inhibitors in urothelial carcinoma, cholangiocarcinoma, and other malignancies.