Citrus fruits are mainly consumed as fresh fruit and processed juice products. They serve as nutritional and a tasty diet in our daily life. However, the formidable bitterness and delayed bitterness significantly impact the citrus industry attributable to the two major bitter compounds naringin and limonin. The extremely sour and acidic also negatively affects the sensory quality of citrus products. Citrus breeding programs have developed different strategies to improve citrus quality and a wealth of studies have aimed to uncover the genetic and biochemical basis of citrus flavor. In this minireview, we outline the major genes characterized to be involved in pathways shaping the sweet, bitter, or sour taste in citrus, and discuss briefly about the possible approaches to modify citrus taste by genetic engineering.