The purpose of this study was to investigate the influence of the addition of inulin (3%, 6% and 9%) to green tea-infused set type yoghurt on its sensory quality and physical properties. Yogurts were made by combining green tea with milk and inulin and inoculated with freeze-dried starter cultures YO-122. Incubation was conducted at 43 °C for approximately 4.5 h until a pH value of 4.5–4.6 was achieved. For the prepared yoghurts, a panel of experts (n = 10) was selected, characterized 35 attributes and conducted a sensory quality assessment of these yoghurts using the Quantitative Descriptive Profile method. Additionally, instrumental analyses such as yield stress, adhesiveness, firmness, physical stability and color parameters were also carried out. The use of green tea infusion increased the perception of green tea flavor, bitterness, astringency, dark color of the yoghurt and the existing whey, which worsened the overall sensory quality of the yoghurt. The addition of inulin (9%) to the green tea yoghurt, increased the perception of sweet, peach flavor and aroma and improved the firmness of the yoghurt while reducing the perception of sour taste, which improved the sensory quality of the yoghurt. Both inulin and green tea affected the physical properties of the yoghurts, causing an increase in the yield stress (43%, and 20%, respectively) and deteriorated the stability of the yoghurts. Green tea affected the color of the yoghurts, causing the lightness to decrease. The L* parameter decreased from 89.80 for the control sample to 84.42 for the green tea infused yoghurt. The use of infused green tea in yoghurt production makes it necessary to use ingredients that will neutralize its adverse effects on sensory quality and physical parameters of yoghurt, and such an additive can be prebiotic fiber–inulin at a concentration of 9%.