Overconsumption of sweets contributes to increasing obesity among children and adults. Functional food brings an opportunity to improve nutritional value of commonly eaten products, e.g., pastry products. New trends in the food industry tend to produce low-calorie products by replacing sugar or fat with additives having pro-health benefits. The aim of this study was to determine the effect of replacing sucrose with steviol glycosides (natural non-caloric sweetener) on the quality properties of bakery products. The analysis of muffin's texture, color, cooking yield, browning index, and sensory analysis were performed. The study showed that a 25% addition of steviol sweetener (as a sucrose replacement) was the most appropriate modification of the basic formula. The resulting muffins gained sensory attractiveness and health-promoting qualities. Moreover, the study showed that a reduction of sucrose in excess of 50% had a negative impact on the quality of muffins and their sensory profiles.