The development of effective methods to utilize industrial and agricultural wastes is crucial from the perspective of a circular economy. Marble powder and olive pomace (OP), byproducts of olive oil production and marble processing, are considered one of the major sources causing severe environmental pollution, especially in Mediterranean countries. Herein, marble powder and OP are aimed to use as fillers in polypropylene (PP)‐based polymer composite. In addition, fractionated OP is further fibrillated by a combination of mechanical grinding and ionic liquid treatment to enhance its performance as a reinforcement. After treatment for 24 h, the particle size decreases from about 2.1 to 1.1 µm, and the lignocellulosic composition also varies due to the partial removal of hemicellulose. Finally, the compounding ratio of polymer composites consisting of PP, marble powder, fibrillated OP, and compatibilizer is optimized using response surface methodology (RSM) to achieve both high mechanical properties and high filler contents. Mechanical properties of polymer composite fabricated with optimum ratio are in excellent agreement with those predicted by RSM. Furthermore, the yield strength and Young's modulus of polymer composite are 33.9 MPa and 1.89 GPa, accordingly, which are higher than those of PP.