Microwave absorbers have many applications in medical, industrial, and military devices. Polymeric composites including carbon-based filler can be used as lightweight absorbers with high electromagnetic (EM) wave absorption performance. Hence, multilayer microwave absorbers were designed using titanium dioxide (TiO2)/reduced graphene oxide (RGO)/epoxy nanocomposites with different weight percentages manufactured using refluxing and annealing methods. The characterization of nanocomposite indicated thin layers of TiO2/RGO as divided sheets in epoxy. The EM properties of the nanocomposites were examined using the Nicolson-Ross-Weir (NRW) detection method. The S-parameters were measured using PNA-N5222A Microwave Network Analyzer. The multilayer absorber software was designed based on the modified local best particle swarm optimization algorithm by MATLAB software, in which the material and thickness of layers were optimized with two cost functions in X-band frequencies. The first cost function seeks to reach the best absorption bandwidth, and the second cost function seeks to reach the maximum average return loss (RL) of the frequency range of 8.2–12.4 GHz. A maximum bandwidth with an RL of less than −12.81 dB was obtained with a thickness of 2.4 mm. A maximum average RL of −22.1 dB was obtained with a thickness of 2.6 mm. The maximum absorption peak was observed with a thickness of 2.5 mm with −62.82 dB at a frequency of 10.86 GHz.