This paper investigates the problem of attitude tracking in quadrotor unmanned aerial vehicles (UAVs) using a model-free online learning control (MFOLC) scheme. The attitude system, which is represented by unit quaternions, is considered in the presence of uncertain and unknown inertia parameters, time-varying external disturbances, and angular velocity measurement noise. A computationally low-cost control scheme consisting of a model-free baseline controller and a module capable of learning from previous control input is designed. The proposed controller does not require precise inertial parameters and does not involve feedforward terms that use these parameters and true system states. This ensures that the approach can protect the control effort from sensor noise as well as parameter uncertainty. We also show that all the signals in the closed-loop system are uniformly ultimately bounded. Comparative simulations and real-world experiments are conducted for validation, which demonstrate the effectiveness and fine performance of the proposed scheme.