The technique of the normal ordering of non-commuting operators is an important tool in the solution of problems involving creation and annihilation operators in quantum physics, such as in many-body theory or quantum optics. We point out the inconsistencies in previous definitions of the two standard normal ordering procedures for such operators, and show how consistent definitions may be made.