For homes to become active participants in a smart grid, intelligent control algorithms are needed to facilitate autonomous interactions that take homeowner preferences into consideration. Many control algorithms for demand response have been proposed in the literature. Comparing the performance of these algorithms has been difficult because each algorithm makes different assumptions or considers different scenarios, i.e., peak load reduction or minimizing cost in response to the variable price of electricity. This work proposes a flexible assessment framework using the Analytical Hierarchy Process to compare and rank residential energy management control algorithms. The framework is a hybrid mechanism that derives a ranking from a combination of subjective user input representing preferences, and objective data from the algorithm performance related to energy consumption, cost and comfort. The Analytical Hierarchy Process results in a single overall score used to rank the alternatives. The approach is illustrated by applying the assessment process to six residential energy management control algorithms. Note on Revision An error in the algorithm that maps simulation results to the AHP's Fundamental Scale of Pairwise Comparisons (Table 1) was corrected in Section 7. This correction resulted in small changes to the scoring of the example algorithms (Table 14, Table 15, and Figure 10). Due to the corrections in the mapping algorithm, the sensitivity analysis was no longer relevant and was removed.