PurposeThis paper aims to identify the main performance criteria for Humanitarian Operations (HOs) from the beneficiary perspective and to propose a taxonomy to support the evaluation of stakeholders.Design/methodology/approachThe research conducts a Systematic Literature Review to identify the main criteria in HOs from the beneficiary's view. Also, we conduct an empirical study based on a survey and a case study to validate the findings in a real-life setting.FindingsConsidering 25 papers, the identified performance criteria were divided into six categories: health, housing, education, socioeconomic factors, care and risk and disaster management. The empirical discussion considered forty-four responses from beneficiaries, and the main criteria complained about were related to socioeconomic factors. In addition, a case study was developed that examines the perspective of the company responsible for the construction of the building to aid in understanding the areas of dissatisfaction noted by the residents.Practical implicationsThe research contributes organized criteria to support the performance evaluation of organizations. It offers a structured basis for further discussion among academics and professionals about other performance evaluation topics, such as dashboards and the integration of indicators from different stakeholders.Originality/valueLiterature is scarce in questions of performance evaluation in HOs and the analysis of the beneficiary as the main client. Therefore, the paper contributes to both areas by evaluating HOs from the beneficiary's perspective.