The improvement of data collection and data storage tech- niques enables it quite easier to obtain large amount of data. Accord- ingly, multiple big-data oriented machine learning become quite popular in terms of decision making. However, the quality of machine learning tools’ output is highly dependent on the cleanness of the input data. As for backdoor attackers, they have strong motivation to pollute the data set to negatively influence the final output. In response to this concern, this paper proposes to leverage energy-based learning to prevent back- door attacks. Specifically, our algorithm cleans the data set iteratively to rule out several possible polluted points before running the machine learning model. The experiments take linear regression as the example and show that out algorithm is fast to implement and can improve the accuracy of final output by 60% on average.