Globally, the recommendation services have become important due to the fact that they support e-commerce applications and different research communities. Recommender systems have a large number of applications in many fields, including economic, education, and scientific research. Different empirical studies have shown that the recommender systems are more effective and reliable than the keyword-based search engines for extracting useful knowledge from massive amounts of data. The problem of recommending similar scientific articles in scientific community is called scientific paper recommendation. Scientific paper recommendation aims to recommend new articles or classical articles that match researchers' interests. It has become an attractive area of study since the number of scholarly papers increases exponentially. In this paper, we first introduce the importance and advantages of the paper recommender systems. Second, we review the recommendation algorithms and methods, such as Content-based, collaborative filtering, graph-based, and hybrid methods. Then, we introduce the evaluation methods of different recommender systems. Finally, we summarize the open issues in the paper recommender systems, including cold start, sparsity, scalability, privacy, serendipity, and unified scholarly data standards. The purpose of this survey is to provide comprehensive reviews on the scholarly paper recommendation.