Reference price plays a significant role in influencing purchase decisions of customers. Due to loss aversion, the asymmetric reference price effect on market demand should be taken into account. This paper develops a joint dynamic pricing and production model with asymmetric reference price effect. In a finite planning horizon, the demand rate is time-varying and depends on price as well as reference price. The decision-making problem with the asymmetric reference price effect turns to be a nonsmooth optimal control problem, which cannot be solved by standard optimal control method. As a special case, we first obtain the joint optimal dynamic pricing and production strategy with symmetric reference price effect by solving the corresponding standard optimal control problem based on Maximum principle. For the case of asymmetric reference price effect, we propose a systematical method on basis of optimality principle to solve the nonsmooth optimal control problem, and obtain the joint strategy. Numerical examples are employed to illustrate the effectiveness of the proposed method. In addition, we assess the sensitivity analysis of system parameters to examine the impacts of asymmetric reference price on optimal pricing and production strategies and total profits.