Physics-based models for battery temperature prediction are often not suitable for online applications due to the large number of fitted parameters, low fidelity results from parameter inaccuracy and unaccounted model dynamics, limited high quality experimental data, and slow convergence of predictions from unknown initial conditions. On the other hand, data-driven models require much less computation power but a large dataset to learn the time dependent behavior. This paper proposes a physics-informed neural network (PINN) to take full advantage of both physics-based and data-driven models. Four comparative studies were performed to investigate the effectiveness of including chamber temperature with two different activation functions, the optimal number of neurons and hidden layers, the dependance on reversible heat generation, and the performance of long short-term memory (LSTM)-PINN model. The results show that the LSTM-PINN with chamber temperature as one of the inputs delivers better prediction accuracy. The LSTM-PINN with an exponential activation function for the chamber temperature has a more accurate prediction for the direct current fast charge (DCFC) test profile and similar prediction accuracy for the grade load (GL) 100 test profile. The root mean square errors (RMSEs) of the LSTM-PINN are 0.57°C for DCFC and 0.52°C for GL 100, respectively. In addition, having 55 neurons and 4 hidden layers gives the lowest prediction error. Furthermore, the improvement by having reversible heat generation is negligible. At last, the LSTM-PINN model has less prediction error than the LSTM model, especially when the battery temperature range is enormous.