When the Liberal Democratic Party (LDP) again took control after the 2012 general election, Japan's ruling party politicians increasingly associated themselves with Shinto Seiji Renmei, a political organization that is affiliated with Shinto, the country's native religion. What are the motivations for joining such a group, considering Japan has institutional regulations regarding the separation of politics and religion, in addition to there being no sign of rising religiosity among the Japanese population? I explain this puzzle by focusing on politicians' electoral incentives in a changing environment of Japan's party politics. As the opposition became fragmented after 2012, the ruling party's candidates found it electorally advantageous to appeal to the core supporters rather than the centrist floating voters. An empirical analysis of an original dataset supports my argument. The findings suggest the changes in Japan's political landscape might affect the future strategies of LDP politicians, particularly regarding the coalition with Komeito. Overall, this study proposes that there is a need to pay closer attention to politicians' strategic use of religion in politics.