The complexity of the parameterized halting problem for nondeterministic Turing machines p-HALT is known to be related to the question of whether there are logics capturing various complexity classes [10]. Among others, if p-HALT is in para-AC 0 , the parameterized version of the circuit complexity class AC 0 , then AC 0 , or equivalently, (+, ×)-invariant FO, has a logic. Although it is widely believed that p-HALT / ∈ para-AC 0 , we show that the problem is hard to settle by establishing a connection to the question in classical complexity of whether NE ⊆ LINH. Here, LINH denotes the linear time hierarchy.On the other hand, we suggest an approach toward proving NE ⊆ LINH using bounded arithmetic. More specifically, we demonstrate that if the much celebrated MRDP (for Matiyasevich-Robinson-DavisPutnam) theorem can be proved in a certain fragment of arithmetic, then NE ⊆ LINH. Interestingly, central to this result is a para-AC 0 lower bound for the parameterized model-checking problem for FO on arithmetical structures.