There is increasing evidence indicating that the sensorimotor system is involved in advanced L2 processing, which raises the question of what role sensorimotor information plays in the course of less advanced L2 comprehension. In the current study, two experiments were conducted using a lexical decision task (LDT) and semantic category task (SCT). The results showed that, in the LDT, a task more likely to result in participants making judgments based on the physical properties of words (e.g., familiarity, orthography), “up” words (e.g., sun, plane) did not result in faster upward than downward responses, and “down” words (e.g., tunnel, cave) also did not result in faster downward than upward responses. In the SCT, compatibility effects were found; specifically, searching for the up target after “up” words was faster than after “down” words and searching for the bottom target after “down” words was faster than after “upward-pointing” words. Hence, we concluded that L2 sensorimotor association, at least for L2 with low proficiency, not automatic in nature and is dependent upon deeper semantic task demands.