Multiple tasks have been used to demonstrate the relation between numbers and space. The classic interpretation of these directional spatial-numerical associations (d-SNAs) is that they are the product of a mental number line (MNL), in which numerical magnitude is intrinsically associated with spatial position. The alternative account is that d-SNAs reflect task demands, such as explicit numerical judgments and/or categorical responses. In the novel ‘Where was The Number?’ task, no explicit numerical judgments were made. Participants were simply required to reproduce the location of a numeral within a rectangular space. Using a between-subject design, we found that numbers, but not letters, biased participants’ responses along the horizontal dimension, such that larger numbers were placed more rightward than smaller numbers, even when participants completed a concurrent verbal working memory task. These findings are consistent with the MNL account, such that numbers specifically are inherently left-to-right oriented in Western participants.