In previous work, Montanaro presented a method to obtain quantum speedups for backtracking algorithms, a general meta-algorithm to solve constraint satisfaction problems (CSPs). In this work, we derive a space efficient implementation of this method. Assume that we want to solve a CSP with m constraints on n variables and that the union of the domains in which these variables take their value is of cardinality d. Then, we show that the implementation of Montanaro's backtracking algorithm can be done by using O(n log d) data qubits. We detail an implementation of the predicate associated to the CSP with an additional register of O(log m) qubits. We explicit our implementation for graph coloring and SAT problems, and present simulation results. Finally, we discuss the impact of the usage of static and dynamic variable ordering heuristics in the quantum setting.