We describe and analyze a hybrid approach to scalable quantum computation based on an optically connected network of few-qubit quantum registers. We show that probabilistically connected fivequbit quantum registers suffice for deterministic, fault-tolerant quantum computation even when state preparation, measurement, and entanglement generation all have substantial errors. We discuss requirements for achieving fault-tolerant operation for two specific implementations of our approach.The key challenge in experimental quantum information science is to identify isolated quantum mechanical systems with good coherence properties that can be manipulated and coupled together in a scalable fashion. Substantial progress has been made towards the physical implementation of few-qubit quantum registers using systems of coupled trapped ions [1,2,3,4], superconducting islands [5,6], solid-state qubits based on electronic spins in semiconductors [7], and color centers in diamond [8,9,10,11]. While the precise manipulation of large, multi-qubit systems still remains an outstanding challenge, approaches for connecting such few qubit registers into large scale circuits are currently being explored both theoretically [12,13,14,15,16,17] and experimentally [18,19]. Of specific importance are approaches which can yield fault-tolerant operations with minimal resources and realistic (high) error rates.In Ref.[13] a novel technique to scalable quantum computation was suggested, where high fidelity local operations can be used to correct low fidelity non-local operations, using techniques that are currently being explored for quantum communication [20,21,22]. In this Letter, we present a hybrid approach, which requires only 5 (or fewer)-qubit registers with local determinstic coupling, while providing additional improvements over the earlier protocol [13]: reduced measurement errors, higher fidelity, and more efficient entanglement purification. The small registers are connected by optical photons, which enables non-local coupling gates and reduces the requirement for fault tolerant quantum computation [23]. Specifically, we analyze two physical systems where this approach is very effective. We consider an architecture where pairwise non-local entanglement can be created in parallel, as indicated in Fig. 1. This is achieved via simultaneous optical excitation of the selected register pairs followed by photon-detection in specific channel. We use a Markov chain analysis to estimate the overhead in time and operational errors, and discuss the feasibility of large scale, fault-tolerant quantum computation using this approach.The present work is motivated by experimental advances in two specific physical systems. Recent experiments have demonstrated quantum registers composed of few trapped ions, which can support high-fidelity local operations [2,3,4]. The ion qubits can couple to light efficiently [24] and were recognized early for their potential in an optically coupled component [13,14]. Probabilistic entanglement of remote ion qubits m...