Due to its ability to reproduce the correct focus cues, holography is considered as a promising display technology for Augmented Reality glasses. However, since it contains a large amount of data, the calculation of a hologram is a time-demanding process, resulting in prohibiting head-motion-to-photon latency. In this paper, we propose a real-time hologram calculation method based on two modules: an offline pre-computation module and an on-the-fly hologram synthesis module. In the offline calculation module, the omnidirectional light field scattered by each scene object is individually pre-computed and stored in a Look-Up Table (LUT). Then, in the hologram synthesis module, the light waves corresponding to the viewer's position and orientation are extracted from the LUT in real-time to compute the hologram. Contrarily to previously proposed methods, our approach handles several independent scene objects and arbitrary user positions and orientations. Experimental results show that the proposed method is able to compute full-HD holograms at more than 256 frames per second, enabling its use in Augmented Reality applications.