Visible light communication (VLC) can offer the advantages of license and electromagnetic interference (EMI) free wireless transmission. As optical signal does not interference with the radio-frequency (RF) signal, VLC can be used to augment RF wireless communication to provide extra communication capacity while without degrading the performance of both signals. In order to achieve high performance VLC transmission, optical alignment between the optical transmit (Tx) and receiver (Rx) is very critical to enhance the received signal-to-noise ratio (SNR). Optical beam-steering at the Tx can be utilized to ensure narrow optical beam can reach the Rx; however, complicated and active tracking are required. Lenses or compound parabolic concentrators (CPCs) can be install in front of the Rx for focusing to enhance the SNR. However, these will limit the Rx field-of-view (FOV) and making the VLC transmission more subjected to misalignment issue. Hence, many creative optical antennas have been proposed and demonstrated using special optical materials as well as special Rx to enhance the FOV of VLC systems. However, they have their limitations, such as data rates and FOVs. In this work, we put forward and demonstrate a bi-direction free-space VLC system supporting multiple moveable Rxs using a light-diffusing optical fiber (LDOF). The downlink (DL) signal is launched from an head-end or central office (CO) far away to the LDOF at the client side via a free-space transmission. When the DL signal is launched to the LDOF, which acts as an optical antenna to re-transmit the DL signal to different moveable Rxs. The uplink (UL) signal is sent via the LDOF towards the CO. In a proof-of-concept demonstration, the LDOF is 100 cm long and the free space VLC transmission between the CO and the LDOF is 100 cm. 210 Mbit/s DL and 850 Mbit/s UL transmissions, meeting the pre-forward-error-correction bit error rate (pre-FEC BER = 3.8 × 10−3) threshold are achieved.