The COVID-19 pandemic has increased the significance of remote collaboration. This study proposes a virtual reality (VR) whiteboard system that enables remote collaboration among multiple participants using natural handwriting. In total, three experiments were conducted to investigate, respectively, collaboration efficiency, user experience, and system delay. First, we compared the collaboration efficiency of the traditional whiteboard, the electronic whiteboard, and the proposed virtual reality whiteboard in a series of controlled experiments. It was discovered that the VR whiteboard significantly improves collaboration efficiency in comparison to the mouse-based electronic whiteboard and is comparable to the traditional whiteboard. Second, we assessed the user experience with a survey scale (questionnaires). The subsequent results demonstrate that the VR whiteboard provides a superior user experience in terms of efficiency, usability, etc., compared to the traditional whiteboard. We also measured an end-to-end latency of approximately 115 milliseconds, which is sufficient for remote collaboration.