The development of automated tractors is anticipated to address the problem of a declining and aging agricultural labor force. However, there are numerous situations in which automatic driving is difficult in the field. We developed a remote operation system allowing novice tractor drivers to control a tractor remotely in situations where automatic driving is difficult and evaluated its performance on a real tractor in a field. Our challenge was to design a user interface (UI) that allows novices to comprehend the tractor's status and return the tractor situation where automatic operation is possible. The system's UI is inspired by popular video games. In experiments, even novice tractor drivers with little or no experience driving automobiles or playing video games could remotely control the tractor and till according to the goal line. In addition, the participants dealt with an invisible obstacle by viewing illustrations of the tractor sensor data. The designed UI's operation methods and operator attributes were analyzed. Through the experiment, the following facts were revealed. A method of operation that allows the analog stick to adhere to the mechanical guide results in smooth operation. In addition, the participant's preferred control method depends on his/her gaming experience. Thus, this study clarifies some of the specifications and design guidelines necessary for a novice-friendly remote UI for the remote operation of a tractor. K E Y W O R D S agricultural machine, human factors, human-machine interface, remote operation, unmanned tractor 1 | INTRODUCTION Recently, declining and aging agricultural workforces have become a problem in various countries around the world. Furthermore, agricultural land is being accumulated and scaled up worldwide, and cases where corporations hire part-time workers to perform agricultural work in large fields are increasing in number. This can be attributed to the improvement in labor productivity and the decline of the agricultural workforce due to the introduction of agricultural machinery (Liu et al., 2020; Ministry of Agriculture, Forestry and Fisheries, 2022).