This paper addresses the challenges posed by deep reinforcement learning (DRL) algorithms when deployed for reactive robotic navigation in agricultural settings. These challenges include the complexity of network models, extensive parameterization, substantial computational demands, and susceptibility to local optima. The intricacies of farmland environments further complicate the application of conventional indoor navigation methods, which falter in tasks such as crop monitoring and interaction with humans. To overcome these obstacles, we introduce the Field Robot Autonomous Navigation System (FRANS), which employs DRL to facilitate the autonomous exploration of unknown farmlands by robots. FRANS is composed of two primary modules: Global Navigation (GN) and Local Navigation (LN). The GN module sets destination points and implements a robust control mechanism to navigate the robot, effectively mitigating issues associated with local optima. Meanwhile, the LN module leverages a streamlined DRL framework to formulate a motion strategy that directs the robot towards these waypoints. Crucially, FRANS operates without prior environmental knowledge and dynamically adapts its navigation strategy in response to real-time environmental changes. The system continuously updates the map as the robot traverses the terrain. Experimental evaluations show that FRANS surpasses competing methodologies in performance.