This paper proposes an improved Q-learning algorithm for the path planning of a mobile robot in a free-space environment. Existing Q-learning methods for path planning focus on the mesh routing environment; therefore, new methods must be developed for free-space environments in which robots move continuously. For the free-space environment, we construct fuzzified state variables for dividing the continuous space to avoid the curse of dimensionality. The state variables include the distances to the target point and obstacles and the heading of the robot. Based on the defined state variables, we propose an integrated learning strategy on the basis of the space allocation to accelerate the convergence during the learning process. Simulation experiments show that the path planning of mobile robots can be realized quickly, and the probability of obstacle collisions can be reduced. The results of the experiments also demonstrate the considerable advantages of the proposed learning algorithm compared to two commonly used methods.
Wax sticking in oil wells has always been a difficult problem in oil exploitation. Wax sticking in oil wells exists not only in the exploitation stage, but also in every link of oil production. Accurate identification of indicator diagram type is very important to prevent oil well wax sticking. In this paper, a BP neural network method is proposed to identify indicator diagram types. This model makes full use of indicator diagram data, simplifies complex mechanism research, and has wider practicability. Through the calculation of an example, the BP neural network established in this paper can accurately identify the type of indicator diagram.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.