No abstract

No abstract

The research topic of this paper is that how an avatar explores the environment, and find the way out to reach the pre-assigned goal. This proposed system is applied to a dynamicallly changable, continuous and largescaled environment. To deal with the learning in such environment, the proposed system partitions the statespace into regions of states, called cells. By using cells, the states of the system can be reduced in which the number of states grows dramatically increasing in proportion to the number and quality of inputs. Through a series of maniputations of cells, the avatar can adapt itself to the changable environment. By adjusting the peferences of the proposed global-cell, the tendancy of exploration behavior of the avatar can be controlled to explore the potential path caused by the changing environment. KEYWORDSvirtual world, dynamic environment, reinforcement learning, machine learning, curse of dimentionality.

Considering the popularity of the Internet, an automatic interactive feedback system for E-learning websites is becoming increasingly desirable. However, computers still have problems understanding natural languages, especially the Chinese language, firstly because the Chinese language has no space to segment lexical entries (its segmentation method is more difficult than that of English) and secondly because of the lack of a complete grammar in the Chinese language, making parsing more difficult and complicated. Building an automated Chinese feedback system for special application domains could solve these problems. This paper proposes an interactive feedback mechanism in a virtual campus that can parse, understand and respond to Chinese sentences. This mechanism utilizes a specific lexical database according to the particular application. In this way, a virtual campus website can implement a special application domain that chooses the proper response in a user friendly, accurate and timely manner.