This study investigates the behavioral indices of attention. A simple repetitive attentive task that resulted in mental fatigue was used consecutively in four trials. In the first step, reaction time and error responses were recorded to evaluate differences among trials. During the task, subjects showed different responses to stimulations. In the second part, to recognize the strategies, multiple clustering methods such as k-means and fuzzy c-means were performed in which behavioral indices and nonlinear features were used. In the last section, mental behavior was identified as a result of the chaotic properties of variations in reaction time. Therefore, the Lyapunov exponent of reaction times was evaluated. Results revealed that behavioral indices could distinguish attention from the occurrence of mental fatigue in trials. In addition, the three strategies used by subjects during the test protocol were assessed. Finally, variation of indices extracted from nonlinear analysis, that is, decrease in degree of chaotic behavior determined the transition from attention to mental fatigue.