According to the latest statistics, the proportion of the elderly (+65) is increasing and is expected to double within the European Union in a period of 50 years. This ageing is due to the improvement of quality of life and advances in medicine in the last decades. Gerontechnology is receiving a great deal of attention as a way of providing the elderly with sustainable products, environments, and services combining gerontology and technology. One of the most important aspects to consider by gerontechnology is the mobility/rehabilitation technologies, because there is an important relationship between mobility and the elderly's quality of life. Telerehabilitation systems have emerged to allow the elderly to perform their rehabilitation exercises remotely. However, in many cases, the proposed systems assist neither the patients nor the experts about the progress of the rehabilitation. To address this problem, we propose in this paper, a fuzzy‐semantic system for evaluating patient's physical state during the rehabilitation process based on well‐known standard for patients' evaluation. Moreover, a tool called FINE has been developed that facilitates the evaluation be accomplished in a semi‐automatic way first asking patients to carry out a set of standard tests and then inferencing their state by means of a fuzzy‐semantic approach using the data captured during the rehabilitation tasks.