Evaluation described in this paper is the evaluation of item-writing program national level Bloom's taxonomy-based application SIAP. This application was developed by the Center for Educational Assessment, Research, Ministry of Education to help facilitate the writing about a question bank. Writing about the new SIAP-based applications were initiated in 2017. The author questions that have been selected to write about using the application SIAP. Material undertaking as center officials also carry out the revision and reception problems with this application. Problems that have been received is what will be a matter for question bank. During the implementation of which will enter the age of two years, of course, required the evaluation of the effectiveness and efficiency of this application. Internal Puspendik have done so for the first time in early 2018. Questionnaires distributed through SIAP application. The method used is the method of evaluative analysis of quantitative and qualitative data. This evaluation uses Kirkpatrick evaluation model. Population and sample are about the author of the national selection results throughout Indonesia in 2016. The result is the level of satisfaction of the application writer SIAP (84.89% / Good), satisfaction of communication with undertaking Materials (79.35% / Good), and satisfaction with the Admin (68.79 / Pretty Good).

Progress in the field of technology often facilitates human work. One of them is progress in the development of questionnaire modes. Currently, existing questionnaires have been based on a digital platform, which makes evaluators easy to design, disseminate, and conduct scoring. All are computer-based, making them reachable by the respondents no matter how far the location of the respondent is, as long as they are connected to the internet. However, any progress is accompanied by several obstacles. For example, the respondents experienced an error in responding to having the intent to respond 'Yes' option but pressing the 'No' button instead. It is very different from filling in paper and pencil based questionnaires in which they are sure to put a checkmark using a pencil on the answer choices. This problem is what the researchers found when distributing digital questionnaires to participants of the National Questions Writing Program based on the 'SIAP' (Sistem Inovatif Aplikasi Penilaian) application. On conditional questions (if you choose 'No', please stop), some respondents who have chosen 'No' answers still respond to the next questions. It causes the data obtained are unreliable. After conducting a more in-depth analysis, the researchers found that respondents’ factors as psychological factors are the cause, such as the new experience of accessing applications, understanding of applications, stress, and personal health. Uniquely, the respondents who have problems are those in the context of productive age, i.e 30 to 39 years old, more than five years of teaching experience, postgraduate level, and female.