O-NET Computer Adaptive Testing
View
The project of program development of Computerized Adaptive Testing: CAT
The Computerized Adaptive Testing (CAT)
It is the testing adjusted to the capability of test takers and based on answers in the first question or the previous questions in that testing. After test takers gave their answer in the beginning of testing or finished the starter set of exams, the program then analyzes answers or assesses the level of capability of test takers for selecting the next appropriated questions based on the primary of Item Response Theory (IRT). The testing will finish when test takers follow the testing conditions or qualified criteria.
The process of Computerized Adaptive Testing (CAT)
There are 5 processes consisting of
1) the item bank production selects the analysis exam using the principle of Item Response Theory (IRT), with 3 parameters composed of the discrimination index (a), the difficulty index (b), and the guessing opportunity index (c).
2) the beginning set of exam selection, this process will screen exams having difficulty index at the middle level.
3) for the next question selection, the program will select a question approximated to the capability of the test taker at that time. It considers the given answers from the previous questions.
4) the capability estimation of test takers, the program will estimate the capability of test takers after receiving answers from previous questions.
5) the testing termination rises when test takers finish following qualified criteria.
Advantages of the Computerized Adaptive Testing (CAT) program
For students
1) improving their learning path for preparing leaning results for the next study level.
2) considering the learning field that is suitable for themselves.
3) planning themselves for more effective learning.
For schools
1) applying learning and teaching procedure development for teachers in each subject.
2) guidelines for educational personnel development and teachers in school effectively.
3) classroom-based research enhancement for teachers to support learner solutions and development.
4) derived information will be applied for periodically specifying teaching assessment rules of teachers in order to operate and follow teaching directions and standards of schools.
5) preparing information to review weaknesses, strengths and suggesting points of schools.
The extent of O-NET item bank operation and the program development of computerized adaptive testing
For the O-NET testing at the elementary level 6, the secondary level 3, and level 6, each level has 8 groups of contents, a total 24 groups of contents, which are: 1) Thai language. 2) Mathematics. 3) Science. 4) Foreign language. 5) Arts. 6) health and physical education. 7) Social studies, religions, and culture; and 8) occupation and technology. It uses O-NET testing by the National Institute of Educational Testing Service (Public Organization) (NIETS) during the 2008 – 2010. The testing platform used in this study is objective testing with 4 choices and 1 correct answer. The research results are following:
1. The item bank of O-NET testing database is effective and applicable to programs of computerized adaptive testing. Moreover, it is applicable to other testing.
2. The quality of the program of computerized adaptive testing is fine and acceptable by professionals. It is suitable for students at the elementary level 6, the secondary level 3, and level 6, and adaptable for O-NET testing operation.
3. The efficiency of the program of computerized adaptive testing for O-NET testing operations, derived from the survey of program testers satisfaction, has competent quality and gratification from users.