(2019)
(2019)
(2019)
(2019)
(2019)
(2019)
(2019)
(2019)
(2019)
(2018)
(2018)
(2018)
(2018)
(2018)
(2018)
(2018)
(2018)
(2018)
(2018)
(2017)
(2017)
(2017)
(2017)
(2017)
(2017)
(2017)
(2017)
(2017)
(2017)
(2016)
(2016)
Special Issue - (2016)
(2016)
(2016)
(2016)
(2016)
(2016)
(2016)
(2016)
(2016)
(2016)
(2016)
(2016)
(2016)
(2016)
(2016)
(2016)
(2015)
(2015)
Special Issue - (2015)
(2015)
(2015)
(2015)
(2012)
(2012)
(2012)
Special Issue - (2012)
pp. 7129-7144 | Article Number: ijese.2016.532
Published Online: September 17, 2016
Abstract
The relevance of the investigated problem is determined by the need to improving the evaluation procedures in education and the student assessment in the age of the context of education widening, new modes of study developing (such as blending learning, e-learning, massive open online courses), immediate feedback necessity, reliable and valid assessments. The purposes of the article are multistage adaptive measurements validation and testing for increasing the student assessment procedures effectiveness and getting immediate feedback, reliable and valid assessments. Multistage adaptive measurements mentioned above are based on modern test theory Item Response Theory (IRT). The main research methods are math models and measurements on the basis of IRT models, mathematical-statistical methods (descriptive statistics, Bayesian models and maximum likelihood method) and the systematic analysis of the developing practices for student evaluation during the assessment procedures, opinion polls and questionnaires of learning process participants at university. The article presents validation and results of multistage adaptive measurements application, description of adaptive measurement algorithm (leading to the increase of effectiveness in student assessment procedure due to the selection of optimal task difficulty for each student, creating a situation of success during computer-based test session with the tasks accomplishable at individual pace, increase of assessment accuracy and cutting of labor input. Multistage adaptive measurements, as one of the innovative approaches increasing the student assessment effectiveness, admit of individualization principle, actualization in education and getting immediate feedback for improving learning process and the content of education. Multistage adaptive measurements can be applied in blending learning, massive open online courses and e-learning. The article can be of interest for teaching staff and experts in developing the effective methods of learning outcomes assessment.
Keywords: Adaptive measurement algorithms; assessment; multistage adaptive measurements; effectiveness
References
Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability / In: F.M. Lord and M.R. Novick. Statistical Theories of Mental Test Scores. Reading, Mass: Addison - Wesly, 568 p.
Boyatzis, R. (2008). The Competent manager. A model for effective performance. Moscow: HIPPO publ., 352 p.
Chelyshkova, M. B. (2001). Adaptive testing in education (theory, methodology, technology). Moscow: Research Center of Training Quality Problems, 165 p.
Chelyshkova, M. B.. (2002). Theory and practice of designing of pedagogical tests. Moscow: Logos, 432 p.
Crocker, L. &Algina, J. (2006). Introduction to Classical and Modern Test Theory. Pacific Grove, CA: Wadsworth, 527 p.
Dorozhkin, E.M., Zaitseva, E.V. & Tatarskikh, B.Y. (2016). Impact of Student Government Bodies on Students' Professional Development . IEJME-Mathematics Education, 11(7), 2666-2677.
Gorbachev, V. T. (2006).Improving the efficiency of adaptive testing the quality of student learning in higher education of a humanitarian profile. PhD Thesis. Moscow: Military University of the Russian Federation Ministry of Defense, 258 p.
Hambleton, R. K., Swaminathan, H.& Rogers, H. J. (1991). Fundamentals of Item Response Theory. N.-Y. :Sage Publications, 174 p.
Lord, F.M. (1980). Application of Item Response Theory to practical testing problems. Hillsdale N.-J. : Lawrence Erlbaum Ass.,Publ, 266 p.
Malygin, А. А. (2011). Computer adaptive testing to quality assurance of distance learning. Vestnikuniversiteta, 4, 166–169.
Malygin, А. А. (2012). Adaptive testing in distance learning. Ivanovo: ISUCT, 138 p.
Minko, N. T. (2010).Pedagogical support of computerized adaptive testing in the context of personal education. PhD Thesis. Ulan-Ude: Buryat State University, 209 p.
Rasch, G. (1980). Probabilistic models for some intelligence and attainment tests. With a foreword and afterword by B.D. Wright. The Univ. of Chicago Press. Chicago & London, 199 р.
Spencer, L. М.&Spencer, S. М. (2005). Competence at Work. Models for Superior Performance. Moscow: HIPPO, 384 p.
Stevens, S. S. (1946). On the Theory of Scales of Measurement. Science. New Series, Vol. 103, 2684, 677-680.
Teryuha, R. V. (2006). The technology of computerized adaptive testing in vocational training of engineers. PhD Thesis. Krasnodar: Kuban State University, 261 p.
Van der Linden, W. J.&Glas, C. A. W. (2010). Elements of adaptive testing, Statistical for social and behavioral sciences. Springer Science + Business Media, LLC, 437 p.
Wainer, H.(2000). Computerized adaptive testing: A Primer. – 2nd edition. – Mahwah, NJ :ELawrence Erlbaum Associates, 278 p.
Weiss, D. J. (1983). New horizons in testing: Latent trait theory and computerized adaptive testing. N. Y. : Academic Press, 380 p.
Zvonnikov, V. I. (2006). Measurement and the quality of education. Moscow: Logos. 312 p.