Using a quantitative case study design, the Acids-Bases Chemistry Achievement Test (ABCAT) was developed to evaluate the extent to which students in Malaysian secondary schools achieved the intended curriculum on acid-base concepts. Responses were obtained from 260 Form 5 (Grade 11) students from five schools to initially create the two-tier multiple-choice items. After pilot testing, the final version of the ABCAT consisting of 19 items, 10 multiple-choice items and nine two-tier multiple-choice items, was administered to 304 students in Form 4 (Grade 10) from seven secondary schools when 12 alternative conceptions were identified by at least 10% of the students. Of these alternative conceptions, three were displayed by less than 15% of students. The two-tier multiple-choice items had a slightly higher internal consistency reliability (Cronbach’s alpha) of 0.54 than the multiple-choices items with a value of 0.42. The data from the study suggest that the ABCAT has shown the extent to which the teaching has reduced the incidence of students’ scientifically inappropriate understandings; for example, in nine of the 19 items, no alternative conceptions were displayed by the students. 

Adams, W. K., & Wieman, C. E. (2011). Development and validation of instruments to measure learning of expert-like thinking. International Journal of Science Education 33(9), 1289-1312.

Airasian, P. W., & Miranda, H. (2002). The role of assessment in the revised taxonomy. Theory Into Practice, 4, 249-254.

Anderson, L. W. (2003). Classroom assessment: Enhancing the quality of teacher decision making. Mahwah, NJ: Lawrence Erlbaum Associates.

Artdej, R., Ratanaroutai, T., Coll, R. K., & Thongpanchang, T. (2010). Thai Grade 11 students’ alternative conceptions for acid–base chemistry. Research in Science and Technological Education, 28(2), 167-183.

Bell, B., & Cowie, B. (2001). The characteristics of formative assessment in science education. Science Education, 85(5), 536-553.

Brislin, R. W. (1970). Back-translation for cross-cultural research. Journal of Cross-Cultural Psychology, 1(3), 185-216.

Burns, J. R. (1982). An evaluation of 6th. and 7th. form chemistry in terms of the needs of the students and the community. Report to the Department of Education, Wellington, New Zealand.

Chandrasegaran, A. L., Treagust, D. F., & Mocerino, M. (2007). The development of a two-tier multiple-choice diagnostic instrument for evaluating secondary school students’ ability to describe and explain chemical reactions using multiple levels of representation. Chemistry Education Research and Practice, 8(3), 293-307.

Chandrasegaran, A. L., Treagust, D. F., & Mocerino, M. (2008). An evaluation of a teaching intervention to promote students’ ability to use multiple levels of representation when describing and explaining chemical reactions. Research in Science Education, 38(2), 237-248.

Chairam, S., Somsook, E., & Coll, R. K. (2009). Enhancing Thai students' learning of chemical kinetics. Research in Science & Technological Education 27(1), 95-115.

Chiu, M-H. (2004). An investigation of exploring mental models and causes of secondary school students' misconceptions in acids-bases, particle theory, and chemical equilibrium. Annual report to the National Science Council in Taiwan. Taiwan: National Science Council.

Chiu, M-H. (2007). A national survey of students’ conceptions of chemistry in Taiwan. International Journal of Science Education, 29(4), 421-454.

Cohen, J. (1988). Statistical power analysis for the behavioural sciences (2nd. ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.

Cohen, L.,  Manion, L., & Morrison, K. (2011). Research methods in education (7th ed.). London: Routledge.

Cros, D., Maurin, M., Amouroux, R., Chastrette, M., Leber, J. & Fayol, M. (1986). Conceptions of first-year university students of the constituents of matter and the notions of acids and bases. European Journal of Science Education, 8, 305-313.

Demircioğlu, G., Ayas, A., & Demircioğlu, H. (2005). Conceptual change achieved through a new teaching program on acids and bases. Chemistry Education Research and Practice, 6(1), 36-51.

Drechsler, M. & Van Driel, J. (2008). Experienced teachers’ pedagogical content knowledge

of teaching acid–base chemistry. Research in Science Education, 38(5), 611-635.

Drechsler, M. & Van Driel, J. (2009). Teachers’ perceptions of the teaching of acids and bases in Swedish upper secondary schools. Chemistry Education Research and Practice, 10, 86-96.

Hand, B., & Treagust, D. F. (1991). Student achievement and science curriculum development using a constructivist framework. School Science and Mathematics, 91, 172-176.

Haslam F. and Treagust D. F. (1987) Diagnosing secondary students’ misconceptions of photosynthesis and respiration in plants using a two-tier multiple choice instrument, Journal of Biological Education. 21, 203-211.

Huang, W. C. (2004). The types and causes of misconceptions of elementary students on acids–bases. Annual Report to the National Science Council in Taiwan (in Chinese). Taiwan: National Science Council.

Kala, N., Yaman, F., & Ayas, A. (2013). The effectiveness of Predict-Observe-Explain technique in probing students’ understanding about acid-base chemistry: A case for the concepts of pH, pOH and strength. International Journal of Science and Mathematics Education, 11(1), 555-574.

Krathwohl, D. R. (2010). A revision of Bloom's taxonomy: An overview. Theory into Practice 41(4), 212-218.

Nakhleh, M. B., & Krajcik, J. S. (1993). A protocol analysis of the influence of technology on

students’ actions, verbal commentary, and thought processes during the performance of acid-base titrations. Journal of Research in Science Teaching, 30, 1149-1168.

Popham, W. J. (1995). Classroom assessment: What teachers need to know. Needham Heights, MA: Allyn and Bacon.

Rahayu, S., Treagust, D. F., Chandrasegaran, A. L., Kita, M, & Ibnu, S. (2011). Assessment of electrochemical concepts: A comparative study involving senior-high school students in Indonesia and Japan. Research in Science &Technological Education, 29(2), 169-188.

Sheppard, K. (2006). High school students’ understanding of titrations and related acid-base phenomena. Chemistry Education Research and Practice, 7(1), 32-45.

Tamir, P. 1990. Justifying the selection of answers in multiple choice items. International Journal of Science Education 12(5), 563-573.

Tan, D. K-C. & Treagust, D. F. (1999). Evaluating students’ understanding of chemical bonding. School Science Review, 81, 75–83.

Tan, D. K-C, Treagust, D. F., Chandrasegaran, A. L., & Mocerino, M. (2010). Kinetics of acid reactions: making sense of associated concepts. Chemistry Education Research and Practice, 11(4), 267–280.

Taylor, C. S., & Nolen, S. B. (2005). Classroom assessment. Uper Saddler River, NJ: Pearson.

Treagust, D. F. (1988). Development and use of diagnostic tests to evaluate students' misconceptions in science, International Journal of Science Education, 10, 159-169.

Treagust, D. F. (1995). Diagnostic assessment of students’ science knowledge. In S. M. Glynn and R. Duit (Eds.), Learning in science in the schools: Research reforming practice (Vol. 1) (pp. 327-346), Mahwah, NJ: Lawrence Erlbaum.

Treagust, D. F. (2006). Diagnostic assessment in science as a means to improving teaching, learning and retention. In UniServe science – symposium proceedings:Assessment in science teaching and learning (pp. 1–9). Sydney, NSW: Uniserve Science.

Treagust, D. F. & Chandrasegaran, A. L. (2007). The Taiwan national science concept learning study in an international perspective. International Journal of ScienceEducation, 29(4), 391–403.

Tyson, L., Treagust, D. F. & Bucat, R. B. (1999). The complexity of teaching and learning chemical equilibrium. Journal of Chemical Education, 35, 1031–1055