Benidiktus Tanujaya, Rully Charitas Indra Prahmana, Jeinne Mumu


Assessment is a crucial aspect of education. A critical point in the evaluation is the validity of the instruments used in conducting the assessment. However, some studies do not pay more attention to this section, which results in the invalid results of the resulting research. This study aimed to map the indicators of the Higher-Order Thinking Skills (HOTS) of mathematics students and analyze their existence as components of the instruments. The subjects were 203 senior high school students of science, Manokwari, Indonesia. Test instruments that involved five critical and four creative thinking were used to measure students' HOTS. The data was analyzed using multidimensional scaling (MDS) to map the indicators. The results showed that the five indicators of critical thinking skills form a unified distribution pattern, while the four indicators of creativity tend to spread. Therefore, each indicator used has a unique contribution in explaining the HOTS of mathematics students.




Penilaian atau evaluasi merupakan aspek penting dari pendidikan. Titik kritis dalam evaluasi adalah validitas instrumen yang digunakan dalam melakukan penilaian. Namun, sejumlah penelitian tidak fokus memperhatikan bagian ini, yang berakibat pada hasil penelitian yang tidak valid. Penelitian ini bertujuan untuk memetakan indikator Higher Order Thinking Skills (HOTS) matematika siswa dan menganalisis keberadaannya sebagai komponen penting pada suatu instrumen. Subjek penelitian ini adalah 203 siswa SMA IPA di Manokwari, Indonesia. Instrumen tes yang melibatkan lima indikator berpikir kritis dan empat indikator berpikir kreatif digunakan untuk mengukur HOTS siswa. Data dianalisis menggunakan multidimensional scaling (MDS) untuk memetakan seluruh indikator. Hasil penelitian menunjukkan bahwa kelima indikator keterampilan berpikir kritis membentuk pola sebaran yang menyatu, sedangkan keempat indikator kreativitas cenderung menyebar. Oleh karena itu, setiap indikator yang digunakan memiliki kontribusi unik dalam menjelaskan HOTS matematika siswa.


Creative thinking; critical thinking; HOTS instrument: multidimensional scaling

Full Text:



Ann Mean, L. (2008). On Creativity. Awakening the Creative Mind. Kuala Lumpur: Pelanduk Publications.

Bilgin, I., Karakuyu, Y., & Ay, Y. (2015). The effects of project based learning on undergraduate students’ achievement and self-efficacy beliefs towards science teaching. Eurasia Journal of Mathematics, Science & Technology Education, 11(3), 469-477.

Borg, I., & Groenen, P. (2006). Modern multidimensional scaling: Theory and applications. Journal of Educational Measurement, 40(3), 277-280.

Brysbaert, M. (2019). How many participants do we have to include in properly powered experiments? A tutorial of power analysis with reference tables. Journal of Cognition, 2(1), 1-38.

Budsankom, P., Sawangboon, T., Damrongpanit, S., & Chuensirimongkol, J. (2015). Factors affecting higher order thinking skills of students: a meta-analytic structural equation modelling study. Educational Research and Reviews, 10(19), 2639-2652. 2371

Coulacoglou, C., & Saklofske, D. (2018). Psychometrics and Psychological Assessment: Principles and Applications. Cambridge: Academic Press.

Davison, M. L., Richards, P. S., & Rounds Jr., J. B. (1986). Multidimension scaling in counselling research and practice. Journal of Counselling and Development, 6, 178-184.

de Bono, E. (1990). Lateral Thinking: A Text Book of Creativity. London: Penguin Books.

Drijvers, P., Kodde-Buitenhuis, H., & Doorman, H. (2019). Assessing mathematical thinking as part of curriculum reform in the Netherlands. Educational Studies in Mathematics, 102, 435–456.

Drost, E. A. (2011). Validity and reliability in social research. Education Research and Perspectives, 38(1), 105-124.

Glassner, A., & Schwarz, B. B. (2007). What stands and develops between creative and critical thinking? Argumentation?. Thinking Skills and Creativity, 2(1), 10-18.

Graham, S., Hebert, M., & Harris, K. R. (2015). Formative assessment and writing: A meta-analysis. The Elementary School Journal, 115(4), 523-547.

Hair, J. F., Ringle, C. M., & Sarstedt, M. (2013). Partial least squares structural equation modeling: Rigorous applications, better results and higher acceptance. Long range planning, 46(1-2), 1-12.

Heriyadi & Prahmana, R. C. I. (2020). Pengembangan lembar kegiatan siswa menggunakan pendekatan pendidikan matematika realistik. AKSIOMA: Jurnal Program Studi Pendidikan Matematika, 9(2), 395-412.

Hodiyanto & Firdaus, M. (2020). The self regulated learning, habit of mind, and creativity as high order thinking skills predictors. AKSIOMA: Jurnal Program Studi Pendidikan Matematika, 9(1), 21-30.

Hout, M. C., Godwin, H. J., Fitzsimmons, G., Robbins, A., Menneer, T., & Goldinger, S. D. (2016). Using multidimensional scaling to quantify similarity in visual search and beyond. Attention, Perception, & Psychophysics, 78, 3-20.

Hout, M. C., Papesh, M. H., & Goldinger, S. D. (2013). Multidimensional scaling. Wiley Interdisciplinary Reviews: Cognitive Science, 4(1), 93-103.

Hulse, S. H., Egeth, H., & Deese, J. (1980). The Psychology of Learning. New York: McGraw-Hill.

Jacoby, W. G., & Armstrong II., D. A. (2014). Bootstrap confidence regions for multidimensional scaling solutions. American Journal of Political Science, 58(1), 264-278.

Keller, M. M., Neumann, K., & Fischer, H. E. (2017). The impact of physics teachers’ pedagogical content knowledge and motivation on students’ achievement and interest. Journal of Research in Science Teaching, 54(5), 586-614.

Koerber, S., Mayer, D., Osterhaus, C., Schwippert, K., & Sodian, B. (2015). The development of scientific thinking in elementary school: A comprehensive inventory. Child Development, 86(1), 327-336.

Limbach, B., & Waugh, W. (2009). Developing higher level thinking. Journal of Instructional Pedagogies, 1-9.

Mertens, D. M. (2015). Research and Evaluation in Education and Psychology. Los Angeles: Sage Publications.

Mohajan, H. K. (2017). Two criteria for good measurement in research: Validity and reliability. Annals of Spiru Haret University, 17(3), 58-82.

NCTM. (2000). Principles and Standards for School Mathematics. Reston: The National Council of Teachers of Mathematics, Inc.

Newton, P. E. (2007). Clarifying the purposes of educational assessment. Assessment in Education: Principles, Policy & Practice, 14(2), 149-170.

Peter, E. E. (2012). Critical thinking: Essence for teaching mathematics and mathematics problem solving skills. African Journal of Mathematics and Computer Science Research, 5(3), 39-43.

Salkind, N. J. (2010). Structural Equation Modelling. Los Angeles: SAGE Publishing.

Schmidt-Catran, A. W., Fairbrother, M., & Andreß, H. J. (2019). Multilevel models for the analysis of comparative survey data: Common problems and some solutions. KZfSS Kölner Zeitschrift für Soziologie und Sozialpsychologie, 71(1), 99-128.

Suurtamm, C., Thompson, D. R., Kim, R. Y., Moreno, L. D., Sayac, N., Schukajlow, S., Silver, E., Ufer, S., & Vos, P. (2016). Assessment in Mathematics Education. Cham: Springer.

Tanujaya, B. (2016). Development an instrument to measure higher order thinking skills in senior high school mathematics instruction. Journal Education and Practice, 7(21), 144-148.

Tanujaya, B. (2017). Application assessment as learning in mathematics instruction. Advances in Social Science, Education, and Humanities Research, 100, 140-145.

Tanujaya, B., Prahmana, R. C. I., & Mumu, J. (2017). Mathematics instruction, problems, challenges, and opportunities: A case study in Manokwari regency, Indonesia. World Transactions on Engineering and Technology Education, 15(3), 287-291.,%20No.3%20(2017)/16-Tanujaya-B.pdf

Teqja, Z., & Dennis Jr., S. F. (2016). Creative thinking, critical thinking and systemic thinking-key instruments to deeply transform the higher education system in Albania: The case of landscape architecture. Educational Alternatives, 14, 543-555.

Thakkar, J. J. (2020). Structural Equation Modelling: Application for Research and Practice. Cham: Springer.

Vidergor, H. E. (2018). Effectiveness of the multidimensional curriculum model in developing higher-order thinking skills in elementary and secondary students. The Curriculum Journal, 29(1), 95-115.

Wang, S., & Wang, H. (2011) Teaching higher order thinking in the introductory MIS course: A model-direct approach. Journal Education for Business, 86(4), 208-212.

Weintrop, D., Beheshti, E., Horn, M., Orton, K., Jona, K., Trouille, L., & Wilensky, U. (2016). Defining computational thinking for mathematics and science classrooms. Journal of Science Education and Technology, 25(1), 127-147.

Yaghmale, F. (2003). Content validity and its estimation. Journal of Medical Education, 1(3), 25-27.

Yang, Y. T. C. (2015). Virtual CEOs: A blended approach to digital gaming for enhancing higher order thinking and academic achievement among vocational high school students. Computers & Education, 81, 281-295.

Yee, M. H, Othman, W., Yunos, J., Tee, T. K., Hassan, R., & Mohamad, M. M. (2011). The level of marzano higher order thinking skills among technical education students. International. Journal of Social Science and Humanity, 1(2), 121-125.

Yee, M. H., Yunos, J. M., Othman, W., Hassan, R., Tee, T. K., & Mohamad, M. M. (2015). Disparity of learning styles and higher order thinking skills among technical students. Procedia-Social and Behavioral Sciences, 204, 143-152.

Zamanzadeh, V., Ghahramanian, A., Rassouli, M., Abbaszadeh, A., Alavi-Majd, H., & Nikanfar, A. (2015). Design and implementation content validity study: Development of an instrument for measuring patient-centered communication. Journal of Caring Sciences, 4(2), 165-178.



  • There are currently no refbacks.

Indexing by: