MATHEMATICS STUDENTS’ HOTS ASSESSMENT

Benidiktus Tanujaya(1), Rully Charitas Indra Prahmana(2*), Jeinne Mumu(3),

(1) Universitas Papua, Manokwari
(2) Universitas Ahmad Dahlan, Yogyakarta
(3) Universitas Papua, Manokwari
(*) Corresponding Author


Abstract


Assessment is a crucial aspect of education. A critical point in the evaluation is the validity of the instruments used in conducting the assessment. However, some studies do not pay more attention to this section, which results in the invalid results of the resulting research. This study aimed to map the indicators of the Higher-Order Thinking Skills (HOTS) of mathematics students and analyze their existence as components of the instruments. The subjects were 203 senior high school students of science, Manokwari, Indonesia. Test instruments that involved five critical and four creative thinking were used to measure students' HOTS. The data was analyzed using multidimensional scaling (MDS) to map the indicators. The results showed that the five indicators of critical thinking skills form a unified distribution pattern, while the four indicators of creativity tend to spread. Therefore, each indicator used has a unique contribution in explaining the HOTS of mathematics students.

 

Abstrak

 

Penilaian atau evaluasi merupakan aspek penting dari pendidikan. Titik kritis dalam evaluasi adalah validitas instrumen yang digunakan dalam melakukan penilaian. Namun, sejumlah penelitian tidak fokus memperhatikan bagian ini, yang berakibat pada hasil penelitian yang tidak valid. Penelitian ini bertujuan untuk memetakan indikator Higher Order Thinking Skills (HOTS) matematika siswa dan menganalisis keberadaannya sebagai komponen penting pada suatu instrumen. Subjek penelitian ini adalah 203 siswa SMA IPA di Manokwari, Indonesia. Instrumen tes yang melibatkan lima indikator berpikir kritis dan empat indikator berpikir kreatif digunakan untuk mengukur HOTS siswa. Data dianalisis menggunakan multidimensional scaling (MDS) untuk memetakan seluruh indikator. Hasil penelitian menunjukkan bahwa kelima indikator keterampilan berpikir kritis membentuk pola sebaran yang menyatu, sedangkan keempat indikator kreativitas cenderung menyebar. Oleh karena itu, setiap indikator yang digunakan memiliki kontribusi unik dalam menjelaskan HOTS matematika siswa.


Keywords


Creative thinking; critical thinking; HOTS instrument: multidimensional scaling

Full Text:

PDF

References


Ann Mean, L. (2008). On Creativity. Awakening the Creative Mind. Kuala Lumpur: Pelanduk Publications.

Bilgin, I., Karakuyu, Y., & Ay, Y. (2015). The effects of project based learning on undergraduate students’ achievement and self-efficacy beliefs towards science teaching. Eurasia Journal of Mathematics, Science & Technology Education, 11(3), 469-477. https://doi.org/10.12973/eurasia.2014.1015a

Borg, I., & Groenen, P. (2006). Modern multidimensional scaling: Theory and applications. Journal of Educational Measurement, 40(3), 277-280. https://doi.org/10.1111/j.1745-3984.2003.tb01108.x

Brysbaert, M. (2019). How many participants do we have to include in properly powered experiments? A tutorial of power analysis with reference tables. Journal of Cognition, 2(1), 1-38. https://doi.org/10.5334/joc.72

Budsankom, P., Sawangboon, T., Damrongpanit, S., & Chuensirimongkol, J. (2015). Factors affecting higher order thinking skills of students: a meta-analytic structural equation modelling study. Educational Research and Reviews, 10(19), 2639-2652. https://doi.org/10.5897/ERR2015. 2371

Coulacoglou, C., & Saklofske, D. (2018). Psychometrics and Psychological Assessment: Principles and Applications. Cambridge: Academic Press.

Davison, M. L., Richards, P. S., & Rounds Jr., J. B. (1986). Multidimension scaling in counselling research and practice. Journal of Counselling and Development, 6, 178-184. https://doi.org/10.1002/j.1556-6676.1986.tb01309.x

de Bono, E. (1990). Lateral Thinking: A Text Book of Creativity. London: Penguin Books.

Drijvers, P., Kodde-Buitenhuis, H., & Doorman, H. (2019). Assessing mathematical thinking as part of curriculum reform in the Netherlands. Educational Studies in Mathematics, 102, 435–456. https://doi.org/10.1007/s10649-019-09905-7

Drost, E. A. (2011). Validity and reliability in social research. Education Research and Perspectives, 38(1), 105-124. https://www.erpjournal.net/wp-content/uploads/2020/02/ERPV38-1.-Drost-E.-2011.-Validity-and-Reliability-in-Social-Science-Research.pdf

Glassner, A., & Schwarz, B. B. (2007). What stands and develops between creative and critical thinking? Argumentation?. Thinking Skills and Creativity, 2(1), 10-18. https://doi.org/10.1016/j.tsc.2006.10.001

Graham, S., Hebert, M., & Harris, K. R. (2015). Formative assessment and writing: A meta-analysis. The Elementary School Journal, 115(4), 523-547. https://doi.org/10.1086/681947

Hair, J. F., Ringle, C. M., & Sarstedt, M. (2013). Partial least squares structural equation modeling: Rigorous applications, better results and higher acceptance. Long range planning, 46(1-2), 1-12. https://ssrn.com/abstract=2233795

Heriyadi & Prahmana, R. C. I. (2020). Pengembangan lembar kegiatan siswa menggunakan pendekatan pendidikan matematika realistik. AKSIOMA: Jurnal Program Studi Pendidikan Matematika, 9(2), 395-412. http://dx.doi.org/10.24127/ajpm.v9i2.2782

Hodiyanto & Firdaus, M. (2020). The self regulated learning, habit of mind, and creativity as high order thinking skills predictors. AKSIOMA: Jurnal Program Studi Pendidikan Matematika, 9(1), 21-30. http://dx.doi.org/10.24127/ajpm.v9i1.2589

Hout, M. C., Godwin, H. J., Fitzsimmons, G., Robbins, A., Menneer, T., & Goldinger, S. D. (2016). Using multidimensional scaling to quantify similarity in visual search and beyond. Attention, Perception, & Psychophysics, 78, 3-20. https://doi.org/10.3758/s13414-015-1010-6

Hout, M. C., Papesh, M. H., & Goldinger, S. D. (2013). Multidimensional scaling. Wiley Interdisciplinary Reviews: Cognitive Science, 4(1), 93-103. https://doi.org/10.1002/wcs.1203

Hulse, S. H., Egeth, H., & Deese, J. (1980). The Psychology of Learning. New York: McGraw-Hill.

Jacoby, W. G., & Armstrong II., D. A. (2014). Bootstrap confidence regions for multidimensional scaling solutions. American Journal of Political Science, 58(1), 264-278. https://doi.org/10.1111/ajps.12056

Keller, M. M., Neumann, K., & Fischer, H. E. (2017). The impact of physics teachers’ pedagogical content knowledge and motivation on students’ achievement and interest. Journal of Research in Science Teaching, 54(5), 586-614. https://doi.org/10.1002/tea.21378

Koerber, S., Mayer, D., Osterhaus, C., Schwippert, K., & Sodian, B. (2015). The development of scientific thinking in elementary school: A comprehensive inventory. Child Development, 86(1), 327-336. https://doi.org/10.1111/cdev.12298

Limbach, B., & Waugh, W. (2009). Developing higher level thinking. Journal of Instructional Pedagogies, 1-9. https://www.aabri.com/manuscripts/09423.pdf

Mertens, D. M. (2015). Research and Evaluation in Education and Psychology. Los Angeles: Sage Publications.

Mohajan, H. K. (2017). Two criteria for good measurement in research: Validity and reliability. Annals of Spiru Haret University, 17(3), 58-82. https://mpra.ub.uni-muenchen.de/83458/1/MPRA_paper_83458.pdf

NCTM. (2000). Principles and Standards for School Mathematics. Reston: The National Council of Teachers of Mathematics, Inc.

Newton, P. E. (2007). Clarifying the purposes of educational assessment. Assessment in Education: Principles, Policy & Practice, 14(2), 149-170. https://doi.org/10.1080/09695940701478321

Peter, E. E. (2012). Critical thinking: Essence for teaching mathematics and mathematics problem solving skills. African Journal of Mathematics and Computer Science Research, 5(3), 39-43. https://doi.org/10.5897/AJMCSR11.161

Salkind, N. J. (2010). Structural Equation Modelling. Los Angeles: SAGE Publishing. https://doi.org/10.4135/978142961288.

Schmidt-Catran, A. W., Fairbrother, M., & Andreß, H. J. (2019). Multilevel models for the analysis of comparative survey data: Common problems and some solutions. KZfSS Kölner Zeitschrift für Soziologie und Sozialpsychologie, 71(1), 99-128. https://doi.org/10.1007/s11577-019-00607-9

Suurtamm, C., Thompson, D. R., Kim, R. Y., Moreno, L. D., Sayac, N., Schukajlow, S., Silver, E., Ufer, S., & Vos, P. (2016). Assessment in Mathematics Education. Cham: Springer. https://doi.org/10.1007/978-3-319-32394-7_1

Tanujaya, B. (2016). Development an instrument to measure higher order thinking skills in senior high school mathematics instruction. Journal Education and Practice, 7(21), 144-148. https://www.iiste.org/Journals/index.php/JEP/article/view/31982/32852

Tanujaya, B. (2017). Application assessment as learning in mathematics instruction. Advances in Social Science, Education, and Humanities Research, 100, 140-145. https://doi.org/10.2991/seadric-17.2017.30

Tanujaya, B., Prahmana, R. C. I., & Mumu, J. (2017). Mathematics instruction, problems, challenges, and opportunities: A case study in Manokwari regency, Indonesia. World Transactions on Engineering and Technology Education, 15(3), 287-291. http://www.wiete.com.au/journals/WTE&TE/Pages/Vol.15,%20No.3%20(2017)/16-Tanujaya-B.pdf

Teqja, Z., & Dennis Jr., S. F. (2016). Creative thinking, critical thinking and systemic thinking-key instruments to deeply transform the higher education system in Albania: The case of landscape architecture. Educational Alternatives, 14, 543-555. https://www.scientific-publications.net/get/1000021/1474994295652029.pdf

Thakkar, J. J. (2020). Structural Equation Modelling: Application for Research and Practice. Cham: Springer. https://doi.org/10.1007/978-981-15-3793-6

Vidergor, H. E. (2018). Effectiveness of the multidimensional curriculum model in developing higher-order thinking skills in elementary and secondary students. The Curriculum Journal, 29(1), 95-115. https://doi.org/10.1080/09585176.2017.1318771

Wang, S., & Wang, H. (2011) Teaching higher order thinking in the introductory MIS course: A model-direct approach. Journal Education for Business, 86(4), 208-212. https://doi.org/10.1080/08832323.2010.505254

Weintrop, D., Beheshti, E., Horn, M., Orton, K., Jona, K., Trouille, L., & Wilensky, U. (2016). Defining computational thinking for mathematics and science classrooms. Journal of Science Education and Technology, 25(1), 127-147. https://doi.org/10.1007/s10956-015-9581-5

Yaghmale, F. (2003). Content validity and its estimation. Journal of Medical Education, 1(3), 25-27. https://doi.org/10.22037/jme.v3i1.870

Yang, Y. T. C. (2015). Virtual CEOs: A blended approach to digital gaming for enhancing higher order thinking and academic achievement among vocational high school students. Computers & Education, 81, 281-295. https://doi.org/10.1016/j.compedu.2014.10.004

Yee, M. H, Othman, W., Yunos, J., Tee, T. K., Hassan, R., & Mohamad, M. M. (2011). The level of marzano higher order thinking skills among technical education students. International. Journal of Social Science and Humanity, 1(2), 121-125. http://ijssh.org/papers/20-H009.pdf

Yee, M. H., Yunos, J. M., Othman, W., Hassan, R., Tee, T. K., & Mohamad, M. M. (2015). Disparity of learning styles and higher order thinking skills among technical students. Procedia-Social and Behavioral Sciences, 204, 143-152. https://doi.org/10.1016/j.sbspro.2015.08.127

Zamanzadeh, V., Ghahramanian, A., Rassouli, M., Abbaszadeh, A., Alavi-Majd, H., & Nikanfar, A. (2015). Design and implementation content validity study: Development of an instrument for measuring patient-centered communication. Journal of Caring Sciences, 4(2), 165-178. https://doi.org/10.15171/jcs.2015.017




DOI: http://dx.doi.org/10.24127/ajpm.v9i4.3107

Refbacks

  • There are currently no refbacks.