DEVELOPMENT OF HIGHER-ORDER THINKING SKILL (HOTS) TEST ON MATHEMATICS IN SECONDARY SCHOOL

Ega Gradini(1), Cut Khairunnisak(2), Julia Noviani(3*),

(1) IAIN Takengon
(2) Universitas Syiah Kuala
(3) IAIN Takengon
(*) Corresponding Author


Abstract


Assessing students' higher-order thinking skills are still challenging for mathematics teachers in Indonesia. This paper aims to develop a valid, reliable, practical, and effective test to assess students' higher-order thinking skills in mathematics learning. The Plomp’s developmental model, Generic Model for Educational Design, was deployed to develop the test. The method consisted of 4 phases; (1) Problem analysis, (2) Design, (3) Realization, and (4) Evaluation and Implementation. The quality of the developed test was examined by using Plomp’s product quality criteria; (1) Validity, (2) Reliability, (3) Practicality/usability, and (4) Effectiveness. The instruments in this study were validation sheets and practical response questionnaires.  The test was validated by expert validation involving two experts on HOTs in mathematics and a trial involving 35 grade 7 secondary school students. The practicality/usability of the test was examined by 25 mathematics teachers from different secondary schools. The effectiveness was measured by trial on three secondary schools. The validity and reliability were measured using Gregory's Expert Agreement Index (EAI). The rubric's practicality was analyzed using practicality product criteria, and the effectivity of the test was analyzed using a two-tailed t-test. The research shows that the validity of the test is 0.88 (high validity), and the reliability is 0.93 (reliable). The practicality of the test is 75.33 (practical). The trial on the lower-index, middle-index, and higher-index schools revealed that the test effectively assessed students' higher-order thinking skills. In conclusion, the HOTs test is valid, reliable, practical, and effective to measure students' higher-order thinking skills in mathematics learning.

 

Menilai keterampilan berpikir tingkat tinggi siswa masih menjadi tantangan bagi guru matematika di Indonesia. Penelitian ini bertujuan untuk mengembangkan tes yang valid, reliabel, praktis, dan efektif untuk menilai kemampuan berpikir tingkat tinggi siswa dalam pembelajaran matematika. Model pengembangan Plomp, the Generic Model for Educational Design, digunakan untuk mengembangkan tes. Metode Plomp terdiri dari 4 fase; (1) Analisis masalah, (2) Perancangan, (3) Realisasi, dan (4) Evaluasi dan Implementasi. Kualitas produk yang dikembangkan diperiksa dengan menggunakan kriteria kualitas produk dari Plomp; (1) Validitas, (2) Reliabilitas, (3) Kepraktisan/kegunaan, dan (4) Efektivitas. Instrumen pada penelitian ini adalah lembar validasi dan angket respon praktikalitas. Produk tes HOTs divalidasi melalui; (1) validasi ahlI yang melibatkan dua validator ahli HOTs matematika dan (2) uji coba yang melibatkan 35 siswa SMP kelas VIII. Praktikalitas tes diuji oleh 25 guru matematika dari SMP yang berbeda. Efektivitas diukur dengan uji coba di tiga SMP/MTs. Validitas dan reliabilitas diukur dengan menggunakan Gregory's Expert Agreement Index (EAI). Kepraktisan rubrik dianalisis menggunakan kriteria produk kepraktisan, dan keefektifan produk dianalisis menggunakan uji-t two-tailed. Hasil penelitian menunjukkan bahwa validitas tes adalah 0,88 (validitas tinggi), dan reliabilitas 0,93 (reliable). Kepraktisan tes mencapai 75,33 (Praktis). Uji coba di sekolah ber-indeks kompetensi rendah, menengah, dan tinggi menemukan bahwa tes HOTs yang dikembangkan efektif untuk mengukur HOTs siswa. Kesimpulannya, tes HOTs yang dikembangkan pada penelitian ini valid, reliabel, praktis, dan efektif dalam mengukur kemampuan berpikir tingkat tinggi siswa dalam pembelajaran matematika.





Keywords


Assessment, HOTs, HOTs problems, thinking skills.

Full Text:

PDF

References


Anderson, L. ., Krathwohl, D. ., Airasian, P. ., Cruikshank, K. ., Mayer, R. ., Pintrich, P. ., Raths, J. ., & Wittrock, M. . (2001). A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives. In Longman.

Barak, M., & Dori, Y. J. (2009). Enhancing higher order thinking skills among inservice science teachers via embedded assessment. Journal of Science Teacher Education, 20(5), 459–474.

Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018). Best practices for developing and validating scales for health, social, and behavioral research: a primer. Frontiers in Public Health, 6, 149.

Brookhart, S. M. (2010). How To Assess Higher-Order Thinking Skills in Your Classroom. In Association for Supervision and Curriculum Development. Association for Supervision and Curriculum Development. https://doi.org/10.1177/002205741808801819

Brookhart, S. M., & Nitko, A. J. (2011). Strategies for Constructing Assessments of Higher-Order Thinking Skills. In G. Schraw & D. H. Robinson (Eds.), Assessment of Higher Order Thinking Skills (pp. 153–168). Information Age and Publishing. https://doi.org/10.4018/978-1-7998-2314-8.ch008

Budsankom, P., Sawangboon, T., Damrongpanit, S., & Chuensirimongkol, J. (2015). Factors affecting higher order thinking skills of students: A meta-analytic structural equation modeling study. Educational Research and Reviews, 10(19), 2639–2652.

Dinni, H. N. (2018). HOTS ( High Order Thinking Skills ) dan Kaitannya dengan Kemampuan Literasi Matematika. Prisma, 1, 170–176.

Faridah, R., Siswono, T. Y. E., & Rahaju, E. B. (2018). Developing Higher Order Thinking Skill (HOTS) Mathematic Problem Using That Quiz Application. Mathematics, Informatics, Science, and Education International Conference (MISEIC 2018), 167–170.

Fitriati, F., Marlaini, M., & Elizar, E. (2021). Integrating Rich Task into the Mathematics Classroom to Develop Students ’ Higher Order Thinking Skills : A Collaborative Action Research Study in a Secondary School. Ilkogretim Online - Elementary Education Online, 20(1), 479–494. https://doi.org/10.17051/ilkonline.2021.01.042

Gradini, E. (2019). MENILIK KONSEP KEMAMPUAN BERPIKIR TINGKAT TINGGI (HIGHER ORDER THINKING SKILLS) DALAM PEMBELAJARAN MATEMATIKA. Jurnal Numeracy, 6(2), 189–203.

Gradini, E., Firmansyah B, & Noviani, J. (2018). Menakar Kemampuan Berpikir Tingkat Tinggi Calon Guru Matematika Melalui Level HOTS Marzano. Eduma: Mathematics Teaching and Learning, 7(2), 41–48.

Gregory, R. J. (2011). Psychological Testing: History, Principles, and Applications (7th editio). Pearson.

Hajar, Y., Yanwar, R., Jalaludin, M. A., Achmad, N., Indriani, G. S., Hidayat, W., & Rohaeti, E. E. (2018). Analisis Kemampuan High Order Thinking (Hot) Siswa Smp Negeri Di Kota Cimahi. JPMI (Jurnal Pembelajaran Matematika Inovatif), 1(3), 453–458.

Hartatiana, Wardani, A. K., & Megawati, M. (2020). Kemampuan Berpikir Tingkat Tinggi Siswa SMP dalam Menyelesaikan Soal Matematika Model PISA. Jurnal Pendidikan Matematika, 14(01), 15–24.

Hartini, P., Setiadi, H., & Ernawati, E. (2021). Instrumen penilaian berbasis LOTS dan HOTS buatan guru kelas VI sekolah dasar mata pelajaran IPA di Jakarta. Jurnal Penelitian Dan Penilaian Pendidikan, 3(1), 14–24.

Izzati, N., Antika, R., Asma, N., & Siregar, R. (2020). PEMBIMBINGAN GURU DALAM MENGEMBANGKAN SOAL. JMM Jurnal Masyarakat Mandiri, 4(3), 370–381. https://doi.org/https://doi.org/10.31764/jmm.v4i3.2511

Jaelani, J., & Retnawati, H. (2016). The Challenges of Junior High School Mathematic Teachers in Implementing the Problem-Based Learning for Improving the Higher-Order Thinking Skills. Online Journal of Counseling & Education, 5(3).

Jansen, T., & Möller, J. (2022). Teacher judgments in school exams: Influences of students’ lower-order-thinking skills on the assessment of students’ higher-order-thinking skills. Teaching and Teacher Education, 111, 103616.

Kurniasi, E. R., & Arsisari, A. (2020). PENGEMBANGAN INSTRUMEN PENGUKUR HIGHER ORDER THINKING SKILLS (HOTS) MATEMATIKA PADA SISWA SEKOLAH MENENGAH PERTAMA. AKSIOMA: Jurnal Program Studi Pendidikan Matematika, 9(4), 1213–1222.

Kurniati, D., Harimukti, R., & Jamil, N. A. (2016). Kemampuan berpikir tingkat tinggi siswa SMP di Kabupaten Jember dalam menyelesaikan soal berstandar PISA. Jurnal Penelitian Dan Evaluasi Pendidikan, 20(2), 142–155.

Maharaj, A., & Wagh, V. (2016). Formulating tasks to develop HOTS for first-year calculus based on Brookhart abilities. South African Journal of Science, 112(11–12), 1–6.

Masniladevi, M., Oneika, S. E., & Helsa, Y. (2019). Development of HOTS Test Instruments as an Effort to Improve the Reasoning Ability of Elementary School Students by Using Edugames. 5th International Conference on Education and Technology (ICET 2019), 682–686.

Nafi’an, M. I., & Pradani, S. L. (2019). Analisis Kemampuan Pemecahan Masalah Siswa dalam Menyelesaikan Soal Matematika Tipe Higher Order Thinking Skill (HOTS). Kreano, Jurnal Matematika Kreatif-Inovatif, 10(2), 112–118.

Nieveen, N., & Folmer, E. (2013). Formative Evaluation in Educational Design Research. In T Plomp & N. Nieveen (Eds.), Netherlands Institute for Curriculum Development: SLO (pp. 152–169). Netherlands Institute for Curriculum Development: SLO.

OECD. (2019). Programme for International Student Assessment (PISA) results from PISA 2018. In Indonesia Country Note - PISA 2018 Results.

Plomp, Tjeerd. (2000). Development Research in / on Educational Development. CITE Seminar Series, 04.

Retnawati, H., Djidu, H., Kartianom, A., & Anazifa, R. D. (2018). Teachers’ knowledge about higher-order thinking skills and its learning strategy. Problems of Education in the 21st Century, 76(2), 215.

Retnawati, H., Hadi, S., & Nugraha, A. C. (2016). Vocational High School Teachers’ Fifficulties in Implementing the Assessment in Curriculum 2013 in Yogyakarta Province of Indonesia. International Journal of Instruction, 9(1), 33–48. https://doi.org/10.12973/iji.2016.914a

Retnawati, H., Munadi, S., Arlinwibowo, J., Wulandari, N. F., & Sulistyaningsih, E. (2017). Teachers’ difficulties in implementing thematic teaching and learning in elementary schools. New Educational Review, 48(2), 201–212. https://doi.org/10.15804/tner.2017.48.2.16

Rosdiana, M., Sumarni, S., & Siswanto, B. (2020). Implementation of 21st Century Learning Through Lesson Study. 4th International Conference on Arts Language and Culture (ICALC 2019), 346–353.

Sadieda, L. U., Indayati, T., Faizien, M. I., & others. (2018). Developing an assessment instrument of higher order thinking skills in mathematics with in Islamic context. Journal of Physics: Conference Series, 1097(1), 12151.

Sari, Y., Cahyaningtyas, A. P., Maharani, M. M., Yustiana, S., & Kusumadewi, R. F. (2019). Meningkatkan kemampuan menyusun soal IPA berorientasi HOTS bagi guru Sekolah Dasar Gugus Pandanaran Dabin IV UPTD Semarang Tengah. Indonesian Journal of Community Services, 1(2), 175. https://doi.org/10.30659/ijocs.1.2.175-183

Stacey, K. (2011). The PISA View of Mathematical Literacy in Indonesia. Journal of Research on Mathematics Education, 2(2), 95–126.

Susetyawati, M. M. E., & Nuryani, C. E. (2021). Developing Mathematics HOTS Test Items in Essay. Journal of Physics: Conference Series, 1823(1), 12041.

Tanudjaya, C. P., & Doorman, M. (2020). EXAMINING HIGHER ORDER THINKING IN INDONESIAN LOWER. Journal on Mathematics Education, 11(2), 277–300.

Tanujaya, B. (2016). Development of an Instrument to Measure Higher Order Thinking Skills in Senior High School Mathematics Instruction. Journal of Education and Practice, 7(21), 144–148.

Tasman, F. (2020). Improving Junior High School Teacher Ability in Designing Higher order Thinking (HOTS) Problems. Pelita Eksakta, 3(1), 25–30.

Yuliati, S. R., & Lestari, I. (2018). Higher-order thinking skills (hots) analysis of students in solving hots question in higher education. Perspektif Ilmu Pendidikan, 32(2), 181–188.




DOI: http://dx.doi.org/10.24127/ajpm.v11i1.4649

Refbacks

  • There are currently no refbacks.