OPTIMIZING NUMERACY ASSESSMENTS: A DETAILED ITEM ANALYSIS FOR PHASE D STUDENTS

Sindi Amelia(1*), Indah Widiati(2), Gusri Yadrika(3),

(1) Universitas Islam Riau
(2) Universitas Islam Riau
(3) Universitas Riau
(*) Corresponding Author


Abstract


Dibandingkan dengan kemampuan literasi, kemampuan numerasi peserta didik Indonesia lebih memprihatinkan. Oleh karena itu, praktik yang dapat mendukung peningkatan kemampuan numerasi sangat dibutuhkan sebagai bentuk usaha untuk meningkatkan prestasi akademik peserta didik. Salah satunya adalah pemberian soal numerasi secara rutin untuk melatih peserta didik dalam menghadapi soal-soal berbasis kemampuan numerasi. Penyusunan soal numerasi yang berkualitas perlu melalui tahapan pengembangan yang ilmiah. Pada penelitian sebelumnya, telah dikembangkan instrumen soal numerasi untuk peserta didik fase D yang telah teruji validitas dan kepraktisannya melalui serangkaian kegiatan kualitatif, yaitu Self-Evaluation, Expert Review, One-to-one, dan Small Group. Untuk menyempurnakan kualitas soal numerasi bagi peserta didik fase D, penelitian dilanjutkan dengan kegiatan kuantitatif, yakni melalui tahapan Field Test. Tujuan dari penelitian ini adalah untuk menganalisis butir soal numerasi untuk peserta didik fase D dengan teknik analisis data menggunakan bantuan program Quest. Penelitian ini menghasilkan 21 butir soal numerasi yang valid dengan tingkat kesukaran yang ideal, yakni 19% soal sulit, 62% soal sedang, dan 19% soal mudah, serta tingkat reliabilitas yang baik sekali (0,92). Butir soal ini dapat digunakan di jenjang SMP atau Fase D sebagai asesmen diagnostik, formatif, maupun sumatif untuk mengukur tingkat kemampuan numerasi peserta didik.

 

Compared to literacy skills, the numeracy skills of Indonesian students are more alarming. Therefore, best practices that support the enhancement of students' numeracy skills are urgently needed as an effort to improve the academic performance of Indonesian students. One effective practice is giving numeracy problems routinely to train students in dealing with numeracy-based problems.. Developing high-quality numeracy questions requires a systematic and scientific approach. In previous research, a numeracy instrument for Phase D students was developed and validated through a series of qualitative activities (Self-Evaluation, Expert Review, One-to-One, and Small Group). To further improve the quality of the numeracy questions for Phase D students, this study will continue with quantitative activities, specifically through the Field Test phase. Aim of this study is to analyse the numeracy questions for Phase D students using data analysis techniques with the aid of the Quest program. This study resulted in 21 valid numeracy questions with an ideal difficulty distribution (19% difficult, 62% moderate, and 19% easy), and a high reliability score (0.92). These questions can be used at the middle school level or Phase D as diagnostic, formative, or summative assessments to measure students' numeracy skills.


Keywords


Numeracy Skill; Quest Program; Student Phase D.

Full Text:

PDF

References


Adi, Nur Romdlon Maslahul, Hidar Amaruddin, Habib Maulana Maslahul Adi, and Isna Laili Qurroti A’yun. 2022. ‘Validity and Reliability Analysis Using the Rasch Model to Measure the Quality of Mathematics Test Items of Vocational High Schools’. Journal of Research and Educational Research Evaluation 11(2):103–13. doi: https://doi.org/10.15294/jere.v11i2.58835.

Alhadabi, Amal, and Said Aldhafri. 2021. ‘A Rasch Model Analysis of the Psychometric Properties of the Student-Teacher Relationship Scale among Middle School Students’. European Journal of Educational Research volume–10–2021(volume–10–issue–2–april–2021):957–73. doi: 10.12973/eu-jer.10.2.957.

Alsina, Angel, Antonio Maurandi, Elvira Ferre, and Claudia Coronata. 2021. ‘Validating an Instrument to Evaluate the Teaching of Mathematics Through Processes’. International Journal of Science and Mathematics Education 19(3):559–77. doi: 10.1007/s10763-020-10064-y.

Amelia, Sindi, Indah Widiati, and Gusri Yadrika. 2023. ‘PENGEMBANGAN SOAL NUMERASI UNTUK PESERTA DIDIK FASE D’. AKSIOMA: Jurnal Program Studi Pendidikan Matematika 12(3):3048. doi: 10.24127/ajpm.v12i3.7236.

Aryadoust, Vahid, Li Ying Ng, and Hiroki Sayama. 2021. ‘A Comprehensive Review of Rasch Measurement in Language Assessment: Recommendations and Guidelines for Research’. Language Testing 38(1):6–40. doi: 10.1177/0265532220927487.

Asempapa, Reuben S., and Doris Lee. 2025. ‘Preservice Teachers’ Knowledge of Math Modeling: Initial Scale Development and Validation’. Discover Education 4(1):68. doi: 10.1007/s44217-025-00458-x.

Chan, Shiau-Wei, Chee-Kit Looi, Weng Kin Ho, Wendy Huang, Peter Seow, and Longkai Wu. 2021. ‘Learning Number Patterns through Computational Thinking Activities: A Rasch Model Analysis’. Heliyon 7(9):e07922. doi: 10.1016/j.heliyon.2021.e07922.

Dewi, Henda Harmantia, Siti Maftuhah Damio, and Sukarno Sukarno. 2023. ‘Item Analysis of Reading Comprehension Questions for English Proficiency Test Using Rasch Model’. REID (Research and Evaluation in Education) 9(1):24–36. doi: 10.21831/reid.v9i1.53514.

Erfan, Muhammad, Mohammad Archi Maulyda, Ida Ermiana, Vivi Rachmatul Hidayati, and Arif Widodo. 2020. ‘Validity and Reliability of Cognitive Tests Study and Development of Elementary Curriculum Using Rasch Model’. Psychology, Evaluation, and Technology in Educational Research 3(1):26–33. doi: 10.33292/petier.v3i1.51.

Ing, Marsha, Karl W. Kosko, Cindy Jong, and Jeffrey C. Shih. 2024. ‘Validity Evidence of the Use of Quantitative Measures of Students in Elementary Mathematics Education’. School Science and Mathematics 124(6):411–23. doi: 10.1111/ssm.12660.

Ismawati, Esti, Hersulastuti Hersulastuti, Indiyah Prana Amertawengrum, and Kun Andyan Anindita. 2023. ‘Portrait of Education in Indonesia: Learning from PISA Results 2015 to Present’. International Journal of Learning, Teaching and Educational Research 22(1):321–40. doi: 10.26803/ijlter.22.1.18.

Isnani, Isnani, Wikan Budi Utami, Purwo Susongko, and Herani Tri Lestiani. 2019. ‘Estimation of College Students’ Ability on Real Analysis Course Using Rasch Model’. REID (Research and Evaluation in Education) 5(2):95–102. doi: 10.21831/reid.v5i2.20924.

Junpeng, Putcharee, Metta Marwiang, Samruan Chinjunthuk, Prapawadee Suwannatrai, Kanokporn Chanayota, Kissadapan Pongboriboon, Keow Ngang Tang, and Mark Wilson. 2020. ‘Validation of a Digital Tool for Diagnosing Mathematical Proficiency’. International Journal of Evaluation and Research in Education (IJERE) 9(3):665. doi: 10.11591/ijere.v9i3.20503.

Kan, Adnan, Okan Bulut, and Damien C. Cormier. 2019. ‘The Impact of Item Stem Format on the Dimensional Structure of Mathematics Assessments’. Educational Assessment 24(1):13–32. doi: 10.1080/10627197.2018.1545569.

Kemendikbudristek RI. 2022. ‘Peraturan Menteri Pendidikan, Kebudayaan, Riset, Dan Teknologi Republik Indonesia Nomor 5 Tahun 2022 Tentang Standar Kompetensi Lulusan Pada Pendidikan Anak Usia Dini, Jenjang Pendidikan Dasar, Dan Jenjang Pendidikan Menengah.’

Kholid, Muhammad Noor, Faizatur Rofi’ah, Naufal Ishartono, Mohamad Waluyo, Swasti Maharani, Annisa Swastika, Nuqthy Faiziyah, and Christina Kartika Sari. 2022. ‘What Are Students’ Difficulties in Implementing Mathematical Literacy Skills for Solving PISA-Like Problem?’ Journal of Higher Education Theory and Practice 22(2):181–200.

Kim, Seock-Ho, Allan S. Cohen, and Hyo Jin Eom. 2021. ‘A Note on the Three Methods of Item Analysis’. Behaviormetrika 48(2):345–67. doi: 10.1007/s41237-021-00131-1.

Parnis, Amanda J., and Peter Petocz. 2016. ‘Secondary School Students’ Attitudes towards Numeracy: An Australian Investigation Based on the National Assessment Program—Literacy and Numeracy (NAPLAN)’. The Australian Educational Researcher 43(5):551–66. doi: 10.1007/s13384-016-0218-3.

Pusat Asesmen dan Pembelajaran. 2020. ‘Desain Pengembangan Soal AKM’.

Quaigrain, Kennedy, and Ato Kwamina Arhin. 2017. ‘Using Reliability and Item Analysis to Evaluate a Teacher-Developed Test in Educational Measurement and Evaluation’ edited by S. King Fai Hui. Cogent Education 4(1):1301013. doi: 10.1080/2331186X.2017.1301013.

Reffiane, Fine, Sudarmin, Wiyanto, and Sigit Saptono. 2021. ‘The Instrument Analysis of Students’ Problem-Solving Ability on Hybrid Learning Model Using ETNO-STEM Approach through Quest Program in COVID-19 Pandemic’. Pegem Journal of Education and Instruction 11(4):1–8. doi: 10.47750/pegegog.11.04.01.

Rizbudiani, Adilla Desy, Amat Jaedun, Abdul Rahim, and Arief Nurrahman. 2021. ‘Rasch Model Item Response Theory (IRT) to Analyze the Quality of Mathematics Final Semester Exam Test on System of Linear Equations in Two Variables (SLETV)’. Al-Jabar : Jurnal Pendidikan Matematika 12(2):399–412. doi: 10.24042/ajpm.v12i2.9939.

Rosnelli, Rosnelli, and Pitra Ashrin Ristiana. 2023. ‘Independent Curriculum Learning Management to Improve Students’ Literacy and Numerical Competence in Schools’. International Journal of Education in Mathematics, Science and Technology 11(4):946–63. doi: 10.46328/ijemst.3513.

Rusyid, Husnul Khatimah, Didi Suryadi, Tatang Herman, Mazlini Adnan, Ahmad Lutfi, and Ahmad Mukhibin. 2024. ‘Rasch Modeling Approach to Measure the Quality of Algebraic Thinking Questions for Junior High School Students’. Beta: Jurnal Tadris Matematika 17(1):55–71. doi: 10.20414/betajtm.v17i1.652.

Saryanto, Saryanto, Rudy Sumiharsono, Syahrul Ramadhan, and Edy Suprapto. 2020. ‘The Analysis of Instrument Quality to Measure theStudents Higher Order Thinking Skill in Physics Learning’. Turkish Journal of Science Education 17(4):520–27. doi: 10.36681/tused.2020.42.

Sinaga, Nurul Afni. 2016. ‘Pengembangan Tes Kemampuan Pemecahan Masalah Dan Penalaran Matematika Siswa SMP Kelas VIII’. PYTHAGORAS: Jurnal Pendidikan Matematika 11(2):169. doi: 10.21831/pg.v11i2.10642.

Sukarelawan, Moh. Irma, Jumadi Jumadi, Heru Kuswanto, and M. Anas Thohir. 2021. ‘The Indonesian Version of the Physics Metacognition Inventory: Confirmatory Factor Analysis and Rasch Model’. European Journal of Educational Research volume–10–2021(volume–10–issue–4–october–2021):2133–44. doi: 10.12973/eu-jer.10.4.2133.

Sumintono, Bambang, and Wahyu Widhiarso. 2015. Aplikasi Pemodelan Rasch Pada Assessment Pendidikan. Cimahi, Indonesia: Trim Komunikata.

Van Vo, De, and Benő Csapó. 2021. ‘Development of Scientific Reasoning Test Measuring Control of Variables Strategy in Physics for High School Students: Evidence of Validity and Latent Predictors of Item Difficulty’. International Journal of Science Education 43(13):2185–2205. doi: 10.1080/09500693.2021.1957515.

Yustitia, Via, Dian Kusmaharti, and Imas Srinana Wardani. 2025. ‘Students’ Critical Thinking in Numeracy Problem-Solving through Moderate Self-Efficacy: A Mixed-Methods Study’. Multidisciplinary Science Journal 7(8):2025410. doi: 10.31893/multiscience.2025410.




DOI: http://dx.doi.org/10.24127/ajpm.v14i1.10495

Refbacks

  • There are currently no refbacks.