EXPLORING THE EFFECTIVENESS OF CHATGPT AS A CONVERSATIONAL PARTNER ON EFL STUDENT’S SPEAKING SKILLS: A QUASI-EXPERIMENTAL STUDY IN INDONESIA HIGHER EDUCATION
(1) English Department, Universitas Muhammadiyah Metro, Indonesia
(2) English Department, Universitas Muhammadiyah Metro, Indonesia
(3) English Department, Universitas Muhammadiyah Metro, Indonesia
(*) Corresponding Author
Abstract
This study explores the effectiveness of ChatGPT in enhancing the speaking skills of EFL undergraduate students in the Hospital Administration program at Universitas Muhammadiyah Metro. A quasi-experimental research design was employed, involving 42 first-semester students divided into two groups: 21 students in ARS 1 as the experimental group and 21 students in ARS 2 as the control group. The experimental group received treatment using specific prompts designed to initiate conversations with ChatGPT. Data were collected through oral tests conducted before and after the intervention (pre-test and post-test). The results indicate a statistically significant improvement in the speaking skills of students in the experimental group. Hypothesis testing showed a significant value of <0.000 for the first hypothesis and 0.004 for the second, both below the threshold of 0.05, indicating that the alternative hypotheses were accepted. In conclusion, the use of ChatGPT had a positive and significant effect on improving the speaking skills of EFL students in the Hospital Administration program. The results highlight the potential of ChatGPT to supplement classroom speaking activities, while contributing to research on AI in EFL learning.
Keywords
References
Akhter, S. (2021). Exploring the significance of speaking skill for EFL Learners. Sir Syed Journal of Education & Social Research, 4(3).1-9. https://doi.org/10.36902/sjesr-vol4-iss3-2021(1-9)
Alsalem, M. S. (2024). EFL students’ perception and attitude towards the use of ChatGPT to promote English speaking skills in the Saudi context. Arab World English Journal, 15(4), 73–84. https://doi.org/10.24093/awej/vol15no4.5
Brown, H. D. (2004). Language Assesment: Principles and Classroom Practice. Longman.
Desnaranti, L., & Putra, F. P. (2022). Undergraduate students perceptions’ analysis about difficulties in English Speaking. Research and Development Journal of Education, 8(2), 469. https://doi.org/10.30998/rdje.v8i2.12862
Du, J., & Daniel, B. K. (2024). Transforming language education: A systematic review of AI-powered chatbots for English as a foreign language speaking practice. In Computers and Education: Artificial Intelligence (Vol. 6). Elsevier B.V. https://doi.org/10.1016/j.caeai.2024.100230
Huang, J. (2024). Enhancing EFL speaking feedback with ChatGPT’s voice prompts. International Journal of TESOL Studies, 6(3), 4–13. https://doi.org/10.58304/ijts.20240302
Huy, N. Van, Nam, N. T., & Bon, B. N. (2024). The importance of speaking in English as a foreign language between skillful and thoughtful competencies: Studying sociolinguistics perspectives. International Journal of English Language Studies. 6(2). 153-159 . https://doi.org/10.32996/ijels
Islam, M. S., & Roy, S. (2024). Challenges in developing learners’ English-speaking skills at the tertiary level in the EFL context: Teachers’ and learners’ perceptions.Research Square. https://doi.org/10.21203/rs.3.rs-4491944/v1
Ismailia, T. (2021). Performance assessment using rubric to improve students’ speaking skill. Journal of Applied Linguistics and Literacy, 5(2). 65-82. https://doi.org/https://dx.doi.org/10.25157/jall.v5i2.5786
Kim, S., & Lee, J. (2023). The effect of voice-enabled ChatGPT on speaking proficiency, affective and metacognitive domains of Korean EFL learners. Journal of Research in Curriculum & Instruction, 27(4), 344-359. https://doi.org/10.24231/rici.2023.27.4.344
Kohnke, L., Moorhouse, B. L., & Zou, D. (2023). ChatGPT for Language Teaching and Learning. RELC Journal, 54(2).537-550. https://doi.org/10.1177/00336882231162868
Long, M. H. (1996). The role of the linguistic environment in second language acquisition. 413-468. https://doi.org/10.1016/b978-012589042-7/50015-3
Muniandy, J., & Selvanathan, M. (2024). ChatGPT, a partnering tool to improve ESL learners’ speaking skills: Case study in a public university, Malaysia. Teaching Public Administration.1-178. https://doi.org/10.1177/0144739424123015
Nhu, P. T. T. (2024). Investigating the effectiveness of practicing English conversation with ChatGPT in improving non-English majored students’ English speaking skills at Nguyen Tat Thanh University. Journal of Science and Technology, 7(4). 175-182. https://doi.org/10.55401/b1rnww21
Nuñez, A. A. C., Nuñez, M. S. C., Pachay, J. F. Z., & Bosquez, A. M. C. (2025). Using ChatGPT voice to improve speaking skills in English Language Learners. Ciencia Latina Revista Científica Multidisciplinar, 9(1), 7143–7161. https://doi.org/10.37811/cl_rcm.v9i1.16390
OpenAI. (2023). ChatGPT: Optimizing language models for dialogue. OpenAI.
Phuong, N. T. K. (2024). The role of ChatGPT in teaching speaking skills for English majored students: A research perspective. International Journal of Social Science and Human Research, 07(10). 7815-7819. https://doi.org/10.47191/ijsshr/v7-i10-60
Pratiwi, N., Efendy, A. G., Rini, H. C., & Ahmed, N. A. (2024). Speaking practice using ChatGPT’s voice conversation: A review on potentials and concerns. Journal of Language Intelligence and Culture, 6(1), 59–72. https://doi.org/10.35719/jlic.v6i1.149
Raihan. (2017). Metodologi Penelitian. Universitas Islam Jakarta.
Salsabil, A. D., & Rakhmawati, L. A. (2025). From Silent learners to confident speakers: The effect of AI voice chat with ChatGPT on EFL speaking skills. Journal of English Education, 3(1), 38–50. https://doi.org/10.61994/jee
Siyoto, S., & Sodik, A. (2015). Dasar metodologi penelitian. Literasi Media Publishiing.
Sugiyono. (2022). Metode Penelitian Kuantitatif , Kualitatif, dan R&D (26th ed.). Bandung: Alfabeta.
Szabó, F., & Csépes, I. (2022). Constructivism in language pedagogy. Hungarian Educational Research Journal, 13(3), 405–417. https://doi.org/10.1556/063.2022.00136
Üstünbaş, Ü. (2024). Hey, GPT, Can We Have a Chat?: A case study on EFL learners’ AI speaking practice. International Journal of Modern Education Studies, 8(1). 91-107. https://doi.org/10.51383/ijonmes.2024.318
Zakiyah, . (2025). AI-driven language learning: Can chatGPT improve student speaking proficiency? KnE Social Sciences, 10(14), 20–37. https://doi.org/10.18502/kss.v10i14.19071
DOI: http://dx.doi.org/10.24127/pj.v14i3.12338
Refbacks
- There are currently no refbacks.
Copyright (c) 2025 Authors
This work is licensed under a Creative Commons Attribution 4.0 International License.
Published by Universitas Muhammadiyah Metro
Scientific Publication Unit (UPI)
Gd. HI, Lt1 Kampus 1 Universitas Muhammadiyah Metro
Jl. Ki Hajar Dewantara 116 A
Kota Metro Lampung 34145 Indonesia
Email : help.upi@ummetro.ac.id
Phone : +62-725-42445
Fax : +62-725-42454
Mobile : +62-8570914-1060
Certificate of Accreditation (Volume 11 No 1, 2022-Volume 15 No 2, 2026
