ChatGPT Use and Self-Reported Academic Writing Development among EFL Students: An Explanatory Sequential Mix-Methods Study

Authors

Maya Marsevani International University of Batam image/svg+xml
Haeruddin Haeruddin International University of Batam image/svg+xml
Cite Copyright

Abstract

This study examined the association between ChatGPT use and self-reported academic writing development and explored students’ perceptions of its role across the planning, drafting, revising, and editing stages. A quantitative-priority explanatory sequential mixed-methods design was employed at one university in Batam, Indonesia. Using purposive sampling, questionnaire data were collected from 80 English Education students who had completed an academic writing course and used ChatGPT for writing tasks. Eight respondents with different ChatGPT-use profiles subsequently participated in semi-structured interviews. The quantitative results showed that higher composite ChatGPT-use scores were significantly associated with higher self-reported academic writing scores, explaining 60.1% of the variance. Based on the eight interviews, participants perceived ChatGPT as a source of support for idea generation, text organization, language refinement, revision, efficiency, and confidence. They also emphasized the importance of verifying information, evaluating AI-generated suggestions critically, maintaining authorship, and avoiding excessive dependence. These findings indicate an association between ChatGPT use and perceived writing outcomes rather than objectively measured or causal improvement. The interpretation is limited by the one-institution purposive sample, cross-sectional design, and reliance on self-reported data. Pedagogically, the findings suggest that verification practices, critical evaluation, academic integrity, and learner autonomy warrant further consideration in AI-assisted writing instruction.

Copyright

Copyright (c) 2026 Maya Marsevani, Haeruddin Haeruddin

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

References

Ahmadi, R. (2025). A qualitative investigation of ChatGPT’s impact on grammar proficiency in Iranian EFL students’ academic writing. ALC Journal, 1(3). https://doi.org/10.22034/alc.2026.570346.1029

Alghasab, M. (2025). Investigating EFL students’ ChatGPT usage and attitudes through the lens of the technology acceptance model (TAM). Educational Process: International Journal, 18. https://doi.org/10.22521/edupij.2025.18.507

Al-Harahsheh, A., Almahasees, Z., & Rousan, R. Al. (2025). The use of ChatGPT in academic writing by university students in Jordan. International Journal of Information and Education Technology, 15(7), 1468–1476. https://doi.org/10.18178/ijiet.2025.15.7.2348

Al-Obaydi, L. H., Pikhart, M., & Hossain, M. K. (2025). ChatGPT and the development of core language skills: An exploratory study of EFL college students. Contemporary Educational Technology, 17(4), 1–21. https://doi.org/10.30935/cedtech/17242

Apriani, E., Hamidah Daulay, S., Aprilia, F., Gafur Marzuki, A., Warsah, I., Supardan, D., & Muthmainnah. (2025). A mixed-method study on the effectiveness of using ChatGPT in academic writing and students’ perceived experiences. Journal of Language and Education, 11(1), 26–45. https://doi.org/10.17323/jle.2025.17913

Baidoo-Anu, D., & Owusu Ansah, L. (2023). Education in the era of generative Artificial Intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning. Journal of AI, 52(7), 52–62.

Bouzar, A., El Idrissi, K., & Ghourdou, T. (2024). ChatGPT and academic writing self-efficacy: Unveiling correlations and technological dependency among postgraduate students. Arab World English Journal, Special Issue, 225–236. https://doi.org/10.24093/awej/ChatGPT.15

Creswell, J. W. (2013). Qualitative Inquiry and Research Design: Choosing among Five Approaches (3rd ed.). SAGE Publications.

Ekizoğlu, M., & Demir, A. N. (2025). The role of AI assisted writing feedback in developing secondary students writing skills. Discover Education, 4(1), 1–16. https://doi.org/10.1007/s44217-025-00919-3

Fathimatuzahro, M., & Rizkiyah, F. (2025). AI-driven feedback in EFL students’ writing: Does it enhance their skills? Celtic : A Journal of Culture, English Language Teaching, Literature and Linguistics, 12(1), 637–657. https://doi.org/10.22219/celtic.v12i1.40594

Flower, L., & Hayes, J. R. (1981). A Cognitive Process Theory of Writing. College Composition and Communication, 32(4), 365–387. http://www.jstor.orgURL:http://www.jstor.org/stable/356600

Jelson, A., Manesh, D., Jang, A., Dunlap, D., & Lee, S. W. (2020). An empirical study to understand how students use ChatGPT for writing essays. CEUR Workshop Proceedings, 1(1), 1–9. https://doi.org/10.1145/nnnnnnn.nnnnnnn

Kasneci, E., Sessler, K., Uchemann, S. K. ¨, Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Unnemann, S. G. ¨, Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Urgen Pfeffer, J. ¨, Poquet, O., Sailer, M., Schmidt, A., Seidel, T., Stadler, M., … Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Elsevier, 103, 1–13. https://doi.org/10.1016/j.lindif.2023.102274

Kharis, S. A. A., & Indriyani, A. (2024). Analyzing social and psychological impacts: Shifting student interaction from teachers to ChatGPT in the learning process. EDUKATIF : JURNAL ILMU PENDIDIKAN, 6(5), 5500–5507. https://doi.org/10.31004/edukatif.v6i5.7109

Köhler, C., & Hartig, J. (2024). ChatGPT in higher education: Measurement instruments to assess student knowledge, usage, and attitude. Contemporary Educational Technology, 16(4), 1–15. https://doi.org/10.30935/cedtech/15144

Lai, T. K. L., & Trinh, H. L. (2025). The effects of ChatGPT on academic writing proficiency among English-majored undergraduates at a university. VNU Journal of Foreign Studies, 41(3), 92–109. https://doi.org/10.63023/2525-2445/jfs.ulis.5514

Laila, K. N., & Lestari, E. R. (2026). Students’ perceptions of the usage of ChatGPT in the editing and revising process of writing skills. Nusantara Journal of Multidisciplinary Science, 2(6), 860–868. https://jurnal.intekom.id/index.php/njms

Li, J., Huang, J., Wu, W., & Whipple, P. B. (2024). Evaluating the role of ChatGPT in enhancing EFL writing assessments in classroom settings: A preliminary investigation. Humanities and Social Sciences Communications, 11(1). https://doi.org/10.1057/s41599-024-03755-2

Lo, C. K., Hew, K. F., & Jong, M. S. yung. (2024). The influence of ChatGPT on student engagement: A systematic review and future research agenda. Computers and Education, 219, 1–21. https://doi.org/10.1016/j.compedu.2024.105100

Lubis, N. K., Azhar, F., & Daud, A. (2025). Students’ perception towards ChatGPT for academic writing at English study program FKIP. IDEAS: Journal of Language Teaching and Learning, Linguistics and Literature, 13(2), 4026–4038. https://doi.org/10.24256/ideas.v13i2.5887

Mai, D. T. T., Da, C. Van, & Hanh, N. Van. (2024). The use of ChatGPT in teaching and learning: a systematic review through SWOT analysis approach. Frontiers in Education, 9, 1–17. https://doi.org/10.3389/feduc.2024.1328769

Man, A., Tai, Y., Meyer, M., Varidel, M., Prodan, A., Vogel, M., & Krausz, R. M. (2023). Exploring the potential and limitations of ChatGPT for academic peer-reviewed writing: Addressing linguistic injustice and ethical concerns. Journal of Academic Language & Learning, 17(1), 16–30.

Marsevani, M., Sasmi, N. I., & Zaki, L. B. (2024). Examining EFL teachers’ perspectives: Enhancing learning through technology-integrated instruction. Linguists : Journal of Linguistics and Language Teaching, 10(2), 249–267. https://doi.org/10.29300/ling.v10i2.5390

Marsevani, M., Slikker, G. M., & Zaki, L. B. (2024). Appealing grammatical competence: Exploring the effectiveness of Kahoot! on young learners’ language proficiency. Jurnal Pendidikan Bahasa Inggris Undiksha, 12(3), 292–301. https://doi.org/10.23887/jpbi.v12i

Marsevani, M., Yeo, F., & Nurlaily. (2025). University-level students’ Difficulties in descriptive writing. English Journal, 19(1), 40–50. https://doi.org/10.32832/english.v19i1.18166

Massoud, O. S., & Zhang, J. (2025). Evaluating the impact of ChatGPT on ESL students’ perceptions of writing skills and academic Integrity. Sophia University Junior College Division Faculty Journal, 46, 33–54.

Mulyono, H., Kusuma Ningsih, S., & Sholeha Raufi, B. (2023). Validating the academic writing creativity and self-efficacy scale: A rasch model analysis. IRJE: Indonesian Research Journal in Education, 7(1), 121–135. https://doi.org/10.22437/irje

Munawwaroh, K., & Fahreza, M. R. (2025). Integrating AI tools in English writing classes to enhance student accuracy and coherence. The Journal of Academic Science, 2(5), 1507–1516. https://creativecommons.org/licenses/by/4.0

Muvid, M. B., Arnandy, D. A., Arrosyidi, A., & Sulistiowati, S. (2025). ChatGPT in education: A new paradigm for enhancing student learning and engagement. AL-ISHLAH: Jurnal Pendidikan, 17(1), 673–682. https://doi.org/10.35445/alishlah.v17i1.5874

Nisa, D. D. K., Basya, D., & Nugraheni, D. A. (2025). Exploring undergraduate students experiences on using ChatGPT in EFL academic writing classroom. Journal of English Language Proficiency, 2(1), 3090–6210.

Niswa, K., & Daulay, S. H. (2024). IDEAS Journal of Language Teaching and Learning, Linguistics and Literature Analyzing the Effectiveness of ChatGPT to Improving Student Writing Proficiency in Recount Texts. Journal of Language Teaching and Learning, Linguistics and Literature, 12(2), 1780–1787. https://doi.org/10.2456/ideas

O’brien-Melford, M. A. P., & Gador, S. C. (2025). ChatGPT as a tool for Enhancing explanation letter writing skills. International Journal of English Literature and Social Sciences, 10(6), 102–112. https://doi.org/10.22161/ijels

Pallivathukal, R. G., Soe, H. H. K., Donald, P. M., Samson, R. S., & Ismail, A. R. H. (2024). ChatGPT for academic purposes: Survey among undergraduate healthcare students in Malaysia. Cureus, 16(1), 1–18. https://doi.org/10.7759/cureus.53032

Pitychoutis, K. M. (2024). Harnessing AI chatbots for EFL essay writing: A paradigm shift in language pedagogy. Arab World English Journal, 2024-April(Special Issue), 197–209. https://doi.org/10.24093/awej/ChatGPT.13

Puteri, C. G., Cahyono, B. Y., Widiati, U., & Suryati, N. (2025). Using ChatGPT as a writing assistant: A study on essay quality development among Indonesian EFL university students. Indonesian Journal of Applied Linguistics, 15(2), 332–346. https://doi.org/10.17509/3ebmy158

Royani, I., & Sihombing, M. R. (2024). ChatGPT in the academic writing classroom. Steem Journal of English Education Study Programme, 7(2), 630–638.

Rozaimee, F., & Mumin, M. A. (2025). ChatGPT integration in writing development: Student experiences and perspectives. World Journal of English Language, 15(8), 74–83. https://doi.org/10.5430/wjel.v15n8p74

Sarwanti, S., Sariasih, Y., Rahmatika, L., Islam, M. M., & Riantina, E. M. (2024). Are they literate on ChatGPT? University language students’ perceptions, benefits and challenges in higher education learning. Online Learning Journal, 28(3), 105–130. https://doi.org/10.24059/olj.v28i3.4599

Serina, Febria, D., & Marsevani, M. (2025). Exploring the effectiveness of visual stimuli in improving eighth graders’ writing skills. Esteem Journal of English Education Study Programme, 8(2), 905–914. https://doi.org/10.31851/esteem.v8i2.19242

Siregar, H. R. H., Siregar, D. Y., & Damanik, E. S. D. (2024). Using artificial intelligence (AI) Chatgpt as a writing tool: Based on Efl students’ perceptions. Jurnal Ilmu Sosial, Humaniora Dan Seni (JISHS), 2(4), 754–760. http://jurnal.minartis.com/index.php/jishs

Solak, E. (2024). Revolutionizing language learning: How ChatGPT and AI are changing the way we learn languages. International Journal of Technology in Education, 7(2), 353–372. https://doi.org/10.46328/ijte.732

Susanti, N., Mariyati, N., & Ningsih, Y. (2024). Improving writing skills: A review of AI to a comprehensive approach. Jurnal SAGA, 2(1), 15–21.

Teng, M. F., & Wang, C. (2023). Assessing academic writing self-efficacy belief and writing performance in a foreign language context. Foreign Language Annals, 56(1), 1–25. https://doi.org/10.1111/flan.12638

Tian, J., & Zhang, R. (2025). Learners’ AI dependence and critical thinking: The psychological mechanism of fatigue and the social buffering role of AI literacy. Acta Psychologica, 260, 1–9. https://doi.org/10.1016/j.actpsy.2025.105725

Tseng, Y. C., & Lin, Y. H. (2024). Enhancing English as a foreign language (EFL) learners’ writing with ChatGPT: A university-level course design. Electronic Journal of E-Learning, 22(2), 78–97. https://doi.org/10.34190/ejel.21.5.3329

Vo, T. L., & Ho, T. M. P. (2026). A quasi-experimental study on enhancing EFL learners’ grammar precision in writing skills under supported-ChatGPT approach at a university in a remote region of Vietnam. Arab World English Journal, 2026-January(Special Issue 3), 361–375. https://doi.org/10.24093/awej/A3.23

Ya’u, M. S., & Mohammed, M. S. (2025). AI-assisted writing and academic literacy: Investigating the dual impact of language models on writing proficiency and ethical concerns in Nigerian higher education. International Journal of Education and Literacy Studies, 13(2), 593–604. https://doi.org/10.7575/aiac.ijels.v.13n.2p.593

Zhan, Y., & Yan, Z. (2025). Students’ engagement with ChatGPT feedback: implications for student feedback literacy in the context of generative artificial intelligence. Assessment and Evaluation in Higher Education. https://doi.org/10.1080/02602938.2025.2471821