Open Access Te Herenga Waka-Victoria University of Wellington
Browse

Human-AI collaboration patterns in AI-assisted academic writing

journal contribution
posted on 2024-02-28, 21:40 authored by Andy Nguyen, Ee Von HongEe Von Hong, Belle Dang, Xiaoshan Huang
Artificial Intelligence (AI) has increasingly influenced higher education, notably in academic writing where AI-powered assisting tools offer both opportunities and challenges. Recently, the rapid growth of generative AI (GAI) has brought its impacts into sharper focus, yet the dynamics of its utilisation in academic writing remain largely unexplored. This paper focuses on examining the nature of human-AI interactions in academic writing, specifically investigating the strategies doctoral students employ when collaborating with a GAI-powered assisting tool. This study involves 626 recorded activities on how ten doctoral students interact with GAI-powered assisting tool during academic writing. AI-driven learning analytics approach was adopted for three layered analyses: (1) data pre-processing and analysis with quantitative content analysis, (2) sequence analysis with Hidden Markov Model (HMM) and hierarchical sequence clustering, and (3) pattern analysis with process mining. Findings indicate that doctoral students engaging in iterative, highly interactive processes with the GAI-powered assisting tool generally achieve better performance in the writing task. In contrast, those who use GAI merely as a supplementary information source, maintaining a linear writing approach, tend to get lower writing performance. This study points to the need for further investigations into human-AI collaboration in learning in higher education, with implications for tailored educational strategies and solutions.

History

Preferred citation

Nguyen, A., Hong, Y., Dang, B. & Huang, X. (n.d.). Human-AI collaboration patterns in AI-assisted academic writing. Studies in Higher Education. https://doi.org/10.1080/03075079.2024.2323593

Journal title

Studies in Higher Education

Publisher

Taylor & Francis

Publication status

Published online

Contribution type

Article

Online publication date

2024-02-28

ISSN

0307-5079

eISSN

0307-5079

Usage metrics

    Journal articles

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC