A team from the University of Reading conducted an experiment to assess the detectability of AI-generated academic work.
Artificial intelligence is reshaping the academic landscape. From essay writing to research, AI tools are increasingly being used by college students. But how is this impacting the quality of education and the future of writing?
The absence of invigilation in many academic assessments creates an opportunity for students to submit AI-generated work as their original work.
And if students cheat using AI and this is undetected, the integrity of the way in which students are assessed is threatened.
Researchers from the University of Reading, UK, ran a real-world test of artificial intelligence infiltration of a university examinations system. They wanted to learn what would happen if they created fake student profiles and submitted the basic AI-generated work for those fake students without teachers knowing.
💬 We report a rigorous, blind study in which we injected 100% AI written submissions into the examinations system in five undergraduate modules, across all years of study, for a BSc degree in Psychology at a reputable UK university.
The general outcome of the study is that AI submissions verged on being undetectable, with 94% not being detected.
What’s more, with a stricter criterion for detection – a need for the flag to mention AI specifically – 97% of AI submissions went undetected.
Another key finding of the study is that the grades awarded to AI submissions were on average half a grade boundary higher than that achieved by real students.
The implications of AI-generated writing are far-reaching. As AI tools become more sophisticated, it’s essential to develop strategies to detect and deter academic dishonesty.
Additionally, teachers may need to reimagine traditional assessment methods to evaluate students’ original thought and creativity.
Via: Study: 94% Of AI-Generated College Writing Is Undetected By Teachers – Forbes
Leave a Reply