June 9, 2023

How to help students navigate AI as cheating-detection software remains imperfect

ChatGPT, created by OpenAI, is a free-to-use artificial intelligence chatbot created to “interact in a conversational way.” Released in late 2022, it has revolutionized the way we do things, fundamentally changing how we approach tasks and interact with technology. With over 100 million users, ChatGPT has effectively integrated itself into several different spaces— including schools and the way students complete assignments. 

Concerns surrounding ChatGPT in schools and higher education institutions started circulating as soon as the artificial intelligence (AI) chatbot was released. Educators shared their worries about students using ChatGPT to do their schoolwork for them and over the last several months have turned to AI cheating-detection software to identify whether or not an assignment was done using AI or not. While this may seem like a good strategy to ensure students are doing their work themselves, it has been proven that this software doesn’t always reliably detect AI in writing. In fact, it may be impossible

ChatGPT has quickly become an integral part of many students’ daily lives. While valid concerns exist regarding academic dishonesty, ChatGPT has also proven to be a valuable tool for students, such as providing creative inspiration or assisting in exam preparation. As ChatGPT’s influence continues to grow and cheating-detection software remains imperfect, our focus should shift towards encouraging students to play to their core and equip them with the skills to make high-character choices that align with their values as they navigate AI.

Detecting AI reliably may be impossible  

Concerns about students using ChatGPT to do their assignments for them are accompanied by concerns that AI cheating-detection software may be unreliable. Some professionals have even said that using this software to spot AI might be impossible

Turnitin, an educational software company used by many institutions, developed an AI cheating detector that, since its release, has reported on more than 38 million student essays. Earlier this year, Turnitin claimed that its tech had a less than 1% rate of producing false positive results. A false positive result is when “real student writing gets incorrectly flagged as cheating.” 

However, that rate is actually higher than Turnitin originally thought: its software incorrectly flags 4% of student writing. Because of this, Turnitin has had to make some adjustments and is urging educators to use their AI score in the software to start a meaningful and impactful dialogue with their students before jumping to conclusions that a student has used ChatGPT to cheat. 

What these reliability issues can mean for students

Though the error rate that comes from Turnitin’s cheating-detection software is technically small, a false accusation of cheating can be extremely damaging, especially in higher education institutions. In many schools, academic dishonesty is punishable by automatically failing the assignment or class, suspension, and even expulsion.

Reliability issues in this type of software can harm students in more ways than false accusations of cheating. They can generate undue stress as students fear being wrongly accused, disproportionately flag the work of non-native English speakers, and exacerbate mistrust between educators and students. 

These consequences can be life-changing for a student, and it begs the question: is using AI cheating-detection software worth it?

TSI’s Take

With the rapid advancements in technology, ChatGPT has emerged as a prime example of the ever-evolving digital landscape. It’s now our responsibility to guide students in adapting to these technological shifts and prepare them for the challenges and opportunities that lie ahead

Technology and social media involve more than what first meets the eye. What’s important is recognizing how they can impact students’ personal lives, well-being, and overall social development. It’s crucial to equip students with the knowledge and skills to navigate emerging AI platforms like ChatGPT responsibly, ensuring they play to their core by reflecting their values, character, and interests, and making informed choices that contribute to their positive growth. 

You can empower your students to practice positive AI use by encouraging them to: 

  • Critically evaluate the information they encounter while using AI platforms since not all the information provided by AI is accurate, timely, or reliable
  • Think about the potential consequences of making dishonest choices using AI and guide them toward high-character decisions that align with their values and reflect strong academic integrity
  • Engage in digital empathy and inclusivity by using AI in a positive and respectful way that avoids harmful language & behavior

To further empower students to use AI like ChatGPT in positive and high-character ways, educators can engage them in respectful and constructive conversations, seeking to learn and share knowledge responsibly. To help students navigate this journey, our ChatGPT Playbook & #WinAtSocial LIVE Lesson Breaking down ChatGPT and the role of artificial intelligence in our lives offer valuable insights and practical tips on using AI platforms ethically and effectively. 

Always stay up-to-date with the latest and greatest trends online by subscribing to our newsletter where we talk about trending tech and social media news weekly! In the meantime, check out our Instagram and TikTok @thesocialinst for tips, trends, and highlights when it comes to social media. 


The Social Institute (TSI) is the leader in understanding student experiences and creator of #WinAtSocial, a gamified, online learning platform that equips students, educators, and families to navigate social experiences — online and offline — in healthy ways. Our unique, student-respected approach incorporates topics like social media, technology use, and current events that have a significant impact on student well-being. Lessons teach life skills for the modern day to inspire high-character decisions that support the health, happiness, and future success of students, while capturing data that provides insights to school leaders to inform school policy and communications, and enable high-impact teaching and a healthy learning environment. For schools, our turnkey technology allows for easy implementation and a comprehensive game plan to support the well-being of school communities. For schools, our turnkey technology allows for easy implementation and a comprehensive game plan to support the well-being of school communities.