Demo of TurnItIn - New AI Detection Tool

Sarah Moore, Ph.D.
4 Apr 202303:12

TLDRDr. Moore, a faculty member at the University of Texas at Dallas, demonstrates the capabilities of Turnitin's new AI detection tool. He simulates a student using an AI writer, Chat GPT, to generate a memo comparing three AI writing services. After uploading the AI-generated memo to Turnitin, it receives a 45% similarity score, indicating a match with previously uploaded content. However, upon closer inspection, Turnitin flags the document with an 'AI 100' warning, indicating it was entirely AI-written. This new feature is significant for educators as it can detect AI-generated content, which is considered unauthorized and could be classified as cheating. Dr. Moore emphasizes the importance of authentic student writing and suggests that this tool may prompt a reevaluation of grading rubrics and assignments.

Takeaways

  • ๐ŸŽ“ Dr. Moore is a faculty member at the University of Texas at Dallas and demonstrates the use of Turnitin's new AI detection tool.
  • ๐Ÿ“ He simulated a student's action by using an AI, Chat GPT, to write a memo comparing three AI writers based on a standard essay assignment prompt.
  • ๐Ÿ’ก The memo generated by Chat GPT was uploaded to Turnitin, which provided a similarity score of 45%, indicating matches with previously uploaded content.
  • ๐Ÿ” Turnitin did not flag the document as problematic but highlighted a potential source of concern with an 'AI 100' caution notice.
  • โš ๏ธ Upon clicking the 'AI 100' notice, it was revealed that the document was flagged as 100% AI written, which is a new feature of the tool.
  • ๐Ÿ“š The sources included in the memo were not flagged by Turnitin, but other phrases were, indicating that the tool is designed to detect AI-written content rather than just plagiarism.
  • ๐Ÿ‘€ The tool is intended to help faculty identify and review documents that may have been generated by unauthorized means, such as AI writing tools.
  • ๐Ÿ› ๏ธ Faculty are encouraged to consider revising their grading rubrics and assignments to adapt to the new capabilities of AI detection tools.
  • โœ๏ธ Students are warned that using AI to complete assignments without authorization is considered cheating and can lead to academic penalties.
  • ๐Ÿ“ˆ Turnitin's new tool is seen as a significant advancement in catching AI-generated content, which was not as effectively detected by previous versions.
  • ๐Ÿ“ˆ The video emphasizes that student writing is generally superior to AI-generated content, as it tends to be more nuanced, interesting, and better structured.
  • ๐Ÿ‘ Dr. Moore expresses appreciation for Turnitin's new strategies and encourages students to focus on their own writing abilities.

Q & A

  • What is the main topic of the video?

    -The main topic of the video is an introduction and demonstration of Turnitin's new AI detection tool and its ability to identify content generated by AI writers.

  • Who is the speaker in the video?

    -The speaker in the video is Dr. Moore, a faculty member at the University of Texas at Dallas.

  • What did Dr. Moore do to test the AI detection tool?

    -Dr. Moore created a memo comparing three AI writers using an AI tool called Chat GPT, then uploaded the memo to Turnitin to see how it would be flagged.

  • What was the similarity score of the memo generated by Chat GPT?

    -The similarity score of the memo generated by Chat GPT was 45%, indicating a match with previously uploaded content.

  • What does the 'AI 100' flag in Turnitin indicate?

    -The 'AI 100' flag in Turnitin indicates that the document is 100% AI written, which requires a manual review for potential academic misconduct.

  • Why did Turnitin not flag the sources used in the memo?

    -The video does not provide a clear explanation for why the sources were not flagged, but it could be due to the sources being genuine and not previously identified as problematic in Turnitin's database.

  • What is the implication for faculty and students regarding the use of AI writers?

    -The implication is that faculty should be aware of the new tool's capabilities and may need to adjust their grading strategies and assignments. Students should be cautious as using AI writers to complete assignments can be considered cheating.

  • What does Dr. Moore suggest about the quality of writing produced by AI?

    -Dr. Moore suggests that the quality of writing produced by AI is not as good as that of human students. He mentions that students can generally write more interesting and better-structured essays.

  • What is the potential consequence of using AI to complete assignments at the University of Texas at Dallas?

    -The potential consequence is that it can be found as an incidence of cheating if reported, as the university considers the use of AI to complete assignments as unauthorized means.

  • How does Dr. Moore conclude the video?

    -Dr. Moore concludes the video by encouraging students to do their best with their own writing and wishing them good luck.

  • What is the primary purpose of Turnitin's AI detection tool?

    -The primary purpose of Turnitin's AI detection tool is to identify content that has been generated by AI writers, which can be used to prevent academic misconduct.

  • What does the video suggest about the effectiveness of Turnitin's AI detection tool?

    -The video suggests that Turnitin's AI detection tool is effective in identifying AI-generated content, as it correctly flagged the memo created by an AI writer as 'AI 100'.

Outlines

00:00

๐Ÿ“š Testing Turnitin's AI Detection Tool

Dr. Moore, a faculty member at the University of Texas at Dallas, conducts an experiment to test Turnitin's new AI detection tool. He uses a standard essay assignment prompt, instructing students to write a memo comparing AI writers. He then inputs this prompt into Chat GPT to generate a memo, which he uploads to Turnitin. The tool provides a similarity score of 45%, indicating a match with previously uploaded documents. However, it does not flag the document as problematic. Upon closer inspection, Turnitin's 'AI 100' feature cautions that the percentage may not indicate academic misconduct and requires review. It correctly identifies the document as 100% AI-written, despite not flagging the sources used. Dr. Moore emphasizes the importance of original student writing and suggests that faculty may need to adjust their grading strategies and assignments to account for the rise of AI writing tools.

Mindmap

Keywords

๐Ÿ’กTurnItIn

TurnItIn is an online plagiarism detection service used by academic institutions to check the originality of student's work. In the video, Dr. Moore discusses the latest updates to TurnItIn's AI detection tool, which is designed to identify content generated by artificial intelligence, such as essays written by AI writers.

๐Ÿ’กAI Detection Tool

An AI Detection Tool is a software feature that can analyze text to determine if it was written by a human or an AI. In the context of the video, TurnItIn's new AI detection tool is highlighted as a significant advancement in identifying AI-generated content, which is crucial for maintaining academic integrity.

๐Ÿ’กFaculty

Faculty refers to the academic staff of a university or college. Dr. Moore, as a faculty member at the University of Texas at Dallas, demonstrates the use of TurnItIn's AI detection tool, indicating the role of faculty in ensuring the authenticity of student submissions.

๐Ÿ’กMemo

A memo, short for memorandum, is a document used for internal communication, typically in a business or academic setting. In the video, Dr. Moore assigns students to write a memo comparing AI writers, which he then uses to test the effectiveness of TurnItIn's AI detection tool.

๐Ÿ’กAI Writers

AI Writers are artificial intelligence systems capable of generating human-like text. The video script involves a comparison of three AI writers, which is the assignment prompt that Dr. Moore uses to create a test case for evaluating TurnItIn's AI detection capabilities.

๐Ÿ’กChat GPT

Chat GPT, presumably a reference to a chatbot or AI language model, is used by Dr. Moore to generate a memo for his assignment prompt. The generated memo is then uploaded to TurnItIn to test the AI detection tool's ability to identify AI-written content.

๐Ÿ’กMicrosoft Word

Microsoft Word is a widely used word processing software. Dr. Moore mentions using Microsoft Word to save the memo generated by the AI before uploading it to TurnItIn, indicating the common use of such software in academic and professional document preparation.

๐Ÿ’กSimilarity Score

A Similarity Score is a percentage indicating the extent to which a document matches other documents in a database. In the video, TurnItIn provides a similarity score of 45 for the memo, suggesting a match with previously uploaded content, which is a standard part of plagiarism detection.

๐Ÿ’กAcademic Misconduct

Academic Misconduct refers to actions that violate academic integrity, such as plagiarism or cheating. The video emphasizes that using AI to complete assignments without authorization, as demonstrated with Chat GPT, is considered academic misconduct at the University of Texas at Dallas.

๐Ÿ’กRubrics

Rubrics are scoring tools used to evaluate the quality of students' work based on specific criteria. Dr. Moore suggests that faculty might need to change their rubrics and assignments in response to the ability of AI detection tools to identify AI-written content.

๐Ÿ’กCheating

Cheating is the act of using dishonest methods to gain an advantage, particularly in an academic context. The video script mentions that using AI to write essays, as tested with TurnItIn, can be found as an incidence of cheating if reported, underscoring the importance of original student work.

Highlights

Dr. Moore demonstrates Turnitin's new AI detection tool.

A memo comparing three AI writers was generated using chat GPT.

The memo was uploaded to Turnitin which returned a similarity score of 45%.

Turnitin did not flag the memo as problematic, indicating a traditional match.

The memo was correctly flagged as 100% AI written content upon further review.

Turnitin's caution message advises that the percentage may not indicate academic misconduct and requires review.

Sources included in the memo were not flagged by Turnitin.

Faculty are encouraged to consider new strategies and changes to rubrics and assignments to counteract AI writing.

The use of chat GPT for completing assignments is considered unauthorized and may be classified as cheating.

Turnitin's tool is expected to catch instances of cheating that have previously gone undetected.

Dr. Moore expresses confidence that students can write better essays than those generated by AI.

The video aims to inform faculty and students about the capabilities and implications of Turnitin's AI detection tool.

The AI-generated memo lacks a conclusion and is deemed of lower quality than student writing.

Faculty at the University of Texas at Dallas are adapting to the new tool to prevent academic misconduct.

Turnitin's update is a response to the rise in AI writing tools like chat GPT.

The video serves as a tutorial and a warning about the ethical use of AI in academic writing.

Students are reminded that their original writing is generally superior to AI-generated content.

The demonstration concludes with well wishes and an encouragement for best practices in academic writing.