Students as content experts critiquing ChatGPT

Teacher instructions: Consider a prompt with which you can prompt ChatGPT. Visit ChatGPT to enter your prompt and generate your response. Some sample ideas from various disciplines:

After generating a prompt from ChatGPT, copy and paste the response into a document and save the document as a PDF. Set it up in your LMS as an Hypothesis-enabled reading. Then, copy and paste these instructions into your own course to use with your students. Be sure to review the instructions before posting in your courses. You may want to make adjustments depending on how you plan to assess annotations or due to your specific discipline and/or assignment.

Instructions for students

Purpose: The purpose of this assignment is to use course materials (readings, lectures, etc) to critique ChatGPT’s writing. Collaboratively annotating ChatGPT’s work will allow us to review and examine key course ideas in a critical way by examining what an AI tool has produced. You can review a quick-start guide for how to add annotations here.

Instructions: As you review the text, add at least 2-3 annotations. Here’s some guidance for what you might consider and/or include in your annotations:

  • Comment on whether or not ChatGPT answered all parts of the prompt completely. Include details about what information is missing, or where extraneous information may have been included that did not need to be.
  • Assess the references and/or citations that ChatGPT provides (or lack thereof). Explain what course materials and authors are appropriate to cite or reference for specific details,
  • Identify areas where ChatGPT either elaborates well/provides sufficient explanation, or fails to do so, and support your response.
  • Identify examples of ChatGPT “hallucinating,” misinforming, or expressing bias. Provide an explanation to support your response.Identify a place in the reading where you are made aware that you are interacting with an AI tool/large language model and not a human author. Explain your thought process.
  • Provide a rewritten version of a sentence or sentence(s) that you feel could be improved with regards to content.
  • If ChatGPT is writing in a specific style, perspective, or from a specific author’s point of view: assess the accuracy by which ChatGPT does so.
  • Comment on how ChatGPT does or does not follow the “rules” of a specific writing style.
  • Comment on incorrect ideas included in a specific perspective or point of view.
  • Reply to a classmate with an additive annotation (add to the conversation by answering their question or extending their response). Here are some ideas on how to start an additive response to a classmate:
    • What did you mean by…
    • Did you consider…/ You might consider…
    • I think you should…
    • I connect with…/It made me think…

Important notes about annotating:

  • Make sure you hit “Post” after you complete your annotation, or else your annotation will not be saved.
  • Make sure it says “Post to [this class]” and not “Post to only me” or else I won’t be able to review your annotations.
  • If someone replies to your annotation, you will not receive a notification. Check back periodically to continue the conversation!