Hide Assignment Information
Instructions
Assignment Submission Directions
In a word document copy the following questions and briefly (1-5 sentences) answer each.
What portion(s) of the LLM’s summary of the original article align with the claims of the original article?
What portion(s) of the LLM’s summary and counter argument align with each other?
What portion(s) of the summary or counter argument suggest the LLM may have been biased or sticking to restrictive rules?
What thoughts are you having about how you will use AI going forward?
What is one way you feel the assignment could be more engaging?
Save it as a PDF and submit it here.
For full points, your submission must be:
In PDF format
1-5 sentences per answer
You may go longer but keep it brief and to the point.
Answering the questions asked
If you completed Part 1&2, stop here. The instructions below are for reference only.
Research Engagement Part 1&2 Instructions (For Reference)
Part 1
Submit a PDF of your research article that you plan to use for the Large Language Model version of the Research Engagement assignment. In order to earn points the article must be:
From a peer reviewed psychology journal
Not sure how to find peer reviewed journal articles? Follow steps 2 through 5 of the library guide at this link:
https://libguides.library.arizona.edu/psy150a1
In PDF format
Related to one of the chapter topics covered in this course:
Ch1: What is Psychology
Ch2: Research Methods
Ch3: BioPsychology
Ch5: Sensation & Perception
Ch6: Learning
Ch7: Thinking & Intelligence
Ch9: Lifespan Development
Ch14: Stress, Lifestyle, and Health
Ch12: Social Psychology
Ch13: Industrial-Organizational Psychology
Ch15: Psychological Disorders
Ch16: Therapy & Treatment
Short enough that your Large Language Model of choice can take it as input
For grading: The article’s main body is less than 10 pages or 5,000 words, not counting citations or abstracts.
You will want to test your LLM of choice because it may have lower or higher limits on inputs.
Part 2
LLM Interaction Directions
Copy and paste the text of your peer reviewed psychology research article into the LLM of your choosing and ask the LLM to summarize the article.
Ask the LLM to provide a counterargument to the article’s main point.
Ask the LLM to provide sources (citations) supporting its counterargument.
IF the LLM provides at least 5 citations,
List the first five citations in your submission for this assignment (instructions on how to do this are below).
Identify which of those first 5 citations are real and which ones are not (hallucinations).
IF the LLM does not provide citations, continue to ask it to provide them until it complies OR until you have made 5 different requests for it to provide citations.
The 5 requests for citations must reasonably different from each other.
Assignment Submission Directions
Copy the entire transcript of your interaction with the Large Language Model to a word document.
At the top of the document, add the following identifying information:
Your Name
The Name of the LLM used
Link to the LLM
Make sure it is clear who is the student and who is the LLM in the document.
Example:
Student: Please read and summarize this paper:
LLM: OK, I’ve read the paper and here is my summary…
Make sure the transcript reads in chronological reading order from top to bottom
Example: Your earliest interactions are at the top of the page and the last interactions are at the bottom of the page.
Put line or spacing breaks between what you wrote and what the LLM wrote.
IF you were able to get the LLM to provide citations, highlight the first 5 provided and describe them at the top of the document using the format:
Source 1:
Evaluation: Real/Hallucination
Source 2:
Evaluation: Real/Hallucination
Source 3:
Evaluation: Real/Hallucination
Source 4:
Evaluation: Real/Hallucination
Source 5:
Evaluation: Real/Hallucination
IF you were not able to get the LLM to provide sources, list the 5 different prompts you used to attempted to get it to provide sources at the top of the document using the format:
Prompt 1:
Prompt 2:
Prompt 3:
Prompt 4:
Prompt 5:
Save and submit a PDF of the document you created according to these guidelines.
