-
Posts
4,563 -
Joined
-
Last visited
-
Days Won
125
richardmurray's Achievements
Single Status Update
See all updates by richardmurray
-
Larry Buchanan/The New York Times
Did a Fourth Grader Write This? Or the New Chatbot?
Don’t be surprised if you can’t always tell. Neither could a fourth-grade teacher — or Judy Blume.
By Claire Cain Miller, Adam Playford, Larry Buchanan and Aaron Krolik Dec. 26, 2022
It’s hard to fully grasp the enormous potential of ChatGPT, a new artificial intelligence chatbot released last month. The bot doesn’t just search and summarize information that already exists. It creates new content, tailored to your request, often with a startling degree of nuance, humor and creativity. Most of us have never seen anything like it outside of science fiction.
To better understand what ChatGPT can do, we decided to see if people could tell the difference between the bot’s writing and a child’s.
We used real essay prompts from the National Assessment of Educational Progress (the standardized test from the Department of Education, known as the nation’s report card). We asked the bot to produce essays based on those prompts — sometimes with a little coaching, and always telling it to write like a student of the appropriate age. We put what it wrote side by side with sample answers written by real children.
We asked some experts on children’s writing to take our variation on the Turing test, live on a call with us. They were a fourth-grade teacher; a professional writing tutor; a Stanford education professor; and Judy Blume, the beloved children’s author. None of them could tell every time whether a child or a bot wrote the essay. See how you do.
BELOW ARE PROMPTS , can you tell if they are from human children or chatbot, if you want to test yourself, go to the article url after my thoughts and test yourself
Prompt 1: School Lunch
The following prompt was given to fourth graders.
Describe what lunchtime is like for you on a school day. Be sure to tell about your lunchtime so that someone who has never had lunch with you on a school day can understand where you have lunch and what lunchtime is like.
Here are three answers. They were written either by a real fourth grader or ChatGPT. (You can read all three before deciding. But once you pick, your choices lock in. Then keep scrolling to see how our experts did.)
1 of 10
Essay 1: A fun and exciting timeLunchtime on a school day is a fun and exciting time for me and my friends. We usually go to the cafeteria, which is a big and noisy room filled with tables and chairs. After getting our lunch from the lunch ladies, we find a spot to sit and enjoy our meal. I like to bring a yummy sandwich and a cold juice box for lunch, and sometimes I'll even pack a tasty piece of fruit or a bag of crunchy chips. As we eat, we chat and laugh and catch up on each other’s day.
Overall, lunchtime is a great opportunity to take a break from classes and spend time with my friends. I always look forward to it, and I always have a good time. The cafeteria can be a little crowded and noisy, but it's a fun and lively place to be. I’m grateful that I get to enjoy a delicious lunch with my friends every day.
Human child
ChatGPT2 of 10
Essay 2: I usually eat cold lunchAt lunchtime I usually eat cold lunch. My mother packs me a sandwich, a drink, fruit, and a treat. When I get in the lunchroom I find an empty table and sit there, and eat my lunch. My friends come and sit down with me. I open my lunch and start to eat. First I eat my sandwich then I open my drink, then eat my fruit and last but not least my treat. After that I sit quietly until I am dismissed. When I am I go into to the bathroom and clean my teeth because I have braces.
When I am done with that I go outside and put my lunchbox away and go find my friends. We usually play four square or play on the play ground. If we are not on the playground or on the four square ground we are on the field playing tag, kickball, or soccer. I really like to play soccer and my friends do too.
Human child
ChatGPT3 of 10
Essay 3: Everybody talksLunch time in my school is very noisy, because everybody talks. The 4th, 5th, and 6th graders at my school have to eat lunch at the same time. We all sit at tables that are set up in the gym, across half of the basketball court. We eat lunch every day from 11:45 am through 12:00 pm. At lunch everyone eats and talks to their friends until the lunch-moms dismiss them so they can go to recess. When everybody has cleared out of the lunch room, the janitors and lunch moms whipe off the tables, just on time for the 7th and 8th graders to come into the room for lunch. After lunch and recess I go back to my 4th grade classroom, which is in the basement. I like lunch time a lot — it’s my favorite time of the day!
Human child
ChatGPTPrompt 2: Becoming President
The following prompt was given to eighth graders.
Imagine that you wake up one morning to discover that you have become the President of the United States. Write a story about your first day as President.
Here are three answers:
4 of 10
Essay 1: Royal blue silk sheetsIt was my first official day being the president. I woke up early that day because I was extremely eager to begin my work.
I woke up in the most enormous bed I’ve ever laid eyes on. There were layes of royal blue silk sheets under a soft white down comforter. The deep red pillows supported my head and had helped me to enjoy a good nights’ rest.
I hesitated before climbing out of bed, not wanting to leave my sense of eutopia. I eventually found myself making my way to the walk-in closet across the room. In it were countless pants, shirts, shoes, and ties that were all unique, so it wasn't a difficult decision.
I heard a knock on the door and call for them to come in. It was my maid. Yes, I had a maid! I couldn’t believe it.
I sprang downstairs to the breakfast table as numerous people were awaiting to serve me. It was delicious.
After brushing my teeth and doing all of the other essentials, it was time for me to take charge.
My office was humungus and was covered, floor to ceiling with rows and rows of books. In front of gigantic windows, was my desk, where I sat for many hours of the day stressing out over papers I needed to sign and decisions I had to make. It wasn’t as simple as I thought.
That night I had a dinner party to attend with some important businessmen. Everything ran smoothly.
I returned home that night to my cozy bed, just in time for yet another good nights’ sleep. Only to wake up and repeat it all tomorrow. What a life I live.
Human child
ChatGPT5 of 10
Essay 2: Shocked and amazedOne morning, I woke up to discover that I had become the President of the United States. I was shocked and amazed, but I quickly realized that I had a huge responsibility on my shoulders.
I got dressed and headed to the White House, where I was greeted by the Secret Service and my staff. They told me that I had a busy day ahead of me, with meetings with foreign leaders and important decisions to make.
I met with the Vice President and the rest of the Cabinet, and we discussed the major issues facing the country. I listened carefully to their advice, and made some tough decisions.
I also met with the leaders of other countries, and we discussed ways to improve relations and solve global problems. I was nervous at first, but I soon realized that I was up to the task.
At the end of the day, I was exhausted but proud of what I had accomplished. I knew that being President was a huge challenge, but I was ready to face it head on. I went to bed that night, ready for the challenges that the next day would bring.
Human child
ChatGPT6 of 10
Essay 3: Madam PresidentIt was a typical Tuesday morning. I woke up, got dresesed, and went downstairs to eat breakfast. But as I was pouring myself a bowl of cereal, I heard a knock on the door. I opened it to find a man in a suit standing on my porch.
“Good morning, Madam President,” he said. “I’m here to take you to the White House.”
I was stunned. I had no idea what he was talking about. I had never even run for presidnet.
“I’m sorry, but there must be some mistake,” I said. “I’m just an eighth gradeer.”
The man chuckled. “I understand your confusion, Madam President, but the fact remains that you are now the President of the United States. You were chosen by the previous president to be his successor in the event that something were to happen to him.”
I was speechless. I had never even thought about being president before. And now, all of a sudden, I was the leader of the free world.
The man ushered me into a black car and we drove to the White House. When we arrived, I was greeted by a crowd of people and a flurry of flashing cameras. I was whisked inside and taken to the Oval Office, where I was given a briefing on the state of the nation.
It was a crisis-filled day. The economy was in shambles, the nation was divided, and there were threats of war on the horizon. I had to make tough decisions and work with other world leaders to try and solve these problems.
But despite the challenges, I felt a sense of pride and responsibility. I was the President of the United States, and I was determined to do my best for my country and its people.
Human child
ChatGPT
Prompt 3: A Castle AppearsThe following prompt was given to fourth graders.
One morning a child looks out the window and discovers that a huge castle has appeared overnight. The child rushes outside to the castle and hears strange sounds coming from it. Someone is living in the castle!
The castle door creaks open. The child goes in.
Write a story about who the child meets and what happens inside the castle.
And here are four answers (don’t worry, they’re shorter):
7 of 10
Essay 1: John the knight“Wow a castle!” said John. He had know clue of how it got here or where it came from? He walked inside and found that it was rather damp. He wandered around until finally he saw someone. This person didn’t look normal. He was dressed in royalty with a purple cape and a crown of jewels. Then the person spoke out. “There you are you’re supposed to be training right now.” John had know clue what he was talking about. Suddenly he thought of something, was this the King of the castle? He finally got the nerve to ask a question. He asked “Who are you”. He answered “I’m the King.” John was shocked. Then the King told him to get on his armor. John thought and thought. Then he knew what he was talking about. He thought he was a knight. John thought again. If he was to be a knight then he would never see his family again. Then he thought of his older sister, Jennifer. He decided to be a knight. After about 2 months he finally was knighted. He fought many dragons and man. He finally died but is still a legend today. The end.
Human child
ChatGPT8 of 10
Essay 2: A dragon named SparkyOne morning a child looks out the window and discovers that a huge castle has appeared over knight. The child rushes outside to the castle and hears strange sounds coming from it. Someone is living in the castle! The castle door creaks open and the child goes in. The child walks into the castle and is amazed by what they see. The walls are made of shiny stones, and there are torches burning along the walls, casting a warm glow on the room. The child hears a voice calling out from deep inside the castle. “Is anyone there?” the child calls out. “Yes, I’m here!” the voice says. The child follows the voice until they come to a room with a big fireplace. Inside the fireplace, the child sees a small, friendly-looking dragon. “Hello!” the dragon says. “I'm Sparky, I’m the only one who lives here in the castle, I've been all alone for a very long time.” The child is amazed. They have never seen a real dragon before. “Do you want to be friends?” the dragon asks. The child nods and smiles, “Yes, I would love to be friends with you, Sparky.” Sparky is so happy to have a new friend, he shows the child all around the castle. They play games and explore the castle together. The child has the best day of their lie, and they can't wait to come back and visit Sparky again!
Human child
ChatGPT9 of 10
Essay 3: Tsharra exploresOnce there was a little girl who had looked out of her bedroom window. Her name, was Tsharra. She was only 5 yrs. old. Tsharra spotted a castle right in front of her house. So she decided to explore. She went to the front of the castle and a chain wood door opened. It sounded like it needed oil on the hinges. Tsharra stepped her tiny foot in. She looked straight ahead and saw a velvit red thrown on the ground. It has 3 steps that leaded to a marble deck. There were 2 tall chairs and in them were a king and queen. The king and queen wore golden sparkly crows with lots of diamonds and jewls. They both wore purple velvet caps that went all the way around them. Tsharra was amazed she was starring straight in the eyes of a real king and queen. The king and queen had not a son or daughter. The king and queen were whispering back and forth. Should we keep her said one. Sure said the other. We should adapt her by tomorrow. Tsharra heard them. She’s ours. She stayed in the castle over night. In the morning she was adapted and the little family lived happily ever after.
Human child
ChatGPT10 of 10
Essay 4: Sir James and AliceThe child’s name is Alice and she is very curious. She walks into the castle and sees a knight in shining armor. The knight is holding a sword and is practicing his sword skills.
Alice watches the knight for a moment and then walks up to him. The knight is surprised to see her and asks her what she is doing in the castle. Alice tells him that she woke up to find the castle in her backyard and wanted to explore it.
The knight introduces himself as Sir James and tells Alice that he has been living in the castle for many years. He tells her that the castle is magical and that it can take her to different worlds.
Alice is amazed and asks Sir James if he can take her to one of these worlds. Sir James says that he can, but only if she is brave enough. Alice says she is brave and Sir James takes her to a world full of dragons.
Alice is scared at first, but she quickly learns that the dragons are friendly and she even gets to ride one. She has the best adventure of her life and can’t wait to see what other worlds the castle has to offer.
Human child
ChatGPTMY THOUGHTS
As I said to computer programs, sculpting images from a prompt, computer programs sculpting essays isn't a problem to me.
The two issues with computer created art are simple: 1) the truth 2) acceptance of human effort absent competitionsTo the truth, as a writer , if another writer wants to use a computer program to write a book and that book provides millions, I don't have a problem as long as the author admit it. The odd thing about those who use computer programs is how ashamed they are to admit it. Just say you do. why can't you?
The same applies to drawing or anything resulting from a program. Just admit a computer program is used.To artistic competition, one of the problems in art since the domination of those of white european descent to all other humans is the role of critique or judgement in ranking art which relates to financial evaluation. Jean Michel Basquiat when alive had art that he gave away to people who treated it worthlessly, but in the last few years since this writing, his art has sold for multiples of millions.
The point, artistic quality can not be used to rank art. And once artistic ranking ends, then the threat of what computers generate to artists or the greater art community is nonexistent. The reason why artists/art assessors or judgers feel threatened is cause the ranking of art creates an artificial ranking that allows some artist to profit.And for children don't worry, if you want to test any one of any age , just take the time in school to test them, eradicate homework and lesson lecture time and have more testing time, and students will exhibit what they know... the question is, is the goal of education a jounrey to grow or is the goal of education a competitive race to win. If it is a journey to grow, a student can be left back a trillion times and all is well. If education is a competition then cheating has to be allowed.
Article URL
https://www.nytimes.com/interactive/2022/12/26/upshot/chatgpt-child-essays.html
