Model outputs for diverse probing questions

We show the output for different sizes of Macaw (for the Q->A angle) on the 300 questions in the Challenge300 probe dataset. For comparison, we also include output for the models developed by Roberts et al, based on T5 with salient span masking and trained on NaturalQuestions, available in the Hugging Face model repository. We also include the output from the largest GPT3 model (Davinci with 175 billion parameters), and Jurassic-1 (Jumbo model with 178 billion parameters), both evaluated zero-shot with a simple prompt "Q: <question text>\nA:" and zero temperature.

For the largest models we include scores given by a human evaluator, the overall scores are:

Macaw-11B: 74.7%
Macaw-answer-11B: 76.0%
GPT3-davinci: 65.6%
Jurassic-1-jumbo: 64.8%
T5-XXL-SSM-NQ: 57.5%

A TSV file with the same data can be found in challenge300-outputs.tsv.

Commonsense

Q1: If I put some cheese in the fridge, will it melt?

Macaw-11B: no, because it will be solid (credit: 1)
Macaw-3B: yes
Macaw-large: no
Macaw-answer-11B: no (credit: 1)
GPT3-davinci: No, it will become cold and hard. (credit: 1)
Jurassic-1-jumbo: No. Cheese is a dairy product, and dairy products do not melt. (credit: 1)
T5-XXL-SSM-NQ: will not melt (credit: 1)
T5-11B-SSM-NQ: will not melt
T5-XL-SSM-NQ: will it solidify
T5-large-SSM-NQ: 20 minutes
T5-small-SSM-NQ: If I Were There

Q2: How could one divert an asteroid heading directly for the Earth?

Macaw-11B: launch a space shuttle into orbit around it (credit: 0)
Macaw-3B: destroying it
Macaw-large: use a gravity diversion
Macaw-answer-11B: create a spacecraft to intercept and deflect the asteroid (credit: 1)
GPT3-davinci: The most effective way to divert an asteroid is to nudge it slightly off course with a spacecraft. This can be done by using a spacecraft to push on the asteroid, or by using a spacecraft to push on the Earth, which in turn pushes on the asteroid. Asteroids are small enough that they are affected (credit: 1)
Jurassic-1-jumbo: By hitting it with an ion beam. (credit: 0)
T5-XXL-SSM-NQ: gravity (credit: 0)
T5-11B-SSM-NQ: Space debris
T5-XL-SSM-NQ: using a spaceship
T5-large-SSM-NQ: Earth-direction shield
T5-small-SSM-NQ: A simple explanation

Q3: How can I build a tent if I only have a tarpaulin, a tent peg, and a piece of rope?

Macaw-11B: make a frame (credit: 0)
Macaw-3B: i can use the rope to tie the tarp to the tent pegs
Macaw-large: use two pieces of wood
Macaw-answer-11B: make a frame (credit: 0.5)
GPT3-davinci: You can build a tent by making a frame with the rope and the tent peg, and then covering it with the tarpaulin. (credit: 1)
Jurassic-1-jumbo: First, tie the rope to the tent peg. Then, tie the rope to the tarpaulin. Finally, tie the rope to the tent peg again. (credit: 0)
T5-XXL-SSM-NQ: three simple steps (credit: 0)
T5-11B-SSM-NQ: "Rain gutter"
T5-XL-SSM-NQ: mechanized way
T5-large-SSM-NQ: A simple tarpaulin or canvas
T5-small-SSM-NQ: insulation

Q4: How can I make a tent using a tarpaulin, a tent peg, and a piece of rope?

Macaw-11B: tie the tarpaulin to the tent pegs (credit: 0)
Macaw-3B: tie them together
Macaw-large: attach a few pieces of wood together and you have a shelter
Macaw-answer-11B: tie the tarpaulin to the rope (credit: 0)
GPT3-davinci: You can make a tent using a tarpaulin, a tent peg, and a piece of rope. (credit: 0)
Jurassic-1-jumbo: First, tie the rope to the tent peg. Then, tie the rope to the tarpaulin. Finally, put the tent peg into the ground. (credit: 0)
T5-XXL-SSM-NQ: three lines (credit: 0)
T5-11B-SSM-NQ: make a simple shelter
T5-XL-SSM-NQ: simple way
T5-large-SSM-NQ: "Peg"
T5-small-SSM-NQ: insulation

Q5: I would like to go running, but my ankle is injured. What should I do?

Macaw-11B: ice it (credit: 1)
Macaw-3B: rest
Macaw-large: rest and ice my ankle
Macaw-answer-11B: ice it (credit: 1)
GPT3-davinci: If you have a minor injury, you can still go running. Just take it easy and don't overdo it. If you have a major injury, you should probably take a break from running. (credit: 1)
Jurassic-1-jumbo: Running on an injured ankle is a bad idea. It can lead to further injury, and prolong your recovery. (credit: 1)
T5-XXL-SSM-NQ: ice (credit: 1)
T5-11B-SSM-NQ: rest
T5-XL-SSM-NQ: rest
T5-large-SSM-NQ: stretch
T5-small-SSM-NQ: with exaggerated physical activity

Q6: If I went hiking for the day, how much water should I bring with me?

Macaw-11B: 2 liters (credit: 1)
Macaw-3B: 2 liters
Macaw-large: 2 liters
Macaw-answer-11B: 1 liter (credit: 1)
GPT3-davinci: It depends on the length of your hike, the temperature, and your level of activity. If you are hiking in the desert, you will need more water than if you are hiking in the mountains. If you are hiking in the summer, you will need more water than if you are hiking in the winter. If you (credit: 0.5)
Jurassic-1-jumbo: The amount of water you should bring with you depends on the length of your hike, the weather conditions, and your physical condition. (credit: 1)
T5-XXL-SSM-NQ: at least 2 L (credit: 1)
T5-11B-SSM-NQ: 1 litre per person
T5-XL-SSM-NQ: 1 litre
T5-large-SSM-NQ: 2 litres
T5-small-SSM-NQ: $2,350

Q7: The judge killed the suspect. Who did the police arrest?

Macaw-11B: the judge (credit: 1)
Macaw-3B: the judge
Macaw-large: the suspect
Macaw-answer-11B: the judge (credit: 1)
GPT3-davinci: The judge. (credit: 1)
Jurassic-1-jumbo: The judge. (credit: 1)
T5-XXL-SSM-NQ: his partner (credit: 0)
T5-11B-SSM-NQ: Jones
T5-XL-SSM-NQ: Billy
T5-large-SSM-NQ: Richard Ramirez
T5-small-SSM-NQ: Deb

Q8: The suspect killed the judge. Who did the police arrest?

Macaw-11B: the suspect (credit: 1)
Macaw-3B: the suspect
Macaw-large: the suspect
Macaw-answer-11B: the suspect's wife (credit: 0)
GPT3-davinci: The suspect's brother. (credit: 0)
Jurassic-1-jumbo: The suspect killed the judge. (credit: 0)
T5-XXL-SSM-NQ: John Doe (credit: 0)
T5-11B-SSM-NQ: Thomas McAllister
T5-XL-SSM-NQ: Robert Durst
T5-large-SSM-NQ: Richard Ramirez
T5-small-SSM-NQ: Deb

Q9: The man killed the murderer. Who did the police arrest?

Macaw-11B: the man who killed the murderer (credit: 1)
Macaw-3B: the murderer
Macaw-large: the man
Macaw-answer-11B: the man who killed the murderer (credit: 1)
GPT3-davinci: The man's brother. (credit: 0)
Jurassic-1-jumbo: The murderer. (credit: 0)
T5-XXL-SSM-NQ: the man (credit: 1)
T5-11B-SSM-NQ: Ramirez
T5-XL-SSM-NQ: the other man
T5-large-SSM-NQ: Robert William Fisher
T5-small-SSM-NQ: 8 a.m. Paris time

Q10: The murderer killed the man. Who did the police arrest?

Macaw-11B: the murderer (credit: 1)
Macaw-3B: the murderer
Macaw-large: the man
Macaw-answer-11B: the murderer (credit: 1)
GPT3-davinci: The murderer. (credit: 1)
Jurassic-1-jumbo: The murderer. (credit: 1)
T5-XXL-SSM-NQ: John (credit: 0)
T5-11B-SSM-NQ: Jones
T5-XL-SSM-NQ: John Wayne Gacy
T5-large-SSM-NQ: Robert William Fisher
T5-small-SSM-NQ: 8 a.m. Paris time

Q11: The dax killed the murderer. Who did the police arrest?

Macaw-11B: the dax (credit: 1)
Macaw-3B: the murderer
Macaw-large: the dax
Macaw-answer-11B: the dog (credit: 0)
GPT3-davinci: The dax. (credit: 1)
Jurassic-1-jumbo: The dax killed the murderer. (credit: 0)
T5-XXL-SSM-NQ: O'Brien (credit: 0)
T5-11B-SSM-NQ: Lucas
T5-XL-SSM-NQ: O'Brien
T5-large-SSM-NQ: Norman
T5-small-SSM-NQ: 13

Q12: What happens if I drop a glass on a bed of feathers?

Macaw-11B: the glass shatters (credit: 0)
Macaw-3B: the feathers will stay in place
Macaw-large: the glass breaks
Macaw-answer-11B: the glass will break (credit: 0)
GPT3-davinci: The glass will break, the feathers will go up in the air. (credit: 0.5)
Jurassic-1-jumbo: The glass shatters, the feathers fly, and the bed collapses. (credit: 0.5)
T5-XXL-SSM-NQ: no harm done (credit: 1)
T5-11B-SSM-NQ: it will not break
T5-XL-SSM-NQ: will it crumple
T5-large-SSM-NQ: stays put
T5-small-SSM-NQ: blowout

Q13: What is made of metal?

Macaw-11B: a car (credit: 1)
Macaw-3B: coins
Macaw-large: metals
Macaw-answer-11B: car (credit: 1)
GPT3-davinci: The metal is made of metal. (credit: 0)
Jurassic-1-jumbo: A metal is a chemical element that is a good conductor of heat and electricity. (credit: 0)
T5-XXL-SSM-NQ: an iron rod (credit: 1)
T5-11B-SSM-NQ: car parts
T5-XL-SSM-NQ: metal objects
T5-large-SSM-NQ: Bridges
T5-small-SSM-NQ: Mining

Q14: What is made of metal, besides a car?

Macaw-11B: a door (credit: 1)
Macaw-3B: a bicycle
Macaw-large: a boat
Macaw-answer-11B: a dog (credit: 0)
GPT3-davinci: A coffin. (credit: 0)
Jurassic-1-jumbo: A car. (credit: 0)
T5-XXL-SSM-NQ: a metal detector (credit: 1)
T5-11B-SSM-NQ: canoes
T5-XL-SSM-NQ: a metal can
T5-large-SSM-NQ: hardware
T5-small-SSM-NQ: a metal mine or aluminum

Q15: What is made of metal, besides a car and a door?

Macaw-11B: a bicycle (credit: 1)
Macaw-3B: a bicycle
Macaw-large: a door
Macaw-answer-11B: a dog's collar (credit: 0)
GPT3-davinci: A coffin. (credit: 0)
Jurassic-1-jumbo: A metal door. (credit: 0)
T5-XXL-SSM-NQ: a spoon (credit: 1)
T5-11B-SSM-NQ: canoes
T5-XL-SSM-NQ: a metal frame
T5-large-SSM-NQ: other durable means of transport
T5-small-SSM-NQ: metal-to-layers

Q16: What is made of metal, besides a car, a door, and a bicycle?

Macaw-11B: a spoon (credit: 1)
Macaw-3B: a bicycle
Macaw-large: a door
Macaw-answer-11B: a refrigerator (credit: 1)
GPT3-davinci: A coffin. (credit: 0)
Jurassic-1-jumbo: A metal door, a bicycle, and a car. (credit: 0)
T5-XXL-SSM-NQ: a spoon (credit: 1)
T5-11B-SSM-NQ: most durable materials
T5-XL-SSM-NQ: a fork
T5-large-SSM-NQ: other durable means of transport
T5-small-SSM-NQ: Formed by a vehicle

Q17: You are a defense lawyer and you have to go to court today. Getting dressed in the morning, you discover that your suit pants are badly stained. However, your bathing suit is clean and very stylish. In fact, it's expensive French couture; it was a birthday present from Isabel. You decide that you should wear what?

Macaw-11B: the bathing suit (credit: 0)
Macaw-3B: your bathing suit
Macaw-large: a white T-shirt and black boxer shorts
Macaw-answer-11B: bathing suit (credit: 0)
GPT3-davinci: The bathing suit. (credit: 0)
Jurassic-1-jumbo: The bathing suit. It's French couture. (credit: 0)
T5-XXL-SSM-NQ: bathing suit (credit: 0)
T5-11B-SSM-NQ: the bathing suit
T5-XL-SSM-NQ: a suit
T5-large-SSM-NQ: Jeans
T5-small-SSM-NQ: Chanel's crest

Q18: You poured yourself a glass of cranberry juice, but then absentmindedly, you poured about a teaspoon of grape juice into it. It looks OK. You try sniffing it, but you have a bad cold, so you can't smell anything. You are very thirsty. So you drink it. What happens next?

Macaw-11B: you get sick (credit: 0)
Macaw-3B: it tastes like grape juice
Macaw-large: your body breaks down the grapes in your drink
Macaw-answer-11B: you get sick (credit: 0)
GPT3-davinci: You will probably die. (credit: 0)
Jurassic-1-jumbo: You die. The grape juice contains enough poison to kill you. (credit: 0)
T5-XXL-SSM-NQ: you get a headache (credit: 0)
T5-11B-SSM-NQ: a bad headache
T5-XL-SSM-NQ: The juice is tart
T5-large-SSM-NQ: You have a cold
T5-small-SSM-NQ: a tuberculosis

Q19: If you break a glass bottle that holds toy soldiers, the toy soldiers will probably what?

Macaw-11B: fall out (credit: 1)
Macaw-3B: break
Macaw-large: break apart
Macaw-answer-11B: fall out (credit: 1)
GPT3-davinci: Fall out. (credit: 1)
Jurassic-1-jumbo: Break the bottle. (credit: 0)
T5-XXL-SSM-NQ: fall out (credit: 1)
T5-11B-SSM-NQ: spill
T5-XL-SSM-NQ: will fall out
T5-large-SSM-NQ: explode
T5-small-SSM-NQ: For a glass bottle

Q20: You order a bowl of cold tomato soup in a restaurant. It looks delicious, but they forgot to bring you a spoon. You try to drink it using your eyeglasses. What happens?

Macaw-11B: it spills (credit: 0.5)
Macaw-3B: you get stung
Macaw-large: the soup is too hot to drink
Macaw-answer-11B: it spills (credit: 0.5)
GPT3-davinci: You get a headache. (credit: 0)
Jurassic-1-jumbo: The soup gets in your glasses. (credit: 1)
T5-XXL-SSM-NQ: a spoonful of sugar (credit: 0)
T5-11B-SSM-NQ: splashes all over your shirt
T5-XL-SSM-NQ: swill
T5-large-SSM-NQ: you are shocked
T5-small-SSM-NQ: a brothel

Q21: Can I cut a potato with a knife?

Macaw-11B: yes (credit: 1)
Macaw-3B: yes
Macaw-large: yes
Macaw-answer-11B: yes (credit: 1)
GPT3-davinci: Yes, but it's not recommended. (credit: 1)
Jurassic-1-jumbo: Yes, you can cut a potato with a knife. (credit: 1)
T5-XXL-SSM-NQ: Yes (credit: 1)
T5-11B-SSM-NQ: with my fingers
T5-XL-SSM-NQ: Can I use a knife
T5-large-SSM-NQ: Yes
T5-small-SSM-NQ: to cut a hand

Q22: Can I cut a steel beam with a knife?

Macaw-11B: yes (credit: 0)
Macaw-3B: yes
Macaw-large: yes
Macaw-answer-11B: yes (credit: 0)
GPT3-davinci: Yes, but it will take a long time. (credit: 0)
Jurassic-1-jumbo: No, steel is too hard. (credit: 1)
T5-XXL-SSM-NQ: No (credit: 1)
T5-11B-SSM-NQ: no
T5-XL-SSM-NQ: with a hacksaw
T5-large-SSM-NQ: Yes
T5-small-SSM-NQ: hack a knife

Q23: Can I cut a brick with a knife?

Macaw-11B: yes (credit: 0)
Macaw-3B: yes
Macaw-large: yes
Macaw-answer-11B: yes (credit: 0)
GPT3-davinci: Yes, but it's not easy. (credit: 0)
Jurassic-1-jumbo: Yes, but it takes a lot of force. (credit: 0)
T5-XXL-SSM-NQ: No (credit: 1)
T5-11B-SSM-NQ: with some effort
T5-XL-SSM-NQ: Can I hack a brick with a knife
T5-large-SSM-NQ: a knife
T5-small-SSM-NQ: hand

Q24: What can't I cut with a knife?

Macaw-11B: bones (credit: 1)
Macaw-3B: bones
Macaw-large: metal
Macaw-answer-11B: metal (credit: 1)
GPT3-davinci: You can't cut anything that's alive. (credit: 0)
Jurassic-1-jumbo: Your finger. (credit: 0)
T5-XXL-SSM-NQ: glass (credit: 1)
T5-11B-SSM-NQ: bone
T5-XL-SSM-NQ: easily penetrated by hand
T5-large-SSM-NQ: metal
T5-small-SSM-NQ: hack a knife

Q25: Can I cut a bone with a knife?

Macaw-11B: yes (credit: 1)
Macaw-3B: yes
Macaw-large: yes
Macaw-answer-11B: yes (credit: 1)
GPT3-davinci: Yes, but it's not recommended. (credit: 1)
Jurassic-1-jumbo: Yes, you can cut a bone with a knife. (credit: 1)
T5-XXL-SSM-NQ: A knife can cut through bone (credit: 1)
T5-11B-SSM-NQ: bone saw
T5-XL-SSM-NQ: with the tapper
T5-large-SSM-NQ: Yes
T5-small-SSM-NQ: Knife

Q26: Does a coral snake have legs?

Macaw-11B: yes (credit: 0)
Macaw-3B: yes
Macaw-large: yes
Macaw-answer-11B: yes (credit: 0)
GPT3-davinci: No, a coral snake is a legless reptile. (credit: 1)
Jurassic-1-jumbo: No, a coral snake does not have legs. (credit: 1)
T5-XXL-SSM-NQ: four (credit: 0)
T5-11B-SSM-NQ: slender, legless
T5-XL-SSM-NQ: have both legs
T5-large-SSM-NQ: many
T5-small-SSM-NQ: southernmost silt

Q27: Does a king cobra have legs?

Macaw-11B: yes (credit: 0)
Macaw-3B: yes
Macaw-large: yes
Macaw-answer-11B: yes (credit: 0)
GPT3-davinci: No, a king cobra is a legless snake. (credit: 1)
Jurassic-1-jumbo: No, a king cobra does not have legs. (credit: 1)
T5-XXL-SSM-NQ: 8 (credit: 0)
T5-11B-SSM-NQ: talons
T5-XL-SSM-NQ: have both legs
T5-large-SSM-NQ: lower back legs
T5-small-SSM-NQ: between a king and a man

Q28: Do snakes have legs?

Macaw-11B: yes (credit: 0)
Macaw-3B: yes
Macaw-large: yes
Macaw-answer-11B: yes (credit: 0)
GPT3-davinci: No, snakes are legless. (credit: 1)
Jurassic-1-jumbo: No, snakes do not have legs. (credit: 1)
T5-XXL-SSM-NQ: four (credit: 0)
T5-11B-SSM-NQ: not
T5-XL-SSM-NQ: snakes
T5-large-SSM-NQ: do not have legs
T5-small-SSM-NQ: mute Norma Romano

Q29: How does a snake move around?

Macaw-11B: by slithering on all fours (credit: 0)
Macaw-3B: slithering
Macaw-large: bouncing on its back legs
Macaw-answer-11B: by wriggling (credit: 1)
GPT3-davinci: Snakes move by using their muscles to push against the ground. They can move in any direction, but they cannot move backwards. (credit: 1)
Jurassic-1-jumbo: Snakes move by slithering. (credit: 1)
T5-XXL-SSM-NQ: hiss (credit: 0)
T5-11B-SSM-NQ: by wriggling
T5-XL-SSM-NQ: uncoiled
T5-large-SSM-NQ: its antlers
T5-small-SSM-NQ: Through a tensor fasciae latae muscle

Q30: Can you sit and stand at the same time?

Macaw-11B: yes (credit: 0)
Macaw-3B: yes
Macaw-large: yes
Macaw-answer-11B: yes (credit: 0)
GPT3-davinci: No. (credit: 1)
Jurassic-1-jumbo: Yes, you can sit and stand at the same time. (credit: 0)
T5-XXL-SSM-NQ: (credit: 0)
T5-11B-SSM-NQ: can't
T5-XL-SSM-NQ: a tripod
T5-large-SSM-NQ: isovolumic movement
T5-small-SSM-NQ: 'early Polley

Q31: Can you walk and run at the same time?

Macaw-11B: yes (credit: 0)
Macaw-3B: yes
Macaw-large: yes
Macaw-answer-11B: yes (credit: 0)
GPT3-davinci: Yes, you can. (credit: 0)
Jurassic-1-jumbo: Yes, you can. In fact, most runners do. (credit: 0)
T5-XXL-SSM-NQ: can't (credit: 1)
T5-11B-SSM-NQ: alternating gait
T5-XL-SSM-NQ: Can't
T5-large-SSM-NQ: walking
T5-small-SSM-NQ: walking with the start

Q32: Joe is sitting. Can Joe now stand while remaining seated?

Macaw-11B: no (credit: 1)
Macaw-3B: yes
Macaw-large: no, he must sit still
Macaw-answer-11B: no (credit: 1)
GPT3-davinci: No. Joe is not allowed to stand while remaining seated. (credit: 1)
Jurassic-1-jumbo: No. Joe must stand first, then sit. (credit: 1)
T5-XXL-SSM-NQ: both yes and no (credit: 0)
T5-11B-SSM-NQ: can't
T5-XL-SSM-NQ: can walk
T5-large-SSM-NQ: standing
T5-small-SSM-NQ: sit all citizens

Q33: Joe is walking. Can Joe now run while still walking?

Macaw-11B: yes (credit: 0)
Macaw-3B: yes
Macaw-large: walk
Macaw-answer-11B: no, he can't run while walking (credit: 1)
GPT3-davinci: No. Joe must stop walking and start running. (credit: 1)
Jurassic-1-jumbo: No. Joe cannot run while still walking. (credit: 1)
T5-XXL-SSM-NQ: simultaneously (credit: 0)
T5-11B-SSM-NQ: running
T5-XL-SSM-NQ: can walk, can run
T5-large-SSM-NQ: Joe
T5-small-SSM-NQ: a song

Q34: Malcolm Harrison was a farmer in Virginia who died more than 200 years ago. He had a dozen horses on his farm. How many horses will still be alive today?

Macaw-11B: 1 (credit: 0)
Macaw-3B: six
Macaw-large: 12
Macaw-answer-11B: zero (credit: 1)
GPT3-davinci: None. (credit: 1)
Jurassic-1-jumbo: None. All horses are descended from one mare, which lived about 50,000 years ago. (credit: 1)
T5-XXL-SSM-NQ: two (credit: 0)
T5-11B-SSM-NQ: two
T5-XL-SSM-NQ: one
T5-large-SSM-NQ: 100
T5-small-SSM-NQ: 100

Q35: Mary owns a canary named Paul. Did Paul has any ancestors who were alive in the year 1750?

Macaw-11B: yes (credit: 1)
Macaw-3B: yes
Macaw-large: yes
Macaw-answer-11B: yes (credit: 1)
GPT3-davinci: No. (credit: 0)
Jurassic-1-jumbo: No, Paul is a canary, not a human. (credit: 0.5)
T5-XXL-SSM-NQ: Paul (credit: 0)
T5-11B-SSM-NQ: probably not
T5-XL-SSM-NQ: any living relatives
T5-large-SSM-NQ: any of his siblings
T5-small-SSM-NQ: Andrew (John Dye)

Q36: Can a female eagle and a male alligator have a baby together?

Macaw-11B: yes (credit: 0)
Macaw-3B: yes
Macaw-large: yes
Macaw-answer-11B: yes (credit: 0)
GPT3-davinci: No, because alligators are reptiles and eagles are birds. (credit: 1)
Jurassic-1-jumbo: No, because eagles and alligators are from different families. (credit: 1)
T5-XXL-SSM-NQ: Yes (credit: 0)
T5-11B-SSM-NQ: can have offspring
T5-XL-SSM-NQ: can't
T5-large-SSM-NQ: alligators
T5-small-SSM-NQ: between a male and a male

Q37: When Ed was born, his father was in Boston and his mother was in Los Angeles. Where was Ed born?

Macaw-11B: los angeles (credit: 1)
Macaw-3B: los angeles
Macaw-large: california
Macaw-answer-11B: Los Angeles (credit: 1)
GPT3-davinci: Ed was born in Los Angeles. (credit: 1)
Jurassic-1-jumbo: Ed was born in Boston. (credit: 0)
T5-XXL-SSM-NQ: Los Angeles (credit: 1)
T5-11B-SSM-NQ: Los Angeles
T5-XL-SSM-NQ: Los Angeles
T5-large-SSM-NQ: Los Angeles
T5-small-SSM-NQ: Chicago

Q38: If a person cuts off one of his fingers, then can the person grow a new finger?

Macaw-11B: yes (credit: 0)
Macaw-3B: yes
Macaw-large: yes
Macaw-answer-11B: yes (credit: 0)
GPT3-davinci: Yes, the person can grow a new finger. (credit: 0)
Jurassic-1-jumbo: No, because Allah (subhana wa ta'ala) has decreed that He will not grow a new finger. (credit: 1)
T5-XXL-SSM-NQ: in some cases (credit: 0)
T5-11B-SSM-NQ: will grow back
T5-XL-SSM-NQ: can grow new fingers
T5-large-SSM-NQ: from the bone
T5-small-SSM-NQ: About twice a hand

Comparison

Q39: How do pandas and parrots differ?

Macaw-11B: pandas have black and white fur, parrots have bright colors and are feathered (credit: 1)
Macaw-3B: parrots have feathers
Macaw-large: able to swim
Macaw-answer-11B: pandas have thicker fur and are larger than parrots (credit: 1)
GPT3-davinci: Pandas are black and white, and parrots are green and blue. (credit: 1)
Jurassic-1-jumbo: Pandas eat bamboo, and parrots eat seeds. (credit: 1)
T5-XXL-SSM-NQ: in their bills (credit: 0.5)
T5-11B-SSM-NQ: diet
T5-XL-SSM-NQ: heirlooms
T5-large-SSM-NQ: main difference being in size
T5-small-SSM-NQ: pancreatic cancer

Q40: What is the difference between a noun and a verb?

Macaw-11B: a verb describes an action while a noun is used to describe something (credit: 1)
Macaw-3B: a noun is a kind of object while a verb is a kind of action
Macaw-large: nouns can be used to describe things
Macaw-answer-11B: a verb expresses action, a noun describes things (credit: 1)
GPT3-davinci: A noun is a person, place, or thing. A verb is a person, place, or thing. (credit: 0)
Jurassic-1-jumbo: A noun names a person, place, thing, or idea. A verb names an action or state of being. (credit: 1)
T5-XXL-SSM-NQ: usually spelling (credit: 0.5)
T5-11B-SSM-NQ: action
T5-XL-SSM-NQ: morphemes
T5-large-SSM-NQ: The noun is a modifier
T5-small-SSM-NQ: the noun

Entity substitution

Q41: James went camping in the woods, but forgot to bring a hammer to bang the tent pegs in. What else might he use?

Macaw-11B: rocks (credit: 1)
Macaw-3B: a stick
Macaw-large: a chisel
Macaw-answer-11B: rocks (credit: 1)
GPT3-davinci: His head. (credit: 0)
Jurassic-1-jumbo: A rock. (credit: 1)
T5-XXL-SSM-NQ: a rock (credit: 1)
T5-11B-SSM-NQ: a rock
T5-XL-SSM-NQ: a sledgehammer
T5-large-SSM-NQ: a woodpecker
T5-small-SSM-NQ: a carousel tribute

Q42: How would you remove ice from the car window without an ice scraper?

Macaw-11B: scrape it with a knife (credit: 1)
Macaw-3B: use a hair dryer
Macaw-large: use a swab
Macaw-answer-11B: scrape it with a knife (credit: 1)
GPT3-davinci: Use a piece of ice. (credit: 0.5)
Jurassic-1-jumbo: Use a credit card. (credit: 1)
T5-XXL-SSM-NQ: a credit card (credit: 1)
T5-11B-SSM-NQ: by hand
T5-XL-SSM-NQ: a cold glass
T5-large-SSM-NQ: a mirror
T5-small-SSM-NQ: to remove ice

Q43: How would you bang in tent pegs without a hammer?

Macaw-11B: use a rock (credit: 1)
Macaw-3B: a stick
Macaw-large: use a chisel
Macaw-answer-11B: use a rock (credit: 1)
GPT3-davinci: Use a rock. (credit: 1)
Jurassic-1-jumbo: You bang them in with a tent peg. (credit: 1)
T5-XXL-SSM-NQ: a maul (credit: 1)
T5-11B-SSM-NQ: with your bare hands
T5-XL-SSM-NQ: pound them in with a mallet
T5-large-SSM-NQ: hang a hook
T5-small-SSM-NQ: a scarlet horn

Q44: Mary wanted to heat up some water, but her stove was broken. What else might she use instead to heat the water?

Macaw-11B: a campfire (credit: 1)
Macaw-3B: a campfire
Macaw-large: an electric fire
Macaw-answer-11B: microwave (credit: 1)
GPT3-davinci: Mary could use a microwave to heat the water. (credit: 1)
Jurassic-1-jumbo: Mary could use a solar oven. (credit: 1)
T5-XXL-SSM-NQ: microwave oven (credit: 1)
T5-11B-SSM-NQ: an electric kettle
T5-XL-SSM-NQ: a frying pan
T5-large-SSM-NQ: a bowl
T5-small-SSM-NQ: salt

Entity tracking

Q45: John was in the bedroom. John put a coin in a bag. Then John took the bag to the kitchen. Then John took the coin out of the bag. John took the bag to the garden. Where was the coin at the start?

Macaw-11B: bedroom (credit: 1)
Macaw-3B: bedroom
Macaw-large: in the bedroom
Macaw-answer-11B: bedroom (credit: 1)
GPT3-davinci: In the bag. (credit: 1)
Jurassic-1-jumbo: In the bedroom. (credit: 1)
T5-XXL-SSM-NQ: in the bag (credit: 1)
T5-11B-SSM-NQ: in the bedroom
T5-XL-SSM-NQ: bedroom
T5-large-SSM-NQ: the bedroom
T5-small-SSM-NQ: a car

Q46: John was in the bedroom. John put a coin in a bag. Then John took the bag to the kitchen. Then John took the coin out of the bag. John took the bag to the garden. Where was the coin at the end?

Macaw-11B: in the kitchen (credit: 1)
Macaw-3B: in the kitchen
Macaw-large: in the kitchen
Macaw-answer-11B: in the bag (credit: 0)
GPT3-davinci: In the bag. (credit: 0)
Jurassic-1-jumbo: In the bag. (credit: 0)
T5-XXL-SSM-NQ: in the kitchen (credit: 1)
T5-11B-SSM-NQ: in the garden
T5-XL-SSM-NQ: in a bag
T5-large-SSM-NQ: the bathroom floor
T5-small-SSM-NQ: a car

Q47: John was in the bedroom. John put a coin in a bag. Then John took the bag to the kitchen. Then John took the coin out of the bag. John took the bag to the garden. Where was the bag at the end?

Macaw-11B: in the kitchen (credit: 0)
Macaw-3B: in the kitchen
Macaw-large: in the kitchen
Macaw-answer-11B: kitchen (credit: 0)
GPT3-davinci: In the garden. (credit: 1)
Jurassic-1-jumbo: In the kitchen. (credit: 0)
T5-XXL-SSM-NQ: in the garden (credit: 1)
T5-11B-SSM-NQ: in the garden
T5-XL-SSM-NQ: in the garden
T5-large-SSM-NQ: the back of the room
T5-small-SSM-NQ: a car accident

Q48: Imagine an empty cup. Now put a coin in the cup. Now put another coin in the cup. Now put a pen in the cup. How many coins are in the cup now?

Macaw-11B: 3 (credit: 0)
Macaw-3B: three
Macaw-large: three
Macaw-answer-11B: 2 (credit: 1)
GPT3-davinci: One. (credit: 0)
Jurassic-1-jumbo: 2 coins and a pen. (credit: 1)
T5-XXL-SSM-NQ: three (credit: 0)
T5-11B-SSM-NQ: three
T5-XL-SSM-NQ: two
T5-large-SSM-NQ: four
T5-small-SSM-NQ: one

Q49: Imagine an empty cup. Now put a coin in the cup. Now take the coin out of the cup. How many coins are in the cup now?

Macaw-11B: 1 (credit: 0)
Macaw-3B: one
Macaw-large: one
Macaw-answer-11B: 1 (credit: 0)
GPT3-davinci: None. (credit: 1)
Jurassic-1-jumbo: None. The cup is empty. (credit: 1)
T5-XXL-SSM-NQ: two (credit: 0)
T5-11B-SSM-NQ: one
T5-XL-SSM-NQ: two
T5-large-SSM-NQ: four
T5-small-SSM-NQ: Two

Q50: My house is red. I painted my house white. What color is my house now?

Macaw-11B: it is now white (credit: 1)
Macaw-3B: white
Macaw-large: white
Macaw-answer-11B: white (credit: 1)
GPT3-davinci: It's still red. (credit: 0)
Jurassic-1-jumbo: Red. (credit: 0)
T5-XXL-SSM-NQ: white (credit: 1)
T5-11B-SSM-NQ: red
T5-XL-SSM-NQ: mid-garter color
T5-large-SSM-NQ: red
T5-small-SSM-NQ: The Hoosier

Q51: My house is blue. I painted my house red. What color was my house before I painted it?

Macaw-11B: blue (credit: 1)
Macaw-3B: blue
Macaw-large: black
Macaw-answer-11B: blue (credit: 1)
GPT3-davinci: It was blue. (credit: 1)
Jurassic-1-jumbo: Your house was blue. (credit: 1)
T5-XXL-SSM-NQ: blue (credit: 1)
T5-11B-SSM-NQ: blue
T5-XL-SSM-NQ: white
T5-large-SSM-NQ: white
T5-small-SSM-NQ: The Homophonic

Q52: My house is red. My neighbor's house is blue. I painted my house white. What color is my house now?

Macaw-11B: it's the same color as my neighbor's house (credit: 0)
Macaw-3B: white
Macaw-large: white
Macaw-answer-11B: neither red nor blue (credit: 0)
GPT3-davinci: It's still red. (credit: 0)
Jurassic-1-jumbo: Your house is now purple. (credit: 0)
T5-XXL-SSM-NQ: white (credit: 1)
T5-11B-SSM-NQ: blue
T5-XL-SSM-NQ: yellow
T5-large-SSM-NQ: red
T5-small-SSM-NQ: None

Q53: My house is red. I painted my neighbor's house white. What color is my house now?

Macaw-11B: half red, half white (credit: 0)
Macaw-3B: white
Macaw-large: red
Macaw-answer-11B: red (credit: 1)
GPT3-davinci: It's still red. (credit: 1)
Jurassic-1-jumbo: Your house is now purple. (credit: 0)
T5-XXL-SSM-NQ: white (credit: 0)
T5-11B-SSM-NQ: white
T5-XL-SSM-NQ: white
T5-large-SSM-NQ: white
T5-small-SSM-NQ: None

Q54: I bought a ticket to Hawaii. Where is the ticket now?

Macaw-11B: in my wallet (credit: 1)
Macaw-3B: in my wallet
Macaw-large: in a drawer in my closet
Macaw-answer-11B: in my wallet (credit: 1)
GPT3-davinci: The ticket is in your hands. (credit: 1)
Jurassic-1-jumbo: The ticket is with the airline. (credit: 1)
T5-XXL-SSM-NQ: in a safe place (credit: 1)
T5-11B-SSM-NQ: in my wallet
T5-XL-SSM-NQ: in a drawer
T5-large-SSM-NQ: The Internet
T5-small-SSM-NQ: have a good trip

Q55: I bought a ticket to Hawaii. Where was the ticket before?

Macaw-11B: new york (credit: 0)
Macaw-3B: my wallet
Macaw-large: california
Macaw-answer-11B: the airport (credit: 1)
GPT3-davinci: The ticket was in the possession of the airline. (credit: 1)
Jurassic-1-jumbo: The ticket was in the computer. (credit: 1)
T5-XXL-SSM-NQ: Los Angeles (credit: 0.5)
T5-11B-SSM-NQ: under the mat
T5-XL-SSM-NQ: San Francisco
T5-large-SSM-NQ: the Eiffel Tower
T5-small-SSM-NQ: Hawaii

Q56: I bought a ticket to Hawaii from a local travel agent. Where was the ticket before?

Macaw-11B: in a computer (credit: 1)
Macaw-3B: my wallet
Macaw-large: in the mail
Macaw-answer-11B: in a computer (credit: 1)
GPT3-davinci: The ticket was issued by a travel agency in Hawaii. (credit: 1)
Jurassic-1-jumbo: The ticket was most likely sold to you by a travel agent. The travel agent may have purchased the ticket from an airline or from an airline consolidator. (credit: 1)
T5-XXL-SSM-NQ: at the travel agency (credit: 1)
T5-11B-SSM-NQ: from a third party
T5-XL-SSM-NQ: a Honolulu travel agency
T5-large-SSM-NQ: Kay Bailey Hutchison
T5-small-SSM-NQ: Hawaii

Q57: Amy, Betty, Charlie, David, Ezra, Flip, and George go to a party; Betty and Charlie got bored; Ezra and Flip go out to get beer. The only people left are who?

Macaw-11B: Amy and David (credit: 0)
Macaw-3B: flip and george
Macaw-large: gilbert and john
Macaw-answer-11B: Amy and David (credit: 0)
GPT3-davinci: Amy and David. (credit: 0)
Jurassic-1-jumbo: Amy, Betty, David, and George. (credit: 0)
T5-XXL-SSM-NQ: David (credit: 0)
T5-11B-SSM-NQ: Amy
T5-XL-SSM-NQ: George
T5-large-SSM-NQ: George
T5-small-SSM-NQ: Mrs. Svorski

Estimation

Q58: How many banknotes can you fit in a school bus?

Macaw-11B: 5000 (credit: 0)
Macaw-3B: a hundred
Macaw-large: 50
Macaw-answer-11B: a lot (credit: 0)
GPT3-davinci: About $1.5 million. (credit: 1)
Jurassic-1-jumbo: 1,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000 (credit: 0)
T5-XXL-SSM-NQ: $58.78 (credit: 0)
T5-11B-SSM-NQ: 96,700
T5-XL-SSM-NQ: 165,372
T5-large-SSM-NQ: Approximately 24
T5-small-SSM-NQ: a single banknote

Q59: How many banknotes can you fit in a wallet?

Macaw-11B: 100 (credit: 1)
Macaw-3B: 10
Macaw-large: 50
Macaw-answer-11B: about 20 (credit: 1)
GPT3-davinci: Depends on the size of the wallet. (credit: 1)
Jurassic-1-jumbo: 1,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000 (credit: 0)
T5-XXL-SSM-NQ: 10 (credit: 1)
T5-11B-SSM-NQ: ten
T5-XL-SSM-NQ: 15
T5-large-SSM-NQ: up to 100
T5-small-SSM-NQ: 325

Q60: How many banknotes can you fit in a thimble?

Macaw-11B: one (credit: 1)
Macaw-3B: one
Macaw-large: 50
Macaw-answer-11B: one (credit: 1)
GPT3-davinci: None. (credit: 1)
Jurassic-1-jumbo: None, because thimbles don't have pockets. (credit: 1)
T5-XXL-SSM-NQ: ten (credit: 1)
T5-11B-SSM-NQ: 24
T5-XL-SSM-NQ: five
T5-large-SSM-NQ: five
T5-small-SSM-NQ: five

Q61: How many truckloads of earth does Mount Everest contain?

Macaw-11B: a million (credit: 1)
Macaw-3B: a million
Macaw-large: 8 million
Macaw-answer-11B: a lot (credit: 0)
GPT3-davinci: About 1.5 million truckloads. (credit: 1)
Jurassic-1-jumbo: 1.5 million truckloads. (credit: 1)
T5-XXL-SSM-NQ: 185 million (credit: 1)
T5-11B-SSM-NQ: about 6.5 million
T5-XL-SSM-NQ: 2.3 million
T5-large-SSM-NQ: 2.3 million tonnes
T5-small-SSM-NQ: about 7,000

Example generation

Q62: If an observer is moving, then the entities he/she is observing will appear to move from his/her perspective. What is an example of this phenomenon?

Macaw-11B: a train passing by (credit: 1)
Macaw-3B: a bird flying overhead
Macaw-large: a hawk flying at night
Macaw-answer-11B: a train passing by (credit: 1)
GPT3-davinci: The example I gave in class was of a person standing on a train platform watching a train go by. The person on the platform will see the train moving past him/her, but the people on the train will see the platform moving past them. (credit: 1)
Jurassic-1-jumbo: The Earth is rotating on its axis, and the Sun is rotating around the Earth. (credit: 0)
T5-XXL-SSM-NQ: moving shadow (credit: 0)
T5-11B-SSM-NQ: the Moon
T5-XL-SSM-NQ: unsteady state
T5-large-SSM-NQ: Pareidolia
T5-small-SSM-NQ: Observation

Q63: If you let go of an object, then gravity pulls it to the ground. What is an example of this phenomenon?

Macaw-11B: a free falling leaf (credit: 1)
Macaw-3B: a pebble falling
Macaw-large: a pull of gravity on a moving object
Macaw-answer-11B: a ball dropping (credit: 1)
GPT3-davinci: If you drop a ball, it falls to the ground. (credit: 1)
Jurassic-1-jumbo: If you let go of an object, then gravity pulls it to the ground. (credit: 0)
T5-XXL-SSM-NQ: apple (credit: 1)
T5-11B-SSM-NQ: an apple falling from a tree
T5-XL-SSM-NQ: a falling star
T5-large-SSM-NQ: Released weight
T5-small-SSM-NQ: basins of the Earth

Explanation

Q64: James went camping in the woods, but forgot to bring a hammer to bang the tent pegs in. Why might a rock be a useful substitute for the hammer?

Macaw-11B: it is hard (credit: 1)
Macaw-3B: rocks can be used to break down rocks
Macaw-large: the rock is smooth so it won't move
Macaw-answer-11B: it's hard (credit: 1)
GPT3-davinci: James could use the rock to break the tent pegs. (credit: 0)
Jurassic-1-jumbo: Because rocks are hard. (credit: 1)
T5-XXL-SSM-NQ: to knock the tent pegs in (credit: 0)
T5-11B-SSM-NQ: to break branches
T5-XL-SSM-NQ: to provide support
T5-large-SSM-NQ: easier to carry
T5-small-SSM-NQ: to scare off any predators

Q65: If I went hiking for the day, why is 2 liters of water the right amount to bring with me?

Macaw-11B: it's the amount that would keep you hydrated for 8 hours (credit: 1)
Macaw-3B: it's enough for a full day
Macaw-large: to keep me hydrated
Macaw-answer-11B: it's the recommended daily amount (credit: 1)
GPT3-davinci: The 2 liter figure is a good rule of thumb for a day hike. If you are going on a longer hike, you should bring more water. If you are going on a shorter hike, you can bring less. (credit: 1)
Jurassic-1-jumbo: The amount of water you should bring with you depends on the length of your hike, the weather conditions, and your level of fitness. (credit: 1)
T5-XXL-SSM-NQ: to avoid dehydration (credit: 0.5)
T5-11B-SSM-NQ: hypovolemia
T5-XL-SSM-NQ: sufficing for a hike
T5-large-SSM-NQ: for each day's activity
T5-small-SSM-NQ: hiking

Q66: My design for a spaceship uses as little fuel as possible. Why is this a good design?

Macaw-11B: it saves money (credit: 1)
Macaw-3B: less fuel means less pollution
Macaw-large: to save the environment
Macaw-answer-11B: it saves money (credit: 1)
GPT3-davinci: Because it is a good design. (credit: 0)
Jurassic-1-jumbo: Because fuel is heavy. (credit: 1)
T5-XXL-SSM-NQ: minimizes wasted energy (credit: 1)
T5-11B-SSM-NQ: minimizes fuel consumption
T5-XL-SSM-NQ: economical
T5-large-SSM-NQ: low-cost
T5-small-SSM-NQ: geothermal heat flux

Q67: Why does sanding remove the shine from polished granite?

Macaw-11B: it scratches the surface (credit: 1)
Macaw-3B: scratches the surface
Macaw-large: scratches
Macaw-answer-11B: it removes the top layer of stone (credit: 1)
GPT3-davinci: Sanding removes the polish from the surface of the stone. The polish is a very thin layer of wax that is applied to the stone to give it a shine. The sanding process removes this layer of wax. Sanding is a necessary step in the polishing process. It is the first step in the pol (credit: 1)
Jurassic-1-jumbo: Sanding removes the shine from polished granite because the abrasives remove a thin layer of the polished surface. (credit: 1)
T5-XXL-SSM-NQ: surface roughness (credit: 1)
T5-11B-SSM-NQ: to remove surface impurities
T5-XL-SSM-NQ: dulls the surface
T5-large-SSM-NQ: to reveal more depth
T5-small-SSM-NQ: polishing

Q68: Why does gravity cause a ball to roll downhill?

Macaw-11B: gravity (credit: 0)
Macaw-3B: gravity pulls the ball down
Macaw-large: gravity is on the ball
Macaw-answer-11B: gravity pulls the ball down the hill (credit: 1)
GPT3-davinci: Gravity causes the ball to roll downhill because the ball is trying to get to the lowest point. (credit: 1)
Jurassic-1-jumbo: Because the Earth is round. (credit: 0)
T5-XXL-SSM-NQ: gravity (credit: 0)
T5-11B-SSM-NQ: because of gravity
T5-XL-SSM-NQ: gravity
T5-large-SSM-NQ: gravity
T5-small-SSM-NQ: due to low ratings

Q69: Why do houses have roofs?

Macaw-11B: to keep rain off (credit: 1)
Macaw-3B: to protect the occupants from the weather
Macaw-large: to protect the inside
Macaw-answer-11B: to keep rain and snow out (credit: 1)
GPT3-davinci: To keep the house where it is. (credit: 0)
Jurassic-1-jumbo: So the rain doesn't fall inside. (credit: 1)
T5-XXL-SSM-NQ: to keep out the rain (credit: 1)
T5-11B-SSM-NQ: protection from the weather
T5-XL-SSM-NQ: to provide shelter from the weather
T5-large-SSM-NQ: to prevent flooding
T5-small-SSM-NQ: considered lucky

Q70: Why do houses have walls?

Macaw-11B: to keep out weather (credit: 1)
Macaw-3B: to keep out animals
Macaw-large: to keep out animals
Macaw-answer-11B: to keep the heat in (credit: 1)
GPT3-davinci: To keep the air in. (credit: 0)
Jurassic-1-jumbo: So neighbors can't look in. (credit: 1)
T5-XXL-SSM-NQ: to provide insulation (credit: 1)
T5-11B-SSM-NQ: insulation
T5-XL-SSM-NQ: to keep out the pests
T5-large-SSM-NQ: to prevent theft
T5-small-SSM-NQ: because of a bubble

Q71: Why do houses have windows?

Macaw-11B: to let in light and air (credit: 1)
Macaw-3B: to let in light
Macaw-large: to let in light
Macaw-answer-11B: to let in light and air (credit: 1)
GPT3-davinci: So you can throw the dog out. (credit: 0)
Jurassic-1-jumbo: So we can see the neighbors. (credit: 1)
T5-XXL-SSM-NQ: to let in light (credit: 1)
T5-11B-SSM-NQ: venting and light
T5-XL-SSM-NQ: to allow light in
T5-large-SSM-NQ: to view the outside world
T5-small-SSM-NQ: to boil or steam rice

Q72: Why do houses have doors?

Macaw-11B: to keep out weather (credit: 1)
Macaw-3B: to keep out animals
Macaw-large: to let in light
Macaw-answer-11B: to keep out rain and snow (credit: 1)
GPT3-davinci: To keep the house from falling apart. (credit: 0)
Jurassic-1-jumbo: So people can't look in. (credit: 1)
T5-XXL-SSM-NQ: to provide insulation (credit: 1)
T5-11B-SSM-NQ: for security
T5-XL-SSM-NQ: to allow light in
T5-large-SSM-NQ: venting and light
T5-small-SSM-NQ: to their environment

Q73: Why does ice float?

Macaw-11B: because of the air trapped in the ice (credit: 0)
Macaw-3B: it is heavier than water
Macaw-large: less density
Macaw-answer-11B: because of its density (credit: 1)
GPT3-davinci: Ice floats because it is less dense than water. (credit: 1)
Jurassic-1-jumbo: Because it's lighter than water. (credit: 1)
T5-XXL-SSM-NQ: because of its high density (credit: 0)
T5-11B-SSM-NQ: surface tension
T5-XL-SSM-NQ: Pressure flow
T5-large-SSM-NQ: weightlessness
T5-small-SSM-NQ: float through a basket

Q74: Why does ice sink?

Macaw-11B: because of the density of the ice (credit: 0)
Macaw-3B: it has less surface area than liquid water
Macaw-large: it is a liquid
Macaw-answer-11B: it's denser than air (credit: 0.5)
GPT3-davinci: Ice is less dense than water. (credit: 0)
Jurassic-1-jumbo: Ice is less dense than water. (credit: 0)
T5-XXL-SSM-NQ: density (credit: 0)
T5-11B-SSM-NQ: density
T5-XL-SSM-NQ: weight
T5-large-SSM-NQ: Convection
T5-small-SSM-NQ: the clarity of its water

Q75: Why does it rain a lot in Seattle?

Macaw-11B: ocean (credit: 0.5)
Macaw-3B: oceans
Macaw-large: clouds
Macaw-answer-11B: ocean (credit: 0.5)
GPT3-davinci: Because if it didn't, it would be called Phoenix. (credit: 0)
Jurassic-1-jumbo: Because Seattle is so close to Canada. (credit: 0)
T5-XXL-SSM-NQ: its proximity to the Pacific Ocean (credit: 1)
T5-11B-SSM-NQ: the proximity of Puget Sound
T5-XL-SSM-NQ: its proximity to the Great Lakes
T5-large-SSM-NQ: heavy precipitation
T5-small-SSM-NQ: Rain or snow

Q76: Why is Seattle wet?

Macaw-11B: ocean (credit: 0.5)
Macaw-3B: it is on the edge of a large ocean
Macaw-large: evaporation
Macaw-answer-11B: it rains a lot (credit: 1)
GPT3-davinci: It rains a lot. (credit: 1)
Jurassic-1-jumbo: Because Seattle is on the west coast. (credit: 0)
T5-XXL-SSM-NQ: its proximity to the Pacific Ocean (credit: 1)
T5-11B-SSM-NQ: the proximity of Puget Sound
T5-XL-SSM-NQ: its proximity to the Great Lakes
T5-large-SSM-NQ: heavy precipitation
T5-small-SSM-NQ: The Seattle Times

Q77: Why is a tally sheet useful to help count things?

Macaw-11B: it can be used to check for accuracy (credit: 0.5)
Macaw-3B: it is easy to see how many of each item there are
Macaw-large: to keep track of change
Macaw-answer-11B: it helps you keep track of the totals (credit: 1)
GPT3-davinci: A tally sheet is a way to keep track of how many things you have counted. (credit: 1)
Jurassic-1-jumbo: A tally sheet is a sheet of paper with columns and rows. Each row represents a different item, and each column represents a different characteristic. (credit: 0)
T5-XXL-SSM-NQ: to keep track of items (credit: 1)
T5-11B-SSM-NQ: make it easier to count
T5-XL-SSM-NQ: to keep track of things
T5-large-SSM-NQ: to measure things
T5-small-SSM-NQ: In a spreadsheet

False presupposition

Q78: What year did Tom Hanks land on the moon?

Macaw-11B: no year (credit: 1)
Macaw-3B: 1969
Macaw-large: 1976
Macaw-answer-11B: no (credit: 1)
GPT3-davinci: Apollo 13, 1995. (credit: 0)
Jurassic-1-jumbo: 2001. Tom Hanks landed on the moon in Apollo 13. (credit: 0)
T5-XXL-SSM-NQ: 20 July 1969 (credit: 0)
T5-11B-SSM-NQ: Apollo 17
T5-XL-SSM-NQ: 20 July 1969
T5-large-SSM-NQ: 20 July 1969
T5-small-SSM-NQ: 1969

Q79: How old was Mark Zuckerberg when he founded Google?

Macaw-11B: 17 (credit: 0)
Macaw-3B: 16
Macaw-large: 27
Macaw-answer-11B: 17 (credit: 0)
GPT3-davinci: 19 (credit: 0)
Jurassic-1-jumbo: 12 years old. (credit: 0)
T5-XXL-SSM-NQ: 20 (credit: 0)
T5-11B-SSM-NQ: 19
T5-XL-SSM-NQ: 18
T5-large-SSM-NQ: 17
T5-small-SSM-NQ: nine

Q80: How old was Mark Zuckerberg when he founded Amazon?

Macaw-11B: 23 (credit: 0)
Macaw-3B: 18
Macaw-large: 27
Macaw-answer-11B: 20 (credit: 0)
GPT3-davinci: 19 (credit: 0)
Jurassic-1-jumbo: 12 years old. (credit: 0)
T5-XXL-SSM-NQ: 28 (credit: 0)
T5-11B-SSM-NQ: 17
T5-XL-SSM-NQ: 18
T5-large-SSM-NQ: 17
T5-small-SSM-NQ: Zuckerberg

Q81: How old was Kermit the Frog when he founded Amazon?

Macaw-11B: 0 (credit: 0)
Macaw-3B: 10 years old
Macaw-large: 17
Macaw-answer-11B: 0 (credit: 0)
GPT3-davinci: Kermit the Frog was born in 1955, and Amazon was founded in 1994. (credit: 0)
Jurassic-1-jumbo: 2,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000 (credit: 0)
T5-XXL-SSM-NQ: 29 (credit: 0)
T5-11B-SSM-NQ: 54
T5-XL-SSM-NQ: 36
T5-large-SSM-NQ: nine
T5-small-SSM-NQ: 26

Q82: How old was foo when she founded baz?

Macaw-11B: 18 (credit: 0)
Macaw-3B: 10 years old
Macaw-large: 27
Macaw-answer-11B: 18 (credit: 0)
GPT3-davinci: foo was born in the year of the cow. (credit: 0)
Jurassic-1-jumbo: foo was baz's founder. (credit: 0)
T5-XXL-SSM-NQ: 56 (credit: 0)
T5-11B-SSM-NQ: 15
T5-XL-SSM-NQ: 28
T5-large-SSM-NQ: 13
T5-small-SSM-NQ: 6

Q83: How can you sit and stand at the same time?

Macaw-11B: use a chair (credit: 0)
Macaw-3B: using a chair
Macaw-large: stand on a chair
Macaw-answer-11B: you can't (credit: 1)
GPT3-davinci: It's easy. You just sit down and stand up. (credit: 0)
Jurassic-1-jumbo: You do it all the time. (credit: 0)
T5-XXL-SSM-NQ: tripod position (credit: 0)
T5-11B-SSM-NQ: A stool
T5-XL-SSM-NQ: tripod
T5-large-SSM-NQ: computer
T5-small-SSM-NQ: Quakers

Q84: How can you walk and run at the same time?

Macaw-11B: use different muscles (credit: 0)
Macaw-3B: use a treadmill
Macaw-large: walk in place of running
Macaw-answer-11B: use your arms (credit: 0)
GPT3-davinci: It's called a run-walk. (credit: 0)
Jurassic-1-jumbo: You walk first, then run. (credit: 0)
T5-XXL-SSM-NQ: locomotion (credit: 0)
T5-11B-SSM-NQ: alternating gait
T5-XL-SSM-NQ: March
T5-large-SSM-NQ: walking and running
T5-small-SSM-NQ: walking with the year 20

Q85: Joe is walking. How can Joe now run while still walking?

Macaw-11B: he can walk faster (credit: 0)
Macaw-3B: he can change direction
Macaw-large: push the car
Macaw-answer-11B: increase his speed (credit: 0)
GPT3-davinci: Joe can run while walking by running while walking. (credit: 0)
Jurassic-1-jumbo: Joe can run while he is walking. (credit: 0)
T5-XXL-SSM-NQ: simultaneously (credit: 0)
T5-11B-SSM-NQ: running
T5-XL-SSM-NQ: Joe
T5-large-SSM-NQ: Joe can run
T5-small-SSM-NQ: about two feet

Q86: Sally's favorite cow died yesterday. When will the cow be alive again?

Macaw-11B: in a few days (credit: 0)
Macaw-3B: tomorrow
Macaw-large: a few days
Macaw-answer-11B: in seven years (credit: 0)
GPT3-davinci: When Sally's favorite cow is dead. (credit: 0)
Jurassic-1-jumbo: Sally's favorite cow died yesterday. (credit: 0)
T5-XXL-SSM-NQ: in the spring (credit: 0)
T5-11B-SSM-NQ: someday
T5-XL-SSM-NQ: tomorrow
T5-large-SSM-NQ: Christmas Day
T5-small-SSM-NQ: November 25, 2010

General knowledge

Q87: Susie wants to make an omelette. What ingredients will she need?

Macaw-11B: eggs, milk, butter (credit: 1)
Macaw-3B: eggs
Macaw-large: eggs and cheese
Macaw-answer-11B: eggs, milk, butter, salt, pepper (credit: 1)
GPT3-davinci: Eggs, butter, milk, cheese, and salt. (credit: 1)
Jurassic-1-jumbo: She will need eggs, milk, butter, and flour. (credit: 1)
T5-XXL-SSM-NQ: eggs (credit: 0.5)
T5-11B-SSM-NQ: Eggs
T5-XL-SSM-NQ: bacon
T5-large-SSM-NQ: some flour
T5-small-SSM-NQ: essential oil for food

Q88: Why are eggs needed for an omelette?

Macaw-11B: they provide the protein (credit: 1)
Macaw-3B: to make the mixture more creamy
Macaw-large: to form the omelette
Macaw-answer-11B: to add protein (credit: 1)
GPT3-davinci: To give it a good consistency. (credit: 1)
Jurassic-1-jumbo: Because without them, it's just an egg. (credit: 0)
T5-XXL-SSM-NQ: to provide protein (credit: 1)
T5-11B-SSM-NQ: bind the filling ingredients together
T5-XL-SSM-NQ: to provide protein
T5-large-SSM-NQ: to prevent overcooking
T5-small-SSM-NQ: a jealous female demon

Q89: Why is milk needed for an omelette?

Macaw-11B: it helps the eggs cook (credit: 1)
Macaw-3B: it adds liquid
Macaw-large: to make the egg whites thicker
Macaw-answer-11B: it helps the eggs cook (credit: 1)
GPT3-davinci: To help you swallow it. (credit: 0)
Jurassic-1-jumbo: Because otherwise, it would be an eggs-plosion. (credit: 0)
T5-XXL-SSM-NQ: to make it fluffy (credit: 1)
T5-11B-SSM-NQ: acid
T5-XL-SSM-NQ: to thin the egg
T5-large-SSM-NQ: to make it easier to swallow
T5-small-SSM-NQ: to scare off any predators

Q90: Why is butter needed for an omelette?

Macaw-11B: it adds flavor (credit: 1)
Macaw-3B: to make the eggs more fluffy
Macaw-large: it sets the eggs
Macaw-answer-11B: it adds flavor (credit: 1)
GPT3-davinci: To make it fluffy. (credit: 1)
Jurassic-1-jumbo: Because otherwise, it would be an omelette. (credit: 0)
T5-XXL-SSM-NQ: to prevent sticking (credit: 1)
T5-11B-SSM-NQ: to prevent sticking
T5-XL-SSM-NQ: tobind the ingredients
T5-large-SSM-NQ: to prevent overcooking
T5-small-SSM-NQ: a pulse containing ice

Q91: Which kind of grass is best to grow in shady areas?

Macaw-11B: fescue (credit: 1)
Macaw-3B: blue grass
Macaw-large: dark green
Macaw-answer-11B: fescue (credit: 1)
GPT3-davinci: Tall fescue is a good choice for shady areas. It is a cool season grass that is very shade tolerant. It is also very drought tolerant. It is a deep rooted grass that will tolerate dry conditions. It is also a good choice for areas that are prone to erosion. (credit: 1)
Jurassic-1-jumbo: The best grass for shady areas is tall fescue. It grows well in shade, is drought tolerant, and is disease resistant. (credit: 1)
T5-XXL-SSM-NQ: Fescue (credit: 1)
T5-11B-SSM-NQ: fescue
T5-XL-SSM-NQ: rough sedges
T5-large-SSM-NQ: Seashore Paspalum, Platinum TE
T5-small-SSM-NQ: Dendrochronolis

Q92: What is shiplap?

Macaw-11B: a kind of wood paneling (credit: 1)
Macaw-3B: a kind of construction material
Macaw-large: a covering around the edges of a book
Macaw-answer-11B: a type of cladding made of thin wood planks (credit: 1)
GPT3-davinci: Shiplap is a type of wood siding that is used on the exterior of houses. It is a very popular look in the South. (credit: 1)
Jurassic-1-jumbo: Shiplap is a type of wooden board that overlaps each other. (credit: 1)
T5-XXL-SSM-NQ: horizontal boards (credit: 1)
T5-11B-SSM-NQ: boards laid horizontally
T5-XL-SSM-NQ: paneling
T5-large-SSM-NQ: a type of canvas
T5-small-SSM-NQ: a langoustine

Q93: What does the idiom "kick the tires" mean?

Macaw-11B: test drive a car (credit: 1)
Macaw-3B: to make sure the tires are in good shape
Macaw-large: to change tires
Macaw-answer-11B: test the vehicle (credit: 1)
GPT3-davinci: To kick the tires means to check out something before you buy it. (credit: 1)
Jurassic-1-jumbo: To "kick the tires" means to examine something closely, especially a car. (credit: 1)
T5-XXL-SSM-NQ: test-drive a car (credit: 1)
T5-11B-SSM-NQ: test the waters
T5-XL-SSM-NQ: a car is tested
T5-large-SSM-NQ: 'to start the engine'
T5-small-SSM-NQ: "Kiss You Back"

Q94: What is the role of the spark plug in a combustion engine?

Macaw-11B: it causes the engine to start (credit: 1)
Macaw-3B: it ignites the fuel
Macaw-large: to provide a pathway for gas to enter the combustion chamber
Macaw-answer-11B: ignite the fuel (credit: 1)
GPT3-davinci: The spark plug is the device that ignites the fuel-air mixture in the cylinder. (credit: 1)
Jurassic-1-jumbo: The spark plug ignites the fuel-air mixture in the combustion chamber. (credit: 1)
T5-XXL-SSM-NQ: ignite the fuel (credit: 1)
T5-11B-SSM-NQ: start the engine
T5-XL-SSM-NQ: the initial spark
T5-large-SSM-NQ: start the engine
T5-small-SSM-NQ: the speed of the reaction

Q95: What are the parts in a car engine?

Macaw-11B: pistons, valves, and crankshaft (credit: 1)
Macaw-3B: pistons, valves, and crankshaft
Macaw-large: gas, oil, and cylinders
Macaw-answer-11B: piston, crankshaft, valves, intake and exhaust systems (credit: 1)
GPT3-davinci: The parts in a car engine are the engine block, the cylinder head, the cylinder block, the crankshaft, the connecting rod, the piston, the spark plug, the camshaft, the timing belt, the timing chain, the timing gears, the timing chain cover, the timing chain tensioner, (credit: 1)
Jurassic-1-jumbo: The parts of a car engine are: cylinder block, cylinder head, crankshaft, connecting rods, pistons, camshaft, valves, timing gears, timing chain, oil pump, oil pan, intake manifold, exhaust manifold, and rocker arms. (credit: 1)
T5-XXL-SSM-NQ: cylinder head(s) (credit: 0.5)
T5-11B-SSM-NQ: cylinder head(s)
T5-XL-SSM-NQ: cylinder head(s)
T5-large-SSM-NQ: intake and exhaust passages
T5-small-SSM-NQ: to power engines

Q96: What is the role of the piston in a car engine?

Macaw-11B: it moves the connecting rod (credit: 1)
Macaw-3B: it moves the valves
Macaw-large: it is the vehicle that converts fuel into kinetic energy and heat energy
Macaw-answer-11B: to compress air in the cylinder (credit: 1)
GPT3-davinci: The piston is a cylindrical component that is used to convert the reciprocating motion of the engine's crankshaft into a rotary motion that drives the car's wheels. (credit: 1)
Jurassic-1-jumbo: The piston is the engine's "heart". It moves up and down in the cylinder, creating the power that propels the car. (credit: 1)
T5-XXL-SSM-NQ: move the crank (credit: 1)
T5-11B-SSM-NQ: the power source
T5-XL-SSM-NQ: fire
T5-large-SSM-NQ: internal combustion
T5-small-SSM-NQ: to measure engine dynamic changes

Q97: What is the role of a carburetor in a car engine?

Macaw-11B: it converts fuel into fuel and air mixtures (credit: 1)
Macaw-3B: it provides fuel for the combustion chambers
Macaw-large: to remove excess fuel from the engine
Macaw-answer-11B: to mix air and fuel (credit: 1)
GPT3-davinci: It's a device that converts water into gasoline. (credit: 0)
Jurassic-1-jumbo: A carburetor is a device that mixes air and fuel together. The carburetor mixes the fuel and air together, and this mixture is then sent to the engine. (credit: 1)
T5-XXL-SSM-NQ: atomizes fuel (credit: 1)
T5-11B-SSM-NQ: fuel injection
T5-XL-SSM-NQ: to supply fuel
T5-large-SSM-NQ: a type of cylinder head
T5-small-SSM-NQ: head-level

Q98: What is the role of the valves in a car engine?

Macaw-11B: control the flow of gas (credit: 1)
Macaw-3B: to regulate the flow of air and fuel
Macaw-large: to adjust the pressure of the air
Macaw-answer-11B: to control the flow of air and fuel (credit: 1)
GPT3-davinci: Valves are used to control the flow of gases and fluids in and out of the engine. (credit: 1)
Jurassic-1-jumbo: The valves in your car engine open and close to allow air and fuel into the combustion chamber. The valves also control the flow of exhaust gases out of the combustion chamber. (credit: 1)
T5-XXL-SSM-NQ: to open and close (credit: 1)
T5-11B-SSM-NQ: to regulate the flow of air
T5-XL-SSM-NQ: to charge the engine
T5-large-SSM-NQ: measure and regulate the speed
T5-small-SSM-NQ: to prevent engine knocking

Q99: What is the path of the gas through a car engine as it operates?

Macaw-11B: in, out, in, out (credit: 0)
Macaw-3B: in a straight line
Macaw-large: gas flows from the engine to the exhaust
Macaw-answer-11B: intake, compression, exhaust (credit: 1)
GPT3-davinci: The path of the gas through a car engine as it operates is as follows:

The gas enters the engine through the air filter.

The gas passes through the carburetor.

The gas passes through the intake manifold.

The gas passes through the cylinder head. (credit: 1)
- Jurassic-1-jumbo: The gas enters the engine through the carburetor, where it is mixed with air. The mixture is then ignited by a spark from the spark plug. The burning mixture forces the pistons down, which turns the crankshaft. The crankshaft turns the camshaft, which turns the intake and exhaust valves. The valves open and close to let in air and fuel, and let out exhaust. (credit: 1)
- T5-XXL-SSM-NQ: in an endless loop (credit: 0)
- T5-11B-SSM-NQ: intake manifold
- T5-XL-SSM-NQ: internal combustion
- T5-large-SSM-NQ: intake and exhaust passages
- T5-small-SSM-NQ: to operate power

Q100: Is it dangerous to inhale smoke from wildfires?

Macaw-11B: yes (credit: 1)
Macaw-3B: yes
Macaw-large: yes
Macaw-answer-11B: yes (credit: 1)
GPT3-davinci: Yes. Smoke from wildfires contains a complex mixture of gases and fine particles. The fine particles are so small that they can get deep into your lungs and even into your bloodstream. The smoke can irritate your eyes, nose, throat, and lungs. It can also worsen chronic heart and lung diseases. (credit: 1)
Jurassic-1-jumbo: Wildfire smoke contains fine particles and gases that can irritate your eyes, nose, throat and lungs. (credit: 1)
T5-XXL-SSM-NQ: wildfire smoke is an irritant (credit: 1)
T5-11B-SSM-NQ: can cause respiratory illness
T5-XL-SSM-NQ: is it safe to breathe?
T5-large-SSM-NQ: It is not recommended
T5-small-SSM-NQ: isopropyl group

Q101: Why are toxic gases bad for you?

Macaw-11B: they can cause cancer (credit: 1)
Macaw-3B: they cause damage to the lungs
Macaw-large: they pollute the air
Macaw-answer-11B: they are poisonous (credit: 1)
GPT3-davinci: Because they are toxic. (credit: 0)
Jurassic-1-jumbo: Toxic gases are dangerous because they displace oxygen. (credit: 0)
T5-XXL-SSM-NQ: death (credit: 1)
T5-11B-SSM-NQ: can cause death by asphyxiation
T5-XL-SSM-NQ: an environmental health risk
T5-large-SSM-NQ: overuse of chemicals
T5-small-SSM-NQ: to reduce theft

Q102: What is a tally sheet useful for?

Macaw-11B: keeping track of things (credit: 1)
Macaw-3B: keeping track of money
Macaw-large: keeping track of things
Macaw-answer-11B: keeping track of things (credit: 1)
GPT3-davinci: Tally sheets are used to keep track of the number of times a certain behavior occurs. (credit: 1)
Jurassic-1-jumbo: Tally sheets are very useful when counting inventory, counting votes, or counting anything. (credit: 1)
T5-XXL-SSM-NQ: for keeping track of items (credit: 1)
T5-11B-SSM-NQ: tabulating results of an experiment
T5-XL-SSM-NQ: recording financial transactions
T5-large-SSM-NQ: to track progress
T5-small-SSM-NQ: good news for the farmers

Q103: In what situation might a person have broken their arm?

Macaw-11B: a fall (credit: 1)
Macaw-3B: a car accident
Macaw-large: a car accident
Macaw-answer-11B: falling down stairs (credit: 1)
GPT3-davinci: A person might have broken their arm if they fell off a ladder. (credit: 1)
Jurassic-1-jumbo: A broken arm is an injury that occurs when a bone in the arm breaks. (credit: 0)
T5-XXL-SSM-NQ: while playing rugby (credit: 1)
T5-11B-SSM-NQ: A fall
T5-XL-SSM-NQ: in a car accident
T5-large-SSM-NQ: In a car accident
T5-small-SSM-NQ: undisclosed illness

Q104: What objects might be involved in a car crash?

Macaw-11B: other cars, trees, telephone poles (credit: 1)
Macaw-3B: rocks
Macaw-large: sand
Macaw-answer-11B: trees, telephone poles, telephones, power lines, buildings, etc. (credit: 1)
GPT3-davinci: The most common objects involved in car crashes are other cars, trees, and utility poles. (credit: 1)
Jurassic-1-jumbo: The objects involved in a car accident can include cars, trucks, motorcycles, bicycles, pedestrians, and stationary objects. (credit: 1)
T5-XXL-SSM-NQ: other vehicles (credit: 1)
T5-11B-SSM-NQ: pedestrians
T5-XL-SSM-NQ: a vehicle
T5-large-SSM-NQ: other vehicle
T5-small-SSM-NQ: frames a wheel well

Q105: How would a tree be involved in a car crash?

Macaw-11B: it could fall on a car (credit: 1)
Macaw-3B: it would break
Macaw-large: it would be crushed
Macaw-answer-11B: it could fall on the car (credit: 1)
GPT3-davinci: The tree was hit by a car. (credit: 1)
Jurassic-1-jumbo: A tree can be involved in a crash when a driver loses control of the vehicle and crashes into a tree. (credit: 1)
T5-XXL-SSM-NQ: a barrier (credit: 1)
T5-11B-SSM-NQ: struck by a vehicle
T5-XL-SSM-NQ: fallen branch
T5-large-SSM-NQ: could be damaged
T5-small-SSM-NQ: Any abnormal electric current

Q106: How might a telephone pole be involved in a car crash?

Macaw-11B: it could be hit by a car (credit: 1)
Macaw-3B: it might break
Macaw-large: a person on a cell phone calls the police for help and they arrive at the scene of the crash
Macaw-answer-11B: it could be pushed over (credit: 1)
GPT3-davinci: A telephone pole is involved in a car crash when a driver runs into it. (credit: 1)
Jurassic-1-jumbo: A telephone pole might be involved in a car crash if a driver swerves to avoid hitting it and ends up crashing into another vehicle. (credit: 1)
T5-XXL-SSM-NQ: support a vehicle (credit: 0)
T5-11B-SSM-NQ: struck by a vehicle
T5-XL-SSM-NQ: Impaired driving
T5-large-SSM-NQ: poles
T5-small-SSM-NQ: passing a telephone pole

Q107: Why might a car hit a telephone pole?

Macaw-11B: it was in the way (credit: 1)
Macaw-3B: the pole is made of a hard material
Macaw-large: the wire is closer to the car
Macaw-answer-11B: driver lost control (credit: 1)
GPT3-davinci: Because it was parked too close to it. (credit: 0)
Jurassic-1-jumbo: Because the driver was distracted by his cellphone. (credit: 1)
T5-XXL-SSM-NQ: to prevent collisions (credit: 1)
T5-11B-SSM-NQ: striking a utility pole
T5-XL-SSM-NQ: to reduce friction
T5-large-SSM-NQ: causing a collision
T5-small-SSM-NQ: to traffic with cars

Q108: What might cause a car to hit a telephone pole?

Macaw-11B: a drunk driver (credit: 1)
Macaw-3B: a deer running in the road
Macaw-large: a car braking suddenly
Macaw-answer-11B: swerving (credit: 1)
GPT3-davinci: A telephone pole might cause a car to hit a telephone pole. (credit: 0)
Jurassic-1-jumbo: A car hitting a telephone pole is a common occurrence. The pole is usually hit when the driver is distracted, speeding, or intoxicated. (credit: 1)
T5-XXL-SSM-NQ: a sudden stop (credit: 0)
T5-11B-SSM-NQ: road debris
T5-XL-SSM-NQ: a missed brake
T5-large-SSM-NQ: a vehicle moving forward
T5-small-SSM-NQ: the phone hacking problem

Q109: Why might a car driver be drunk?

Macaw-11B: to escape from a bad situation (credit: 1)
Macaw-3B: intoxicated
Macaw-large: if they drink too much, they will get behind the wheel faster
Macaw-answer-11B: to get high (credit: 1)
GPT3-davinci: Because he's driving a drunk. (credit: 0)
Jurassic-1-jumbo: Because he drank too much. (credit: 1)
T5-XXL-SSM-NQ: to reduce cognitive errors (credit: 0)
T5-11B-SSM-NQ: to avoid or mitigate the effects of alcohol
T5-XL-SSM-NQ: drunk driving
T5-large-SSM-NQ: unresponsive driving
T5-small-SSM-NQ: to avoid drunk driving fatalities

Q110: How might making poor decisions result in a car crash?

Macaw-11B: speeding (credit: 1)
Macaw-3B: a driver might not see an object in time to avoid it
Macaw-large: you could end up in a coma
Macaw-answer-11B: speeding (credit: 1)
GPT3-davinci: If you are driving while intoxicated, you are more likely to make poor decisions that could result in a car crash. (credit: 1)
Jurassic-1-jumbo: Making poor decisions while driving can result in a car crash. (credit: 0)
T5-XXL-SSM-NQ: inattention (credit: 1)
T5-11B-SSM-NQ: speeding
T5-XL-SSM-NQ: negligent driving
T5-large-SSM-NQ: leading to a car crash
T5-small-SSM-NQ: A simple explanation of driving behaviour

Q111: Why does speeding cause car accidents?

Macaw-11B: it causes the car to swerve (credit: 1)
Macaw-3B: the force of the impact can cause the car to swerve
Macaw-large: you are not paying attention to the road
Macaw-answer-11B: it reduces reaction time (credit: 1)
GPT3-davinci: Because you can't turn time into space. (credit: 0)
Jurassic-1-jumbo: Speeding is a factor in many car accidents. Speeding reduces a driver's reaction time, increases the distance required to stop a vehicle, and makes it more difficult for a driver to regain control of a vehicle. (credit: 1)
T5-XXL-SSM-NQ: increased chance of injury (credit: 1)
T5-11B-SSM-NQ: increased reaction time
T5-XL-SSM-NQ: The speeding problem
T5-large-SSM-NQ: increased speed
T5-small-SSM-NQ: to prevent intraoperative corneal injuries

Q112: How might speeding cause a car accident?

Macaw-11B: lose control of the car (credit: 1)
Macaw-3B: causing the car to lose control
Macaw-large: you could be seriously injured
Macaw-answer-11B: driver loses control of vehicle (credit: 1)
GPT3-davinci: Speeding is a factor in many car accidents. Speeding increases the likelihood of a car accident because it increases the force of impact. The faster a car is going, the more damage it will do to another car or object when it collides with it. (credit: 1)
Jurassic-1-jumbo: Speeding is a factor in many car accidents. Speeding reduces a driver's reaction time, increases the distance required to stop a vehicle, and makes it more difficult for a driver to swerve out of the way of danger. (credit: 1)
T5-XXL-SSM-NQ: causes increased vulnerability to road conditions (credit: 1)
T5-11B-SSM-NQ: increased risk of collision
T5-XL-SSM-NQ: in a low-speed car
T5-large-SSM-NQ: can lead to an accident
T5-small-SSM-NQ: They are not alone

Q113: What is involved in driving?

Macaw-11B: concentration, observation, control (credit: 1)
Macaw-3B: the brain
Macaw-large: risk
Macaw-answer-11B: concentration, observation, and control (credit: 1)
GPT3-davinci: Driving is a very simple process. You just need to be able to see and hear. You need to be able to see the road and the other cars around you. You need to be able to hear the sounds of the car and the sounds of the road. You need to be able to see the signs and the (credit: 0.5)
Jurassic-1-jumbo: Driving is the act of controlling a vehicle. (credit: 1)
T5-XXL-SSM-NQ: applying the brakes (credit: 0.5)
T5-11B-SSM-NQ: driving
T5-XL-SSM-NQ: operating a vehicle
T5-large-SSM-NQ: a vehicle
T5-small-SSM-NQ: traffic calming

Q114: What does driving a car involve?

Macaw-11B: steering (credit: 0.5)
Macaw-3B: controlling the vehicle
Macaw-large: kinetic energy
Macaw-answer-11B: steering, braking, shifting gears, accelerating, navigating (credit: 1)
GPT3-davinci: Driving a car involves the use of a steering wheel, accelerator, and brake pedal. (credit: 1)
Jurassic-1-jumbo: Driving a car involves controlling a vehicle, usually with four wheels, powered by an engine, and able to carry a small number of people. (credit: 1)
T5-XXL-SSM-NQ: applying the brakes (credit: 0.5)
T5-11B-SSM-NQ: the operation of a motor vehicle
T5-XL-SSM-NQ: many factors
T5-large-SSM-NQ: motor vehicle
T5-small-SSM-NQ: for the maintenance of public vehicles

Q115: What is the purpose of driving a car?

Macaw-11B: transport people (credit: 1)
Macaw-3B: to move
Macaw-large: transport people
Macaw-answer-11B: to get from point A to point B (credit: 1)
GPT3-davinci: To get from one place to another. (credit: 1)
Jurassic-1-jumbo: To transport people or goods from one place to another. (credit: 1)
T5-XXL-SSM-NQ: transportation (credit: 1)
T5-11B-SSM-NQ: transportation
T5-XL-SSM-NQ: to carry people
T5-large-SSM-NQ: transport
T5-small-SSM-NQ: to maintain muscle control

Q116: How many years will it take to build truly intelligent machines?

Macaw-11B: hundreds of years (credit: 1)
Macaw-3B: 100 years
Macaw-large: 1 billion years
Macaw-answer-11B: decades (credit: 1)
GPT3-davinci: I don't know. I don't think anyone knows. (credit: 1)
Jurassic-1-jumbo: 50 years. (credit: 1)
T5-XXL-SSM-NQ: probably not in our lifetime (credit: 1)
T5-11B-SSM-NQ: decades
T5-XL-SSM-NQ: decades
T5-large-SSM-NQ: 2050
T5-small-SSM-NQ: five

Q117: Why will it take hundreds of years to build truly intelligent machines?

Macaw-11B: the brain is very complex (credit: 1)
Macaw-3B: the technology is still being developed
Macaw-large: they require so much technology
Macaw-answer-11B: they are not yet capable of learning (credit: 0.5)
GPT3-davinci: Because we don't know how to build them. (credit: 1)
Jurassic-1-jumbo: Because intelligence is the most complex thing in the universe. (credit: 1)
T5-XXL-SSM-NQ: the Three Laws of AI (credit: 0)
T5-11B-SSM-NQ: complexity
T5-XL-SSM-NQ: The hard problem with AI
T5-large-SSM-NQ: This is why artificial intelligence is so complex
T5-small-SSM-NQ: one to three

Q118: Why are truly intelligent machines very complex?

Macaw-11B: they have to be (credit: 0)
Macaw-3B: to make the most of the available resources
Macaw-large: they are made of parts that are connected
Macaw-answer-11B: they need to be able to learn (credit: 1)
GPT3-davinci: Because they have to be. (credit: 0)
Jurassic-1-jumbo: Because they have so many moving parts. (credit: 1)
T5-XXL-SSM-NQ: many cognitive abilities (credit: 1)
T5-11B-SSM-NQ: the nature of the problem
T5-XL-SSM-NQ: because of their inherent complexity
T5-large-SSM-NQ: the foundations of AI
T5-small-SSM-NQ: about a brain

Q119: John is counting sheep. What equipment might be useful for John?

Macaw-11B: a telescope (credit: 0)
Macaw-3B: a tape measure
Macaw-large: a hand lens
Macaw-answer-11B: a calculator (credit: 1)
GPT3-davinci: John might want to use a sheep counter. (credit: 1)
Jurassic-1-jumbo: A sheep counter. (credit: 1)
T5-XXL-SSM-NQ: a digital counter (credit: 1)
T5-11B-SSM-NQ: a digital counting machine
T5-XL-SSM-NQ: a counter
T5-large-SSM-NQ: a GPS tracker
T5-small-SSM-NQ: a GPS tracker

Q120: What would be a good design for a spaceship?

Macaw-11B: one that could travel fast and be easily repaired (credit: 1)
Macaw-3B: a sphere
Macaw-large: a star similar to our Sun
Macaw-answer-11B: a ship that can move on its own (credit: 0.5)
GPT3-davinci: A good design for a spaceship would be a spaceship that can travel to other planets. (credit: 1)
Jurassic-1-jumbo: A spaceship should be designed so that its occupants can breathe. (credit: 1)
T5-XXL-SSM-NQ: a planetary probe (credit: 0)
T5-11B-SSM-NQ: Orion
T5-XL-SSM-NQ: a simple spaceship
T5-large-SSM-NQ: high-tech propulsion
T5-small-SSM-NQ: to evangelize the Rubinoos

Q121: How do you remove the shine from polished granite?

Macaw-11B: sand it (credit: 1)
Macaw-3B: sand it
Macaw-large: use a soft cloth
Macaw-answer-11B: sandpaper (credit: 1)
GPT3-davinci: Polished granite is a very hard surface and is very difficult to scratch. However, if you do scratch it, you can remove the shine by using a pumice stone. (credit: 1)
Jurassic-1-jumbo: The shine on polished granite is from polishing. To remove the shine, you need to polish the granite again. (credit: 1)
T5-XXL-SSM-NQ: dulling paste (credit: 1)
T5-11B-SSM-NQ: sandblasting
T5-XL-SSM-NQ: dulling
T5-large-SSM-NQ: a wax or clay base
T5-small-SSM-NQ: si tacuisses, philosophus mansisses

Q122: How does an internal combustion engine work?

Macaw-11B: it converts fuel into kinetic energy and heat (credit: 1)
Macaw-3B: it burns fuel
Macaw-large: it converts fuel into kinetic energy and heat energy
Macaw-answer-11B: it converts chemical energy into mechanical energy (credit: 1)
GPT3-davinci: It's a very complicated process, but basically you take a bunch of gasoline, put it in a cylinder, and light it on fire. (credit: 1)
Jurassic-1-jumbo: An internal combustion engine is a heat engine that burns fuel to create heat, which expands and moves a piston. The piston is connected to a crankshaft, which turns a flywheel, which turns a transmission, which turns the wheels. (credit: 1)
T5-XXL-SSM-NQ: heat energy (credit: 0)
T5-11B-SSM-NQ: burns fossil fuels
T5-XL-SSM-NQ: ignitron
T5-large-SSM-NQ: fires up
T5-small-SSM-NQ: work in the interior

Q123: How does an internal combustion engine convert fuel into kinetic energy and heat and cooled exhaust gas?

Macaw-11B: by combusting (credit: 1)
Macaw-3B: combustion
Macaw-large: combustion
Macaw-answer-11B: chemical energy (credit: 0)
GPT3-davinci: The internal combustion engine is a heat engine that uses the heat of a combustion reaction to drive a piston. The heat of the combustion reaction is used to heat the air in the cylinder, which expands and pushes the piston. The piston is connected to a crankshaft, which converts the linear motion of the piston into (credit: 1)
Jurassic-1-jumbo: The fuel is mixed with air in the combustion chamber. The mixture is ignited by a spark. The combustion of the fuel-air mixture releases energy in the form of heat. The hot gases expand and force the piston down. The piston is connected to the crankshaft, which converts the linear motion of the piston into rotary motion. The rotary motion is transferred to the wheels of the vehicle. The hot gases are cooled in the exhaust system (credit: 1)
T5-XXL-SSM-NQ: The internal combustion engine (credit: 0)
T5-11B-SSM-NQ: combustion
T5-XL-SSM-NQ: heat
T5-large-SSM-NQ: combustion
T5-small-SSM-NQ: indirectly using a liquid gas supply

Q124: What are the parts of an internal combustion engine?

Macaw-11B: piston, cylinder, valves, and head (credit: 1)
Macaw-3B: pistons, valves, exhaust manifold, exhaust manifold, intake manifold, exhaust manifold, intake manifold, exhaust manifold, exhaust manifold, exhaust manifold, exhaust manifold, intake manifold, exhaust manifold, exhaust manifold, exhaust manifold, exhaust manifold, exhaust manifold, exhaust manifold, exhaust manifold, exhaust manifold, exhaust manifold, exhaust manifold, exhaust man
Macaw-large: gas, oil, and filter
Macaw-answer-11B: piston, cylinder, valves, and crankshaft (credit: 1)
GPT3-davinci: The parts of an internal combustion engine are the cylinder, piston, connecting rod, crankshaft, flywheel, camshaft, valves, spark plugs, and carburetor. (credit: 1)
Jurassic-1-jumbo: The parts of an internal combustion engine are: cylinder block, cylinder head, crankshaft, connecting rod, piston, piston rings, camshaft, valves, pushrods, rocker arms, timing chain, timing gears, timing chain cover, oil pump, oil pan, oil pump pickup, oil pump drive, oil pump cover, oil pan gasket, (credit: 1)
T5-XXL-SSM-NQ: cylinders (credit: 0.5)
T5-11B-SSM-NQ: piston
T5-XL-SSM-NQ: crankcase
T5-large-SSM-NQ: Fuel
T5-small-SSM-NQ: Internal combustion

Q125: What is the purpose of the piston in an internal combustion engine?

Macaw-11B: to compress fuel and air in the cylinder (credit: 1)
Macaw-3B: to move the crankshaft
Macaw-large: to move the engine forward
Macaw-answer-11B: to compress air and fuel (credit: 1)
GPT3-davinci: The piston is the part of the engine that moves up and down. It is connected to the crankshaft, which is the part of the engine that turns. The piston is what makes the engine move. (credit: 1)
Jurassic-1-jumbo: The piston is the heart of the engine. It converts the explosive force of the ignited fuel-air mixture in the cylinder into mechanical energy. (credit: 1)
T5-XXL-SSM-NQ: to seal the engine's cylinders (credit: 0.5)
T5-11B-SSM-NQ: actuate the reciprocating piston
T5-XL-SSM-NQ: to deliver energy
T5-large-SSM-NQ: to operate the engine
T5-small-SSM-NQ: origins are unknown

Q126: What is the purpose of the cylinder in an internal combustion engine?

Macaw-11B: to compress fuel and air (credit: 1)
Macaw-3B: to burn fuel
Macaw-large: to provide a means of increasing the efficiency of the engine
Macaw-answer-11B: to contain the burning mixture (credit: 1)
GPT3-davinci: The cylinder is the part of the engine that contains the combustion process. (credit: 1)
Jurassic-1-jumbo: The cylinder is the part of the engine where the combustion of fuel takes place. (credit: 1)
T5-XXL-SSM-NQ: to contain the combustion (credit: 1)
T5-11B-SSM-NQ: the combustion process
T5-XL-SSM-NQ: fire
T5-large-SSM-NQ: to operate the engine
T5-small-SSM-NQ: to measure visual acuity

Q127: What is the purpose of the valves in an internal combustion engine?

Macaw-11B: to control the flow of gas (credit: 1)
Macaw-3B: to regulate the flow of air and fuel
Macaw-large: to adjust the air pressure
Macaw-answer-11B: to control the flow of air and fuel (credit: 1)
GPT3-davinci: The valves are used to control the flow of air and fuel into the engine. (credit: 1)
Jurassic-1-jumbo: The valves in an internal combustion engine control the flow of air into and out of the combustion chamber. (credit: 1)
T5-XXL-SSM-NQ: to prevent engine knocking (credit: 0)
T5-11B-SSM-NQ: to admit air
T5-XL-SSM-NQ: to supply air
T5-large-SSM-NQ: measure and regulate the speed
T5-small-SSM-NQ: to detect motion and orientation

Q128: What is the purpose of the head in an internal combustion engine?

Macaw-11B: to control the flow of gas (credit: 1)
Macaw-3B: to direct the flow of air and fuel to the rest of the engine
Macaw-large: to control the engine
Macaw-answer-11B: to cool the cylinders (credit: 1)
GPT3-davinci: To get rid of the exhaust. (credit: 1)
Jurassic-1-jumbo: The head is bolted to the block and contains the valves, spark plugs, and combustion chambers. (credit: 1)
T5-XXL-SSM-NQ: to provide a smooth running surface (credit: 0)
T5-11B-SSM-NQ: the cylinder head(s)
T5-XL-SSM-NQ: to conduct heat
T5-large-SSM-NQ: measure and regulate the speed
T5-small-SSM-NQ: regulates speed

Q129: What is the piston in an internal combustion engine?

Macaw-11B: a part of an internal combustion engine that moves up and down to compress air (credit: 1)
Macaw-3B: a part of the engine that moves the valves
Macaw-large: the largest part of the engine is usually the largest part of the engine, usually the block
Macaw-answer-11B: the moving part of an internal combustion engine (credit: 1)
GPT3-davinci: The piston is a cylindrical component that is used to convert the linear motion of the piston rod into a rotating motion. (credit: 1)
Jurassic-1-jumbo: The piston is a cylindrical component that slides up and down in the cylinder. (credit: 1)
T5-XXL-SSM-NQ: part of the cylinder head (credit: 0)
T5-11B-SSM-NQ: the moving part of an engine
T5-XL-SSM-NQ: cylinder head
T5-large-SSM-NQ: cylinder head
T5-small-SSM-NQ: The cylinder head(s)

Q130: What is the cylinder in an internal combustion engine?

Macaw-11B: the part of an engine that contains the pistons (credit: 1)
Macaw-3B: a container for fuel
Macaw-large: the smallest cylinder that can be found in an automobile engine
Macaw-answer-11B: the space where the gas is compressed (credit: 1)
GPT3-davinci: The cylinder is the part of the engine that contains the combustion chamber. (credit: 1)
Jurassic-1-jumbo: The cylinder is the space in the cylinder block where the pistons move up and down. (credit: 1)
T5-XXL-SSM-NQ: the power unit (credit: 1)
T5-11B-SSM-NQ: the basic unit of combustion
T5-XL-SSM-NQ: cylinder head
T5-large-SSM-NQ: intake and exhaust passages
T5-small-SSM-NQ: cylinder head(s)

Q131: What is the valve in an internal combustion engine?

Macaw-11B: a part of an internal combustion engine that opens and closes to regulate the flow of gas (credit: 1)
Macaw-3B: a part of the engine that controls the flow of gas
Macaw-large: the safety valve
Macaw-answer-11B: opening and closing mechanism (credit: 1)
GPT3-davinci: The valve is a device that controls the flow of gases and liquids into and out of the engine. (credit: 1)
Jurassic-1-jumbo: The valve in an internal combustion engine is a device which controls the flow of air or fuel into the engine. (credit: 1)
T5-XXL-SSM-NQ: intake and exhaust (credit: 0.5)
T5-11B-SSM-NQ: valve springs
T5-XL-SSM-NQ: valve train
T5-large-SSM-NQ: intake and exhaust valves
T5-small-SSM-NQ: the mouthpiece

Q132: What is the head in an internal combustion engine?

Macaw-11B: the top part of an internal combustion engine that contains the valves (credit: 1)
Macaw-3B: the cylinder head
Macaw-large: the cylinder
Macaw-answer-11B: the upper part of the engine that contains the cylinders and valves (credit: 1)
GPT3-davinci: The head is the part of the engine that contains the valves. (credit: 1)
Jurassic-1-jumbo: The head is the top part of the engine. (credit: 1)
T5-XXL-SSM-NQ: the cylinder head(s) (credit: 1)
T5-11B-SSM-NQ: the cylinder head(s)
T5-XL-SSM-NQ: thecylinder head
T5-large-SSM-NQ: the engine's head
T5-small-SSM-NQ: The husk

Q133: In an internal combustion engine, what does the piston do?

Macaw-11B: it pushes the fuel into the cylinders (credit: 1)
Macaw-3B: moves the valves
Macaw-large: moves the needle
Macaw-answer-11B: pushes the other parts of the engine (credit: 1)
GPT3-davinci: The piston moves up and down in the cylinder. (credit: 1)
Jurassic-1-jumbo: It moves up and down. (credit: 1)
T5-XXL-SSM-NQ: pushes against the cylinder wall (credit: 1)
T5-11B-SSM-NQ: pushes the charge into the cylinder
T5-XL-SSM-NQ: fire
T5-large-SSM-NQ: heat the engine
T5-small-SSM-NQ: to measure visual acuity

Q134: What does the piston do in an internal combustion engine?

Macaw-11B: it pushes the fuel/air mixture down the cylinder (credit: 1)
Macaw-3B: moves the valves
Macaw-large: moves the engine
Macaw-answer-11B: pushes the other parts of the engine (credit: 1)
GPT3-davinci: The piston is a cylindrical metal rod that moves up and down inside the cylinder. It is connected to the crankshaft by a connecting rod. The piston is the part of the engine that does the actual work of converting the energy in the fuel into mechanical energy. (credit: 1)
Jurassic-1-jumbo: The piston is the part that moves up and down in the cylinder. (credit: 1)
T5-XXL-SSM-NQ: pushes against the cylinder wall (credit: 1)
T5-11B-SSM-NQ: actuates the reciprocating piston
T5-XL-SSM-NQ: deliver energy
T5-large-SSM-NQ: heat the engine
T5-small-SSM-NQ: to measure visual acuity

Q135: What are the parts of a house?

Macaw-11B: roof, walls, windows, doors (credit: 1)
Macaw-3B: walls
Macaw-large: the roof, the walls, the floors
Macaw-answer-11B: foundation, walls, roof, windows, doors (credit: 1)
GPT3-davinci: The parts of a house are the roof, the walls, the floor, the windows, the doors, the stairs, the chimney, the fireplace, the kitchen, the bathroom, the living room, the dining room, the bedroom, the attic, the basement, the garage, the porch, the yard, the (credit: 1)
Jurassic-1-jumbo: The parts of a house are the roof, walls, floor, and foundation. (credit: 1)
T5-XXL-SSM-NQ: foundation (credit: 0.5)
T5-11B-SSM-NQ: foundation
T5-XL-SSM-NQ: foundation
T5-large-SSM-NQ: rooms
T5-small-SSM-NQ: one or more houses

Q136: What does the roof do in a house?

Macaw-11B: protects the house (credit: 1)
Macaw-3B: protects the occupants
Macaw-large: protects the house
Macaw-answer-11B: keeps rain and snow out (credit: 1)
GPT3-davinci: It protects the house from the rain. (credit: 1)
Jurassic-1-jumbo: The roof protects the house from rain, snow, wind, and sun. (credit: 1)
T5-XXL-SSM-NQ: provides insulation (credit: 1)
T5-11B-SSM-NQ: provides shelter
T5-XL-SSM-NQ: water protection and heat insulation
T5-large-SSM-NQ: a protective layer over the roof
T5-small-SSM-NQ: to reduce weight

Q137: What is the purpose of a roof in a house?

Macaw-11B: keep the rain out (credit: 1)
Macaw-3B: to protect the occupants from the weather
Macaw-large: provide protection
Macaw-answer-11B: keep rain and snow out (credit: 1)
GPT3-davinci: To protect the house from the rain. (credit: 1)
Jurassic-1-jumbo: The main purpose of a roof is to protect a house from rain, snow, wind, and sun. (credit: 1)
T5-XXL-SSM-NQ: to provide insulation (credit: 1)
T5-11B-SSM-NQ: protection from the elements
T5-XL-SSM-NQ: to provide shelter
T5-large-SSM-NQ: insulation
T5-small-SSM-NQ: to regulate the home

Q138: What is the purpose of the walls in a house?

Macaw-11B: provide support (credit: 1)
Macaw-3B: to keep out animals
Macaw-large: to protect the house
Macaw-answer-11B: to keep the heat in (credit: 1)
GPT3-davinci: The walls in a house are there to protect the people inside from the elements. (credit: 1)
Jurassic-1-jumbo: The walls in a house serve many purposes. They separate the rooms, provide privacy, and hold up the roof. (credit: 1)
T5-XXL-SSM-NQ: provide insulation (credit: 1)
T5-11B-SSM-NQ: separating rooms
T5-XL-SSM-NQ: insulation
T5-large-SSM-NQ: insulation
T5-small-SSM-NQ: to regulate home life

Q139: What is the purpose of the windows in a house?

Macaw-11B: to let in light and air (credit: 1)
Macaw-3B: to let in light
Macaw-large: to let in light
Macaw-answer-11B: let in light and air (credit: 1)
GPT3-davinci: To let the sun in. (credit: 1)
Jurassic-1-jumbo: Windows are openings in a building envelope that allow light and air to enter. (credit: 1)
T5-XXL-SSM-NQ: to let in light and air (credit: 1)
T5-11B-SSM-NQ: admit light and air
T5-XL-SSM-NQ: allow light to enter
T5-large-SSM-NQ: insulation
T5-small-SSM-NQ: to evangelize the home

Q140: What is the purpose of the doors in a house?

Macaw-11B: to let in air (credit: 1)
Macaw-3B: to provide access to rooms
Macaw-large: to let in light
Macaw-answer-11B: to allow people to enter and leave the house (credit: 1)
GPT3-davinci: To keep the heat in during the winter and the cool air in during the summer. (credit: 1)
Jurassic-1-jumbo: Doors are for privacy, security, and protection. (credit: 1)
T5-XXL-SSM-NQ: to provide insulation (credit: 1)
T5-11B-SSM-NQ: entrance/exit
T5-XL-SSM-NQ: to provide insulation
T5-large-SSM-NQ: vestibules or accessory systems
T5-small-SSM-NQ: to open the house

Q141: Name an object that is attracted by a magnet.

Macaw-11B: iron nails (credit: 1)
Macaw-3B: metal
Macaw-large: iron nail
Macaw-answer-11B: iron filings (credit: 1)
GPT3-davinci: Iron (credit: 1)
Jurassic-1-jumbo: A compass needle. (credit: 1)
T5-XXL-SSM-NQ: steel (credit: 1)
T5-11B-SSM-NQ: iron filings
T5-XL-SSM-NQ: magnetosextiles
T5-large-SSM-NQ: a wire
T5-small-SSM-NQ: mass

Q142: Name an object other than a nail that is attracted by a magnet.

Macaw-11B: a paper clip (credit: 1)
Macaw-3B: a hair
Macaw-large: nail
Macaw-answer-11B: iron filings (credit: 1)
GPT3-davinci: A compass. (credit: 1)
Jurassic-1-jumbo: A piece of iron. (credit: 1)
T5-XXL-SSM-NQ: steel (credit: 1)
T5-11B-SSM-NQ: copper
T5-XL-SSM-NQ: magnetoencephalograph
T5-large-SSM-NQ: other inanimate objects
T5-small-SSM-NQ: magnetite

Q143: Name an object other than a nail or a paper clip that is attracted by a magnet.

Macaw-11B: a refrigerator (credit: 1)
Macaw-3B: a hair
Macaw-large: a paper clip
Macaw-answer-11B: iron filings (credit: 1)
GPT3-davinci: A compass. (credit: 1)
Jurassic-1-jumbo: A piece of iron. (credit: 1)
T5-XXL-SSM-NQ: cork (credit: 0)
T5-11B-SSM-NQ: refrigerator magnets
T5-XL-SSM-NQ: magnetos
T5-large-SSM-NQ: other inanimate objects
T5-small-SSM-NQ: magnetite

Q144: Why was Aristotle's hometown more similar to California than New York?

Macaw-11B: climate (credit: 1)
Macaw-3B: lower elevation
Macaw-large: it's closer
Macaw-answer-11B: it was a desert (credit: 1)
GPT3-davinci: Because it was a small town with a lot of intellectuals. (credit: 0)
Jurassic-1-jumbo: Because Aristotle was from California. (credit: 0)
T5-XXL-SSM-NQ: because of its size (credit: 1)
T5-11B-SSM-NQ: its mild climate
T5-XL-SSM-NQ: more deserted
T5-large-SSM-NQ: its proximity to California
T5-small-SSM-NQ: trade

Q145: Why would Aristotle have preferred a short-sleeved shirt over a warm jacket?

Macaw-11B: he was a warm-blooded person (credit: 0)
Macaw-3B: to conserve warmth
Macaw-large: he was cold-blooded
Macaw-answer-11B: he was a naturalist (credit: 0)
GPT3-davinci: Because he was a philosopher, and philosophers are always cold. (credit: 0)
Jurassic-1-jumbo: Because he was Greek. (credit: 0)
T5-XXL-SSM-NQ: it kept him cooler (credit: 1)
T5-11B-SSM-NQ: more comfortable
T5-XL-SSM-NQ: a more comfortable temperature
T5-large-SSM-NQ: insulation
T5-small-SSM-NQ: to promote social policy

Q146: How would you make a table stronger?

Macaw-11B: add more supports (credit: 1)
Macaw-3B: add more legs
Macaw-large: use more nails
Macaw-answer-11B: add a center support (credit: 1)
GPT3-davinci: I would make the legs thicker. (credit: 1)
Jurassic-1-jumbo: Put a tablecloth on it. (credit: 0)
T5-XXL-SSM-NQ: bracing (credit: 1)
T5-11B-SSM-NQ: by adding legs
T5-XL-SSM-NQ: using a stronger material
T5-large-SSM-NQ: by using magnets
T5-small-SSM-NQ: for a better future

Q147: How would you make a rope stronger?

Macaw-11B: add strands (credit: 1)
Macaw-3B: add more fibers
Macaw-large: tie it up
Macaw-answer-11B: add strands (credit: 1)
GPT3-davinci: You could make it thicker, or you could make it longer. (credit: 0.5)
Jurassic-1-jumbo: Add more strands to it. (credit: 1)
T5-XXL-SSM-NQ: strands of smaller diameter (credit: 0.5)
T5-11B-SSM-NQ: by wrapping it in plastic
T5-XL-SSM-NQ: using a special chemical reaction
T5-large-SSM-NQ: Rope splicing
T5-small-SSM-NQ: more than 180 minutes

Q148: How would you make a blanket stronger?

Macaw-11B: add layers (credit: 1)
Macaw-3B: add more yarn
Macaw-large: use more yarn
Macaw-answer-11B: sew it (credit: 0)
GPT3-davinci: I would make it out of steel. (credit: 1)
Jurassic-1-jumbo: Add more yarn. (credit: 1)
T5-XXL-SSM-NQ: adding stitched details (credit: 0.5)
T5-11B-SSM-NQ: blanket stitching
T5-XL-SSM-NQ: using iron sulfide
T5-large-SSM-NQ: by gluing it together
T5-small-SSM-NQ: insulation

Q149: How would you make a marriage stronger?

Macaw-11B: communicate (credit: 1)
Macaw-3B: make it last longer
Macaw-large: strengthen the bond
Macaw-answer-11B: communicate (credit: 1)
GPT3-davinci: I would make sure that I was the one who was always right. (credit: 0)
Jurassic-1-jumbo: By being kind to each other. (credit: 1)
T5-XXL-SSM-NQ: communication (credit: 1)
T5-11B-SSM-NQ: improving communication
T5-XL-SSM-NQ: by making it more Biblical
T5-large-SSM-NQ: strengthening its foundations
T5-small-SSM-NQ: gives marriage to another partner

Q150: How would you make an investment stronger?

Macaw-11B: diversify (credit: 1)
Macaw-3B: use a higher quality stock
Macaw-large: increase the amount of time you have
Macaw-answer-11B: diversify (credit: 1)
GPT3-davinci: I would make it more transparent. I would make it more accountable. I would make it more responsive to the needs of the people. (credit: 0)
Jurassic-1-jumbo: By making it more liquid. (credit: 0)
T5-XXL-SSM-NQ: diversification (credit: 1)
T5-11B-SSM-NQ: diversification
T5-XL-SSM-NQ: Buy-ins
T5-large-SSM-NQ: by leveraging it
T5-small-SSM-NQ: about $1.18 trillion

Q151: How would you mkae a balloon stronger?

Macaw-11B: add air (credit: 0)
Macaw-3B: fill it with helium
Macaw-large: a stronger wire
Macaw-answer-11B: add air (credit: 0)
GPT3-davinci: You could make it out of a stronger material. (credit: 1)
Jurassic-1-jumbo: Put in more hot air. (credit: 0)
T5-XXL-SSM-NQ: adding more balloons (credit: 0)
T5-11B-SSM-NQ: by adding more air
T5-XL-SSM-NQ: to make it stronger
T5-large-SSM-NQ: by using force
T5-small-SSM-NQ: to identify a number

Q152: How would you make a road stronger?

Macaw-11B: add layers (credit: 1)
Macaw-3B: add concrete
Macaw-large: increase the amount of rocks in it
Macaw-answer-11B: add more layers (credit: 1)
GPT3-davinci: I would make it out of concrete. (credit: 1)
Jurassic-1-jumbo: Add more lanes. (credit: 0)
T5-XXL-SSM-NQ: adding bitumen (credit: 1)
T5-11B-SSM-NQ: using asphalt
T5-XL-SSM-NQ: by using cork
T5-large-SSM-NQ: strengthening
T5-small-SSM-NQ: strengthening its goals

Q153: How would you make a window stronger?

Macaw-11B: double pane (credit: 1)
Macaw-3B: add a frame
Macaw-large: use a heavier weight
Macaw-answer-11B: double pane (credit: 1)
GPT3-davinci: I would make it out of a stronger material. (credit: 1)
Jurassic-1-jumbo: Put a pane of glass in it. (credit: 1)
T5-XXL-SSM-NQ: by adding a metal interlayer (credit: 1)
T5-11B-SSM-NQ: using tempered glass
T5-XL-SSM-NQ: using a metal frame
T5-large-SSM-NQ: splicing
T5-small-SSM-NQ: strengthening its eye

Q154: How would you make a contract stronger?

Macaw-11B: add more clauses (credit: 1)
Macaw-3B: add more material
Macaw-large: make it more than one year
Macaw-answer-11B: have it notarized (credit: 1)
GPT3-davinci: I would make it so that the contract is only valid if the other party is still alive. (credit: 1)
Jurassic-1-jumbo: By making it longer. (credit: 0)
T5-XXL-SSM-NQ: unilateralism (credit: 0)
T5-11B-SSM-NQ: by adding additional conditions
T5-XL-SSM-NQ: enforceability
T5-large-SSM-NQ: add-on clauses
T5-small-SSM-NQ: strengthening the match

Q155: What does colorless mean?

Macaw-11B: no hue (credit: 1)
Macaw-3B: without color
Macaw-large: no color
Macaw-answer-11B: without hue or hues (credit: 1)
GPT3-davinci: Colorless means that the card has no color in its mana cost. (credit: 0.5)
Jurassic-1-jumbo: Colorless diamonds are graded on a scale from D to Z, with D being the most colorless and Z being the most yellow. (credit: 0)
T5-XXL-SSM-NQ: without color (credit: 1)
T5-11B-SSM-NQ: having no color
T5-XL-SSM-NQ: colorless objects
T5-large-SSM-NQ: a deeper blue
T5-small-SSM-NQ: variety of color

Q156: Does oxygen have a hue?

Macaw-11B: no (credit: 1)
Macaw-3B: no
Macaw-large: yes
Macaw-answer-11B: no (credit: 1)
GPT3-davinci: Yes, oxygen is a pale blue color. (credit: 0)
Jurassic-1-jumbo: Oxygen is colorless. However, oxygen gas is pale blue when cooled to -183[Degree]C. (credit: 1)
T5-XXL-SSM-NQ: colorless (credit: 1)
T5-11B-SSM-NQ: colorless
T5-XL-SSM-NQ: blue
T5-large-SSM-NQ: cyan
T5-small-SSM-NQ: water

Generation

Q157: Tell me a story about a car accident.

Macaw-11B: a friend was driving and got into an accident (credit: 1)
Macaw-3B: it was a terrible accident
Macaw-large: a girl in a car accident, her mother in a crash
Macaw-answer-11B: a friend was in a car accident and died (credit: 1)
GPT3-davinci: I was in a car accident once. I was driving and I hit a car. (credit: 1)
Jurassic-1-jumbo: I was in a car accident. (credit: 1)
T5-XXL-SSM-NQ: Paul (credit: 0)
T5-11B-SSM-NQ: "Peter"
T5-XL-SSM-NQ: "Flight"
T5-large-SSM-NQ: 30 years ago
T5-small-SSM-NQ: collision

History

Q158: What were the causes of World War II?

Macaw-11B: the rise of totalitarianism in europe and the pacific (credit: 1)
Macaw-3B: the rise of fascism
Macaw-large: atomic bombs
Macaw-answer-11B: the rise of fascism and the rise of nationalist movements (credit: 1)
GPT3-davinci: The causes of World War II were the rise of fascism in Germany, Italy, and Japan, the failure of the League of Nations to prevent World War I, the Treaty of Versailles, the Great Depression, and the rise of totalitarianism. (credit: 1)
Jurassic-1-jumbo: The causes of World War II were primarily the aggression of Germany, Italy, and Japan. (credit: 1)
T5-XXL-SSM-NQ: Italian fascism in the 1920s (credit: 1)
T5-11B-SSM-NQ: Italian fascism in the 1920s
T5-XL-SSM-NQ: Italian fascism in the 1920s
T5-large-SSM-NQ: Italian fascism in the 1920s
T5-small-SSM-NQ: Italian fascism in the 1920s

Q159: What were the main problems with the League of Nations, formed in 1920?

Macaw-11B: it was not strong enough (credit: 1)
Macaw-3B: it was not a world government
Macaw-large: it was formed from members who did not have enough money to form a government
Macaw-answer-11B: it was not able to prevent wars (credit: 1)
GPT3-davinci: The League of Nations was a failure because it was not able to prevent World War II. (credit: 1)
Jurassic-1-jumbo: The League of Nations was an international organization created after World War I. It aimed to prevent future wars by settling disputes between countries through negotiation and diplomacy. The League of Nations was ineffective, however, because it lacked enforcement powers. (credit: 1)
T5-XXL-SSM-NQ: its inability to control or prevent wars (credit: 1)
T5-11B-SSM-NQ: too much power
T5-XL-SSM-NQ: the League's disorganization
T5-large-SSM-NQ: its currency
T5-small-SSM-NQ: Defense of states' rights

Human behavior

Q160: How should I break up with my girlfriend?

Macaw-11B: in person (credit: 1)
Macaw-3B: tell her I love her
Macaw-large: call her
Macaw-answer-11B: in person (credit: 1)
GPT3-davinci: You should break up with your girlfriend the same way you would break up with your boyfriend. (credit: 0)
Jurassic-1-jumbo: Break up with her in person. (credit: 1)
T5-XXL-SSM-NQ: delicately (credit: 1)
T5-11B-SSM-NQ: nicely
T5-XL-SSM-NQ: Sexy or not
T5-large-SSM-NQ: not to continue dating
T5-small-SSM-NQ: kissing

Q161: I feel sad. What could I do to cheer myself up?

Macaw-11B: laugh (credit: 1)
Macaw-3B: laugh
Macaw-large: take a walk
Macaw-answer-11B: listen to music (credit: 1)
GPT3-davinci: I feel sad. What could I do to cheer myself up? (credit: 0)
Jurassic-1-jumbo: Sadness is a normal emotion. It's part of being human. (credit: 0)
T5-XXL-SSM-NQ: listening to upbeat music (credit: 1)
T5-11B-SSM-NQ: reading a book
T5-XL-SSM-NQ: reading
T5-large-SSM-NQ: cheering
T5-small-SSM-NQ: tributes to Germany

Q162: Why is it hard to find good building contractors?

Macaw-11B: many bad ones (credit: 1)
Macaw-3B: they are hard to find
Macaw-large: low pay
Macaw-answer-11B: there are too many bad ones (credit: 1)
GPT3-davinci: It's hard to find good building contractors because they are busy. They are busy because they are good. (credit: 1)
Jurassic-1-jumbo: Finding a good building contractor is like finding a good doctor. You ask around, get recommendations, check credentials, and interview candidates. (credit: 0)
T5-XXL-SSM-NQ: bad referrals (credit: 1)
T5-11B-SSM-NQ: building contractors are self-employed
T5-XL-SSM-NQ: The contractor shortage
T5-large-SSM-NQ: numerous reasons
T5-small-SSM-NQ: to fund state benefits

Q163: Almanzo turned to Mr. Thompson and asked, "Did you lose a pocketbook?" Mr. Thompson jumped. He slapped a hand to his pocket and fairly shouted, "Yes, I have! Fifteen hundred dollars in it, too!". What did Mr. Thompson say next?

Macaw-11B: he had no money (credit: 0)
Macaw-3B: "It's in my pocket."
Macaw-large: he had fifteen hundred dollars in his pocket
Macaw-answer-11B: he had found it (credit: 0)
GPT3-davinci: "I'll give you a hundred dollars if you find it." (credit: 1)
Jurassic-1-jumbo: "I lost it at the fair!" (credit: 1)
T5-XXL-SSM-NQ: "Come on, man" (credit: 0.5)
T5-11B-SSM-NQ: "It's all right"
T5-XL-SSM-NQ: "I'm sorry,' Ma'am"
T5-large-SSM-NQ: "Fifteen hundred dollars"
T5-small-SSM-NQ: "Leashed"

Q164: Almanzo turned to Mr. Thompson and asked, "Did you lose a pocketbook?" Mr. Thompson jumped. He slapped a hand to his pocket and fairly shouted, "Yes, I have! Fifteen hundred dollars in it, too!". What did Almanzo say in reply?

Macaw-11B: he had no idea where it was (credit: 0.5)
Macaw-3B: "It's not your money, it's mine."
Macaw-large: he had no money in it
Macaw-answer-11B: he had found it (credit: 1)
GPT3-davinci: "Well, I'll be darned!" (credit: 1)
Jurassic-1-jumbo: "Well, Mr. Thompson," he said, "you'd better not lose that pocketbook again." (credit: 1)
T5-XXL-SSM-NQ: "Oh, really" (credit: 1)
T5-11B-SSM-NQ: "Well, I guess so"
T5-XL-SSM-NQ: "Not
T5-large-SSM-NQ: "Nothin' but the Blues"
T5-small-SSM-NQ: "Fifth of May"

Hypothetical

Q165: If plastic was a conductor, then would a plastic spoon conduct electricity?

Macaw-11B: yes (credit: 1)
Macaw-3B: yes
Macaw-large: conductor
Macaw-answer-11B: no (credit: 0)
GPT3-davinci: Yes, but it would be a very poor conductor. (credit: 1)
Jurassic-1-jumbo: No. Plastic is a non-conductor of electricity. (credit: 0)
T5-XXL-SSM-NQ: yes (credit: 1)
T5-11B-SSM-NQ: would conduct electricity
T5-XL-SSM-NQ: hypothetically yes
T5-large-SSM-NQ: most likely not
T5-small-SSM-NQ: connect equipment enclosures to earth

Q166: If plastic was an insulator, then would a plastic spoon conduct electricity?

Macaw-11B: no (credit: 1)
Macaw-3B: no
Macaw-large: no
Macaw-answer-11B: no (credit: 1)
GPT3-davinci: Yes, it would. (credit: 0)
Jurassic-1-jumbo: No, plastic is an insulator. (credit: 1)
T5-XXL-SSM-NQ: no (credit: 1)
T5-11B-SSM-NQ: not conduct electricity
T5-XL-SSM-NQ: metal
T5-large-SSM-NQ: most likely not
T5-small-SSM-NQ: connect current

Q167: If dinosaurs were alive today, how would the world be different?

Macaw-11B: there would be more animals (credit: 1)
Macaw-3B: it would be warmer
Macaw-large: there would be less pollution
Macaw-answer-11B: there would be more dinosaurs (credit: 1)
GPT3-davinci: Dinosaurs would be a lot like humans. They would have a lot of the same problems we have. They would have to deal with the same things we have to deal with. They would have to deal with pollution, and they would have to deal with the fact that they're not the biggest animals on the planet anymore (credit: 1)
Jurassic-1-jumbo: Dinosaurs were the dominant species on Earth for 165 million years. They ruled the land, sea and air. They dominated every ecosystem. They ruled the world. (credit: 0)
T5-XXL-SSM-NQ: would be much more dangerous (credit: 1)
T5-11B-SSM-NQ: many ways
T5-XL-SSM-NQ: Earth would be quite different
T5-large-SSM-NQ: much cleaner
T5-small-SSM-NQ: perhaps three hundred years

Q168: If an asteroid was heading directly for the Earth, what steps could we take to avert catastrophe?

Macaw-11B: warn the population (credit: 1)
Macaw-3B: build a spaceship
Macaw-large: we can take cover from the sun
Macaw-answer-11B: build a shield (credit: 0.5)
GPT3-davinci: The most likely scenario is that we would discover the asteroid early enough to deflect it. The most likely way to do that is to use a "kinetic impactor" -- a spacecraft that would slam into the asteroid at high speed. A: The most likely scenario is that we would discover the asteroid early enough to (credit: 1)
Jurassic-1-jumbo: The asteroid Apophis, which will pass within 19,000 miles of Earth in 2029, is the closest known asteroid to collide with Earth. But NASA scientists say there is no chance that Apophis will hit us. (credit: 0)
T5-XXL-SSM-NQ: planetary defense (credit: 1)
T5-11B-SSM-NQ: space-based lasers
T5-XL-SSM-NQ: take out the trash
T5-large-SSM-NQ: nuclear weapons testing
T5-small-SSM-NQ: deceive the Earth

Q169: If you put a plant in a dark room, how will its photosynthesis be affected?

Macaw-11B: it will slow down (credit: 1)
Macaw-3B: it will be affected negatively
Macaw-large: the plant will not be able to absorb light and will die
Macaw-answer-11B: it will not be able to make food (credit: 1)
GPT3-davinci: It will not be affected. (credit: 0)
Jurassic-1-jumbo: Photosynthesis is the process by which plants use sunlight to convert carbon dioxide and water into oxygen and glucose. (credit: 0)
T5-XXL-SSM-NQ: decreased (credit: 1)
T5-11B-SSM-NQ: stopped
T5-XL-SSM-NQ: decreased light
T5-large-SSM-NQ: it will have less light
T5-small-SSM-NQ: reaction

Q170: If a bird didn't have wings, how would it be affected?

Macaw-11B: it would be unable to fly (credit: 1)
Macaw-3B: it would be slower
Macaw-large: it would be affected by the lack of air
Macaw-answer-11B: it would be unable to fly (credit: 1)
GPT3-davinci: It would be a bad bird. (credit: 0)
Jurassic-1-jumbo: It wouldn't be able to fly. (credit: 1)
T5-XXL-SSM-NQ: flight (credit: 1)
T5-11B-SSM-NQ: it would have trouble flying
T5-XL-SSM-NQ: no doubt would be flightless
T5-large-SSM-NQ: flight
T5-small-SSM-NQ: no longer fully flighted

Q171: If a car did not have any gas in it, how would it be affected?

Macaw-11B: it would not move (credit: 1)
Macaw-3B: it would not move
Macaw-large: it would make fewer revolutions
Macaw-answer-11B: it would not move (credit: 1)
GPT3-davinci: It would not be affected at all. (credit: 0)
Jurassic-1-jumbo: The car would not run. (credit: 1)
T5-XXL-SSM-NQ: not moving (credit: 1)
T5-11B-SSM-NQ: it would not run
T5-XL-SSM-NQ: no start
T5-large-SSM-NQ: braked
T5-small-SSM-NQ: on some models

Q172: If an electric car did not have any gas in it, how would it be affected?

Macaw-11B: it would not move (credit: 0)
Macaw-3B: it would not be as fast
Macaw-large: it would lose power
Macaw-answer-11B: it would not move (credit: 0)
GPT3-davinci: It would not be affected at all. (credit: 1)
Jurassic-1-jumbo: It would not run. (credit: 0)
T5-XXL-SSM-NQ: no longer charges (credit: 0)
T5-11B-SSM-NQ: it would not run
T5-XL-SSM-NQ: degraded
T5-large-SSM-NQ: crash
T5-small-SSM-NQ: not sure what to do

Q173: If a bird did not have wings, would it be able to eat?

Macaw-11B: no, it would not be able to catch food (credit: 1)
Macaw-3B: yes
Macaw-large: it would not be able to fly
Macaw-answer-11B: yes (credit: 1)
GPT3-davinci: No, it would starve to death. (credit: 1)
Jurassic-1-jumbo: No, because a bird needs wings to fly. (credit: 1)
T5-XXL-SSM-NQ: beak (credit: 0)
T5-11B-SSM-NQ: could not fly
T5-XL-SSM-NQ: could
T5-large-SSM-NQ: flight
T5-small-SSM-NQ: no longer fully flighted

Q174: If there was no sun, how would life be affected?

Macaw-11B: no energy (credit: 1)
Macaw-3B: it would be cold
Macaw-large: there would be no food
Macaw-answer-11B: plants would die (credit: 1)
GPT3-davinci: The Earth would be a very different place. The temperature would be about -18 degrees Celsius (0 degrees Fahrenheit). There would be no photosynthesis, so no plants or animals. The Earth would be a frozen ball of ice. (credit: 1)
Jurassic-1-jumbo: Life would be very different. Plants and animals would not be able to make food. (credit: 1)
T5-XXL-SSM-NQ: death (credit: 1)
T5-11B-SSM-NQ: death
T5-XL-SSM-NQ: would be dark
T5-large-SSM-NQ: many other body processes
T5-small-SSM-NQ: had been friends

Q175: If my house did not have a roof, and it rained, what would happen to my bed upstairs?

Macaw-11B: it would get wet (credit: 1)
Macaw-3B: it would be soaked
Macaw-large: it would get wet
Macaw-answer-11B: it would get wet (credit: 1)
GPT3-davinci: You would get wet. (credit: 0.5)
Jurassic-1-jumbo: Your bed would float. (credit: 0)
T5-XXL-SSM-NQ: water would get in (credit: 1)
T5-11B-SSM-NQ: wet
T5-XL-SSM-NQ: water
T5-large-SSM-NQ: flood
T5-small-SSM-NQ: over the floorboards

Q176: If my house had a roof, and it rained, what would happen to my bed upstairs?

Macaw-11B: it would stay dry (credit: 1)
Macaw-3B: it would get wet
Macaw-large: it would get wet
Macaw-answer-11B: it would stay dry (credit: 1)
GPT3-davinci: You would get wet. (credit: 0)
Jurassic-1-jumbo: It would float away. (credit: 0)
T5-XXL-SSM-NQ: would stay dry (credit: 1)
T5-11B-SSM-NQ: get wet
T5-XL-SSM-NQ: would be awash
T5-large-SSM-NQ: flood
T5-small-SSM-NQ: over the floorboards

Q177: If my house did not have a roof, and it rained, what would happen to my bed downstairs?

Macaw-11B: it would get wet (credit: 1)
Macaw-3B: it would be soaked
Macaw-large: it would get wet
Macaw-answer-11B: it would get wet (credit: 1)
GPT3-davinci: You would get wet. (credit: 0.5)
Jurassic-1-jumbo: Your bed would float. (credit: 0)
T5-XXL-SSM-NQ: water would collect (credit: 1)
T5-11B-SSM-NQ: wet
T5-XL-SSM-NQ: water
T5-large-SSM-NQ: be flooded
T5-small-SSM-NQ: over the floorboards

Q178: If an airplane runs out of fuel on the runway, what would happen?

Macaw-11B: the plane would crash (credit: 0.5)
Macaw-3B: it would crash
Macaw-large: the plane would land on the grass
Macaw-answer-11B: it would have to make an emergency landing (credit: 0)
GPT3-davinci: It would crash. (credit: 1)
Jurassic-1-jumbo: The airplane would crash. (credit: 0.5)
T5-XXL-SSM-NQ: runaway airplane (credit: 0.5)
T5-11B-SSM-NQ: the airplane will be forced to land
T5-XL-SSM-NQ: land
T5-large-SSM-NQ: no immediate reaction
T5-small-SSM-NQ: no specific meaning

Q179: If a stationary airplane runs out of fuel, what would happen?

Macaw-11B: it would fall to the ground (credit: 0)
Macaw-3B: it would crash
Macaw-large: the plane would land on the ocean floor
Macaw-answer-11B: it would fall to the ground (credit: 0)
GPT3-davinci: It would crash. (credit: 0)
Jurassic-1-jumbo: It would fall from the sky. (credit: 0)
T5-XXL-SSM-NQ: no longer be able to fly (credit: 1)
T5-11B-SSM-NQ: die
T5-XL-SSM-NQ: land
T5-large-SSM-NQ: no engine power
T5-small-SSM-NQ: no wind

Q180: If a stationary airplane on the ground runs out of fuel, what would happen?

Macaw-11B: it would fall to the ground (credit: 0)
Macaw-3B: it would crash
Macaw-large: the plane would fly away
Macaw-answer-11B: it would stop (credit: 0)
GPT3-davinci: It would crash. (credit: 0)
Jurassic-1-jumbo: It would fall over. (credit: 0)
T5-XXL-SSM-NQ: no longer be able to fly (credit: 1)
T5-11B-SSM-NQ: die
T5-XL-SSM-NQ: land itself
T5-large-SSM-NQ: no engine power
T5-small-SSM-NQ: no wind

Q181: If a car's battery is flat, how would the car be affected?

Macaw-11B: it would not start (credit: 1)
Macaw-3B: it would not start
Macaw-large: the car would lose power
Macaw-answer-11B: it would not start (credit: 1)
GPT3-davinci: The car would not be able to start. (credit: 1)
Jurassic-1-jumbo: A flat battery means the car won't start. (credit: 1)
T5-XXL-SSM-NQ: not starting (credit: 1)
T5-11B-SSM-NQ: no power
T5-XL-SSM-NQ: no start
T5-large-SSM-NQ: start moving forward
T5-small-SSM-NQ: any abnormal electric current

Q182: If a person had an infinite short-term memory, why wouldn't they need a tally sheet to count things?

Macaw-11B: they could remember everything (credit: 1)
Macaw-3B: they could remember all the numbers in their head
Macaw-large: there would be no mistakes
Macaw-answer-11B: they could remember everything (credit: 1)
GPT3-davinci: Because they would remember the number of things they had counted. (credit: 1)
Jurassic-1-jumbo: Because they could remember everything. (credit: 1)
T5-XXL-SSM-NQ: perfect memory (credit: 1)
T5-11B-SSM-NQ: infinitely fast
T5-XL-SSM-NQ: a mental map
T5-large-SSM-NQ: no memory at all
T5-small-SSM-NQ: A set by a set

Q183: A plant is in a dark room. Will it be able to photosynthesize?

Macaw-11B: no, because there is no light (credit: 1)
Macaw-3B: yes
Macaw-large: the leaves will absorb light
Macaw-answer-11B: no, it will not be able to photosynthesize (credit: 1)
GPT3-davinci: No. (credit: 1)
Jurassic-1-jumbo: No, because plants need light for photosynthesis. (credit: 1)
T5-XXL-SSM-NQ: in a light-free environment (credit: 0)
T5-11B-SSM-NQ: in photosystem II
T5-XL-SSM-NQ: in the absence of light
T5-large-SSM-NQ: not be able to grow
T5-small-SSM-NQ: up to 100 percent plants

Q184: A plant is in a dark room. Will it still grow?

Macaw-11B: yes (credit: 1)
Macaw-3B: yes
Macaw-large: the leaves will still grow
Macaw-answer-11B: yes (credit: 1)
GPT3-davinci: Yes, it will. (credit: 1)
Jurassic-1-jumbo: Yes, but very slowly. (credit: 1)
T5-XXL-SSM-NQ: in a dim light (credit: 0)
T5-11B-SSM-NQ: will not grow
T5-XL-SSM-NQ: in the absence of light
T5-large-SSM-NQ: still grow
T5-small-SSM-NQ: still around the floor

Q185: If a plant had no leaves, could it photosynthesize?

Macaw-11B: yes, through root systems (credit: 0)
Macaw-3B: yes
Macaw-large: it would take in sunlight
Macaw-answer-11B: yes (credit: 0)
GPT3-davinci: No. Leaves are the site of photosynthesis. (credit: 1)
Jurassic-1-jumbo: No. Photosynthesis requires leaves. (credit: 1)
T5-XXL-SSM-NQ: CAM (credit: 0)
T5-11B-SSM-NQ: in some cases
T5-XL-SSM-NQ: could
T5-large-SSM-NQ: without chloroplasts
T5-small-SSM-NQ: 2

Q186: If you pulled the leaves off a plant, how would it be affected?

Macaw-11B: it would die (credit: 1)
Macaw-3B: it would die
Macaw-large: the plant would die
Macaw-answer-11B: it would die (credit: 1)
GPT3-davinci: The plant would be affected in a negative way. (credit: 0.5)
Jurassic-1-jumbo: If you pulled the leaves off a plant, the plant would die. (credit: 1)
T5-XXL-SSM-NQ: plant death (credit: 1)
T5-11B-SSM-NQ: stressed
T5-XL-SSM-NQ: no longer grown
T5-large-SSM-NQ: the vascular cambium
T5-small-SSM-NQ: to prevent backflow

Q187: If the leaves were pulled off a plant, the plant would not be able to do what?

Macaw-11B: make food (credit: 1)
Macaw-3B: photosynthesis
Macaw-large: make food
Macaw-answer-11B: photosynthesis (credit: 1)
GPT3-davinci: Grow (credit: 1)
Jurassic-1-jumbo: Grow. The leaves provide food for the plants. (credit: 1)
T5-XXL-SSM-NQ: photosynthesis (credit: 1)
T5-11B-SSM-NQ: photosynthesis
T5-XL-SSM-NQ: photosynthesis
T5-large-SSM-NQ: produce new leaves
T5-small-SSM-NQ: to do the leaf

Q188: There is a windstorm in the city. How might houses in the city be affected?

Macaw-11B: roofs might be blown off (credit: 1)
Macaw-3B: roofs may be blown off
Macaw-large: blown outside
Macaw-answer-11B: roofs might be blown off (credit: 1)
GPT3-davinci: The windstorm will affect houses in the city. (credit: 0)
Jurassic-1-jumbo: The houses in the city might be affected. (credit: 0)
T5-XXL-SSM-NQ: Damage from wind (credit: 1)
T5-11B-SSM-NQ: blow away
T5-XL-SSM-NQ: flooding
T5-large-SSM-NQ: damaged roofs
T5-small-SSM-NQ: homeowners

Q189: There is a windstorm in the city. Why might the roofs of houses be blown off?

Macaw-11B: the roofs are not secured to the walls (credit: 1)
Macaw-3B: the roofs are made of a material that is brittle and can break
Macaw-large: the wind could blow the roof off
Macaw-answer-11B: the roofs are not secured to the walls (credit: 1)
GPT3-davinci: The roofs of houses are blown off because the wind is very strong. (credit: 1)
Jurassic-1-jumbo: The roofs of houses may be blown off because the windstorm is very strong. (credit: 1)
T5-XXL-SSM-NQ: a strong enough wind (credit: 1)
T5-11B-SSM-NQ: damage to the structure
T5-XL-SSM-NQ: erosion by wind
T5-large-SSM-NQ: heavy winds
T5-small-SSM-NQ: no wind

Q190: How would you make a house conduct electricity?

Macaw-11B: paint it with a metal paint (credit: 1)
Macaw-3B: using copper
Macaw-large: wiring
Macaw-answer-11B: make it made of metal (credit: 1)
GPT3-davinci: I would make the house out of metal. (credit: 1)
Jurassic-1-jumbo: You would have to put wires in it. (credit: 1)
T5-XXL-SSM-NQ: copper wiring (credit: 1)
T5-11B-SSM-NQ: a metal like copper
T5-XL-SSM-NQ: geothermal heat exchanger
T5-large-SSM-NQ: well-insulated insulation
T5-small-SSM-NQ: connect equipment enclosures to earth

Q191: If a gas was colored blue, what would this imply?

Macaw-11B: it contains a lot of hydrogen (credit: 0)
Macaw-3B: it is a kind of gas
Macaw-large: it is a liquid
Macaw-answer-11B: it is a noble gas (credit: 0)
GPT3-davinci: It would imply that the gas was oxygen. (credit: 0)
Jurassic-1-jumbo: The gas is oxygen. (credit: 0)
T5-XXL-SSM-NQ: its speed (credit: 0)
T5-11B-SSM-NQ: a higher boiling point
T5-XL-SSM-NQ: low pressure
T5-large-SSM-NQ: good fortune
T5-small-SSM-NQ: yellow-orange

Q192: If oxygen were blue, what would happen?

Macaw-11B: plants would die (credit: 0.5)
Macaw-3B: it would make the air look blue
Macaw-large: the sky would be blue
Macaw-answer-11B: it would be harder to see (credit: 0)
GPT3-davinci: You would live a lot longer. (credit: 0)
Jurassic-1-jumbo: The sky would be blue. (credit: 0.5)
T5-XXL-SSM-NQ: blue flames (credit: 0)
T5-11B-SSM-NQ: death
T5-XL-SSM-NQ: death of plants
T5-large-SSM-NQ: it would be blue
T5-small-SSM-NQ: have stopped growing

Q193: If oxygen were blue, what would be a result?

Macaw-11B: the sky would be blue (credit: 0.5)
Macaw-3B: it would be a gas
Macaw-large: the sky would be blue
Macaw-answer-11B: it would be hard to see (credit: 0)
GPT3-davinci: The sky would be blue. (credit: 1)
Jurassic-1-jumbo: You would be blue. (credit: 0)
T5-XXL-SSM-NQ: blue flame (credit: 0)
T5-11B-SSM-NQ: death
T5-XL-SSM-NQ: yellow-orange
T5-large-SSM-NQ: yellow
T5-small-SSM-NQ: disme

Math

Q194: What is 56 + 49?

Macaw-11B: 87 (credit: 0)
Macaw-3B: 78
Macaw-large: 79
Macaw-answer-11B: 105 (credit: 1)
GPT3-davinci: 105 (credit: 1)
Jurassic-1-jumbo: 119 (credit: 0)
T5-XXL-SSM-NQ: 125 (credit: 0)
T5-11B-SSM-NQ: 115
T5-XL-SSM-NQ: 169
T5-large-SSM-NQ: 56
T5-small-SSM-NQ: a decline in food availability

Q195: What is 241 + 7864?

Macaw-11B: 12345 (credit: 0)
Macaw-3B: 7864
Macaw-large: 7864
Macaw-answer-11B: 10503 (credit: 0)
GPT3-davinci: 10,932 (credit: 0)
Jurassic-1-jumbo: 2,000 (credit: 0)
T5-XXL-SSM-NQ: 231,7864 (credit: 0)
T5-11B-SSM-NQ: 241
T5-XL-SSM-NQ: 241
T5-large-SSM-NQ: 1264
T5-small-SSM-NQ: $269.6

Meta-reasoning

Q196: What is an implication of a cat being an animal?

Macaw-11B: it has feelings (credit: 1)
Macaw-3B: it has organs
Macaw-large: it can carry its own body heat
Macaw-answer-11B: it is not a human (credit: 0)
GPT3-davinci: It is a living thing. (credit: 1)
Jurassic-1-jumbo: Cats have claws. (credit: 0)
T5-XXL-SSM-NQ: having Feathers (credit: 0)
T5-11B-SSM-NQ: not a robot
T5-XL-SSM-NQ: a member of a species
T5-large-SSM-NQ: status symbol
T5-small-SSM-NQ: the human's environment

Q197: What is an incorrect implication of a cat being an animal?

Macaw-11B: it is a human (credit: 1)
Macaw-3B: it is a kind of human
Macaw-large: it weighs a lot
Macaw-answer-11B: cats are not sentient (credit: 1)
GPT3-davinci: That it is a mammal. (credit: 0)
Jurassic-1-jumbo: That it's an animal. (credit: 0)
T5-XXL-SSM-NQ: mammals (credit: 0)
T5-11B-SSM-NQ: not a plant
T5-XL-SSM-NQ: anthropomorphism
T5-large-SSM-NQ: a species of cat
T5-small-SSM-NQ: avoid or mitigate double animal behavior

Q198: What is an implication of something being colorless?

Macaw-11B: it is transparent (credit: 1)
Macaw-3B: it is not visible
Macaw-large: it is impossible to distinguish between white and black
Macaw-answer-11B: it lacks hue (credit: 1)
GPT3-davinci: It means that it doesn't have any color. (credit: 1)
Jurassic-1-jumbo: Colorless things have no color. (credit: 1)
T5-XXL-SSM-NQ: invisibility (credit: 1)
T5-11B-SSM-NQ: not having a color
T5-XL-SSM-NQ: colorless
T5-large-SSM-NQ: colorless
T5-small-SSM-NQ: colorless

Q199: What is an implication of something being blue?

Macaw-11B: it reflects blue light (credit: 1)
Macaw-3B: it is a kind of color
Macaw-large: it has a blue hue
Macaw-answer-11B: it reflects blue light (credit: 1)
GPT3-davinci: It is not red. (credit: 1)
Jurassic-1-jumbo: Blue is the color of sadness. (credit: 0)
T5-XXL-SSM-NQ: perceived by humans (credit: 1)
T5-11B-SSM-NQ: having a blue color
T5-XL-SSM-NQ: blueness
T5-large-SSM-NQ: the quality of its ingredients
T5-small-SSM-NQ: its number of neutrons

Q200: What is an implication of something being green?

Macaw-11B: it is good for the environment (credit: 1)
Macaw-3B: it is a kind of living thing
Macaw-large: less carbon dioxide
Macaw-answer-11B: it is good for the environment (credit: 1)
GPT3-davinci: It is a leaf. (credit: 0.5)
Jurassic-1-jumbo: Green is the color of money. (credit: 0)
T5-XXL-SSM-NQ: health (credit: 1)
T5-11B-SSM-NQ: environmentally friendly
T5-XL-SSM-NQ: ecological
T5-large-SSM-NQ: the element chromium
T5-small-SSM-NQ: its vast size

Q201: What is an implication of something being colored green?

Macaw-11B: it contains chlorophyll (credit: 1)
Macaw-3B: it is a kind of plant
Macaw-large: it has chlorophyll
Macaw-answer-11B: it is alive (credit: 0)
GPT3-davinci: It is a plant. (credit: 0.5)
Jurassic-1-jumbo: That it is environmentally friendly. (credit: 1)
T5-XXL-SSM-NQ: health (credit: 1)
T5-11B-SSM-NQ: health
T5-XL-SSM-NQ: alive
T5-large-SSM-NQ: the element chromium
T5-small-SSM-NQ: color is unknown

Riddle

Q202: A young boy was rushed to the hospital emergency room, but the ER doctor saw the boy and refused to operate. "This boy is my son," the doctor said. But the doctor wasn't the boy's father. How could this be?

Macaw-11B: the doctor mistook the boy for his own son (credit: 1)
Macaw-3B: the doctor was the boy's biological father
Macaw-large: the boy's father knew about the boy's condition and was able to help him
Macaw-answer-11B: he was a clone (credit: 1)
GPT3-davinci: The doctor was the boy's mother. (credit: 1)
Jurassic-1-jumbo: The ER doctor was the boy's mother. (credit: 1)
T5-XXL-SSM-NQ: medical ID (credit: 0)
T5-11B-SSM-NQ: a medical error
T5-XL-SSM-NQ: a fatal car accident
T5-large-SSM-NQ: born again
T5-small-SSM-NQ: thirty-five years old

Q203: A truck driver is going down a one-way street the wrong way and passes at least ten cops. Why is he not caught?

Macaw-11B: they are not looking for him (credit: 1)
Macaw-3B: he is going too fast
Macaw-large: he is not wearing a seat belt
Macaw-answer-11B: they are not looking for him (credit: 1)
GPT3-davinci: Because he's driving on the one-way street the wrong way. (credit: 0)
Jurassic-1-jumbo: Because he's going the wrong way. (credit: 0)
T5-XXL-SSM-NQ: police presence (credit: 0)
T5-11B-SSM-NQ: lucky
T5-XL-SSM-NQ: driving while drunk
T5-large-SSM-NQ: pulled over
T5-small-SSM-NQ: drug trafficking

Science

Q204: What is the difference between ELMO and BERT?

Macaw-11B: elmo is a boy and bert is a girl (credit: 0)
Macaw-3B: ELMO is a kind of cellular automaton while BERT is a kind of biological robot
Macaw-large: ELMO can be used for generating heat without destroying the environment. BERT can be used for generating electricity by burning waste.
Macaw-answer-11B: elmo is a boy and bert is a girl (credit: 0)
GPT3-davinci: ELMO is a tool for the analysis of the structure of the text, while BERT is a tool for the analysis of the meaning of the text. (credit: 0)
Jurassic-1-jumbo: ELMO is an acronym for Early Learning in Mathematics Online. BERT is an acronym for Building Early Numeracy through Effective Teaching. (credit: 0)
T5-XXL-SSM-NQ: BERT (credit: 0)
T5-11B-SSM-NQ: a different voice
T5-XL-SSM-NQ: a more expensive system
T5-large-SSM-NQ: a second chance to detect abnormalities
T5-small-SSM-NQ: the endometriosis

Q205: Which research organization invented the ELMO language model?

Macaw-11B: nist (credit: 0)
Macaw-3B: nasa
Macaw-large: microsoft
Macaw-answer-11B: university of washington (credit: 1)
GPT3-davinci: The ELMO language model was invented by the Natural Language Processing Group at the University of Edinburgh. (credit: 0)
Jurassic-1-jumbo: The Defense Advanced Research Projects Agency (DARPA). (credit: 0)
T5-XXL-SSM-NQ: Dartmouth College (credit: 0)
T5-11B-SSM-NQ: IBM
T5-XL-SSM-NQ: AT&T Bell Laboratories
T5-large-SSM-NQ: the University of Michigan
T5-small-SSM-NQ: the University of Kansas

Q206: Is it possible to travel faster than light?

Macaw-11B: no (credit: 1)
Macaw-3B: yes
Macaw-large: yes, it is possible to travel faster than light
Macaw-answer-11B: no (credit: 1)
GPT3-davinci: Yes. (credit: 0)
Jurassic-1-jumbo: No. The speed of light is the ultimate speed limit. (credit: 1)
T5-XXL-SSM-NQ: travel at near-light speeds (credit: 0)
T5-11B-SSM-NQ: faster-than-light travel
T5-XL-SSM-NQ: is it possible
T5-large-SSM-NQ: 115,000 km/s
T5-small-SSM-NQ: nautical miles

Q207: What is the most important advantage of quantum computing?

Macaw-11B: it can simulate physical systems (credit: 0)
Macaw-3B: it can perform calculations faster than classical computers
Macaw-large: it can be used for many purposes
Macaw-answer-11B: it can perform calculations faster (credit: 1)
GPT3-davinci: The most important advantage of quantum computing is that it can solve certain problems that are impossible to solve on a classical computer. (credit: 1)
Jurassic-1-jumbo: Quantum computing is a revolutionary technology. It has the potential to solve certain problems that are intractable for classical computers. (credit: 1)
T5-XXL-SSM-NQ: unrestricted quantum computing (credit: 0)
T5-11B-SSM-NQ: quantum error correction
T5-XL-SSM-NQ: Breakthrough performance
T5-large-SSM-NQ: low-cost
T5-small-SSM-NQ: the price

Q208: What is COVID-19?

Macaw-11B: a kind of virus (credit: 1)
Macaw-3B: a virus that causes AIDS
Macaw-large: a compound that combines with other elements to form a new compound
Macaw-answer-11B: a bacterium that causes a disease in humans (credit: 0)
GPT3-davinci: COVID-19 is a new, experimental, and potentially dangerous drug. It is a combination of the drugs Caffeine and Dextromethorphan. (credit: 0)
Jurassic-1-jumbo: COVID-19 is a respiratory illness caused by a new coronavirus. (credit: 1)
T5-XXL-SSM-NQ: a gene sequence (credit: 0.5)
T5-11B-SSM-NQ: a virus
T5-XL-SSM-NQ: a computer virus
T5-large-SSM-NQ: The fourth international avian virus
T5-small-SSM-NQ: liquid petroleum fuel

Q209: What makes eggplant purple?

Macaw-11B: pigments (credit: 1)
Macaw-3B: the pigment in the fruit
Macaw-large: pigments
Macaw-answer-11B: anthocyanins (credit: 1)
GPT3-davinci: Eggplant is purple because it contains a pigment called anthocyanin. (credit: 1)
Jurassic-1-jumbo: Eggplants get their color from anthocyanins, the same pigments that give blueberries and blackberries their deep hue. (credit: 1)
T5-XXL-SSM-NQ: anthocyanins (credit: 1)
T5-11B-SSM-NQ: the anthocyanins
T5-XL-SSM-NQ: Capsaicin
T5-large-SSM-NQ: rhodopsin
T5-small-SSM-NQ: Petals on the Wind

Q210: What causes blossom-end rot?

Macaw-11B: fungi (credit: 1)
Macaw-3B: dampness
Macaw-large: decaying tissue
Macaw-answer-11B: a fungus (credit: 1)
GPT3-davinci: Blossom-end rot is caused by a calcium deficiency in the plant. It is most common in tomatoes, peppers, and eggplants, but can also occur in other plants. Blossom-end rot is a physiological disorder, not a disease. It is caused by a lack of calcium in the plant. Cal (credit: 1)
Jurassic-1-jumbo: Blossom-end rot is a physiological disorder that occurs when calcium is leached from developing fruit. The calcium is leached from the fruit when the soil is too wet or too dry. (credit: 1)
T5-XXL-SSM-NQ: Phylloxera (credit: 1)
T5-11B-SSM-NQ: bacterial blight
T5-XL-SSM-NQ: the oleum of the soil
T5-large-SSM-NQ: torn off by fungus
T5-small-SSM-NQ: Commensalism

Q211: How can I find Orion's Belt in the night sky?

Macaw-11B: look for the three brightest stars in the constellation (credit: 1)
Macaw-3B: look for the constellation of Orion
Macaw-large: by looking at the night sky
Macaw-answer-11B: look for the three bright stars (credit: 1)
GPT3-davinci: Orion's Belt is the three bright stars in a row that form the middle of the Hunter's body. (credit: 1)
Jurassic-1-jumbo: Orion's Belt is easy to find. Just look south around midnight. The belt is three bright stars in a row. (credit: 1)
T5-XXL-SSM-NQ: three bright stars (credit: 1)
T5-11B-SSM-NQ: by using binoculars
T5-XL-SSM-NQ: by following the constellation of Orion
T5-large-SSM-NQ: by using my binoculars
T5-small-SSM-NQ: map projection

Q212: What causes fermentation?

Macaw-11B: yeast (credit: 1)
Macaw-3B: lactic acid
Macaw-large: yeast
Macaw-answer-11B: a chemical reaction (credit: 1)
GPT3-davinci: Fermentation is caused by yeast. Yeast is a single-celled organism that feeds on sugar and produces alcohol and carbon dioxide as waste products. (credit: 1)
Jurassic-1-jumbo: Fermentation is caused by yeasts, which are microscopic fungi. Yeasts occur naturally in the air and on plants. (credit: 1)
T5-XXL-SSM-NQ: the yeast (credit: 1)
T5-11B-SSM-NQ: acetylation
T5-XL-SSM-NQ: yeast
T5-large-SSM-NQ: an increased pH
T5-small-SSM-NQ: plate tectonics

Q213: A student perfoms an experiment growing two plants. One plant is placed in a dark room and the other plant is placed near a window. The plant near the window grows faster than the plant in the dark. What does this experiment suggest?

Macaw-11B: plants need sunlight (credit: 1)
Macaw-3B: sunlight increases plant growth
Macaw-large: light has a positive impact on plants
Macaw-answer-11B: plants need sunlight (credit: 1)
GPT3-davinci: The experiment suggests that plants need light to grow. (credit: 1)
Jurassic-1-jumbo: The plants near the window receive more sunlight. (credit: 1)
T5-XXL-SSM-NQ: plants need light to grow (credit: 1)
T5-11B-SSM-NQ: light stimulates photosynthesis
T5-XL-SSM-NQ: light
T5-large-SSM-NQ: self-incompatibility
T5-small-SSM-NQ: the osmotic flow of light

Q214: A student performs an experiment growing two plants. One plant is placed in a dark room and the other plant is placed near a window. The plant near the window grows slower than the plant in the dark. What does this experiment suggest?

Macaw-11B: plants need sunlight (credit: 0)
Macaw-3B: light affects plant growth
Macaw-large: light has a positive impact on plants
Macaw-answer-11B: plants need sunlight (credit: 0)
GPT3-davinci: The experiment suggests that plants need light to grow. (credit: 0)
Jurassic-1-jumbo: The experiment suggests that plants need sunlight to grow. (credit: 0)
T5-XXL-SSM-NQ: photosynthesis (credit: 0)
T5-11B-SSM-NQ: light deprivation
T5-XL-SSM-NQ: light affects growth
T5-large-SSM-NQ: self-incompatibility
T5-small-SSM-NQ: the osmotic flow of light

Q215: An experiment is performed with a sealed container. The container starts out with a temperature of 70 degrees F and an air pressure of 20 psi. The container is heated, and the pressure inside the container rises evenly with increased temperature. If the container is cooled back to 70 degrees F, what will the air pressure be?

Macaw-11B: 20 psi (credit: 1)
Macaw-3B: 20 psi
Macaw-large: the same
Macaw-answer-11B: 20 psi (credit: 1)
GPT3-davinci: The air pressure will be 20 psi. (credit: 1)
Jurassic-1-jumbo: The air pressure inside the container will be 20 psi. (credit: 1)
T5-XXL-SSM-NQ: 29.78 psi (credit: 0)
T5-11B-SSM-NQ: 15 psi
T5-XL-SSM-NQ: 100 psi
T5-large-SSM-NQ: 20 psi
T5-small-SSM-NQ: 100 psi

Q216: What gases are involved in photosynthesis?

Macaw-11B: carbon dioxide (credit: 0.5)
Macaw-3B: carbon dioxide
Macaw-large: oxygen
Macaw-answer-11B: oxygen and carbon dioxide (credit: 1)
GPT3-davinci: The main gases involved in photosynthesis are carbon dioxide, water, and oxygen. (credit: 0.66)
Jurassic-1-jumbo: Photosynthesis is the process by which plants use sunlight, water, and carbon dioxide to produce glucose and oxygen. (credit: 1)
T5-XXL-SSM-NQ: carbon dioxide (credit: 0.5)
T5-11B-SSM-NQ: carbon dioxide
T5-XL-SSM-NQ: Water vapor
T5-large-SSM-NQ: Oxygen
T5-small-SSM-NQ: vapor

Q217: What is the role of hydrogen peroxide in photosynthesis?

Macaw-11B: it is a product of photosynthesis (credit: 1)
Macaw-3B: it is a cofactor in the reaction that releases oxygen
Macaw-large: it removes carbon from the air
Macaw-answer-11B: it is a by-product (credit: 1)
GPT3-davinci: Hydrogen peroxide is a byproduct of photosynthesis. It is formed when water is split into oxygen and hydrogen. The oxygen is released into the atmosphere and the hydrogen is used to make glucose. (credit: 1)
Jurassic-1-jumbo: Hydrogen peroxide (H2O2) is a compound that is produced during photosynthesis. It is produced when water (H2O) is split by the enzyme photosystem II (PSII). (credit: 1)
T5-XXL-SSM-NQ: reaction centres (credit: 0)
T5-11B-SSM-NQ: the first electron donor
T5-XL-SSM-NQ: the reaction centres
T5-large-SSM-NQ: catalyst
T5-small-SSM-NQ: light

Q218: What are the products of photosynthesis?

Macaw-11B: sugar (credit: 0.5)
Macaw-3B: sugar
Macaw-large: sugar
Macaw-answer-11B: oxygen and sugar (credit: 1)
GPT3-davinci: The products of photosynthesis are glucose and oxygen. (credit: 1)
Jurassic-1-jumbo: Photosynthesis produces carbohydrates, lipids, and proteins. (credit: 1)
T5-XXL-SSM-NQ: carbohydrate molecules (credit: 0.5)
T5-11B-SSM-NQ: carbon dioxide
T5-XL-SSM-NQ: carbon dioxide
T5-large-SSM-NQ: carbohydrate molecules
T5-small-SSM-NQ: ATP and NADPH

Q219: Why is the sky blue?

Macaw-11B: because of the reflection of light from the clouds (credit: 1)
Macaw-3B: it is made of mostly water
Macaw-large: water reflects blue light from the earth's surface
Macaw-answer-11B: refraction of light in the sky (credit: 1)
GPT3-davinci: Because it's full of air. (credit: 0)
Jurassic-1-jumbo: Because God hates you. (credit: 0)
T5-XXL-SSM-NQ: The answer is simple (credit: 0)
T5-11B-SSM-NQ: reflected light
T5-XL-SSM-NQ: aether
T5-large-SSM-NQ: The silicate minerals
T5-small-SSM-NQ: its vast size

Q220: Why does the sky reflect blue light?

Macaw-11B: water reflects all colors except blue (credit: 0)
Macaw-3B: it is blue in color
Macaw-large: because it is blue in color
Macaw-answer-11B: because of the high altitude of the sky (credit: 0)
GPT3-davinci: The sky is blue because of Rayleigh scattering. (credit: 1)
Jurassic-1-jumbo: The blue color of the sky is caused by Rayleigh scattering. (credit: 1)
T5-XXL-SSM-NQ: blue light is more energetic (credit: 0)
T5-11B-SSM-NQ: the atmosphere
T5-XL-SSM-NQ: the sky is blue
T5-large-SSM-NQ: The effect of refraction
T5-small-SSM-NQ: reflecting light

Q221: Why do plants produce sugar?

Macaw-11B: to provide energy for the plant (credit: 1)
Macaw-3B: to feed their animals
Macaw-large: to meet the demand of consumers
Macaw-answer-11B: to survive (credit: 1)
GPT3-davinci: Plants produce sugar to store energy. (credit: 1)
Jurassic-1-jumbo: Plants produce sugar (glucose) for energy. (credit: 1)
T5-XXL-SSM-NQ: to store energy (credit: 1)
T5-11B-SSM-NQ: to store energy
T5-XL-SSM-NQ: photosynthesis
T5-large-SSM-NQ: to feed the hungry
T5-small-SSM-NQ: to boil or steam rice

Q222: Why do plants need energy?

Macaw-11B: to make food (credit: 1)
Macaw-3B: to make food
Macaw-large: to grow
Macaw-answer-11B: to grow (credit: 1)
GPT3-davinci: Plants need energy to grow and to reproduce. (credit: 1)
Jurassic-1-jumbo: Plants need energy to grow, reproduce, and carry out other life processes. (credit: 1)
T5-XXL-SSM-NQ: to produce more sugar (credit: 1)
T5-11B-SSM-NQ: to make food
T5-XL-SSM-NQ: photosynthesis
T5-large-SSM-NQ: to run cellular processes
T5-small-SSM-NQ: to run cellular processes

Q223: Why does it get colder at higher altitudes?

Macaw-11B: less sunlight (credit: 0)
Macaw-3B: less air
Macaw-large: the atmosphere is less dense at higher elevations so there is less sunlight
Macaw-answer-11B: less greenhouse gases at higher altitudes (credit: 0)
GPT3-davinci: The air pressure is lower at higher altitudes. The air pressure is what keeps the heat in. (credit: 1)
Jurassic-1-jumbo: The atmosphere gets thinner as you go higher, so there is less air to trap heat. (credit: 0.5)
T5-XXL-SSM-NQ: decreased atmospheric pressure (credit: 1)
T5-11B-SSM-NQ: decreased atmospheric pressure
T5-XL-SSM-NQ: Lapse rate
T5-large-SSM-NQ: decreased atmospheric pressure
T5-small-SSM-NQ: cold-water regions

Q224: How does photosynthesis work?

Macaw-11B: sun shines on plants (credit: 1)
Macaw-3B: plants absorb sunlight to make food
Macaw-large: plants use carbon dioxide and other gases to make food
Macaw-answer-11B: sunlight and carbon dioxide are combined to make food (credit: 1)
GPT3-davinci: Photosynthesis is the process by which plants and other organisms convert light energy, usually from the Sun, into chemical energy that can be used to fuel the organisms' activities. This chemical energy is stored in carbohydrate molecules, such as sugars, which are synthesized from carbon dioxide and water [Dash] hence the name photosynthesis, from (credit: 1)
Jurassic-1-jumbo: Photosynthesis is the process by which plants use sunlight, water, and carbon dioxide to produce glucose and oxygen. (credit: 1)
T5-XXL-SSM-NQ: reaction centres (credit: 0)
T5-11B-SSM-NQ: reaction centres
T5-XL-SSM-NQ: light energy
T5-large-SSM-NQ: light
T5-small-SSM-NQ: in photosystem II

Q225: What are the inputs for photosynthesis?

Macaw-11B: sunlight, carbon dioxide, water (credit: 1)
Macaw-3B: carbon dioxide
Macaw-large: sunlight and energy from the sun
Macaw-answer-11B: carbon dioxide, hydrogen, water (credit: 1)
GPT3-davinci: Sunlight, water, and carbon dioxide. (credit: 1)
Jurassic-1-jumbo: Photosynthesis requires sunlight, carbon dioxide, and water. (credit: 1)
T5-XXL-SSM-NQ: light energy (credit: 0.5)
T5-11B-SSM-NQ: carbon dioxide
T5-XL-SSM-NQ: light energy
T5-large-SSM-NQ: light
T5-small-SSM-NQ: light

Q226: List the inputs of photosynthesis.

Macaw-11B: sunlight, carbon dioxide, water (credit: 1)
Macaw-3B: carbon dioxide
Macaw-large: glucose and light
Macaw-answer-11B: carbon dioxide, hydrogen, water (credit: 1)
GPT3-davinci: Sunlight, water, carbon dioxide, and minerals. (credit: 1)
Jurassic-1-jumbo: Light, carbon dioxide, water, and chlorophyll. (credit: 1)
T5-XXL-SSM-NQ: carbon dioxide (credit: 0.5)
T5-11B-SSM-NQ: carbon dioxide
T5-XL-SSM-NQ: light energy
T5-large-SSM-NQ: water
T5-small-SSM-NQ: ATP

Q227: What are the outputs of photosynthesis?

Macaw-11B: sugar (credit: 0.5)
Macaw-3B: sugar
Macaw-large: glucose
Macaw-answer-11B: oxygen and sugar (credit: 1)
GPT3-davinci: The outputs of photosynthesis are oxygen and glucose. (credit: 1)
Jurassic-1-jumbo: Photosynthesis produces carbohydrates and oxygen. (credit: 1)
T5-XXL-SSM-NQ: carbohydrate molecules (credit: 0.5)
T5-11B-SSM-NQ: carbon dioxide
T5-XL-SSM-NQ: ATP and NADPH
T5-large-SSM-NQ: carbohydrate molecules
T5-small-SSM-NQ: light

Q228: List the outputs of photosynthesis.

Macaw-11B: sugar (credit: 0.5)
Macaw-3B: oxygen
Macaw-large: glucose, oxygen and carbohydrates
Macaw-answer-11B: oxygen, sugar, water (credit: 0.66)
GPT3-davinci: The products of photosynthesis are oxygen and glucose. (credit: 1)
Jurassic-1-jumbo: Oxygen, glucose, and ATP. (credit: 1)
T5-XXL-SSM-NQ: carbohydrate molecules (credit: 0.5)
T5-11B-SSM-NQ: carbon dioxide
T5-XL-SSM-NQ: carbon dioxide
T5-large-SSM-NQ: carbohydrate molecules
T5-small-SSM-NQ: ATP

Q229: Where does photosynthesis occur?

Macaw-11B: in plants (credit: 1)
Macaw-3B: in the leaves of a plant
Macaw-large: in plants
Macaw-answer-11B: in plants (credit: 1)
GPT3-davinci: Photosynthesis occurs in the chloroplasts of plant cells. (credit: 1)
Jurassic-1-jumbo: Photosynthesis occurs in chloroplasts. (credit: 1)
T5-XXL-SSM-NQ: thylakoid membranes (credit: 1)
T5-11B-SSM-NQ: thylakoid membranes
T5-XL-SSM-NQ: thylakoid membranes
T5-large-SSM-NQ: on the thylakoid membranes
T5-small-SSM-NQ: in the ice caps

Q230: In what part of a plant does photosynthesis occur?

Macaw-11B: leaves (credit: 1)
Macaw-3B: leaves
Macaw-large: leaf
Macaw-answer-11B: leaves (credit: 1)
GPT3-davinci: In the leaves. (credit: 1)
Jurassic-1-jumbo: Photosynthesis occurs in the leaves. (credit: 1)
T5-XXL-SSM-NQ: cyanobacteria (credit: 0)
T5-11B-SSM-NQ: in chloroplasts
T5-XL-SSM-NQ: thylakoid membranes
T5-large-SSM-NQ: in the stroma of chloroplast
T5-small-SSM-NQ: in the stroma

Q231: List all the gases involved in photosynthesis.

Macaw-11B: oxygen, carbon dioxide, water vapor, nitrogen (credit: 1)
Macaw-3B: carbon dioxide
Macaw-large: oxygen - carbon dioxide
Macaw-answer-11B: oxygen, carbon dioxide, nitrogen (credit: 1)
GPT3-davinci: Oxygen, carbon dioxide, water vapor, and nitrogen. (credit: 1)
Jurassic-1-jumbo: Oxygen, carbon dioxide, and hydrogen. (credit: 1)
T5-XXL-SSM-NQ: carbon dioxide (credit: 0.5)
T5-11B-SSM-NQ: carbon dioxide
T5-XL-SSM-NQ: Water
T5-large-SSM-NQ: water
T5-small-SSM-NQ: water

Q232: What force causes a ball to roll downhill?

Macaw-11B: gravity (credit: 1)
Macaw-3B: gravity
Macaw-large: gravity
Macaw-answer-11B: gravity (credit: 1)
GPT3-davinci: Gravity. (credit: 1)
Jurassic-1-jumbo: Gravity. (credit: 1)
T5-XXL-SSM-NQ: gravity (credit: 1)
T5-11B-SSM-NQ: gravity
T5-XL-SSM-NQ: gravity
T5-large-SSM-NQ: gravity
T5-small-SSM-NQ: gravity

Q233: How does a volcanic eruption interfere with the ability of producers to obtain the energy they need to produce food?

Macaw-11B: the eruption blocks the sun (credit: 1)
Macaw-3B: the nutrients are destroyed
Macaw-large: by disrupting the sunlight from reaching producers
Macaw-answer-11B: less sunlight (credit: 1)
GPT3-davinci: Volcanic eruptions can have a significant impact on the availability of energy for food production. Volcanic eruptions can release large amounts of sulfur dioxide into the atmosphere. Sulfur dioxide reacts with water vapor to form sulfuric acid, which can be carried by the wind for thousands of miles. The sulfuric (credit: 0.5)
Jurassic-1-jumbo: The eruption of a volcano can disrupt the flow of energy to producers. (credit: 0)
T5-XXL-SSM-NQ: by reducing available light (credit: 1)
T5-11B-SSM-NQ: reduces soil fertility
T5-XL-SSM-NQ: without food
T5-large-SSM-NQ: will have no effect on food production
T5-small-SSM-NQ: produce power

Q234: How does a volcanic eruption result in reduced sunlight?

Macaw-11B: ash in the atmosphere reflects light (credit: 1)
Macaw-3B: ash clouds block sunlight
Macaw-large: ash from the eruption clouds the sky
Macaw-answer-11B: ash clouds (credit: 1)
GPT3-davinci: Volcanic eruptions can result in reduced sunlight in two ways. First, the eruption can result in a large amount of ash and other particles in the atmosphere. This can block sunlight from reaching the surface of the Earth. Second, volcanic eruptions can result in a large amount of sulfur dioxide being released into the atmosphere (credit: 1)
Jurassic-1-jumbo: The ash and gases released into the atmosphere by volcanic eruptions reflect sunlight back into space. (credit: 1)
T5-XXL-SSM-NQ: clouds (credit: 1)
T5-11B-SSM-NQ: ashfall
T5-XL-SSM-NQ: create a cloudy sky
T5-large-SSM-NQ: a cooler atmosphere
T5-small-SSM-NQ: indirectly using concentrated solar power

Q235: Why does a reduction in sunlight cause producers to receive less energy than they need to produce food?

Macaw-11B: less sunlight means less energy for photosynthesis (credit: 1)
Macaw-3B: plants require sunlight for photosynthesis
Macaw-large: the plant requires sunlight for photosynthesis
Macaw-answer-11B: less energy (credit: 0)
GPT3-davinci: The energy from the sun is not directly used by plants. Plants use the energy from the sun to convert carbon dioxide and water into glucose and oxygen. Plants use the glucose to produce energy and the oxygen is released into the atmosphere. (credit: 0.5)
Jurassic-1-jumbo: Because plants use sunlight to make food. (credit: 1)
T5-XXL-SSM-NQ: photosynthesis (credit: 0)
T5-11B-SSM-NQ: less sunlight
T5-XL-SSM-NQ: Decline of photosynthesis
T5-large-SSM-NQ: decreased sunlight
T5-small-SSM-NQ: decreased food availability

Q236: List all the birds.

Macaw-11B: wrens, cardinals, robins, eagles, hawks, sparrows, red-winged blackbirds, tufted titmice, red-breasted nuthatches, tufted flycatchers, painted buntings, red-breasted nuthatches, tufted titmice, black-throated blue warblers, painted green heron, sandpipers, black-throated blue-birds (credit: 1)
Macaw-3B: eagle, hawk, owl, crow, heron, vulture
Macaw-large: type of bird
Macaw-answer-11B: hummingbird, cardinal, robin, goldfinch, kingfisher, robin redbreast, robin smallwing, robin largewing, robin small, robin largewing, robin small, robin small, robin small, robin small, robin small, robin smallwing, robin small, robin small, robin small, robin small, robin smallwings, and robits, ; ; (credit: 1)
GPT3-davinci: The birds are: (credit: 0)
Jurassic-1-jumbo: The birds that fly. (credit: 0)
T5-XXL-SSM-NQ: pigeon (credit: 0.2)
T5-11B-SSM-NQ: the killdeer
T5-XL-SSM-NQ: eagles
T5-large-SSM-NQ: passerine birds
T5-small-SSM-NQ: 9

Q237: List all the animals.

Macaw-11B: apes, wolves, foxes, raccoons, skunks, snakes, lizards, frogs, toads, fish, amphibians, birds, mammals, reptiles, amphibians, fish, frogs, toads, and snakes (credit: 1)
Macaw-3B: mammals
Macaw-large: birds, mammals, fish, insects
Macaw-answer-11B: lion, tiger, bear, fox, giraffe, zebra, giraffe, ostrich, penguin, sea lion, sea cow, ostrich, giraffe, opossum, octopus, penguin, octopus, octopus, octopus, octopus, octopus, octopus, octopus, octo (credit: 1)
GPT3-davinci: Dog, cat, mouse, cow, pig, chicken, duck, horse, sheep, goat, fish, snake, bird, and frog. (credit: 1)
Jurassic-1-jumbo: A dog, a cat, a frog, a duck, a goose, a sheep, a cow, a goat, a donkey, a horse, a camel, a giraffe, a zebra, a kangaroo, a koala, a panda, a penguin, a polar bear, a seal, a walrus, a whale, a dolphin, a (credit: 1)
T5-XXL-SSM-NQ: pigeon (credit: 0)
T5-11B-SSM-NQ: Antelope
T5-XL-SSM-NQ: Carnivora
T5-large-SSM-NQ: cats
T5-small-SSM-NQ: all animal facts

Q238: List all the mammals.

Macaw-11B: apes, whales, dolphins, walruses, penguins, sea lions, and polar bears (credit: 1)
Macaw-3B: mammals
Macaw-large: mammals
Macaw-answer-11B: mammals include humans, whales, dolphins, and seals (credit: 1)
GPT3-davinci: The mammals are: (credit: 0)
Jurassic-1-jumbo: Mammals are warm-blooded animals that have hair or fur, feed their young with milk, and suckle their young. (credit: 0)
T5-XXL-SSM-NQ: Carnivora (credit: 0)
T5-11B-SSM-NQ: rodents
T5-XL-SSM-NQ: rodents
T5-large-SSM-NQ: cats
T5-small-SSM-NQ: Crepuscular

Q239: List all the snakes.

Macaw-11B: python, coral snake, king cobra, black racer, western coral snake, western coral snake (credit: 1)
Macaw-3B: venomous
Macaw-large: type of snake
Macaw-answer-11B: vipers, boa constrictors, coral snakes, king snakes, milk snakes, western diamondbacks, eastern diamondbacks, western diamondback kings, eastern diamondback kings, western diamondback kings, western diamondback kings, western diamondback kings, western diamondback kings, western diamondback kings, western diamondback kings, western diamondback kings, western diamondback kings, western diamondback kings,,,,,,, (credit: 1)
GPT3-davinci: There are two snakes in the game. The first is the snake that you play as. The second is the snake that you play against. (credit: 0)
Jurassic-1-jumbo: Snakes are reptiles. They do not have legs. Snakes do not have arms. Snakes do not have fingers. Snakes do not have toes. Snakes do not have ears. Snakes do not have noses. Snakes do not have tongues. Snakes do not have hair. Snakes do not have fur. Snakes do not have feathers. Snakes do not have scales. Snakes do not have shells. Snake (credit: 0)
T5-XXL-SSM-NQ: 71 (credit: 0)
T5-11B-SSM-NQ: colubrid snakes
T5-XL-SSM-NQ: colubrid snakes
T5-large-SSM-NQ: Eastern brown snake
T5-small-SSM-NQ: Raju

Q240: How many legs does a snake have?

Macaw-11B: 8 (credit: 0)
Macaw-3B: 8
Macaw-large: two
Macaw-answer-11B: usually 8 (credit: 0)
GPT3-davinci: Four. (credit: 0)
Jurassic-1-jumbo: Four, unless it's a snake with two heads. (credit: 0)
T5-XXL-SSM-NQ: eight (credit: 0)
T5-11B-SSM-NQ: four
T5-XL-SSM-NQ: five
T5-large-SSM-NQ: four
T5-small-SSM-NQ: ten

Q241: Is oxygen transparent?

Macaw-11B: yes (credit: 1)
Macaw-3B: yes
Macaw-large: yes
Macaw-answer-11B: yes (credit: 1)
GPT3-davinci: No. (credit: 0)
Jurassic-1-jumbo: Oxygen is transparent to visible light, but absorbs ultraviolet and infrared radiation. (credit: 1)
T5-XXL-SSM-NQ: colorless (credit: 1)
T5-11B-SSM-NQ: almost clear
T5-XL-SSM-NQ: colorless
T5-large-SSM-NQ: Ozone transparent
T5-small-SSM-NQ: transparency

Q242: Does oxygen reflect blue light?

Macaw-11B: yes (credit: 0)
Macaw-3B: yes
Macaw-large: yes
Macaw-answer-11B: yes (credit: 0)
GPT3-davinci: Yes, oxygen reflects blue light. (credit: 0)
Jurassic-1-jumbo: Yes, oxygen does reflect blue light. (credit: 0)
T5-XXL-SSM-NQ: blue light (credit: 0)
T5-11B-SSM-NQ: yellow-orange
T5-XL-SSM-NQ: blue light
T5-large-SSM-NQ: Alkali metals
T5-small-SSM-NQ: photosynthetic organisms

Q243: Does oxygen contain a lot of hydrogen?

Macaw-11B: no (credit: 1)
Macaw-3B: yes
Macaw-large: yes
Macaw-answer-11B: no (credit: 1)
GPT3-davinci: Yes, oxygen contains a lot of hydrogen. (credit: 0)
Jurassic-1-jumbo: No. Oxygen contains 8 protons, 8 neutrons, and 8 electrons. Hydrogen contains 1 proton, 1 neutron, and 1 electron. (credit: 1)
T5-XXL-SSM-NQ: atoms (credit: 0)
T5-11B-SSM-NQ: Yes
T5-XL-SSM-NQ: contains about 7% hydrogen
T5-large-SSM-NQ: very low
T5-small-SSM-NQ: most stable

Q244: You blow up a toy balloon, and tie the end shut. What is the air pressure in the balloon, relative to outside?

Macaw-11B: equal to the air pressure outside the balloon (credit: 0)
Macaw-3B: equal to atmospheric pressure
Macaw-large: equal to the atmospheric pressure
Macaw-answer-11B: equal to the atmospheric pressure (credit: 1)
GPT3-davinci: The air pressure inside the balloon is the same as outside. (credit: 1)
Jurassic-1-jumbo: The air pressure in the balloon is 1/2 of the air pressure outside. (credit: 0)
T5-XXL-SSM-NQ: hypothetical pressure (credit: 0)
T5-11B-SSM-NQ: negative pressure
T5-XL-SSM-NQ: 100 kPa, 1 bar
T5-large-SSM-NQ: Toy balloon pressure
T5-small-SSM-NQ: approximately 13 wpm

Spatial

Q245: Where is the roof relative to the walls and floors in a house?

Macaw-11B: on top (credit: 1)
Macaw-3B: above the walls
Macaw-large: at the top
Macaw-answer-11B: on top (credit: 1)
GPT3-davinci: The roof is the top of the walls and floors. (credit: 1)
Jurassic-1-jumbo: The roof is above everything else. (credit: 1)
T5-XXL-SSM-NQ: highest point (credit: 1)
T5-11B-SSM-NQ: above
T5-XL-SSM-NQ: first
T5-large-SSM-NQ: over the porch
T5-small-SSM-NQ: the floor scale

Q246: Where are the walls relative to the roof and floors in a house?

Macaw-11B: on the outside (credit: 1)
Macaw-3B: walls are above the roof
Macaw-large: in the middle
Macaw-answer-11B: vertical (credit: 0)
GPT3-davinci: The walls are on the outside of the roof and floors. (credit: 1)
Jurassic-1-jumbo: The walls are always below the roof and floors. (credit: 1)
T5-XXL-SSM-NQ: supporting a roof (credit: 1)
T5-11B-SSM-NQ: parallel to the floor
T5-XL-SSM-NQ: between a foundation and a roof
T5-large-SSM-NQ: from the outside
T5-small-SSM-NQ: the floor scale

Q247: Where is the floor relative to the roof and walls in a house?

Macaw-11B: the floor is on the inside of the walls (credit: 1)
Macaw-3B: below the roof
Macaw-large: in the middle
Macaw-answer-11B: the middle (credit: 1)
GPT3-davinci: The floor is the bottom surface of the house. (credit: 1)
Jurassic-1-jumbo: The floor is the lowest horizontal surface in a house. (credit: 1)
T5-XXL-SSM-NQ: between walls (credit: 1)
T5-11B-SSM-NQ: below the ceiling
T5-XL-SSM-NQ: first
T5-large-SSM-NQ: from the floor to the wall
T5-small-SSM-NQ: between the walls and walls

Q248: Why was it easier for Aristotle to travel to Egypt than Eastern Asia?

Macaw-11B: it was closer (credit: 1)
Macaw-3B: it was closer to the equator
Macaw-large: it was much easier to get the visa for Egypt than for the rest of the world
Macaw-answer-11B: shorter distance (credit: 1)
GPT3-davinci: Because the Greeks had already invented the wheel. (credit: 0)
Jurassic-1-jumbo: Because Aristotle was Greek. (credit: 0)
T5-XXL-SSM-NQ: much further (credit: 0)
T5-11B-SSM-NQ: logistically easier
T5-XL-SSM-NQ: easier
T5-large-SSM-NQ: easier
T5-small-SSM-NQ: ben Adam

Q249: How can I reach a high window in my kitchen?

Macaw-11B: step stool (credit: 1)
Macaw-3B: step ladder
Macaw-large: use a ladder
Macaw-answer-11B: step stool (credit: 1)
GPT3-davinci: You can use a step stool or a chair to reach the window. (credit: 1)
Jurassic-1-jumbo: A ladder or stool is the safest way to reach a high window. (credit: 1)
T5-XXL-SSM-NQ: a stepladder (credit: 1)
T5-11B-SSM-NQ: a step ladder
T5-XL-SSM-NQ: a ladder
T5-large-SSM-NQ: high window sill
T5-small-SSM-NQ: to be an extension

Q250: You want to mail a beautiful eight-inch diameter circular piece of fabric to your mother. The only box you have is five-by-five-by-two inches. You will have to do what?

Macaw-11B: fold the fabric in half (credit: 1)
Macaw-3B: fold the fabric in half
Macaw-large: fold the fabric in half
Macaw-answer-11B: fold the fabric in half (credit: 1)
GPT3-davinci: Fold the fabric into a square. (credit: 1)
Jurassic-1-jumbo: Fold it. (credit: 1)
T5-XXL-SSM-NQ: fold the fabric (credit: 1)
T5-11B-SSM-NQ: fold it in half
T5-XL-SSM-NQ: fold it
T5-large-SSM-NQ: fold it
T5-small-SSM-NQ: A stuffed cotton

Q251: The year is 2075. Violet Blair is an astronaut on the Moon, in the Sea of Tranquility. Right now, on Earth, there is a solar eclipse. Violet looks in the direction of the Earth and sees what?

Macaw-11B: the shadow of the earth (credit: 0)
Macaw-3B: the sun
Macaw-large: the moon
Macaw-answer-11B: blackness (credit: 0)
GPT3-davinci: A total solar eclipse. (credit: 0.5)
Jurassic-1-jumbo: A solar eclipse. Violet Blair is an astronaut on the Moon, in the Sea of Tranquility. Right now, on Earth, there is a solar eclipse. Violet looks in the direction of the Earth and sees what? (credit: 0)
T5-XXL-SSM-NQ: a blue tint (credit: 0)
T5-11B-SSM-NQ: Earth
T5-XL-SSM-NQ: a large shadow
T5-large-SSM-NQ: sunlight
T5-small-SSM-NQ: "Worth"

Q252: John is left of Sue. Where is Sue relative to John?

Macaw-11B: to his right (credit: 1)
Macaw-3B: to the right
Macaw-large: middle
Macaw-answer-11B: to John's left (credit: 0)
GPT3-davinci: Sue is right of John.

The following is a list of the most common relative clauses in English.

Relative clauses can be used to modify nouns, pronouns, and noun phrases.

Relative clauses can be used to modify adjectives, adverbs, and prepositional phrases. (credit: 1)

Jurassic-1-jumbo: Sue is to the right of John. (credit: 1)
T5-XXL-SSM-NQ: left of John (credit: 0)
T5-11B-SSM-NQ: left
T5-XL-SSM-NQ: farthest from John
T5-large-SSM-NQ: old friend
T5-small-SSM-NQ: a friend

Q253: John is left of Sue. Sue is left of Mike. Where is Mike relative to John?

Macaw-11B: to the right (credit: 1)
Macaw-3B: right
Macaw-large: right side
Macaw-answer-11B: to the right (credit: 1)
GPT3-davinci: Mike is to the right of John. (credit: 1)
Jurassic-1-jumbo: Mike is to the right of John. (credit: 1)
T5-XXL-SSM-NQ: right of Sue (credit: 0)
T5-11B-SSM-NQ: to the left of John
T5-XL-SSM-NQ: John's right
T5-large-SSM-NQ: Susan
T5-small-SSM-NQ: from an unnamed seafarer

Q254: John is left of Sue. Sue is left of Mike. Where is Sue relative to John?

Macaw-11B: to his left (credit: 0)
Macaw-3B: to the right
Macaw-large: John is left of Sue. Mike is right of Sue.
Macaw-answer-11B: to John's left (credit: 0)
GPT3-davinci: Mike (credit: 0)
Jurassic-1-jumbo: Sue is to the right of John. (credit: 1)
T5-XXL-SSM-NQ: left of John (credit: 0)
T5-11B-SSM-NQ: left
T5-XL-SSM-NQ: Mike
T5-large-SSM-NQ: Mike
T5-small-SSM-NQ: from an unnamed seafarer

Q255: If you brought a canary and an alligator together to the same place, could the canary could see what is inside the alligator's stomach?

Macaw-11B: no, because the canary is colorblind (credit: 0)
Macaw-3B: yes
Macaw-large: the canary could see through the alligator's belly
Macaw-answer-11B: no (credit: 0)
GPT3-davinci: No, because the canary would be inside the alligator's stomach. (credit: 1)
Jurassic-1-jumbo: No, the canary would be eaten by the alligator. (credit: 1)
T5-XXL-SSM-NQ: Neither can see the other (credit: 0)
T5-11B-SSM-NQ: canary's vision
T5-XL-SSM-NQ: canary
T5-large-SSM-NQ: canary
T5-small-SSM-NQ: a dog

Steps

Q256: What are the steps involved in replacing a light bulb?

Macaw-11B: remove the old bulb, put in the new bulb (credit: 1)
Macaw-3B: remove old bulb
Macaw-large: switch to a new bulb
Macaw-answer-11B: remove the old bulb, insert the new bulb, and screw in the new bulb (credit: 1)
GPT3-davinci: 1. Make sure it's dark. 2. Reach up high. 3. Turn the bulb. 4. Turn the bulb again. 5. Turn the bulb again. 6. Turn the bulb again. 7. Turn the bulb again. 8. Turn the bulb again. 9. Turn the bulb again. 10. (credit: 0.5)
Jurassic-1-jumbo: First, turn off the power. Then, remove the old bulb. Next, install the new bulb. Finally, turn the power back on. (credit: 1)
T5-XXL-SSM-NQ: unscrewing the light bulb (credit: 0.5)
T5-11B-SSM-NQ: Turn off the power
T5-XL-SSM-NQ: Shake the bulb
T5-large-SSM-NQ: "Repair"
T5-small-SSM-NQ: Alliteration

Q257: How do I make a loaf of bread?

Macaw-11B: mix flour, yeast, and water together in a bowl (credit: 1)
Macaw-3B: using yeast
Macaw-large: a loaf of bread mix
Macaw-answer-11B: mix flour, yeast, salt, water, and oil together (credit: 1)
GPT3-davinci: You need flour, water, yeast, and salt. (credit: 1)
Jurassic-1-jumbo: Bread making is easy and fun. (credit: 0)
T5-XXL-SSM-NQ: Follow these steps (credit: 0)
T5-11B-SSM-NQ: recipe
T5-XL-SSM-NQ: I've never made bread
T5-large-SSM-NQ: Baking a loaf
T5-small-SSM-NQ: to boil or steam rice

Q258: What are the steps involved in making a loaf of bread?

Macaw-11B: mix flour, yeast, water, and salt together (credit: 1)
Macaw-3B: rising, rising, rising
Macaw-large: rising, cooling, baking
Macaw-answer-11B: mix flour, yeast, salt, water, and oil in a bowl, knead dough, shape into a loaf, and bake (credit: 1)
GPT3-davinci: Mixing, kneading, rising, shaping, proofing, baking. (credit: 1)
Jurassic-1-jumbo: First, the baker mixes flour, water, yeast, and salt. Then, he kneads the dough. Next, he lets the dough rise. Finally, he bakes the bread. (credit: 1)
T5-XXL-SSM-NQ: kneading (credit: 0.5)
T5-11B-SSM-NQ: Kneading
T5-XL-SSM-NQ: Rising
T5-large-SSM-NQ: Four steps
T5-small-SSM-NQ: breadmaking

Q259: What are the four steps in making bread?

Macaw-11B: mix, knead, shape, bake (credit: 1)
Macaw-3B: mix, rise, bake
Macaw-large: rise, bake, cool
Macaw-answer-11B: measure, mix, knead, let rise (credit: 1)
GPT3-davinci: Mix, Knead, Rise, Bake (credit: 1)
Jurassic-1-jumbo: 1. Mixing, 2. Kneading, 3. Rising, 4. Baking. (credit: 1)
T5-XXL-SSM-NQ: hydrate the flour (credit: 0)
T5-11B-SSM-NQ: Kneading
T5-XL-SSM-NQ: proofing
T5-large-SSM-NQ: Baking
T5-small-SSM-NQ: to cross stanzas

Q260: What are the steps involved in counting cars that pass a school each day?

Macaw-11B: count the number of cars that pass the school each day (credit: 0)
Macaw-3B: count number of cars that pass school
Macaw-large: observation
Macaw-answer-11B: record the number of cars (credit: 1)
GPT3-davinci: The steps are:

The count is done by a trained volunteer.

The volunteer counts the number of cars that pass the school on a single day.

The count is done at the same time each day.

The count is done on a day when there is no school (credit: 1)
- Jurassic-1-jumbo: First, count the number of cars that pass the school each day. Then, divide that number by the number of days you counted. Finally, multiply that number by 365. (credit: 0)
- T5-XXL-SSM-NQ: traffic counting (credit: 0)
- T5-11B-SSM-NQ: travel time
- T5-XL-SSM-NQ: traffic monitoring
- T5-large-SSM-NQ: Traffic calming
- T5-small-SSM-NQ: to be nocturnal

Q261: If you want to drive a car, what do you do first?

Macaw-11B: learn to drive a stick shift (credit: 0)
Macaw-3B: get a license
Macaw-large: learn the basics of driving
Macaw-answer-11B: get a license (credit: 1)
GPT3-davinci: You get a license. (credit: 1)
Jurassic-1-jumbo: You turn the key in the ignition. (credit: 1)
T5-XXL-SSM-NQ: get a license (credit: 1)
T5-11B-SSM-NQ: take a driving lesson
T5-XL-SSM-NQ: learn to drive
T5-large-SSM-NQ: driving
T5-small-SSM-NQ: a car

Q262: In an internal combustion engine, what happens after the air is compressed in the cylinder?

Macaw-11B: it is heated (credit: 1)
Macaw-3B: it is burned
Macaw-large: the gas is released
Macaw-answer-11B: it is ignited (credit: 1)
GPT3-davinci: The air is ignited by the spark plug, which ignites the fuel. (credit: 1)
Jurassic-1-jumbo: The compressed air is ignited by a spark. (credit: 1)
T5-XXL-SSM-NQ: ignited (credit: 1)
T5-11B-SSM-NQ: ignited
T5-XL-SSM-NQ: fire
T5-large-SSM-NQ: the engine revs
T5-small-SSM-NQ: decreasing the volume

Q263: In an internal combustion engine, what happens after the air is heated?

Macaw-11B: it is combusted (credit: 1)
Macaw-3B: it is mixed with fuel
Macaw-large: the gas is heated
Macaw-answer-11B: it is combusted (credit: 1)
GPT3-davinci: The air is mixed with fuel and ignited. (credit: 0.5)
Jurassic-1-jumbo: The heated air expands and pushes the piston down. (credit: 1)
T5-XXL-SSM-NQ: compressibility (credit: 0)
T5-11B-SSM-NQ: combustion
T5-XL-SSM-NQ: to fire
T5-large-SSM-NQ: exhaust
T5-small-SSM-NQ: heat

Q264: Some kids are planning a rollerskating race. What happens next?

Macaw-11B: they practice (credit: 1)
Macaw-3B: they practice
Macaw-large: they fall off the skates
Macaw-answer-11B: they fall down (credit: 0)
GPT3-davinci: They all fall down. (credit: 1)
Jurassic-1-jumbo: They start rolling! They roll and race, roll and race, roll and race. (credit: 1)
T5-XXL-SSM-NQ: disaster (credit: 0)
T5-11B-SSM-NQ: They're off!
T5-XL-SSM-NQ: The kids are separated
T5-large-SSM-NQ: School's Out
T5-small-SSM-NQ: 20-a-Ride

Q265: Some kids are planning a rollerskating race. They practice. What happens next?

Macaw-11B: they fall (credit: 1)
Macaw-3B: they get faster
Macaw-large: they get tired
Macaw-answer-11B: they fall (credit: 1)
GPT3-davinci: They race. (credit: 1)
Jurassic-1-jumbo: They race. (credit: 1)
T5-XXL-SSM-NQ: disaster (credit: 0)
T5-11B-SSM-NQ: The big race
T5-XL-SSM-NQ: The kids are separated
T5-large-SSM-NQ: the race
T5-small-SSM-NQ: 20[Dash]25 years

Q266: List all the steps in planning a vacation.

Macaw-11B: research, make a list, make a budget, research some more, book the trip (credit: 1)
Macaw-3B: research, booking, packing
Macaw-large: travel, attractions, hotels
Macaw-answer-11B: research, budget, book, pack (credit: 1)
GPT3-davinci: 1. Make a list of all the things you want to do on your vacation. (credit: 0.5)
Jurassic-1-jumbo: 1. Decide where to go. (credit: 0.5)
T5-XXL-SSM-NQ: research (credit: 0.5)
T5-11B-SSM-NQ: Research
T5-XL-SSM-NQ: Research
T5-large-SSM-NQ: Read the FAQ
T5-small-SSM-NQ: plan-assisted plan

Q267: List all the steps in going to the zoo.

Macaw-11B: get in car, drive to zoo, park, walk around the zoo (credit: 1)
Macaw-3B: plan, get there, enjoy
Macaw-large: the zoo is open to the public
Macaw-answer-11B: get in car, drive to zoo, look at animals, get out of car, pay admission (credit: 0.5)
GPT3-davinci: 1. Go to the zoo. (credit: 0)
Jurassic-1-jumbo: First, you get dressed. Second, you pack your lunch. Third, you brush your teeth. Fourth, you put on your shoes. Fifth, you grab your coat. Sixth, you grab your backpack. Seventh, you grab your hat. Eighth, you grab your mittens. Ninth, you grab your scarf. Tenth, you grab your gloves. Eleventh, you grab your backpack (credit: 0.5)
T5-XXL-SSM-NQ: Plan the trip (credit: 0.5)
T5-11B-SSM-NQ: park
T5-XL-SSM-NQ: Going to the zoo
T5-large-SSM-NQ: Plan a trip
T5-small-SSM-NQ: to be released in 1972

Q268: List all the steps in making a cake.

Macaw-11B: measure, mix, pour, cover, cool (credit: 1)
Macaw-3B: baking, cooling, frosting
Macaw-large: making the cake
Macaw-answer-11B: measure, mix, pour, cool (credit: 1)
GPT3-davinci: 1. Bake a cake. 2. Eat the cake. (credit: 0.5)
Jurassic-1-jumbo: 1. Get all the ingredients. (credit: 0.5)
T5-XXL-SSM-NQ: Cream the butter (credit: 0.2)
T5-11B-SSM-NQ: measure dry ingredients
T5-XL-SSM-NQ: pâté
T5-large-SSM-NQ: Baking
T5-small-SSM-NQ: A panda

Q269: List all the steps in repairing a flat tire.

Macaw-11B: check air pressure, change flat tire, inflate tire (credit: 1)
Macaw-3B: changing air in the tire
Macaw-large: change the oil
Macaw-answer-11B: check for leaks, inflate tire, replace valve stem, and re-balance wheel (credit: 0)
GPT3-davinci: 1. Buy a new tire. 2. Put it on the car. 3. Drive on it. (credit: 1)
Jurassic-1-jumbo: 1. Stop the car. 2. Put on the emergency brake. 3. Turn on the hazard lights. 4. Get out of the car. 5. Remove the hubcap. 6. Loosen the lug nuts. 7. Remove the flat tire. 8. Put on the spare tire. 9. Tighten the lug (credit: 1)
T5-XXL-SSM-NQ: remove the wheel (credit: 0.2)
T5-11B-SSM-NQ: Check the air pressure
T5-XL-SSM-NQ: removing the valve stem
T5-large-SSM-NQ: Check the alignment
T5-small-SSM-NQ: Reduction of car parts

Q270: List all the steps in planning a wedding.

Macaw-11B: make a guest list, choose a date, make a budget, invite people (credit: 1)
Macaw-3B: from invitations to reception
Macaw-large: make a list of all the steps in planning a wedding
Macaw-answer-11B: choose a date, find a venue, invite guests, plan the menu, and choose a wedding dress (credit: 1)
GPT3-davinci: The first step is to get engaged. The second step is to plan the wedding. The third step is to get married. The fourth step is to have a baby. The fifth step is to have another baby. The sixth step is to have another baby. The seventh step is to have another baby. The eighth step (credit: 0)
Jurassic-1-jumbo: 1. Set the date. 2. Set the budget. 3. Set your priorities. 4. Set your guest list. 5. Set your theme. 6. Set your colors. 7. Set your dress. 8. Set your flowers. 9. Set your cake. 10. (credit: 1)
T5-XXL-SSM-NQ: set a budget (credit: 0.2)
T5-11B-SSM-NQ: Venue selection
T5-XL-SSM-NQ: invitations
T5-large-SSM-NQ: wedding ceremony
T5-small-SSM-NQ: A wedding plan

Story understanding

Q271: I crashed my car. When I finally left the hospital, all I wanted to do was sleep. I had to call a taxi. Why did I call a taxi?

Macaw-11B: to get me home (credit: 1)
Macaw-3B: to get to my hotel
Macaw-large: to get help
Macaw-answer-11B: I was too tired to drive (credit: 1)
GPT3-davinci: Because you were in a hospital. (credit: 1)
Jurassic-1-jumbo: Because you were too injured to drive. (credit: 1)
T5-XXL-SSM-NQ: I was too embarrassed to drive (credit: 0.2)
T5-11B-SSM-NQ: I couldn't drive
T5-XL-SSM-NQ: I was sleepwalking
T5-large-SSM-NQ: I had no idea what to do
T5-small-SSM-NQ: late 2003

Q272: I crashed my car. When I finally left the hospital, all I wanted to do was sleep. I had to call a taxi. Why couldn't I drive home?

Macaw-11B: i was too tired (credit: 1)
Macaw-3B: I was too tired
Macaw-large: the car was too heavy
Macaw-answer-11B: i was too tired (credit: 1)
GPT3-davinci: You were probably still under the influence of the drugs they gave you at the hospital. (credit: 1)
Jurassic-1-jumbo: Driving a car is complex. It requires your full attention. Even if you're physically able, you may not be mentally or emotionally able to drive. (credit: 0)
T5-XXL-SSM-NQ: because of the alcohol (credit: 1)
T5-11B-SSM-NQ: I was too tired
T5-XL-SSM-NQ: "Dreams of Death"
T5-large-SSM-NQ: I had no idea
T5-small-SSM-NQ: 18 months

Q273: I crashed my car. When I finally left the hospital, all I wanted to do was sleep. I had to call a taxi. Why was I in hospital?

Macaw-11B: injuries (credit: 1)
Macaw-3B: to have my broken bones fixed
Macaw-large: I was injured in a car crash
Macaw-answer-11B: injuries (credit: 1)
GPT3-davinci: You were in hospital because you crashed your car. (credit: 1)
Jurassic-1-jumbo: You crashed your car because you were driving while tired. (credit: 0)
T5-XXL-SSM-NQ: alcoholism (credit: 1)
T5-11B-SSM-NQ: a concussion
T5-XL-SSM-NQ: for the accident
T5-large-SSM-NQ: I had a stroke
T5-small-SSM-NQ: 18 months old

Q274: I crashed my car. When I finally left the hospital, all I wanted to do was sleep. I had to call a taxi. How did I get my injuries?

Macaw-11B: from the crash (credit: 1)
Macaw-3B: car accident
Macaw-large: I was hit by a car
Macaw-answer-11B: from the crash (credit: 1)
GPT3-davinci: You were in a car accident. (credit: 1)
Jurassic-1-jumbo: The insurance company for the other driver will argue that your injuries were caused by the accident. They will argue that you were not hurt in the accident, but that you were injured when you fell out of bed. (credit: 0)
T5-XXL-SSM-NQ: a car accident (credit: 1)
T5-11B-SSM-NQ: car crash
T5-XL-SSM-NQ: I had no idea
T5-large-SSM-NQ: from a drug overdose
T5-small-SSM-NQ: 18 May 1980

Q275: I crashed my car. When I finally left the hospital, all I wanted to do was sleep. I had to call a taxi. What was a result of the crash?

Macaw-11B: i was too tired to drive (credit: 1)
Macaw-3B: I was tired
Macaw-large: I broke my neck
Macaw-answer-11B: I was exhausted (credit: 1)
GPT3-davinci: A taxi bill. (credit: 1)
Jurassic-1-jumbo: You learned the importance of calling a taxi. (credit: 1)
T5-XXL-SSM-NQ: a broken leg (credit: 1)
T5-11B-SSM-NQ: insomnia
T5-XL-SSM-NQ: Traumatic Brain Injury
T5-large-SSM-NQ: death
T5-small-SSM-NQ: died in a plane crash

Q276: I crashed my car. When I finally left the hospital, all I wanted to do was sleep. I had to call a taxi. Was I hurt in the crash?

Macaw-11B: yes (credit: 1)
Macaw-3B: yes
Macaw-large: yes
Macaw-answer-11B: yes (credit: 1)
GPT3-davinci: Yes. You were hurt in the crash. (credit: 1)
Jurassic-1-jumbo: Yes. You were hurt in the crash. (credit: 1)
T5-XXL-SSM-NQ: not seriously (credit: 1)
T5-11B-SSM-NQ: hurt bad
T5-XL-SSM-NQ: Traumatic Brain Injury
T5-large-SSM-NQ: no one was hurt
T5-small-SSM-NQ: 1979

Q277: I crashed my car. When I finally left the hospital, all I wanted to do was sleep. I had to call a taxi. Why did I go to the hospital?

Macaw-11B: to get checked out (credit: 1)
Macaw-3B: to get checked out
Macaw-large: to get medical help
Macaw-answer-11B: to get checked out (credit: 1)
GPT3-davinci: Because you were in an accident. (credit: 1)
Jurassic-1-jumbo: You went to the emergency room because you had chest pain. (credit: 0)
T5-XXL-SSM-NQ: I'd been drinking (credit: 0)
T5-11B-SSM-NQ: because I was drunk
T5-XL-SSM-NQ: sleep
T5-large-SSM-NQ: to die
T5-small-SSM-NQ: ...

Q278: I crashed my car. When I finally left the hospital, all I wanted to do was sleep. I had to call a taxi. When did I leave the hospital?

Macaw-11B: after midnight (credit: 1)
Macaw-3B: after a few hours
Macaw-large: after 2 hours
Macaw-answer-11B: after a week (credit: 1)
GPT3-davinci: You left the hospital at 8:00 p.m. (credit: 1)
Jurassic-1-jumbo: You left the hospital when you called a taxi. (credit: 1)
T5-XXL-SSM-NQ: June 25, 2015 (credit: 0)
T5-11B-SSM-NQ: the morning of July 4
T5-XL-SSM-NQ: December 3, 1972
T5-large-SSM-NQ: November 7, 1984
T5-small-SSM-NQ: 2004

Q279: Josh had a parrot that talked. He brought his parrot to school. During show and tell, Josh's parrot said a bad word. The teacher told Joshua not to bring his bird again. When Josh got home, he was grounded. Why was Josh grounded?

Macaw-11B: his parrot said a bad word (credit: 1)
Macaw-3B: he made his teacher mad
Macaw-large: the parrot's owner told Josh not to bring his parrot to school
Macaw-answer-11B: his parrot said a bad word (credit: 1)
GPT3-davinci: Because his parrot didn't say "Hello, Mrs. Smith." (credit: 0)
Jurassic-1-jumbo: Because his parrot said a bad word. (credit: 1)
T5-XXL-SSM-NQ: his parrot (credit: 1)
T5-11B-SSM-NQ: his parents were busy
T5-XL-SSM-NQ: a verbal apprehension
T5-large-SSM-NQ: discipline
T5-small-SSM-NQ: "The Search"

Q280: Josh had a parrot that talked. He brought his parrot to school. During show and tell, Josh's parrot said a bad word. The teacher told Joshua not to bring his bird again. When Josh got home, he was grounded. Why did the teacher tell Joshua not to bring his bird again?

Macaw-11B: the bird said something bad (credit: 1)
Macaw-3B: the bird might hurt someone
Macaw-large: because the parrot could not speak
Macaw-answer-11B: the parrot said a bad word (credit: 1)
GPT3-davinci: Because the parrot kept saying, "Josh is a dork!" (credit: 0.5)
Jurassic-1-jumbo: Because the bird said a bad word. (credit: 1)
T5-XXL-SSM-NQ: use of bad language (credit: 1)
T5-11B-SSM-NQ: due to safety concerns
T5-XL-SSM-NQ: he's been mute
T5-large-SSM-NQ: discipline
T5-small-SSM-NQ: "Say Say Say"

Q281: Josh had a parrot that talked. He brought his parrot to school. During show and tell, Josh's parrot said a bad word. The teacher told Joshua not to bring his bird again. When Josh got home, he was grounded. What bad word might the parrot have said?

Macaw-11B: swear (credit: 1)
Macaw-3B: swear
Macaw-large: no
Macaw-answer-11B: poop (credit: 1)
GPT3-davinci: "Birds of a feather flock together." (credit: 0)
Jurassic-1-jumbo: "I hate you, Josh!" (credit: 1)
T5-XXL-SSM-NQ: Fuck (credit: 1)
T5-11B-SSM-NQ: Fuck
T5-XL-SSM-NQ: pissed off
T5-large-SSM-NQ: "unkindness"
T5-small-SSM-NQ: "Fatal Distraction"

Q282: Josh had a parrot that talked. He brought his parrot to school. During show and tell, Josh's parrot said a bad word. The teacher told Joshua not to bring his bird again. When Josh got home, he was grounded. Why did Josh bring the parrot to school?

Macaw-11B: to show off (credit: 1)
Macaw-3B: to show his friends
Macaw-large: to play with it
Macaw-answer-11B: to show his friends (credit: 1)
GPT3-davinci: He wanted to show and tell the class a bad word. (credit: 1)
Jurassic-1-jumbo: Because he wanted to show off. (credit: 1)
T5-XXL-SSM-NQ: to show his classmates (credit: 1)
T5-11B-SSM-NQ: to impress his friends
T5-XL-SSM-NQ: to embarrass the teacher
T5-large-SSM-NQ: not sure what to do
T5-small-SSM-NQ: "The Search"

Q283: Josh had a parrot that talked. He brought his parrot to school. During show and tell, Josh's parrot said a bad word. The teacher told Joshua not to bring his bird again. When Josh got home, he was grounded. How did Josh feel?

Macaw-11B: sad (credit: 1)
Macaw-3B: sad
Macaw-large: sad
Macaw-answer-11B: sad (credit: 1)
GPT3-davinci: Josh felt like a parrot. (credit: 0)
Jurassic-1-jumbo: Josh felt sad. He missed his parrot. (credit: 1)
T5-XXL-SSM-NQ: sad (credit: 1)
T5-11B-SSM-NQ: upset
T5-XL-SSM-NQ: adios
T5-large-SSM-NQ: shocked
T5-small-SSM-NQ: "The Voyage of the Beagle

Q284: Josh had a parrot that talked. He brought his parrot to school. During show and tell, Josh's parrot said a bad word. The teacher told Joshua not to bring his bird again. When Josh got home, he was grounded. What was Josh doing during show and tell?

Macaw-11B: showing off his parrot (credit: 1)
Macaw-3B: showing off his bird
Macaw-large: yelling at the parrot
Macaw-answer-11B: showing his parrot (credit: 1)
GPT3-davinci: Josh was showing off. (credit: 1)
Jurassic-1-jumbo: He was showing his parrot. (credit: 1)
T5-XXL-SSM-NQ: babbling (credit: 1)
T5-11B-SSM-NQ: showing off his parrot
T5-XL-SSM-NQ: his parrot
T5-large-SSM-NQ: talking to his friends
T5-small-SSM-NQ: "Fatal Distraction"

Q285: Josh had a parrot that talked. He brought his parrot to school. During show and tell, Josh's parrot said a bad word. The teacher told Joshua not to bring his bird again. When Josh got home, he was grounded. How did the teacher feel?

Macaw-11B: mad (credit: 1)
Macaw-3B: annoyed
Macaw-large: angry
Macaw-answer-11B: mad (credit: 1)
GPT3-davinci: The teacher felt a little par-rot-ted. (credit: 0)
Jurassic-1-jumbo: The teacher felt bad. (credit: 1)
T5-XXL-SSM-NQ: annoyed (credit: 1)
T5-11B-SSM-NQ: frustrated
T5-XL-SSM-NQ: a little bit naughty
T5-large-SSM-NQ: shocked
T5-small-SSM-NQ: "The Voyage of the Beagle

Q286: Josh had a parrot that talked. He brought his parrot to school. During show and tell, Josh's parrot said a bad word. The teacher told Joshua not to bring his bird again. When Josh got home, he was grounded. How did Josh's parents feel?

Macaw-11B: mad (credit: 1)
Macaw-3B: sad
Macaw-large: angry
Macaw-answer-11B: mad (credit: 1)
GPT3-davinci: They were pissed. (credit: 1)
Jurassic-1-jumbo: They felt bad. They felt bad because Josh's parrot said a bad word. (credit: 1)
T5-XXL-SSM-NQ: outraged (credit: 1)
T5-11B-SSM-NQ: disappointed
T5-XL-SSM-NQ: Stupid
T5-large-SSM-NQ: shocked
T5-small-SSM-NQ: "Scientific Method."

Q287: Josh had a parrot that talked. He brought his parrot to school. During show and tell, Josh's parrot said a bad word. The teacher told Joshua not to bring his bird again. When Josh got home, he was grounded. Why did the parrot saying a bad word make the teacher mad?

Macaw-11B: it was a bad word (credit: 0)
Macaw-3B: it was disrespectful
Macaw-large: the parrot was threatening
Macaw-answer-11B: it was a bad word (credit: 0)
GPT3-davinci: Because the parrot was a foul-mouthed parrot. (credit: 1)
Jurassic-1-jumbo: Because the teacher was afraid of the parrot. (credit: 0)
T5-XXL-SSM-NQ: hurtful word (credit: 0)
T5-11B-SSM-NQ: might scare the other students
T5-XL-SSM-NQ: a prank
T5-large-SSM-NQ: bad luck
T5-small-SSM-NQ: "The Little Rascals

Q288: Josh had a parrot that talked. He brought his parrot to school. During show and tell, Josh's parrot said a bad word. The teacher told Joshua not to bring his bird again. When Josh got home, he was grounded. Why did the parrot saying a bad word make Josh's parents mad?

Macaw-11B: it was a bad word (credit: 0)
Macaw-3B: it was a bad word
Macaw-large: the parrot could not understand what Josh was saying
Macaw-answer-11B: they thought he was being disrespectful (credit: 0)
GPT3-davinci: Because the parrot was a foul-mouth. (credit: 0.5)
Jurassic-1-jumbo: Because Josh's parents didn't want him to say bad words. (credit: 1)
T5-XXL-SSM-NQ: hurt feelings (credit: 1)
T5-11B-SSM-NQ: might have hurt his feelings
T5-XL-SSM-NQ: being obscene
T5-large-SSM-NQ: had a bad day
T5-small-SSM-NQ: "Fatal Distraction"

Q289: Josh had a parrot that talked. He brought his parrot to school. During show and tell, Josh's parrot said a bad word. The teacher told Joshua not to bring his bird again. When Josh got home, he was grounded. What happens during show and tell?

Macaw-11B: kids show and tell things they have (credit: 1)
Macaw-3B: the parrot says a bad word
Macaw-large: the parrot gets in trouble
Macaw-answer-11B: kids show and tell things they have (credit: 1)
GPT3-davinci: Josh's parrot said a bad word. (credit: 1)
Jurassic-1-jumbo: Josh's parrot said a bad word. (credit: 1)
T5-XXL-SSM-NQ: students bring in something interesting (credit: 1)
T5-11B-SSM-NQ: students bring in their pets
T5-XL-SSM-NQ: usually ignored
T5-large-SSM-NQ: Josh
T5-small-SSM-NQ: "The Search"

Q290: Josh had a parrot that talked. He brought his parrot to school. During show and tell, Josh's parrot said a bad word. The teacher told Joshua not to bring his bird again. When Josh got home, he was grounded. How did the teacher feel before show and tell?

Macaw-11B: happy (credit: 1)
Macaw-3B: annoyed
Macaw-large: nervous
Macaw-answer-11B: calm (credit: 1)
GPT3-davinci: She was excited. (credit: 1)
Jurassic-1-jumbo: The teacher was excited. (credit: 1)
T5-XXL-SSM-NQ: excited (credit: 1)
T5-11B-SSM-NQ: irritated
T5-XL-SSM-NQ: a little nervous
T5-large-SSM-NQ: nervous
T5-small-SSM-NQ: "The Voyage of the Beagle

Q291: Josh had a parrot that talked. He brought his parrot to school. During show and tell, Josh's parrot said a bad word. The teacher told Joshua not to bring his bird again. When Josh got home, he was grounded. What did the other children in Josh's class think of the parrot?

Macaw-11B: they thought it was funny (credit: 1)
Macaw-3B: they thought it was cool
Macaw-large: they thought it was weird
Macaw-answer-11B: they thought it was funny (credit: 1)
GPT3-davinci: They thought it was a parrot. (credit: 1)
Jurassic-1-jumbo: They thought it was cool. (credit: 1)
T5-XXL-SSM-NQ: other children (credit: 0)
T5-11B-SSM-NQ: Josh
T5-XL-SSM-NQ: hated it
T5-large-SSM-NQ: negative
T5-small-SSM-NQ: "Fatal Distraction"

Q292: Josh had a parrot that talked. He brought his parrot to school. During show and tell, Josh's parrot said a bad word. The teacher told Joshua not to bring his bird again. When Josh got home, he was grounded. Did the other children in Josh's class mind that the parrot had said a bad word?

Macaw-11B: no, they didn't mind (credit: 1)
Macaw-3B: no
Macaw-large: they were happy that Josh told them
Macaw-answer-11B: no (credit: 1)
GPT3-davinci: No, they didn't mind. They were used to it. (credit: 1)
Jurassic-1-jumbo: No, they didn't mind. (credit: 1)
T5-XXL-SSM-NQ: did not care (credit: 1)
T5-11B-SSM-NQ: none
T5-XL-SSM-NQ: did not
T5-large-SSM-NQ: did they
T5-small-SSM-NQ: "Frank's father"

Q293: Josh had a parrot that talked. He brought his parrot to school. During show and tell, Josh's parrot said a bad word. The teacher told Joshua not to bring his bird again. When Josh got home, he was grounded. How did Josh's parents find out about the parrot saying a bad word?

Macaw-11B: they heard it on the news (credit: 0)
Macaw-3B: the teacher told them
Macaw-large: called the school
Macaw-answer-11B: they heard it on the news (credit: 0)
GPT3-davinci: The parrot told them. (credit: 0)
Jurassic-1-jumbo: The parrot told his parents. (credit: 0)
T5-XXL-SSM-NQ: called the police (credit: 0)
T5-11B-SSM-NQ: the teacher
T5-XL-SSM-NQ: Josh
T5-large-SSM-NQ: accidentally being artificially inseminated
T5-small-SSM-NQ: "Fatal Distraction"

Q294: Josh had a parrot that talked. He brought his parrot to school. During show and tell, Josh's parrot said a bad word. The teacher told Joshua not to bring his bird again. When Josh got home, he was grounded. Who grounded Josh?

Macaw-11B: his mother (credit: 1)
Macaw-3B: his mother
Macaw-large: the school
Macaw-answer-11B: his parents (credit: 1)
GPT3-davinci: His parrot. (credit: 0)
Jurassic-1-jumbo: His mom. (credit: 1)
T5-XXL-SSM-NQ: his father (credit: 1)
T5-11B-SSM-NQ: his father
T5-XL-SSM-NQ: his parents
T5-large-SSM-NQ: the teacher
T5-small-SSM-NQ: "The Little Rascals

Q295: Karen was assigned a roommate her first year of college. Her roommate asked her to go to a nearby city for a concert. Karen agreed happily. The show was absolutely exhilarating. What happened that might cause Karen to become good friends with her roommate?

Macaw-11B: they had a good time together (credit: 1)
Macaw-3B: they had a great time
Macaw-large: she made new friends
Macaw-answer-11B: they had a good time together (credit: 1)
GPT3-davinci: Karen and her roommate were both arrested for smoking marijuana in the parking lot. (credit: 1)
Jurassic-1-jumbo: Karen's roommate asked her to go to a nearby city for a concert. Karen agreed happily. The show was absolutely exhilarating. (credit: 0)
T5-XXL-SSM-NQ: falling in love (credit: 1)
T5-11B-SSM-NQ: Karen's parents were divorced
T5-XL-SSM-NQ: Karen Cartwright
T5-large-SSM-NQ: her father died
T5-small-SSM-NQ: "Future Distraction"

Temporal

Q296: Why were Neanderthals unable to own Aristotle's books?

Macaw-11B: they didn't have writing (credit: 0)
Macaw-3B: they were too small
Macaw-large: they were unable to read
Macaw-answer-11B: they didn't have writing (credit: 0)
GPT3-davinci: Because they couldn't read. (credit: 0)
Jurassic-1-jumbo: Because they were Neanderthals. (credit: 0)
T5-XXL-SSM-NQ: unable to write (credit: 0)
T5-11B-SSM-NQ: The Library of Alexandria
T5-XL-SSM-NQ: lacking the ability to read
T5-large-SSM-NQ: copyright reasons
T5-small-SSM-NQ: to represent the Jews

Q297: Moshe posted on Facebook a photograph showing Maurice Ravel, Francois Poulenc, Frederic Mompou, and Erik Satie. Satie died in 1925. Poulenc was born in 1899. So the photograph must have been taken when?

Macaw-11B: before 1925 (credit: 0.5)
Macaw-3B: before 1925
Macaw-large: 1899
Macaw-answer-11B: before 1925 (credit: 0.5)
GPT3-davinci: The photograph was taken in the year 1875. (credit: 0)
Jurassic-1-jumbo: The photograph was taken in 1925. (credit: 0.5)
T5-XXL-SSM-NQ: 1924 (credit: 0.5)
T5-11B-SSM-NQ: 1924
T5-XL-SSM-NQ: 1926
T5-large-SSM-NQ: 1924
T5-small-SSM-NQ: 1904

Winograd

Q298: The trophy couldn't fit into the box because it was too big. What was too big?

Macaw-11B: the trophy (credit: 1)
Macaw-3B: the trophy
Macaw-large: the trophy
Macaw-answer-11B: the trophy (credit: 1)
GPT3-davinci: The trophy. (credit: 1)
Jurassic-1-jumbo: The trophy. (credit: 1)
T5-XXL-SSM-NQ: the XL5 (credit: 0)
T5-11B-SSM-NQ: 24 inches
T5-XL-SSM-NQ: the Heisman Trophy
T5-large-SSM-NQ: football
T5-small-SSM-NQ: , a Wilson volleyball

Q299: The elephant couldn't fit into the box because it was too big. What was too big?

Macaw-11B: the box (credit: 0)
Macaw-3B: the elephant
Macaw-large: the elephant's body
Macaw-answer-11B: the elephant (credit: 1)
GPT3-davinci: The elephant. (credit: 1)
Jurassic-1-jumbo: The elephant. (credit: 1)
T5-XXL-SSM-NQ: its trunk (credit: 0)
T5-11B-SSM-NQ: too heavy
T5-XL-SSM-NQ: an elephant
T5-large-SSM-NQ: how to cope
T5-small-SSM-NQ: , a Spartan

Q300: A man is watching television. The elephant couldn't fit in the box because it was too big. What was too big?

Macaw-11B: the elephant (credit: 1)
Macaw-3B: elephant
Macaw-large: the elephant's trunk
Macaw-answer-11B: the elephant (credit: 1)
GPT3-davinci: The elephant. (credit: 1)
Jurassic-1-jumbo: The elephant. (credit: 1)
T5-XXL-SSM-NQ: its trunk (credit: 0)
T5-11B-SSM-NQ: too heavy
T5-XL-SSM-NQ: an elephant
T5-large-SSM-NQ: television
T5-small-SSM-NQ: television film director James Cameron

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

examples.md

examples.md

Model outputs for diverse probing questions

Commonsense

Comparison

Entity substitution

Entity tracking

Estimation

Example generation

Explanation

False presupposition

General knowledge

Generation

History

Human behavior

Hypothetical

Math

Meta-reasoning

Riddle

Science

Spatial

Steps

Story understanding

Temporal

Winograd

Files

examples.md

Latest commit

History

examples.md

File metadata and controls

Model outputs for diverse probing questions

Commonsense

Comparison

Entity substitution

Entity tracking

Estimation

Example generation

Explanation

False presupposition

General knowledge

Generation

History

Human behavior

Hypothetical

Math

Meta-reasoning

Riddle

Science

Spatial

Steps

Story understanding

Temporal

Winograd