Skip to content

Latest commit

 

History

History
514 lines (254 loc) · 21.4 KB

README_more_samples.md

File metadata and controls

514 lines (254 loc) · 21.4 KB

More examples in MM-Vet

MM-Vet example

Q: What is x in the equation?

GT: -1 <AND> -5

Required capabilities: OCR, math


MM-Vet example

Q: What is d in the last equation?

GT: 1.25 <OR> 5/4

Required capabilities: OCR, math


MM-Vet example

Q: What is the total price for a bottle of Merlot and a bottle of Cabernet shown in the image?

GT: 249.98

Required capabilities: OCR, spatial awareness, math


MM-Vet example

Q: I am getting one funghi pizza and one prosciutto pizza. How much should I pay in total?

GT: 14.8

Required capabilities: OCR, math


MM-Vet example

Q: What is the price for tomatoes?

GT: eight <OR> 8.0

Required capabilities: recognition, OCR, spatial awareness


MM-Vet example

Q: What earth's interior structure does number 2 indicate?

GT: mantle

Required capabilities: OCR, knowledge, spatial awareness


MM-Vet example

Q: Should I add sugar when mixing egg and milk?

GT: no

Required capabilities: recognition, OCR, spatial awareness


MM-Vet example

Q: What should we add in the third step?

GT: milk

Required capabilities: recognition, OCR, spatial awareness


MM-Vet example

Q: What is the difference in metric tonnes between the amount of plastic produced and the amount discarded?

GT: 105

Required capabilities: OCR, spatial awareness, math


MM-Vet example

Q: What is the estimated average standing charge for the year 2023?

GT: 271

Required capabilities: OCR, spatial awareness, math


MM-Vet example

Q: What are the appliances in the kitchen in this floorplan?

GT: oven <AND> dishwasher

Required capabilities: OCR, spatial awareness


MM-Vet example

Q: What is the solution if the lamp is plugged in and the bulb has burned out?

GT: replace blub

Required capabilities: OCR, spatial awareness


MM-Vet example

Q: What is the average wait time to climb out of bed?

GT: 15 min

Required capabilities: OCR, spatial awareness, math


MM-Vet example

Q: What is Japan's gdp in 2012?

GT: 6,233.15 billion U.S. dollars

Required capabilities: OCR, spatial awareness


MM-Vet example

Q: In which years did rowing and athletics have the same number of gold medals?

GT: 2000 <AND> 2012

Required capabilities: OCR, spatial awareness


MM-Vet example

Q: Which department is the person who has the highest salary from?

GT: Administration

Required capabilities: OCR, spatial awareness


MM-Vet example

Q: What percentage does salary contribute to total income?

GT: 56.2

Required capabilities: OCR, spatial awareness, math


MM-Vet example

Q: Who is the person on the left?

GT: Keira Knightley

Required capabilities: recognition, spatial awareness


MM-Vet example

Q: Which one is unsweetened?

GT: oat

Required capabilities: OCR, spatial awareness


MM-Vet example

Q: What are the calories for the entire bag?

GT: 275

Required capabilities: OCR, math


MM-Vet example

Q: What is the name of this dish?

GT: pad thai

Required capabilities: recognition


MM-Vet example

Q: What is the make of the car on the left?

GT: volkswagen

Required capabilities: recognition, OCR, spatial awareness


MM-Vet example

Q: What is the name of this landmark?

GT: baochu pagoda

Required capabilities: recognition


MM-Vet example

Q: What is the face value of this banknote?

GT: five

Required capabilities: recognition, knowledge


MM-Vet example

Q: What type of currency does this banknote represent?

GT: Swede <OR> Kronor

Required capabilities: recognition


MM-Vet example

Q: Which chest xray disease can be found? (Options include: Atelectasis; Cardiomegaly; Effusion; Infiltration; Mass; Nodule; Pneumonia; Pneumothorax; Consolidation; Edema; Emphysema; Fibrosis; Pleural Thickening; Hernia.)

GT: Cardiomegaly

Required capabilities: recognition, knowledge


MM-Vet example

Q: How many books are there?

GT: 63

Required capabilities: recognition


MM-Vet example

Q: What is all the scene text in the image?

GT: MR. WILLIAM SHAKESPEARES <AND> COMEDIES, HISTORIES, & TRAGEDIES.<AND> publifhed according to the True Originall Copies.

Required capabilities: OCR


MM-Vet example

Q: What is the brand of this device?

GT: MOTOROLA

Required capabilities: OCR


MM-Vet example

Q: What are all the French scene text in the image?

GT: HISTOIRE DE FRANCE <AND> De La préhistoire à ans jours <AND> Queelle Histoire

Required capabilities: OCR


MM-Vet example

Q: Which continent is highlighted?

GT: Asia

Required capabilities: recognition, knowledge


MM-Vet example

Q: Where is this photo taken?

GT: qatar

Required capabilities: recognition, knowledge


MM-Vet example

Q: Are the trees taller than the giraffes?

GT: no

Required capabilities: recognition


MM-Vet example

Q: Is this airplane taking off or landing?

GT: taking off

Required capabilities: recognition


MM-Vet example

Q: Does the giraffe appear dangerous?

GT: no

Required capabilities: recognition


MM-Vet example

Q: Is there any reflection of zebra in water?

GT: yes

Required capabilities: recognition


MM-Vet example

Q: Are all of the cats the same color?

GT: no

Required capabilities: recognition


MM-Vet example

Q: Are there napkins under the utensil to the left of the rice?

GT: yes

Required capabilities: recognition, spatial awareness


MM-Vet example

Q: Is the surfer to the left or to the right of the surfboard?

GT: left

Required capabilities: recognition, spatial awareness


MM-Vet example

Q: Why are the persons wearing black clothes? Answer it and give the rationale.

GT: They are going to a funeral. I think so because it is traditional for people to wear black to a funeral.

Required capabilities: recognition, knowledge, language generation


MM-Vet example

Q: Is the woman in red going to be mad at the man, for looking at the woman in dress? Answer it and give the rationale.

GT: Yes, the woman in red and the man appear to be a couple and the woman in red would not appreciate the man checking out other women. I think so because in a monogamous relationship, partners are expected to be faithful to one another.

Required capabilities: recognition, knowledge, language generation


MM-Vet example

Q: Can you explain this meme?

GT: This meme is a commentary on the current situation of online learning due to the COVID-19 pandemic. It shows how different parties are affected by it.

The first two images show the Zoom company and the teachers throwing money in the air, which implies that they are profiting from the situation. Zoom, in particular, has seen a surge in usage and revenue due to the pandemic.

The third image shows the WiFi company also throwing money in the air, which implies that they are also profiting from the situation as more people are using the internet for online learning.

The last image shows a student with a sad clown face, which implies that students are not benefiting from the situation and are struggling with online learning. The "Put on a happy face" sign in the background further emphasizes the idea that students are putting on a brave face despite their struggles.

Required capabilities: recognition, OCR, knowledge, language generation


MM-Vet example

Q: What is funny about this image?

GT: It is a cartoon of a rhinoceros painting a picture and each picture has its rhino horn because the rhino horn grows in front of its eyes. The caption "You see the world as you are!" is a playful commentary on how our perspective shapes our perception of the world.

Required capabilities: recognition, OCR, knowledge, language generation


MM-Vet example

Q: How to cook this dish?

GT: The dish is called "Hungarian Mushroom Soup". This Hungarian mushroom soup has lots of flavor and is fairly quick to make. It's primarily a mushroom soup but derives a lot of its flavor from other ingredients. My family loves soup and this is one of their favorites.


Prep Time: 15 mins
Cook Time: 35 mins
Total Time: 50 mins
Servings: 6


Ingredients

4 tablespoons unsalted butter
2 cups chopped onions
1 pound fresh mushrooms, sliced
2 cups chicken broth
1 tablespoon soy sauce
1 tablespoon paprika
2 teaspoons dried dill weed
1 cup milk
3 tablespoons all-purpose flour
½ cup sour cream
¼ cup chopped fresh parsley
2 teaspoons lemon juice
1 teaspoon salt
ground black pepper to taste


Directions

Step1
Melt butter in a large pot over medium heat. Add onions; cook and stir until softened, about 5 minutes. Add mushrooms and sauté for 5 more minutes. Stir in broth, soy sauce, paprika, and dill; reduce heat to low, cover, and simmer for 15 minutes.

Step2
Whisk milk and flour together in a separate bowl; stir into soup until blended. Cover and simmer for 15 more minutes, stirring occasionally.

Step3
Add sour cream, parsley, lemon juice, salt, and ground black pepper; stir over low heat until warmed through, about 3 to 5 minutes. Serve immediately.

Required capabilities: recognition, knowledge, language generation


MM-Vet example

Q: How to make this?

GT: This is called "Sparkling Cantaloupe Agua Fresca". This refreshing agua fresca with cantaloupe and lime juice topped with club soda is perfect on a hot day.

Prep Time: 15 mins
Total Time: 15 mins
Servings: 8

Ingredients

2 pounds fresh cantaloupe cubes (6 cups)
2 cups water
6 tablespoons freshly squeezed lime juice (from 2 limes)
3 tablespoons honey
1/4 teaspoon salt
2 cups club soda, chilled

cantaloupe melon balls or cubes, for garnish
lime zest twists, for garnish


Directions

Step 1
Working in batches if needed, blend cantaloupe, water, lime juice, honey, and salt in a blender until smooth. Press through a sieve; discard solids. Add strained juice to a pitcher.

Step 2
Chill until ready to serve. Add club soda just before serving. Serve over ice, and garnish glasses with melon balls and lime zest twists.

Required capabilities: recognition, knowledge, language generation


MM-Vet example

Q: Can you give a short introduction to this movie?

GT: The Shawshank Redemption is a 1994 American drama film written and directed by Frank Darabont, based on the 1982 Stephen King novella Rita Hayworth and Shawshank Redemption. The film tells the story of banker Andy Dufresne (Tim Robbins), who is sentenced to life in Shawshank State Penitentiary for the murders of his wife and her lover, despite his claims of innocence. Over the following two decades, he befriends a fellow prisoner, contraband smuggler Ellis "Red" Redding (Morgan Freeman), and becomes instrumental in a money laundering operation led by the prison warden Samuel Norton (Bob Gunton). William Sadler, Clancy Brown, Gil Bellows, and James Whitmore appear in supporting roles.

Required capabilities: recognition, knowledge, language generation

MM-Vet example 49

Q: Can you give a short introduction to this painting?

GT: Arrangement in Grey and Black No. 1, best known under its colloquial name Whistler's Mother or Portrait of Artist's Mother, is a painting in oils on canvas created by the American-born painter James Abbott McNeill Whistler in 1871. The subject of the painting is Whistler's mother, Anna McNeill Whistler. The painting is 56.81 by 63.94 inches (1,443 mm × 1,624 mm), displayed in a frame of Whistler's own design. It is held by the Musée d'Orsay in Paris, having been bought by the French state in 1891. It is one of the most famous works by an American artist outside the United States. It has been variously described as an American icon and a Victorian Mona Lisa.

Required capabilities: recognition, knowledge, language generation


MM-Vet example

Q: What is this disease (give short introduction) and how to treat it?

GT: It is club root. Affecting most brassica crops (cabbage, broccoli, cauliflower, etc.), club root is a serious plant disease in North American home gardens. It is caused by the soil-borne fungus Plasmodiophora brassicae which infects susceptible plants through root hairs. Diseased roots become swollen, misshapen and deformed (clubbed) often cracking and rotting. As a result, plants have difficulty absorbing water and nutrients properly.

Plants often grow poorly and wilt during the heat of the day; plants often revive during cool nights. Outer leaves may turn yellow, purple or brown. Club root will reduce yields and can cause total crop failure.

Fungal spores can be spread by wind, water and garden tools. Disease development can occur over a wide range of conditions, but is favored by excessive moisture, low soil pH and soil temperatures between 64 and 77˚F. Spores can survive in the soil for as many as 10 years.

Treatment
1. Fungicides will NOT treat this soil-dwelling micro-organism.
2. Choose resistant cultivars when possible.
3. Try to prevent the occurrence of this disease by keeping a clean garden and rotating crops.
4. Keep in mind that the disease spores can persist in the soil for up to 20 years. If club root is present you may want to solarize the soil.*
5. Control susceptible weeds \u2014 mustard, radish, shepherd\u2019s purse \u2014 that may be infected to reduce potential buildup of the disease.
6. Carefully remove infected plants and sterilize garden tools (one part bleach to 4 parts water) after use.
7. Raise your soil\u2019s pH to a more alkaline 7.2 by mixing oyster shell or dolomite lime into your garden in the fall. Simple and affordable soil test kits are available to check pH often.

Required capabilities: recognition, knowledge, language generation


MM-Vet example

Q: What is this disease (give short introduction) and how to treat it?

GT: Joshua Abraham Norton (February 4, 1818 – January 8, 1880), known as Emperor Norton, was a resident of San Francisco, California, who in 1859 proclaimed himself "Norton I., Emperor of the United States". In 1863, after Napoleon III invaded Mexico, he took the secondary title of "Protector of Mexico".

Required capabilities: recognition, knowledge, language generation


MM-Vet example

Q: The graph and table below give information about water use worldwide and water consumption in two different countries.

Summarise the information by selecting and reporting the main features, and make comparisons where relevant.

You should write at least 150 words.

GT: The charts compare the amount of water used for agriculture, industry and homes around the world, and water use in Brazil and the Democratic Republic of Congo.

It is clear that global water needs rose significantly between 1900 and 2000, and that agriculture accounted for the largest proportion of water used. We can also see that water consumption was considerably higher in Brazil than in the Congo.

In 1900, around 500km³ of water was used by the agriculture sector worldwide. The figures for industrial and domestic water consumption stood at around one fifth of that amount. By 2000, global water use for agriculture had increased to around 3000km³, industrial water use had risen to just under half that amount, and domestic consumption had reached approximately 500km³.

In the year 2000, the populations of Brazil and the Congo were 176 million and 5.2 million respectively. Water consumption per person in Brazil, at 359m³, was much higher than that in the Congo, at only 8m³, and this could be explained by the fact that Brazil had 265 times more irrigated land.

Required capabilities: recognition, OCR, language generation, spatial awareness


MM-Vet example

Q: Chorleywood is a village near London whose population has increased steadily since the middle of the nineteenth century. The map below shows the development of the village.

Write a report for a university lecturer describing the development of the village.

You should write at least 150 words.

GT: The map shows the growth of a village called Chorleywood between 1868 and 1994.

It is clear that the village grew as the transport infrastructure was improved. Four periods of development are shown on the map, and each of the populated areas is near to the main roads, the railway or the motorway.

From 1868 to 1883, Chorleywood covered a small area next to one of the main roads. Chorleywood Park and Golf Course is now located next to this original village area. The village grew along the main road to the south between 1883 and 1922, and in 1909 a railway line was built crossing this area from west to east. Chorleywood station is in this part of the village.

The expansion of Chorleywood continued to the east and west alongside the railway line until 1970. At that time, a motorway was built to the east of the village, and from 1970 to 1994, further development of the village took place around motorway intersections with the railway and one of the main roads.

Required capabilities: recognition, OCR, language generation, spatial awareness