Small fixes to EN training data

[ozancaglayan]

Hello,

I had these changes hanging around for quite some time from my thesis. I don't think it'll change anything substantial, but for correctness, I suggest the following changes to detokenize some pre-tokenized words/expressions (+ 1 S.C.U.B.A occurrence to scuba as it is occurring more frequently):

--- train.en	2020-10-28 10:34:44.453252639 +0000
+++ train.en.new	2020-10-28 10:36:56.671872154 +0000
@@ -558,8 +558,8 @@
 A boy poses for a picture and in the background a man is hanging by a rope.
 Two people are sitting with their backs facing cotton candy.
 A girl in a yellow dress with the sun shining on her face
-Eight gentlemen are working with stone & tile.
-2 women wearing brightly colored clothes are sitting next to a dirt road on a rock having a conversation while they 're watching the field.
+Eight gentlemen are working with stone & tile.
+2 women wearing brightly colored clothes are sitting next to a dirt road on a rock having a conversation while they're watching the field.
 Two men in black eating a sandwich.
 Closeup of a man in a bar, holding his glasses slanted in front of his face.
 A boy is sitting on rectangular blocks.
@@ -3155,7 +3155,7 @@
 An Asian boy is leaning against a pole.
 A ballerina teacher is showing a young girl how to position herself.
 A boy reads at a desk in front of closed blinds.
-People walking down the street past a Lounge & Grill.
+People walking down the street past a Lounge & Grill.
 Two young kids are in a hut.
 Young people are using computers next to each other.
 Three men in a rustic cabin working with laptops.
@@ -3508,7 +3508,7 @@
 The greyhound dogs are racing along a dirt path with buildings nearby.
 Three men stand outside a restaurant smoking and conversing.
 A man flips barbecue chicken legs while another chef watches.
-A S.C.U.B.A. diver swims in deep blue water.
+A scuba diver swims in deep blue water.
 A man is rowing on his boat through very still water.
 A little boy in a red shirt holding a superman produce and staring at an older man.
 Three people walking through a ravine between two rocky cliffs.
@@ -3910,7 +3910,7 @@
 One woman painting the other one's face for a carnival.
 A woman pulls an inflatable boat into the water.
 A woman holding a water bottle is running on the beach.
-Many people of Indian descent wearing bright, colorful clothing & walking up steep flights of stairs.
+Many people of Indian descent wearing bright, colorful clothing & walking up steep flights of stairs.
 A big black dog carries a blue ball while two Corgis run at his side.
 A little boy is watching a palace guard stand outside a little black hut.
 Two dogs are playing in the white snow.
@@ -4002,7 +4002,7 @@
 Six small children in coats are gathered around a food cart selling chestnuts for 2.00 Euros.
 A construction worker overseeing someone digging with a machine.
 A bunch on people are seated in a stadium.
-The images aren't showing up, so I 'm going to assume the picture is lovely.
+The images aren't showing up, so I'm going to assume the picture is lovely.
 Two boys eating apples playing on a cement car barrier
 Boy with a painted face is walking around a track.
 A band is on stage playing music, led by a man wearing a suit.
@@ -4524,7 +4524,7 @@
 Two men and a child are using a ruler on a wall.
 Indian man with elephant and group of indian children in temple.
 A boy has a spiked bracelet and a strange glove on.
-A man known as Deleon speaks at a Q&A.
+A man known as Deleon speaks at a Q&A.
 Man with glasses on speaking in a microphone surrounded by a group of people.
 A small child plays with a batman toy car
 A lady wearing a green sweater is putting candy on a shelf.
@@ -4600,7 +4600,7 @@
 A child is playing among a flock of birds in the park.
 A Food Vendor selling food at a street market.
 An Asian woman in black clothing is sitting in a public place.
-The building is covered with red & black graffiti.
+The building is covered with red & black graffiti.
 A man in a canoe paddles while another man tosses a net out into a large body of water.
 A normal sunny day in a big city.
 A big black dog bares its teeth while running through the snow.
@@ -5212,7 +5212,7 @@
 A few people and cars out on their daily commute on a rainy day.
 A girl sits in a car wearing sunglasses and a hat.
 One man is standing in a red room while another person sits next to him.
-A female Texas A&M tennis player dribbling the tennis ball.
+A female Texas A&M tennis player dribbling the tennis ball.
 Two men in white shirts with matching logos inspect the engine of a vintage red convertible.
 A man is banging on pots and pans in his kitchen.
 There is a man walking with a bag in front of a black square paneled wall.
@@ -7087,7 +7087,7 @@
 A man and women are rock climbing.
 A young asian boy in a orange long-sleeved t-shirt holds a magazine.
 A bridesmaid in a knee-length blue dress walks down the aisle with a grooms-man.
-A man in a yellow tie and shirt is making the "hook 'em horns" sign.
+A man in a yellow tie and shirt is making the "hook'em horns" sign.
 A woman and man are standing together.
 A bride and groom dance at their wedding reception.
 Bride eating wedding cake from her new husband's shirt.
@@ -8003,7 +8003,7 @@
 A man in a yellow jacket is skiing in the snow.
 A saxophone player dressed in a blue sweatshirt and an accordion player entertain people on the street, including a pirate.
 An Indian man standing on the bank of a river.
-Yellow team vs Red team kicking a blue & white soccer ball.
+Yellow team vs Red team kicking a blue & white soccer ball.
 A little boy is approaching the soccer ball to kick it.
 A man with a beard and sunglasses leans back on a couch with his feet on a coffee table.
 A baby in pink clothes staring at corn on the cob
@@ -8283,7 +8283,7 @@
 A large group of people are at a beach.
 A man walking along a road next to a blue building and red stop sign.
 A dog is playing catch on the grassy plain
-A woman opens a gift while standing in a dining room that has been festively decorated : her face is obstructed by one of the decorations.
+A woman opens a gift while standing in a dining room that has been festively decorated: her face is obstructed by one of the decorations.
 A little dog plays with a colorful ball in the sand.
 A black and white dog jumping in the air to catch a white Frisbee.
 Black dog jumping into the air to catch a Frisbee.
@@ -9182,7 +9182,7 @@
 Three women are climbing a wire tower while wearing little clothing.
 Several people are eating and talking while another plays the piano.
 Asian man walking in a muddy stream pushing a wooden tool.
-Two cowboys on horses chase a young cow with lassos'.
+Two cowboys on horses chase a young cow with lassos.
 A large construction site with many vehicles in a city.
 A boy with a yellow shirt and gray pants playing ball alone.
 A dirt road that has trees on one side and run down buildings on the other.
@@ -11974,7 +11974,7 @@
 A man with a white beard is wearing an apron and in the kitchen.
 Two men are playing in a band.
 A man in a white restaraunt shirt smokes next to a dumpster.
-Dancers pose in front of a multicolored, drawn (art ) backdrop.
+Dancers pose in front of a multicolored, drawn (art) backdrop.
 A dog runs along a beach near the waves.
 Two little girls walk down a big desert.
 A dark-haired woman in a black outfit and black high heels is posing for a picture with cacti in the background.
@@ -12585,7 +12585,7 @@
 A dancing troupe of African American youngsters doing a choreographed move.
 A row of birds is sitting in front of a gray cloud.
 Someone is looking at the beautiful view of the city.
-A man in the middle of the section for women's lifestyle magazines reads a magazine that declares "I 'm Pregnant!"
+A man in the middle of the section for women's lifestyle magazines reads a magazine that declares "I'm Pregnant!"
 A black limo is parked next to a crowded staircase.
 A lady wearing a butcher's apron is singing on a stage while her band plays behind her
 A barefooted guy in an orange shirt and black pants jumping on a trampoline in a cage.
@@ -12915,7 +12915,7 @@
 Two men sit on a chairlift.
 A group of people have a candlelight vigil in honor of saving trees.
 A pregnant protester holding up a pro-America sign.
-A man in jeans & a cowboy hat holds up a sign.
+A man in jeans & a cowboy hat holds up a sign.
 A man mowing a lawn at a commercial property.
 Muzzled greyhounds are racing along a dog track at night.
 A man wearing a backpack and helmet riding a bicycle.
@@ -13388,7 +13388,7 @@
 A crowd is standing in front of a building while holding newspapers and holding flags.
 Three girls with head wraps carrying objects while standing on unpaved surface.
 A couple sit on a park bench with purple balloons tied to it.
-A contestant in horseback sword fighting- the crowd looks on.
+A contestant in horseback sword fighting - the crowd looks on.
 A woman carrying a purse walks by a shop.
 Two dogs run in a field.
 A lady standing near the counter of a bakery smiling at the camera.
@@ -14348,7 +14348,7 @@
 A lone bicyclist wearing a helmet jumping a graffitied concrete ramp.
 A bulldozer on a beach with no water.
 A large brown dog sits next to a small white dog in a field of long grass.
-The Canadian biker sponsored by H&R Block rides by.
+The Canadian biker sponsored by H&R Block rides by.
 A woman is riding her bike in a bike race.
 A man holds up a contestant in a bicycle race.
 Three children are wearing face paint and smiling.
@@ -14872,7 +14872,7 @@
 A lady wearing red glasses and a floral shirt speaks to passengers in a bus.
 A boy sticks an aligator puppet out of a camper van window.
 A man and a woman sit back-to-back on a bench outside a storefront.
-A man is walking by Brenmark Tools & Fasteners.
+A man is walking by Brenmark Tools & Fasteners.
 An older man in a gray shirt standing by a building that has meat hanging out to dry.
 A family sits at a park while birds fly around.
 The dog runs next to the crashing waves of the ocean.
@@ -16751,7 +16751,7 @@
 Black male wearing Run DMC t-shirt giving another black male a haircut
 Three men are gathered around while one is operating a camera.
 The black boy in the gray t-shirt is shaking his hands.
-Man outside in the rain promoting a 50 % off sale.
+Man outside in the rain promoting a 50% off sale.
 Young women in colorful costumes raise their hands in happiness.
 A man in a gray shirt gets his hair done with people standing around him.
 A riot breaks out in the streets of an Asian city.
@@ -17168,7 +17168,7 @@
 A child is pushing or kicking a bird with his foot.
 A old couple is playing musical instrument on a street corner.
 A bearded man reads while sitting on a wall in a park.
-Two gentleman standing outside a Smoothies & Bubble Tea vendor.
+Two gentleman standing outside a Smoothies & Bubble Tea vendor.
 Two large cones are outside, in the street, in front of a large building.
 A couple of boys are in a gym with partially assembled bicycles.
 Two men on motorcycles, one with a silver helmet and the other with a black helmet, riding in a city, with a boy with a white long-sleeve shirt on, approaching one of the motorcycles.
@@ -20941,7 +20941,7 @@
 People are playing soccer on the grass.
 Two young people are standing in the doorway of a room filled with pink, white, and red balloons.
 A man and a woman in suits are walking in front of a wall.
-2 rows of woman walking towards each other on the sidewalk outside of a store with a boy 50 % sign on the golden framed windows.
+2 rows of woman walking towards each other on the sidewalk outside of a store with a boy 50% sign on the golden framed windows.
 A man, wearing a black hat, carving a design into wood.
 A scene in a street, where one has shopping bags and the other is asking for directions.
 A man sits on the ground under a sign.
@@ -21069,7 +21069,7 @@
 A father reading a picture book to his young daughter.
 A man and a woman are jumping from a pier into a lake.
 Man holding a blue sash that is around a woman wearing a black robe.
-A gas station name m&h with gas the price of $ 2.52.
+A gas station name m&h with gas the price of $2.52.
 A blond girl in a swing wearing Crocs.
 Black male vendor staying cool under his white umbrella waiting for customers.
 A man playing a keyboard in an empty subway station.
@@ -22193,7 +22193,7 @@
 People walking on a crowded street.
 A woman in a dress and cowboy boots is walking next to another woman in a black t-shirt.
 Woman in a long skirt and a man walk down the street.
-A group of men perform on the sidewalk with their guitars'.
+A group of men perform on the sidewalk with their guitars.
 Two young girls pose for a picture beside the water.
 Two shirtless little boys, one leaning on the other, standing on a large rock in front of some trees.
 The boardwalk is very brightly lit by restaurant signs at night.
@@ -22973,7 +22973,7 @@
 People sitting outside in a park on a rock.
 Two women are talking to each other on a street.
 A young woman having some break on a big perimeter wall.
-Two teenage boys are racing- the one with long hair is winning.
+Two teenage boys are racing - the one with long hair is winning.
 A man wearing a green long-sleeved shirt is running.
 Young boy in white shirt runs on a track holding a marker.
 Several people are standing at a bus stop.
@@ -23645,7 +23645,7 @@
 A woman is kneeling near lanterns while a little boy plays in the sand.
 A man holding out a deflated soccer ball to a gray dog.
 Two girls dressed in white and one dressed in brown.
-A man in a suit jacket with a  free word  sign.
+A man in a suit jacket with a free word sign.
 Man look through a telescope in a city.
 A man and child underwater in a swimming pool holding their breath.
 A little girl planting her first flower in the sand.
@@ -26050,11 +26050,11 @@
 A man wearing blue, holding two fishing poles with one pointing upward and the other one in the water with fish being caught.
 A woman is jumping in the air on a tree-lined trail on an autumn day.
 Three men playing football where one guy wearing a red uniform is holding the football, the second guy wearing a red uniform and the third guy wearing a white uniform.
-A Texas A&M football player running with the ball.
+A Texas A&M football player running with the ball.
 There is a group of nine young women wearing long black dresses holding folders, standing on metal bleachers and singing in front of a group of people.
 These two men are going for the ball at a soccer match.
 One man in a dress dances as another man stands by a ladder and faces the other way.
-Texas A&M's Ryan Tannehill is nearly sacked by an Iowa State player.
+Texas A&M's Ryan Tannehill is nearly sacked by an Iowa State player.
 A cross guard helps people get across the street.
 A husky women with a red hat, directs traffic.
 A man in blue with his mouth open beside a medical apparatus.
@@ -26080,7 +26080,7 @@
 A dinner party is occurring with numerous people who are all wearing crowns and eating food at a candle lit dining room.
 A pro cyclist in blue, yellow and white biking clothes.
 Two females are in a chemistry classroom; one is pouring a solution into a beaker.
-Hopefully when I mix these I 'll still have eyebrows.
+Hopefully when I mix these I'll still have eyebrows.
 A group of young high school or college students are smiling while performing a science experiment involving beakers and the transfer of liquids
 A scientist really deep into his experiment.
 A large woman with a pink feather boa strolls down the sidewalk.
@@ -26469,7 +26469,7 @@
 A young boy colors on small sheets of paper.
 A little girl making arts and crafts with small umbrellas and corks.
 Children making crafts at a craft table with one adult.
-A child is doing an activity involving a circular disk with radiating lines on it ( in red and blue, a glue stick, and cut-out numbers.
+A child is doing an activity involving a circular disk with radiating lines on it (in red and blue, a glue stick, and cut-out numbers.
 A small child is learning about electricity with wires.
 An electronic device is being worked on by a woman.
 A child is interacting with an electronics laboratory kit.
@@ -26521,7 +26521,7 @@
 A Spanish looking woman carries a heavy red bag slouched over her shoulder.
 A group of people are exercising in a yard and have their hands touching over their heads.
 A guitarist is performing music on stage.
-Little boy attempting to help mom do dishes & play in the bubbles.
+Little boy attempting to help mom do dishes & play in the bubbles.
 Two men, one playing a horn and the other playing a sax on a dimly lit stage.
 Two women dressed in red gypsy clothing dance around in the dark.
 A blue race car is parked on the road.
@@ -26636,7 +26636,7 @@
 A team is huddled up on the playing field, wearing blue shirts and blue and red shorts.
 A man in bright colors is being helped to perform his routine.
 A soccer player wearing a red and white uniform catching the ball for a score as the opponent wearing a blue and white uniform is in the background along with a crowd of people watching the game
-Several soccer players in defensive position( s ) on the ground during a game.
+Several soccer players in defensive positions on the ground during a game.
 A man in blue pants is behind a car parked on grass outside of a brick gateway.
 A child in a sweatshirt and jean skirt squatting.
 Photographer captures his shadow as he photographs young boys mingling on the lawn.
@@ -26664,7 +26664,7 @@
 Two players face off in ice-hockey as the referee has just thrown the puck onto the ice.
 Two men in red shirts and blue pants are playing hockey.
 Two black dogs are fighting in front of a tan sofa.
-I 'm really hurting after that ball bounced off my forehead.
+I'm really hurting after that ball bounced off my forehead.
 A woman carrying a tray with drinks on it.
 A woman is covered up completely and fixing a machine.
 A man with a yellow hard hat on is working above some water.
@@ -28605,7 +28605,7 @@
 A man wearing a hat is selling sunglasses outside.
 A group of people standing on public transit, two in the foreground are reading newspapers.
 A crowd of people at a Jewish celebration.
-An overweight man and woman are walking on a street past a Coffee & Tea shop.
+An overweight man and woman are walking on a street past a Coffee & Tea shop.
 A cowgirl is riding a horse while chasing a brown bull.
 A woman in a cowboy hat on a horse chases a calf around a dirt ring.
 Dog swims in the water

[Um-dude-thats-like]

A girl in a mini skirt with ripped leggings underneath and a crop top with a smile and a sword