Skip to content

Use BeautifulSoup and Splinter to scrape full-resolution images of Mars’s hemispheres and the titles of those images, store the scraped data on a Mongo database, use a web application to display the data, and alter the design of the web app to accommodate these images.

Notifications You must be signed in to change notification settings

klaudio07/Mission-to-Mars

Repository files navigation

Mission-to-Mars

Project Overview

Automate a web browser to visit different websites to extract data about the Mission to Mars.

Goal

  • Gain familiarity with and use HTML elements, as well as class and id attributes, to identify content for web scraping.

  • Use BeautifulSoup and Splinter to automate a web browser and perform a web scrape.

  • Create a MongoDB database to store data from the web scrape.

  • Create a web application with Flask to display the data from the web scrape.

  • Create an HTML/CSS portfolio to showcase projects.

  • Use Bootstrap components to polish and customize the portfolio.

Deliverables

Use Python, Pandas, the ETL process, and code refactoring, write a function that reads in the three data files and creates three separate DataFrames

Use knowledge of Python, Pandas, the ETL process, and code refactoring, extract and transform the Wikipedia data so you can merge it with the Kaggle metadata.

Extract and transform the Kaggle metadata and MovieLens rating data, then convert the transformed data into separate DataFrames. Then, you’ll merge the Kaggle metadata DataFrame with the Wikipedia movies DataFrame to create the movies_df DataFrame.

About

Use BeautifulSoup and Splinter to scrape full-resolution images of Mars’s hemispheres and the titles of those images, store the scraped data on a Mongo database, use a web application to display the data, and alter the design of the web app to accommodate these images.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published