This lesson summarizes the topics we'll be covering in section 04 and why they'll be important to you as a data scientist.
You will be able to:
- Understand and explain what is covered in this section
- Understand and explain why the section will help you to become a data scientist
In this section, we're going to continue to hone our exploratory data analysis skills.
Sometimes you want to write a little function in Python "on the fly" to solve a problem - often to be applied to a collection of data to clean it up. Lambda functions are Pythons tool for writing a function just where you need to use it. So we'll kick off the section introducing and then practicing Lambda functions so you have another tool at your disposal for cleaning up data.
We'll then look at how you can split, apply and combine DataFrames so you can bring together data from mutliple sources into a singel larger data set.
We'll then learn about the various ways we can index and structure our data sets to make it easier to process or understand, using aggregation functions and pivot tables.
From there, we'll then go on to looking at a numnber of common techniques for dealing with missing data - the bane of a data scientists existance!
Finally, we'll finish up section 4 with an open ended project where you get plenty of experience cleaning up date using the skills you just learned.
In this section, we're digging deeper into the tools required to import, combine and clean up data.