okcupid_scraper

Welcome to read my blog, or connect with me on LinkedIn.

Background

40 million Americans indicated that they used online dating services at least once in their life, which got my attention — Who are these people? How do they behave online? This is why I did this web scraping project during the study at NYC Data Science Academy.

Introduction

Demographics analysis (age and location distribution), along with some psychological analysis (who are pickier? who are lying?) are included in this project. Analysis is based on 2,054 straight male, 2,412 straight female, and 782 bisexual mixed gender profiles scraped from Okcupid.

Distribution Map

Georeferenced heat map shows the user distribution around the world: https://chengfzchn.cartodb.com/viz/9b404876-1acd-11e5-9ef1-0e5e07bb5d8a/public_map

What's Included

Source code is included in OkcupidScraper.ipynb. High level project information and data analysis part is included in Introduction.pdf.