Skip to content
This repository has been archived by the owner on Jan 21, 2022. It is now read-only.

owen-brooks/craigslist-car-finder

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

22 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

craigslist-car-finder

web app to gather nation-wide car listings

Check out the intro I wrote on web scraping here.

purpose

For people who like weird / rare cars, Craigslist is a great resource. Unlike other items sold on Craigslist, a car buyer will often be willing and sometimes have no choice but to search nationwide for the right car. This application allows users to search across all US Craigslist pages, for the car they are looking to buy.

alt text

features

Currently a search collects the following data from a post:

  • Posting ID
  • Price
  • Post title
  • State
  • Link to post

For example - a search for "Datsun 510" will return the following:

alt text

Each row is clickable, and will open the Craiglist post in another tab.

code

Overview of file structure:

|___ scraper
        |___ URLScraper.py
        |___ CarScraper.py
|___ run.py
|___ app.yaml
|___ app
        |___ controller.py
        |___ __init__.py
        |___ static
                |___ images
                        |___ retro.jpg
                |___ style.css
        |___ templates
                |___ search.html
|___ requirements.txt
|___ docs
        |___ results.png
        |___ home.png
|___ README.md

TODO

  • Deploy to Google Cloud. Has all the files, just need to create app and collect requirements
  • Collect additional data (transmission type, fuel, title, etc.)
  • Try to present cars as images. This can be tough to scale - it seems the sites for different regions, label the post images in HTML differently

About

web scraper to gather nation-wide car listings

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published