Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
Browse files

Replace broken Pittwater scraper

  • Loading branch information...
commit 6071359873f4783284943b1daacf6b039f5b271c 1 parent 1ee92c1
@henare henare authored
Showing with 1 addition and 30 deletions.
  1. +1 −1  scraper_factory.rb
  2. +0 −29 scrapers/pittwater_scraper.rb
View
2  scraper_factory.rb
@@ -97,7 +97,7 @@ def self.scrapers
WaggaWaggaScraper.new("City of Wagga Wagga", "Wagga Wagga", "NSW"),
GriffithScraper.new("Griffith City Council", "Griffith", "NSW"),
PenrithScraper.new("Penrith City Council", "Penrith", "NSW"),
- PittwaterScraper.new("Pittwater Council", "Pittwater", "NSW"),
+ ScraperWikiScraper.new("Pittwater Council", "Pittwater", "NSW", "pittwater_council_development_applications"),
WyongScraper.new("Wyong Shire Council", "Wyong", "NSW"),
NorthSydneyScraper.new("North Sydney Council", "North Sydney", "NSW"),
HawkesburyScraper.new("Hawkesbury City Council", "Hawkesbury", "NSW"),
View
29 scrapers/pittwater_scraper.rb
@@ -1,29 +0,0 @@
-require 'info_master_scraper'
-
-class PittwaterScraper < InfoMasterScraper
- def applications(date)
- base_path = "http://portal.pittwater.nsw.gov.au/internet/modules/TrackingDA/"
- base_url = base_path + "default.aspx"
- raw_table_values(date, "#{base_url}?page=search", 1).map do |values|
-
- #Example description column in applications listing:
- #NUM ROAD, SUBURB
- #DESCRIPTION TEXT
- #Applicant: ...
-
- da = DevelopmentApplication.new(
- :application_id => extract_application_id(values[1]),
- :date_received => extract_date_received(values[2]),
- :address => extract_address(values[3]),
- :description => extract_description(values[3],1..1)
- )
-
- application_number = da.application_id
- application_year=""
-
- da.info_url = URI.escape(base_path + extract_info_url(values[0]))
- da.comment_url = da.info_url
- da
- end
- end
-end
Please sign in to comment.
Something went wrong with that request. Please try again.