Skip to content

Commit

Permalink
Add comment_url back
Browse files Browse the repository at this point in the history
  • Loading branch information
henare committed Apr 26, 2016
1 parent a6aa057 commit c884cec
Showing 1 changed file with 4 additions and 4 deletions.
8 changes: 4 additions & 4 deletions scraper.rb
Expand Up @@ -3,7 +3,7 @@

agent = Mechanize.new

comment_url = "http://www.melbourne.vic.gov.au/BuildingandPlanning/Planning/planningpermits/Pages/Objecting.aspx"
comment_url = "mailto:planning@melbourne.vic.gov.au"
base_url = "http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx"

# Get applications from the last two weeks
Expand All @@ -28,9 +28,9 @@
all_urls.each do |url|
puts "Fetching #{url}"
p = agent.get(url)
# Comment URl has been removed from the new version of the detailed view of the Application ID
#"comment_url" => comment_url
record = {"info_url" => url, "date_scraped" => Date.today.to_s }

record = {"info_url" => url, "comment_url" => comment_url, "date_scraped" => Date.today.to_s}

p.at('.permit-detail').search('tr').each do |tr|
heading = tr.at('th').inner_text
value = tr.at('td').inner_text
Expand Down

0 comments on commit c884cec

Please sign in to comment.