Skip to content

Commit

Permalink
Update scraper.py
Browse files Browse the repository at this point in the history
  • Loading branch information
yngveny committed Sep 27, 2017
1 parent 8607178 commit bf1233b
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion scraper.py
Expand Up @@ -43,7 +43,7 @@ def scrape_dof(url):
# Finally, save the record to the datastore - 'Name' is our unique key
scraperwiki.sqlite.save(["Dofref"], record)

doflist = ['www.doffin.no/Notice?query=&PageNumber=1&PageSize=20&OrderingType=0&OrderingDirection=1&RegionId=&CountyId=&MunicipalityId=&IsAdvancedSearch=false&location=&NoticeType=3&PublicationType=&IncludeExpired=false&Cpvs=&EpsReferenceNr=&DeadlineFromDate=&DeadlineToDate=&PublishedFromDate=&PublishedToDate=']
doflist = ['www.doffin.no/Notice?query=&PageNumber=1&PageSize=20&OrderingType=0&OrderingDirection=1&NoticeType=3&IncludeExpired=false']
for url in doflist:
fullurl = 'http://'+url
print 'scraping ', fullurl
Expand Down

0 comments on commit bf1233b

Please sign in to comment.