Skip to content

Commit

Permalink
Add new URL seed list.
Browse files Browse the repository at this point in the history
  • Loading branch information
juhanurmi committed Oct 2, 2017
1 parent 0e4677e commit 358aae7
Showing 1 changed file with 5 additions and 2 deletions.
7 changes: 5 additions & 2 deletions ahmia/ahmia/spiders/onionspider.py
Expand Up @@ -20,8 +20,11 @@ class OnionSpider(WebSpider):
'http://msydqstlz2kzerdg.onion/address/',
'http://msydqstlz2kzerdg.onion/add/onionsadded/',
'https://blockchainbdgpzk.onion/',
'http://7cbqhjnlkivmigxf.onion/',
'http://zlal32teyptf4tvi.onion/']
'http://7cbqhjnlkivmigxf.onion/']

url = "http://zlal32teyptf4tvi.onion/?search=&rep=n%2Fa&page="
for index in range(1,100):
default_start_url.append( url + str(index) )

def get_link_extractor(self):
return LinkExtractor(allow=r'^http://[a-z2-7]{16}.onion',
Expand Down

0 comments on commit 358aae7

Please sign in to comment.