Skip to content

Commit

Permalink
Merge pull request #120 from Lukas0907/master
Browse files Browse the repository at this point in the history
Sometimes there is a space at the end of the link which leads to a 404.
  • Loading branch information
Lukas0907 committed Jun 28, 2018
2 parents 4687946 + 9a45206 commit a139825
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion feeds/spiders/orf_at.py
Original file line number Diff line number Diff line change
Expand Up @@ -101,7 +101,8 @@ def parse_node(self, response, node):
):
self.logger.debug("Ignoring link to '{}'".format(link))
else:
yield scrapy.Request(link, self._parse_article, meta=meta)
# Sometimes there is a space at the end of a link ...
yield scrapy.Request(link.strip(), self._parse_article, meta=meta)

def _parse_article(self, response):
try:
Expand Down

0 comments on commit a139825

Please sign in to comment.