Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix Chile Compra Bulk #437

Merged
merged 9 commits into from
Jun 30, 2020
Merged

Fix Chile Compra Bulk #437

merged 9 commits into from
Jun 30, 2020

Conversation

yolile
Copy link
Member

@yolile yolile commented Jun 29, 2020

closes #375 #408

Signed-off-by: Yohanna Lisnichuk <yohanitalisnichuk@gmail.com>
Signed-off-by: Yohanna Lisnichuk <yohanitalisnichuk@gmail.com>
…e into 375-chile-bulk-fix

Signed-off-by: Yohanna Lisnichuk <yohanitalisnichuk@gmail.com>
Signed-off-by: Yohanna Lisnichuk <yohanitalisnichuk@gmail.com>
@yolile yolile requested a review from aguilerapy June 29, 2020 18:39
aguilerapy
aguilerapy previously approved these changes Jun 29, 2020
Signed-off-by: Yohanna Lisnichuk <yohanitalisnichuk@gmail.com>
Signed-off-by: Yohanna Lisnichuk <yohanitalisnichuk@gmail.com>
jpmckinney
jpmckinney previously approved these changes Jun 30, 2020
Signed-off-by: Yohanna Lisnichuk <yohanitalisnichuk@gmail.com>
'errors': json_data,
})
else:
return super().build_file(data=data, file_name=file_name, url=url, data_type=data_type, encoding=encoding)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we instead do data=None, **kwargs in the method signature, and then super().build_file(data=data, **kwargs) here?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it is kind of the same, but I changed it

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Indeed – but this way we don't need to change two places if we add keyword arguments :)

@@ -67,5 +73,6 @@ def parse_list(self, response):
meta={
'year': year,
'month': month,
}
},
callback=self.parse_list
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jpmckinney sorry, I noticed that chile_base was missing a callback call in the parse_list method so I included the fix here too

Signed-off-by: Yohanna Lisnichuk <yohanitalisnichuk@gmail.com>
@yolile yolile requested a review from jpmckinney June 30, 2020 13:38
@yolile yolile merged commit af6c726 into master Jun 30, 2020
@yolile yolile deleted the 375-chile-bulk-fix branch June 30, 2020 13:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

chile_compra_bulk: Spider doesn't recognize HTTP 500 errors
3 participants