Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Item_pipeline not working #19

Open
zodiac15 opened this issue Jun 30, 2019 · 0 comments
Open

Item_pipeline not working #19

zodiac15 opened this issue Jun 30, 2019 · 0 comments

Comments

@zodiac15
Copy link

I have made a news scraping spider which stores items into an sqlite3 database. I've added the following to the settings.py file
SPIDER_SETTINGS = [ { 'endpoint': 'tech_news', 'location': 'spiders.news_spider', 'spider': 'TechSpider', 'scrapy_settings': { 'ITEM_PIPELINES': { 'pipelines.NewsCrawlerPipeline': 300 } } } ]

But the Item_pipeline doesn't seem to be working as there is no data being sent to the database.
The spider is working perfectly fine when I run it through the terminal.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant