Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
..
Failed to load latest commit information.
commands Merge pull request #2957 from ScrapingLab/add_meta_json_to_parse_command Nov 29, 2017
contracts Allow spiders to return dicts. See GH-1064. Mar 18, 2015
contrib fixed backwards compatibility for scrapy.contrib.exporter.PythonItemE… May 5, 2015
contrib_exp Move scrapy/contrib/downloadermiddleware to scrapy/downloadermiddlewares Apr 30, 2015
core update docstring of ScrapyClientTLSOptions Mar 14, 2018
downloadermiddlewares Merge branch 'master' into master Feb 8, 2018
extensions use INFO log level to show telnet host/port Feb 8, 2018
http corrected syntax error in XPath Mar 19, 2018
linkextractors [MRG+1] Add 'flv' to ignored video extensions. (#3165) Mar 13, 2018
loader Merge pull request #1467 from dacjames/master Sep 17, 2015
pipelines Merge branch 'master' into extending-s3-files-store Dec 31, 2017
selector Selector should not receive both response and text Jul 30, 2016
settings Use https link in default user agent Oct 28, 2017
spidermiddlewares url_pattern is now being compiled before entering the loop Dec 7, 2017
spiders Merge pull request #2854 from jenya/2853-sitemap-follow-alternate-fix Aug 21, 2017
templates Migrate all subdomains on readthedocs.org to readthedocs.io Oct 28, 2017
utils Fix OS signal names Jan 27, 2018
xlib Wipe scrapy.xlib.tx Dec 2, 2016
VERSION Bump version: 1.4.0 → 1.5.0 Dec 29, 2017
__init__.py drop deprecated "optional_features" set Sep 15, 2015
__main__.py Add support for executing scrapy using -m option of python May 16, 2017
_monkeypatches.py Use https links wherever possible Oct 28, 2017
cmdline.py Move garbage_collect to scrapy.utils.python Jun 15, 2017
command.py scrapy/command.py shim May 9, 2015
conf.py better backwards compatibility for scrapy.conf.settings Oct 25, 2012
crawler.py Use https links wherever possible Oct 28, 2017
dupefilter.py scrapy/dupefilter.py shim Apr 30, 2015
dupefilters.py fixed RFPDupeFilter persistence Jul 28, 2015
exceptions.py pylint cleanup: unused imports and old-style exceptions Oct 18, 2013
exporters.py Use https links wherever possible Oct 28, 2017
extension.py Replace BaseSettings._getcomposite() with public .getwithbase() method Nov 11, 2015
interfaces.py rename scrapy.spidermanager.SpiderManager to scrapy.spiderloader.Spid… Apr 16, 2015
item.py BUG: Fix __classcell__ propagation. Feb 8, 2017
link.py PY3 raise an exception if bytes are passed as url to Link constructor Aug 28, 2015
linkextractor.py scrapy/linkextractor.py shim May 9, 2015
log.py keep level_names in scrapy.log for backwards compatibility May 21, 2015
logformatter.py [logformatter] backward compat comments Mar 17, 2017
mail.py Use a helper for to_bytes() and None input Oct 5, 2017
middleware.py Use long classes names for enabled middlewares in startup logs Jan 26, 2016
mime.types moved module scrapy.core.downloader.responsetypes to scrapy.responset… Aug 7, 2011
project.py Drop support for scrapy.project.crawler (And scrapy.stats consequently) Aug 12, 2014
resolver.py Do not cache DNS responses when cache size is 0 Jul 4, 2017
responsetypes.py Merge pull request #1503 from demelziraptor/amazon-json-response Sep 12, 2016
shell.py Populate spider variable when using shell.inspect_response Jul 3, 2017
signalmanager.py Use https links wherever possible Oct 28, 2017
signals.py An attempt to resolve #977, add signal to be sent when request is dro… Nov 27, 2014
spider.py scrapy/spider.py shim May 9, 2015
spiderloader.py Add SPIDER_LOADER_WARN_ONLY to toggle between spiderloader failure an… Mar 7, 2017
spidermanager.py rename scrapy.spidermanager.SpiderManager to scrapy.spiderloader.Spid… Apr 16, 2015
squeue.py scrapy/squeue.py shim Apr 30, 2015
squeues.py Clarify comment about Pyhton versions Feb 8, 2018
stats.py Drop support for scrapy.project.crawler (And scrapy.stats consequently) Aug 12, 2014
statscol.py scrapy/statscol.py shim Apr 30, 2015
statscollectors.py enable test_stats and test_utils_log tests in Python 3 Aug 25, 2015
telnet.py Relocate telnetconsole to extensions/ Oct 5, 2015