Release commit for v.0.9.3

holgerd77 · Jan 14, 2016 · c02af44 · c02af44
1 parent 741aed0
commit c02af44
Show file tree

Hide file tree

Showing 3 changed files with 14 additions and 2 deletions.
diff --git a/docs/development.rst b/docs/development.rst
@@ -94,6 +94,12 @@ Docker container can be run with::
 
 Release Notes
 =============
+**Changes in version 0.9.3-beta** (2016-01-14)
+
+* New command line options ``output_num_mp_response_bodies`` and ``output_num_dp_response_bodies``
+  for logging the complete response bodies of the first {Int} main/detail page responses to the screen
+  for debugging (for the really hard cases :-)) (see: :ref:`running_scrapers`)
+
 **Changes in version 0.9.2-beta** (2016-01-14)
 
 * New processor ``remove_chars`` (see: :ref:`processors`) for removing one or several type of chars from

diff --git a/docs/getting_started.rst b/docs/getting_started.rst
@@ -389,7 +389,8 @@ as following::
   scrapy crawl [--output=FILE --output-format=FORMAT] SPIDERNAME -a id=REF_OBJECT_ID 
                           [-a do_action=(yes|no) -a run_type=(TASK|SHELL) 
                           -a max_items_read={Int} -a max_items_save={Int}
-                          -a max_pages_read={Int}]
+                          -a max_pages_read={Int}
+                          -a output_num_mp_response_bodies={Int} -a output_num_dp_response_bodies={Int} ]
   
 * With ``-a id=REF_OBJECT_ID`` you provide the ID of the reference object items should be scraped for,
   in our example case that would be the Wikinews ``NewsWebsite`` object, probably with ID 1 if you haven't
@@ -406,6 +407,11 @@ as following::
 
 * With ``-a max_pages_read={Int}`` you can limit the number of pages read when using pagination
 
+* With ``-a output_num_mp_response_bodies={Int}`` and ``-a output_num_dp_response_bodies={Int}`` you can log
+  the complete response body content of the {Int} first main/detail page responses to the screen for debugging
+  (beginnings/endings are marked with a unique string in the form ``RP_MP_{num}_START`` for using full-text
+  search for orientation)
+
 * If you don't want your output saved to the Django DB but to a custom file you can use Scrapy`s build-in 
   output options ``--output=FILE`` and ``--output-format=FORMAT`` to scrape items into a file. Use this without 
   setting the ``-a do_action=yes`` parameter!

diff --git a/setup.py b/setup.py
@@ -4,7 +4,7 @@
 
 setup(
     name='django-dynamic-scraper',
-    version='0.9.2',
+    version='0.9.3',
     description='Creating Scrapy scrapers via the Django admin interface',
     author='Holger Drewes',
     author_email='Holger.Drewes@gmail.com',