Skip to content

Commit

Permalink
Update mexico inai spider.
Browse files Browse the repository at this point in the history
  • Loading branch information
nativaldezt committed Mar 19, 2021
1 parent 8508ac4 commit 93e1a53
Show file tree
Hide file tree
Showing 4 changed files with 35 additions and 95 deletions.
11 changes: 2 additions & 9 deletions docs/spiders.rst
Original file line number Diff line number Diff line change
Expand Up @@ -701,19 +701,12 @@ Mexico
scrapy crawl mexico_grupo_aeroporto
.. autoclass:: kingfisher_scrapy.spiders.mexico_inai.MexicoINAI
.. autoclass:: kingfisher_scrapy.spiders.mexico_inai_api.MexicoINAIAAPI
:no-members:

.. code-block:: bash
scrapy crawl mexico_inai
.. autoclass:: kingfisher_scrapy.spiders.mexico_inai_portal.MexicoINAIPortal
:no-members:

.. code-block:: bash
scrapy crawl mexico_inai_portal
scrapy crawl mexico_inai_api
.. autoclass:: kingfisher_scrapy.spiders.mexico_nuevo_leon_records.MexicoNuevoLeonRecords
:no-members:
Expand Down
45 changes: 0 additions & 45 deletions kingfisher_scrapy/spiders/mexico_inai.py

This file was deleted.

33 changes: 33 additions & 0 deletions kingfisher_scrapy/spiders/mexico_inai_api.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
from kingfisher_scrapy.base_spider import PeriodicSpider
from kingfisher_scrapy.util import components


class MexicoINAIAAPI(PeriodicSpider):
"""
Domain
Instituto Nacional de Transparencia, Acceso a la Información y Protección de Datos Personales (INAI)
Spider arguments
from_date
Download only releases from this date onward (YYYY format).
If ``from_date`` is not provided defaults to 2015.
until_date
Download only releases until this date (YYYY format).
If ``from_date`` is not provided defaults to current year.
API documentation
http://contratacionesabiertas.inai.org.mx/contratacionesabiertas/datosabiertos
"""
name = 'mexico_inai_api'

# BaseSpider
root_path = 'arrayReleasePackage.item'
date_format = 'year'
default_from_date = '2015'

# SimpleSpider
data_type = 'release_package'

# PeriodicSpider
pattern = 'http://contratacionesabiertas.inai.org.mx:3000/edca/contractingprocess/{}'

def get_formatter(self):
return components(-1)
41 changes: 0 additions & 41 deletions kingfisher_scrapy/spiders/mexico_inai_portal.py

This file was deleted.

0 comments on commit 93e1a53

Please sign in to comment.