農產品批發市場交易行情站 爬蟲

爬取台灣農產品批發市場交易行情站(http://amis.afa.gov.tw/)上之每日蔬果拍賣價格, 並儲存為csv

Getting Started

pip install -r requirements.txt

mkdir data
mkdir fruit_data

python veg_crawler.py # for vegetable
python veg_etl.py # for vegetable

python fruit_crawler.py # for vegetable
python fruit_etl.py # for vegetable

Prerequisites

What things you need to install the software and how to install them

python 3.5^

Installing

A step by step series of examples that tell you have to get a development env running

Say what the step will be

Give the example

And repeat

until finished

End with an example of getting some data out of the system or using it for a little demo

Running the tests

Explain how to run the automated tests for this system

Break down into end to end tests

Explain what these tests test and why

Give an example

And coding style tests

Explain what these tests test and why

Give an example

Deployment

Add additional notes about how to deploy this on a live system

Built With

• Python

Contributing

Please read CONTRIBUTING.md for details on our code of conduct, and the process for submitting pull requests to us.

Versioning

We use SemVer for versioning. For the versions available, see the tags on this repository.

Authors

• Ian Chen - Initial work - ianchenhq

See also the list of contributors who participated in this project.

License

This project is licensed under the MIT License - see the LICENSE.md file for details

Acknowledgments

• Hat tip to anyone who's code was used
• Inspiration
• etc