To modify the behavior of the spider,
edit the files marked with # in the directory tree below.
Directory structure of PTTdict/:
.
├── run.sh # scrapy crawl parameters
├── view.json # Auto-generated (for viewing)
├── scrapy.cfg
├── setup.py
│
├── PTTdict
│ ├── __init__.py
│ ├── items.py # Define item fields
│ ├── middlewares.py
│ ├── pipelines.py
│ ├── postprocess
│ │ ├── __pycache__/
│ │ └── tidyup.py # Process items before output
│ ├── __pycache__/
│ ├── settings.py # Setting for item piplines
│ └── spiders
│ ├── dict.py # Spider for scraping PTT wiki
│ ├── __init__.py
│ └── __pycache__/
└── data
├── dict_constr.R # Filter & convert to data frame
├── index.Rmd # Build Web Site
├── _site.yml
└── style.css