Navigation Menu

Skip to content

Commit

Permalink
Initial implementation.
Browse files Browse the repository at this point in the history
  • Loading branch information
MichaelBone committed Aug 8, 2018
1 parent dacbf6c commit 68ea701
Show file tree
Hide file tree
Showing 7 changed files with 647 additions and 61 deletions.
9 changes: 8 additions & 1 deletion .gitignore
@@ -1,2 +1,9 @@
# Ignore output of scraper
# Ignore output of scraper.
data.sqlite

# Ignore dependency cache.
node_modules
package-lock.json

# Ignore Visual Studio Code files.
.vscode
2 changes: 1 addition & 1 deletion README.md
@@ -1 +1 @@
This is a scraper that runs on [Morph](https://morph.io). To get started [see the documentation](https://morph.io/documentation)
This is a scraper that runs on [Morph](https://morph.io). It scrapes lodged development applications from the South Australian [Mount Barker District Council web site](https://www.mountbarker.sa.gov.au).
17 changes: 12 additions & 5 deletions package.json
@@ -1,13 +1,20 @@
{
"version": "0.0.1",
"version": "1.0.0",
"engines": {
"node": "10.6.0"
},
"main": "scraper.js",
"dependencies": {
"cheerio": "latest",
"request": "latest",
"sqlite3": "latest"
"cheerio": "^0.22.0",
"moment": "^2.22.2",
"pdf2json": "^1.1.7",
"request": "^2.87.0",
"request-promise-native": "^1.0.5",
"sqlite3": "^4.0.1",
"url": "^0.11.0"
},
"keywords": [
"scraper",
"morph"
]
}
}
330 changes: 276 additions & 54 deletions scraper.js

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

0 comments on commit 68ea701

Please sign in to comment.