crawl-data-slack

docker-hub gos16052/crawl-data-slack

Setup

Requirements

• mysql (migrations are run automatically)

Feed hackernews

1. Create new app (https://api.slack.com/apps)
2. Go to your app - OAuth & Permissions
3. Add thescopes into bot token scopes (channels.read, chat:write, groups:read, im:read, mpim:read, users:read) It uses 3 apis (conversations.list, chat.postMessage, users.list)
4. Install to workspace and copy your bot user token

Run the crawler

1. Pull the repository to run with chromedp
2. Creata a .env file and write the environments

# Fill ID, PW, HOST, PORT, DATABASE, SLACK_BOT_TOKEN
MYSQL_CONN=<ID>:<PW>@tcp(<HOST>:<PORT>)/<DATABASE>?charset=utf8&parseTime=True
SLACK_BOT_TOKEN=<SLACK_BOT_TOKEN>

3. Run with the command make up cmd="crawl\ hackernews\ --channel\ <YOUR_CHANNEL>