Ptt-Stock-Data

Goal

只抓取標題分類為標的或是Re:標的的文章，內容格式都一樣。

• 標的

"[標的] 8261 富鼎  跟著董事一起賣": {
        "STOCK_ID": "8261",
        "TITLE": "[標的] 8261 富鼎  跟著董事一起賣",
        "ID": "M.1673535142.A.C90",
        "LINK": "https://www.ptt.cc/bbs/Stock/M.1673535142.A.C90.html",
        "AUTHOR": "n88713117",
        "CONTENT": "long text",
        "TIME": "Thu Jan 12 22:52:20 2023",
        "MESSAGE_ALL": 38,
        "BOO": 0,
        "PUSH": 21,
        "MESSAGE_COUNT": 21,
        "NEUTRAL": 17,
        "TAG": "標的"
}

• Re:標的

"Re: [標的] TSLA, AMD, TSM.US 歐印誰 討論": {
    "STOCK_ID": 0,
    "TITLE": "Re: [標的] TSLA, AMD, TSM.US 歐印誰 討論",
    "ID": "M.1673549109.A.6D3",
    "LINK": "https://www.ptt.cc/bbs/Stock/M.1673549109.A.6D3.html",
    "AUTHOR": "andylu1207",
    "CONTENT": "long text",
    "TIME": "Fri Jan 13 02:45:07 2023",
    "MESSAGE_ALL": 55,
    "BOO": 4,
    "PUSH": 19,
    "MESSAGE_COUNT": 15,
    "NEUTRAL": 32,
    "TAG": "Re標的"
}

功能

• 多執行緒爬取Ptt文章
• 可透過slack發送通知

run on local

如果要使用Slack，在local端新增一個.env file，內容為

SLACK_WEBHOOK = "slack-webhook <-自行替換"

並將以下程式碼的註釋打開

# test .ENV
# use in local 
config = dotenv_values(".env")
SLACK_WEBHOOK = config['SLACK_WEBHOOK']

• 如果不使用Slack，則自行mark掉相關code

run on github or server

在github repo setting中，設置SLACK_WEBHOOK，即可透過Slack接收通知

# prod .ENV
# use in github or production
SLACK_WEBHOOK = os.getenv('SLACK_WEBHOOK')