hulabearCrawler

• Crawler for BBS hulabear
• Usage: hulaCrawler.py account board startPostId endPostId [--password PASSWORD]
• Manually copy the bbs.css into "crawled" directory

Credits

• "簡易版 PTT 爬蟲", http://mhwong2007.logdown.com/posts/314403
• "uao_decode", https://gist.github.com/andycjw/5617496
• "BBS Crawler 筆記", http://blog.changyy.org/2010/08/python-bbs-crawler.html
• "naive PTT gossiping crawler", http://daat-blog.logdown.com/posts/181159-naive-ptt-gossiping-crawler
• "鱉/Bossliaw", https://github.com/Bossliaw/hulabear-crawler

Related python documents

• https://docs.python.org/2/library/telnetlib.html

Known Bugs and Todo

• 文章只有一頁的時候無法刪除底下狀態列
• 處理進板畫面的偵測目標字串不應該包含色碼
• Beautify the layout