Skip to content

Steam商店游戏爬虫, 爬取全量游戏打折信息/图片链接

Notifications You must be signed in to change notification settings

wanghongfei/gamepark-craw

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

25 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Steam/杉果商店爬虫

爬取Steam商店搜索页面上的全部游戏数据。使用方法:

Usage of ./gamepark-craw:
  -concurrency int
        page crawl concurrency (default 1)
  -output string
        output file path (default "steam.tsv")
  -start int
        start page (default 1)
  -target string
        target website, steam/shanguo (default "steam")

其中start表示从第一页开始爬取, concurrency表示最多同时爬取2个页面, output用来指定输出文件,target表示爬取的平台。

游戏数据以tsv格式存储,一行有6个token, 每个token用\t分割,格式:

游戏名\t现价\t原价\t打折幅度\t图片\t商店

Demo:

Atom Zombie Smasher	36	36	0	https://store.steampowered.com/app/55040/Atom_Zombie_Smasher/?snr=1_7_7_230_150_2500	https://media.st.dl.eccdnx.com/steam/apps/55040/header.jpg?t=1586734113

About

Steam商店游戏爬虫, 爬取全量游戏打折信息/图片链接

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published