Kickstarter-spider

This python file is just for collecting kickstarter crowdfunding platform data!!
and the aim is for help myself to access the crowdfunding field what may i need.

Menu

---

1. Included materials
2. Files
3. Codes
4. update
5. upgrade

---

1. included materials

In those code files, those may include some useless materials for other people who want to read.Here,i just show the important materials if you want to use my code.These have three folders which may include a lots of .py files

if you are intersted in this project, first folder which is kickstarterforcollectingdata should be focus on.

kickstarterforcollectingdata

• this folder include main spiderbot program
• in the kickstarterforcollectingdata folder, you can find a folder named reconstruction .
  • any things you want are all saved in this folder
• there is only one file you may be interested in: plan.py

2.files

• you may find a lot of txt files and csv or xlsx files, that are some data what i have collected until 4 July 2016. -PS: i will fully clean up those useless files when i finish my dissertation finally

3. codes

• I use python 2.7 to code
• and when you run the code, you may find some number or path be required to type in, you should type full path into two parts.
  • one is public path for what dir/folder you want save the data. the dir/folder must include 4 csv files and one txt file.
  • another is the full name of target file(csv format)
  • (those must be named as follow)

targetfile.csv
collected.txt
project_data.csv
rewards_backers_distribution.csv
rewards_pledge_limit.csv
rewards_pledged_amount.csv 				

-the target file must include the target urls

4. update

• i know there still some bug i have not fixed, but anyway it work, that is it. i do not promise to fix it,but i will try my best to fix it and update it.

5.upgrade

• for now, i still try to upgrade my code, untill i finish my disseration.
• now i'm working on covering the projects which cannnot be searched from category pages

I'm a line_

Wirtten by sn0wfree at 15 July 2016 Cardiff, UK