ScalAggravator

A UCSB GOLD scraper

Lessons Learned

Here is a list of lessons I learned while working on this project. These are for specific consumption; they relate specifically to this project and should be kept in mind whenever I work on this project. In other words, for posterity.

• .aspx is fickle. Expect failure in communication often
• Do not clean values found in select drop down list.
  • If they need to be submitted, they need to be kept as originally received
• To continue communication, sometimes using the most recent set of cookies is bad
  • Try using cookies of penultimate request instead