Random

Random folder containing random small projects or demo codes for reference purpose

1. Excel Templating

   • Crawl Hunter x Hunter's main characters battle stats from hunterwiki
   • Use pandas ExcelWriter to print the stats according to the template on Excel sheets

2. Requests and Geocoder

   • Crawl Penang top shopping mall using requests
   • Obtain the latitude and longitude of the shop according to the address crawled
   • Plot the shops with their information on the map

3. Selenium

   • Use selenium to book airticket
   • Real usecase is to use selenium to login your account, this is just a demo on the library

4. Setups

   • HDFS3
     • Install hdfs3
     • Demo some API
   • Dremio
     • Install & run dremio
     • Install dremio ODBC (CentOS & Ubuntu)

5. Utility

   • argparse & yaml reader
   • pyMQL & Psycopg2
     • practice @classmethod and @staticmethod