This is a repo for quick and dirty test bedding of new ideas, new codes, anything useful and interesting, or anything i learnt off youtube, articles, ChatGPT, etc. Mainly notebooks will be used as it is great for visualisation and learning, but there is really no limits here. :)
_notebook_.ipynb
Title: Implement Gradient Descent algorithm
Description: This is just an attempt to implement gradient descent algorithm, with the help of chatGPT.
_notebook_time_series.ipynb
Title: Time Series notebook
Description: Just to quickly try out anything time-series related
notebook_1.ipynb
Title: Resume details generation tool
Description: This aims to output resume details from my source details in excel sheet.
notebook_2.ipynb
Title: Convert Excel table to Markdown syntax
Description: Because typing out the markdown code for a table is tough and tedious, therefore, I use python to help me generate the markdown syntax from excel tables. Excel tables makes it more user friendly for data entry.
notebook_2_private.ipynb
Title: Convert Excel table to Markdown syntax
Description: Because typing out the markdown code for a table is tough and tedious, therefore, I use python to help me generate the markdown syntax from excel tables. Excel tables makes it more user friendly for data entry.
notebook_3.ipynb
Title: Time Series Forecasting with XGBoost - Use python and machine learning to predict energy consumption
Description: https://www.youtube.com/watch?v=vV12dGe_Fho
Time Series Forecasting with XGBoost - Use python and machine learning to predict energy consumption
notebook_4.ipynb
Title: Make Your Pandas Code Lightning Fast
Description: Make Your Pandas Code Lightning Fast
Speed up slow pandas/python code by 2500x using this simple trick. Face it, your pandas code is slow. Learn how to speed it up! In this video Rob discusses a key trick to making your code faster! Pandas is an essential tool for any python programmer and data scientist. Using the pandas apply function, using vectorized functions, the speed difference can be significant. Write faster python code.
notebook_5.ipynb
Title: Try out dask
Description: To find out what dask can do and have some hands on with codes.
notebook_6.ipynb
Title: Doing diff on resume (docx)
Description: Compare two resumes in docx format.
notebook_7.ipynb
Title: This INCREDIBLE trick will speed up your data processes.
Description: https://www.youtube.com/watch?v=u4rsA5ZiTls
CSV/Pickle/Feather/Parquet/Other Options/Benchmarking
notebook_8.ipynb
Title: To get the index of some numbers from a list of more numbers.
Description: I was checking ChatGPT's solution.
notebook_9_private.ipynb
Title: To compare two excel sheet for differences
Description:
notebook_10.ipynb
Title: Polars: The Super Fast Dataframe Library for Python ... bye bye Pandas?
Description: Polars: The Super Fast Dataframe Library for Python ... bye bye Pandas?
To install polars: https://pypi.org/project/polars/
notebook_11_sound.ipynb
Title: Mp3 audio cutting and analysis
Description: Original intention was to use this to cut away useless part of a long mp3 audio. Also wanted to visualise the sound wave to know when to cut. Later found fffmpeg which runs by typing on command line.
notebook_pytorch.ipynb
Title: Implementing original U-Net from scratch using PyTorch
Description: Abhishek Thakur
segmentation.ipynb
Title: Image Segmentation with Watershed Algorithm
Description: https://docs.opencv.org/4.x/d3/db4/tutorial_py_watershed.html
whatsapp_message.ipynb
Title: Sending Whatsapp message via python
Description: To try different ways to send whatsapp messages via python. The eventual goal is to integrate this with a system for buy and sell signals for stocks.