origin data in data/Amex_ori
Manual data wash in experiments.
run experiments/Manual.ipynb should give you some clean data.
agents is for script that make runs data is for storage datasets is to define pytorch dataloader
- any processed data should use data/*.parquet
- data/* is ignored to aviod over sized transfer