Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Hyperparameter Optimization Module #151

Merged
merged 125 commits into from
May 14, 2024
Merged

Hyperparameter Optimization Module #151

merged 125 commits into from
May 14, 2024

Commits on Jun 30, 2023

  1. 1. bug fixed. 2. kernel extension. 3. batch GP implementatoin.

    @middleyuan
    middleyuan committed Jun 30, 2023
    Configuration menu
    Copy the full SHA
    8d3be23 View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2023

  1. update dependencies

    @middleyuan
    middleyuan committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    7f0e3ff View commit details
    Browse the repository at this point in the history

  2. explicitliy import scipy.linalg

    @middleyuan
    middleyuan committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    cf3d4e8 View commit details
    Browse the repository at this point in the history

  3. add cartpole configs for gpmpc

    @middleyuan
    middleyuan committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    359eecc View commit details
    Browse the repository at this point in the history

  4. add hyperparameter optimization module

    @middleyuan
    middleyuan committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    89a29b8 View commit details
    Browse the repository at this point in the history

  5. catch all the exception in hpo for debugging purpose.

    @middleyuan
    middleyuan committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    9e2a7ef View commit details
    Browse the repository at this point in the history

  6. put cartpole configs for gpmpc under the folder of gpmpc

    @middleyuan
    middleyuan committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    27454da View commit details
    Browse the repository at this point in the history

  7. add hpo scripts

    @middleyuan
    middleyuan committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    17e408b View commit details
    Browse the repository at this point in the history

  8. 1. include pandas 2. change rel import in gpmpc_experiment.py 3. remo… 

    …ve unnecessary config in cartpole_stab.yaml 2. add hpo module in test_build.py
    @middleyuan
    middleyuan committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    bb4e1b0 View commit details
    Browse the repository at this point in the history

  9. rename config to match default algo name.

    @middleyuan
    middleyuan committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    14a6db1 View commit details
    Browse the repository at this point in the history

  10. remove old configs

    @middleyuan
    middleyuan committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    e6a2e3d View commit details
    Browse the repository at this point in the history

  11. add tests

    @middleyuan
    middleyuan committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    0484388 View commit details
    Browse the repository at this point in the history

  12. edit bash file with correct arg name

    @middleyuan
    middleyuan committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    84830df View commit details
    Browse the repository at this point in the history

  13. add another host in gpmpc_hpo.sh

    @middleyuan
    middleyuan committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    e69e048 View commit details
    Browse the repository at this point in the history

  14. change to new dir in gpmpc_hpo.sh

    @middleyuan
    middleyuan committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    097e1c2 View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2023

  1. 1. fix a small bug 2. add test_train_gpmpc_cartpole

    @middleyuan
    middleyuan committed Jul 11, 2023
    Configuration menu
    Copy the full SHA
    405dcea View commit details
    Browse the repository at this point in the history

  2. add a hpo parallelism test

    @middleyuan
    middleyuan committed Jul 11, 2023
    Configuration menu
    Copy the full SHA
    549ff3e View commit details
    Browse the repository at this point in the history

  3. saving before runing hpo

    @middleyuan
    middleyuan committed Jul 11, 2023
    Configuration menu
    Copy the full SHA
    81b5602 View commit details
    Browse the repository at this point in the history

  4. I think the bug is that it reaches thee goal in the first step.

    @middleyuan
    middleyuan committed Jul 11, 2023
    Configuration menu
    Copy the full SHA
    a5ad5f2 View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2023

  1. 1. PPO configs. 2. Make cartpole init states harder. 3. First version… 

    … of JSRL on PPO.
    @middleyuan
    middleyuan committed Jul 18, 2023
    Configuration menu
    Copy the full SHA
    ce4d75e View commit details
    Browse the repository at this point in the history

  2. Re-organize a bit (file name, remove __init__.py in test folders).

    @middleyuan
    middleyuan committed Jul 18, 2023
    Configuration menu
    Copy the full SHA
    b40566c View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2023

  1. 1. HPO strategies. 2. test on hpo for ppo. 3. another way to save che… 

    …ckpoint in ppo.py. 4. Boolean var in ppo_sampler.
    @middleyuan
    middleyuan committed Jul 22, 2023
    Configuration menu
    Copy the full SHA
    23f571d View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2023

  1. update gitignore

    @middleyuan
    middleyuan committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    802edb6 View commit details
    Browse the repository at this point in the history

  2. change configs

    @middleyuan
    middleyuan committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    02d1c33 View commit details
    Browse the repository at this point in the history

  3. update bash for hpo on gpmpc

    @middleyuan
    middleyuan committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    20d3a7f View commit details
    Browse the repository at this point in the history

  4. add prior arg in gpmpc_sampler

    @middleyuan
    middleyuan committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    ad96f6f View commit details
    Browse the repository at this point in the history

  5. 1. HPO effort evaluations. 2. Bash file for hpo strategy evalution.

    @middleyuan
    middleyuan committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    5318c25 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2023

  1. update dependencies

    @middleyuan
    middleyuan committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    924d3b3 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2023

  1. add the freedom to choose between random sampler and TPE sampler.

    @middleyuan
    middleyuan committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    14ae2aa View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2023

  1. 1. add strategy 5. 2. add unit test accordingly.

    @middleyuan
    middleyuan committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    c0b1b34 View commit details
    Browse the repository at this point in the history

  2. 1. prior configs. 2. update eval.py, sen.sh, and .gitifonore.

    @middleyuan
    middleyuan committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    f5c3a5a View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2023

  1. gpmpc hpo strategy study

    @middleyuan
    middleyuan committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    0e1248a View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2023

  1. refactor the code

    @middleyuan
    middleyuan committed Aug 7, 2023
    Configuration menu
    Copy the full SHA
    a0feec7 View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2023

  1. 1. hpo on sac. 2. add activation arg in sac and fix a small bug.

    @middleyuan
    middleyuan committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    bd39347 View commit details
    Browse the repository at this point in the history

  2. fix typos

    @middleyuan
    middleyuan committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    4342b2a View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2023

  1. change to two jobs

    @middleyuan
    middleyuan committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    1e1f7cf View commit details
    Browse the repository at this point in the history

  2. change num of repetitions to make sure it at least has same num of sa… 

    …mples as s2.
    @middleyuan
    middleyuan committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    b087c87 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'hpo-on-ppo' into hpo-on-sac

    @middleyuan
    middleyuan committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    59b4220 View commit details
    Browse the repository at this point in the history

  4. reduce the budget

    @middleyuan
    middleyuan committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    4c22c86 View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2023

  1. toy example

    @middleyuan
    middleyuan committed Aug 10, 2023
    Configuration menu
    Copy the full SHA
    fe02a65 View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2023

  1. consider 4 version of noisy functions.

    @middleyuan
    middleyuan committed Aug 11, 2023
    Configuration menu
    Copy the full SHA
    3d33487 View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2023

  1. include var study

    @middleyuan
    middleyuan committed Aug 13, 2023
    Configuration menu
    Copy the full SHA
    714a76d View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2023

  1. improve visualization in toy examples

    @middleyuan
    middleyuan committed Aug 14, 2023
    Configuration menu
    Copy the full SHA
    2663cde View commit details
    Browse the repository at this point in the history

  2. updated visualization improvement in toy examples.

    @middleyuan
    middleyuan committed Aug 14, 2023
    Configuration menu
    Copy the full SHA
    249a284 View commit details
    Browse the repository at this point in the history

  3. change naming

    @middleyuan
    middleyuan committed Aug 14, 2023
    Configuration menu
    Copy the full SHA
    e03cb33 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2023

  1. final experiment setup

    @middleyuan
    middleyuan committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    ee29967 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'hpo-on-ppo' into hpo-on-sac

    @middleyuan
    middleyuan committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    3a6448d View commit details
    Browse the repository at this point in the history

  3. final experiment setup

    @middleyuan
    middleyuan committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    831e186 View commit details
    Browse the repository at this point in the history

  4. modify seeding

    @middleyuan
    middleyuan committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    452937d View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2023

  1. Ignore runtime error for hpo

    @middleyuan
    middleyuan committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    7b4a844 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'hpo-on-ppo' into hpo-on-gpmpc

    @middleyuan
    middleyuan committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    bfd6f21 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'hpo-on-sac' into hpo-on-gpmpc

    @middleyuan
    middleyuan committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    e310829 View commit details
    Browse the repository at this point in the history

  4. merge from sac

    @middleyuan
    middleyuan committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    c45e3e4 View commit details
    Browse the repository at this point in the history

  5. fix a bug in hpo_sampler.py

    @middleyuan
    middleyuan committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    8596fc8 View commit details
    Browse the repository at this point in the history

  6. final design to show possible lower compute time.

    @middleyuan
    middleyuan committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    df01b80 View commit details
    Browse the repository at this point in the history

  7. 1. hpo on ddpg. 2. fix a small bug in ddpg_utils.

    @middleyuan
    middleyuan committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    9faae33 View commit details
    Browse the repository at this point in the history

  8. relax the threshold

    @middleyuan
    middleyuan committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    de90501 View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2023

  1. relax the threshold

    @middleyuan
    middleyuan committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    4322f67 View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2023

  1. make rl_hpo_strategy_eval.sh automatic.

    @middleyuan
    middleyuan committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    038f046 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'hpo-on-ppo' into hpo-on-sac

    @middleyuan
    middleyuan committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    4703d8b View commit details
    Browse the repository at this point in the history

  3. Merge branch 'hpo-on-ppo' into hpo-on-ddpg

    @middleyuan
    middleyuan committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    807e358 View commit details
    Browse the repository at this point in the history

  4. fix a bug in rl_hpo_strategy_eval.sh

    @middleyuan
    middleyuan committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    6590134 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'hpo-on-ppo' into hpo-on-sac

    @middleyuan
    middleyuan committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    8c594c3 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'hpo-on-ppo' into hpo-on-ddpg

    @middleyuan
    middleyuan committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    87cbd1e View commit details
    Browse the repository at this point in the history

  7. add gpmpc_hpo_strategy_eval.sh

    @middleyuan
    middleyuan committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    8211c52 View commit details
    Browse the repository at this point in the history

  8. fix a small bug

    @middleyuan
    middleyuan committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    26536e9 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2023

  1. fix the budget (trial) bug in configs.

    @middleyuan
    middleyuan committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    5bca27a View commit details
    Browse the repository at this point in the history

  2. prepare comparing hpo strategy on gpmpc

    @middleyuan
    middleyuan committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    f083b64 View commit details
    Browse the repository at this point in the history

  3. fix a bug in gpmpc_hpo_strategy.sh

    @middleyuan
    middleyuan committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    bed32ce View commit details
    Browse the repository at this point in the history

  4. fix bugs in bash files

    @middleyuan
    middleyuan committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    9503398 View commit details
    Browse the repository at this point in the history

  5. fix the trial bug in config

    @middleyuan
    middleyuan committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    6cd934f View commit details
    Browse the repository at this point in the history

  6. fix a function bug in eval.py

    @middleyuan
    middleyuan committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    ecb27b1 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'hpo-on-ppo' into hpo-on-ddpg

    @middleyuan
    middleyuan committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    69d416b View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2023

  1. 1. add hpo resume functionality. 2. make eval function more general.

    @middleyuan
    middleyuan committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    a1b0756 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'hpo-on-ppo' into hpo-on-sac

    @middleyuan
    middleyuan committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    c88e7e7 View commit details
    Browse the repository at this point in the history

  3. update configs

    @middleyuan
    middleyuan committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    a9aa83b View commit details
    Browse the repository at this point in the history

  4. make main.sh general

    @middleyuan
    middleyuan committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    7f791aa View commit details
    Browse the repository at this point in the history

  5. Merge branch 'hpo-on-ppo' into hpo-on-sac

    @middleyuan
    middleyuan committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    d8d047b View commit details
    Browse the repository at this point in the history

  6. Merge branch 'hpo-on-ppo' into hpo-on-ddpg

    @middleyuan
    middleyuan committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    1e16f06 View commit details
    Browse the repository at this point in the history

  7. resume previous config with trial increasd.

    @middleyuan
    middleyuan committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    c4a8ded View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2023

  1. fix the sorting bug.

    @middleyuan
    middleyuan committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    80e59ec View commit details
    Browse the repository at this point in the history

  2. Merge branch 'hpo-on-ppo' into hpo-on-ddpg

    @middleyuan
    middleyuan committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    1a3a98a View commit details
    Browse the repository at this point in the history

  3. Merge branch 'hpo-on-ppo' into hpo-on-sac

    @middleyuan
    middleyuan committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    43387d5 View commit details
    Browse the repository at this point in the history

  4. fix sorting bug

    @middleyuan
    middleyuan committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    952b267 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2023

  1. a small bug fixed

    @middleyuan
    middleyuan committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    7f62195 View commit details
    Browse the repository at this point in the history

  2. fix a bug on computing reward

    @middleyuan
    middleyuan committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    d5109f4 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2023

  1. Merge branch 'hpo-on-ppo' into hpo-on-gpmpc

    @middleyuan
    middleyuan committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    1618395 View commit details
    Browse the repository at this point in the history

  2. adsd resume functionality

    @middleyuan
    middleyuan committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    778128b View commit details
    Browse the repository at this point in the history

  3. edit main bash file and fix some typos

    @middleyuan
    middleyuan committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    61ea053 View commit details
    Browse the repository at this point in the history

  4. simply assign zero if numerical issues happen during HPO

    @middleyuan
    middleyuan committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    1caae68 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'hpo-on-ppo' into hpo-on-gpmpc

    @middleyuan
    middleyuan committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    8583978 View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2023

  1. adjust eval

    @middleyuan
    middleyuan committed Sep 16, 2023
    Configuration menu
    Copy the full SHA
    f9f701d View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2023

  1. change to boxenplot

    @middleyuan
    middleyuan committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    5caf0c6 View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2023

  1. fix typo

    @middleyuan
    middleyuan committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    eea138a View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2023

  1. add reliable_stats

    @middleyuan
    middleyuan committed Sep 24, 2023
    Configuration menu
    Copy the full SHA
    362ea75 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'hpo-on-gpmpc' into hpo-on-ppo

    @middleyuan
    middleyuan committed Sep 24, 2023
    Configuration menu
    Copy the full SHA
    3649c44 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'hpo-on-ddpg' into hpo-on-ppo

    @middleyuan
    middleyuan committed Sep 24, 2023
    Configuration menu
    Copy the full SHA
    d6e0b08 View commit details
    Browse the repository at this point in the history

  4. update outdated configs

    @middleyuan
    middleyuan committed Sep 24, 2023
    Configuration menu
    Copy the full SHA
    55624cd View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/hpo-on-sac' into hpo-on-ppo

    @middleyuan
    middleyuan committed Sep 24, 2023
    Configuration menu
    Copy the full SHA
    6e9bbc9 View commit details
    Browse the repository at this point in the history

Commits on Oct 5, 2023

  1. update jupyter notebooks

    @middleyuan
    middleyuan committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    02d75ad View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2023

  1. update jupyter notebooks.

    @middleyuan
    middleyuan committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    00f6608 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2023

  1. final update for appendix

    @middleyuan
    middleyuan committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    b5749d0 View commit details
    Browse the repository at this point in the history

  2. update readme

    @middleyuan
    middleyuan committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    e4d616d View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2023

  1. fix typo

    @middleyuan
    middleyuan committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    ef29146 View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2024

  1. 1. clean up code for ppo controller, hyperparameter module. 2. Test o… 

    …ut package dependencies and MySQL database.
    @middleyuan
    middleyuan committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    47f1598 View commit details
    Browse the repository at this point in the history

  2. test training with given optimized hp files.

    @middleyuan
    middleyuan committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    83ec989 View commit details
    Browse the repository at this point in the history

  3. 1. test hpo with and without MySQL. 2. update README.

    @middleyuan
    middleyuan committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    e890c04 View commit details
    Browse the repository at this point in the history

  4. remove discrepancy of readme.

    @middleyuan
    middleyuan committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    e9499cd View commit details
    Browse the repository at this point in the history

  5. update readme

    @middleyuan
    middleyuan committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    c45a975 View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2024

  1. 1. remove 'pandas' and 'seaborn' in package dependencies. 2. move tes… 

    …ts to tests. 3. write comments in batch GP in GPMPC controller. 4. move experiments in examples.
    @middleyuan
    middleyuan committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    8350b63 View commit details
    Browse the repository at this point in the history

  2. -

    @middleyuan
    middleyuan committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    ee9ec34 View commit details
    Browse the repository at this point in the history

  3. update config_overrides in examples of rl

    @middleyuan
    middleyuan committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    a260695 View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2024

  1. run pre-commit hooks to improve linting

    @middleyuan
    middleyuan committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    13ef164 View commit details
    Browse the repository at this point in the history

  2. 1. ignore W503 and W504 as they conflict in pre-commit-config. 2. run… 

    … and pass this version of pre-commit hooks.
    @middleyuan
    middleyuan committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    3bbd0ba View commit details
    Browse the repository at this point in the history

  3. add activation config to the examples that use RL.

    @middleyuan
    middleyuan committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    56f2738 View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2024

  1. 1. standardize hpo template in the examples. 2. remove _learn(). 3. a… 

    …dd an example of hpo for gpmpc.
    @middleyuan
    middleyuan committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    ba837c5 View commit details
    Browse the repository at this point in the history

  2. run pre-commit hooks.

    @middleyuan
    middleyuan committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    51c601e View commit details
    Browse the repository at this point in the history

  3. add gpmpc hpo test without using mysql

    @middleyuan
    middleyuan committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    fb572f2 View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2024

  1. 1. update config of cartpole task. 2. add max_steps and exponentiated… 

    … avg return in base_experiment.py. 3. use BaseExperiment class in hpo example 3. add hp study bash script and jupyter notebook for gpmpc.
    @middleyuan
    middleyuan committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    c5fbeed View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2024

  1. 1. add bash files to automate hpo pipeline for gpmpc. 2. update gpmpc… 

    … config. 3. add done_on_max_steps in base_experiment.py. 4. remove _run() and use BaseExperiment in hpo.
    @middleyuan
    middleyuan committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    f8e3d0c View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into hpo

    @middleyuan
    middleyuan committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    1f62d3b View commit details
    Browse the repository at this point in the history

  3. match .gitignore to upstram/main.

    @middleyuan
    middleyuan committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    ffb29de View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2024

  1. update for review

    @middleyuan
    middleyuan committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    1508634 View commit details
    Browse the repository at this point in the history

Commits on May 13, 2024

  1. update based on the review comments.

    @middleyuan
    middleyuan committed May 13, 2024
    Configuration menu
    Copy the full SHA
    896ac9f View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. fix typo in readme.

    @middleyuan
    middleyuan committed May 14, 2024
    Configuration menu
    Copy the full SHA
    3b49f7b View commit details
    Browse the repository at this point in the history