Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Organize performance benchmarks #95

Merged
merged 29 commits into from
Jul 21, 2023
Merged

Organize performance benchmarks #95

merged 29 commits into from
Jul 21, 2023

Commits on Mar 7, 2023

  1. document SDK makefile targets

    @countvajhula
    countvajhula committed Mar 7, 2023
    Configuration menu
    Copy the full SHA
    c8ff0b6 View commit details
    Browse the repository at this point in the history

  2. makefile target for performance regression report

    @countvajhula
    countvajhula committed Mar 7, 2023
    Configuration menu
    Copy the full SHA
    dd7051d View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2023

  1. Refactor benchmarks to unify form-related ones

    @countvajhula
    countvajhula committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    32116d8 View commit details
    Browse the repository at this point in the history

  2. start to separate form benchmarks from other benchmarks

    @countvajhula
    countvajhula committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    7c955e8 View commit details
    Browse the repository at this point in the history

  3. Organize scripts to generate performance reports 

    Have separate scripts to generate reports of different aspects, to
preserve separation of concerns. This results in some duplication of
configuration, though, which is probably best avoided via some
improvements to the cli library.

Follow the general pattern of echoing live results to STDERR and
actual formatted output to STDOUT.
    @countvajhula
    countvajhula committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    1a51450 View commit details
    Browse the repository at this point in the history

  4. Use require-latency library instead of measuring load time locally

    @countvajhula
    countvajhula committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    49a827a View commit details
    Browse the repository at this point in the history

  5. move competitive benchmarks into a separate folder

    @countvajhula
    countvajhula committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    eaa26cf View commit details
    Browse the repository at this point in the history

  6. update phonies in makefile

    @countvajhula
    countvajhula committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    87fed46 View commit details
    Browse the repository at this point in the history

  7. merge some require forms

    @countvajhula
    countvajhula committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    3958320 View commit details
    Browse the repository at this point in the history

  8. categorize performance modules into intrinsic vs competitive

    @countvajhula
    countvajhula committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    662a0bc View commit details
    Browse the repository at this point in the history

  9. rename a file for uniformity

    @countvajhula
    countvajhula committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    25a267a View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2023

  1. begin refactor of competitive benchmarks for uniformity/tractability

    @countvajhula
    countvajhula committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    f82f1ba View commit details
    Browse the repository at this point in the history

  2. label a todo so it doesn't get lost

    @countvajhula
    countvajhula committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    e967c1b View commit details
    Browse the repository at this point in the history

  3. standardize nonlocal benchmark names for use via CLI

    @countvajhula
    countvajhula committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    a4517fa View commit details
    Browse the repository at this point in the history

  4. support selecting specific nonlocal benchmarks to run via CLI

    @countvajhula
    countvajhula committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    c213a94 View commit details
    Browse the repository at this point in the history

  5. standardize flag conventions

    @countvajhula
    countvajhula committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    9411eaf View commit details
    Browse the repository at this point in the history

  6. reorganize benchmarks as local and nonlocal

    @countvajhula
    countvajhula committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    09b24c4 View commit details
    Browse the repository at this point in the history

  7. continue reorganizing benchmarks..

    @countvajhula
    countvajhula committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    551b9a1 View commit details
    Browse the repository at this point in the history

  8. run nonlocal benchmarks for racket or qi via CLI

    @countvajhula
    countvajhula committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    7c34773 View commit details
    Browse the repository at this point in the history

  9. use regression logic to implement competitive benchmarks

    @countvajhula
    countvajhula committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    71c638e View commit details
    Browse the repository at this point in the history

  10. respect CLI flags in performance regression reporting

    @countvajhula
    countvajhula committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    a3f230e View commit details
    Browse the repository at this point in the history

  11. check regression wrt the "after" data to respect narrowed selection

    @countvajhula
    countvajhula committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    a796dac View commit details
    Browse the repository at this point in the history

  12. update makefile targets and name things consistently

    @countvajhula
    countvajhula committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    e055609 View commit details
    Browse the repository at this point in the history

  13. improve live output in competitive report

    @countvajhula
    countvajhula committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    ab28a32 View commit details
    Browse the repository at this point in the history

  14. cleanup, remove unused imports

    @countvajhula
    countvajhula committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    0033742 View commit details
    Browse the repository at this point in the history

  15. use "local" instead of "forms"

    @countvajhula
    countvajhula committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    73b5b6b View commit details
    Browse the repository at this point in the history

  16. add back needed import

    @countvajhula
    countvajhula committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    916b7b9 View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2023

  1. add nonlocal benchmarks to the performance report

    @countvajhula
    countvajhula committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    f8f3e8a View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2023

  1. contain load path parameter to eval where it's needed

    @countvajhula
    countvajhula committed Mar 23, 2023
    Configuration menu
    Copy the full SHA
    e2bcf06 View commit details
    Browse the repository at this point in the history