Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Runtime Engine #404

Merged
merged 94 commits into from
Oct 31, 2023
Merged

Runtime Engine #404

merged 94 commits into from
Oct 31, 2023

Commits on Oct 6, 2023

  1. engine: drop in some typings

    @josephjclark
    josephjclark committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    5be95d4 View commit details
    Browse the repository at this point in the history

  2. engine: refactor the runners to not be factories 

    This is way easeier for testing and understanding
    @josephjclark
    josephjclark committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    07446be View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2023

  1. engine: part way through huge refactor

    @josephjclark
    josephjclark committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    be11be6 View commit details
    Browse the repository at this point in the history

  2. Implement and test execute

    @josephjclark
    josephjclark committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    30b70a0 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2023

  1. engine: sort out api and engine, add unit tests on internal engine

    @josephjclark
    josephjclark committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    95a8511 View commit details
    Browse the repository at this point in the history

  2. engine: use a context object 

    I think I've finally worked out hte api/context/state stuff - now it's just a context object, itself an event emitter, which tracks state
    @josephjclark
    josephjclark committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    d7c7188 View commit details
    Browse the repository at this point in the history

  3. engine: extra test

    @josephjclark
    josephjclark committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    78cc25e View commit details
    Browse the repository at this point in the history

  4. engine: tidying and typings

    @josephjclark
    josephjclark committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    b18c1c0 View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2023

  1. engine: add public api wrapper

    @josephjclark
    josephjclark committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    7cda1fd View commit details
    Browse the repository at this point in the history

  2. engine: fix types and restore types test

    @josephjclark
    josephjclark committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    8e4a685 View commit details
    Browse the repository at this point in the history

  3. engine: tidyups

    @josephjclark
    josephjclark committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    90eca70 View commit details
    Browse the repository at this point in the history

  4. engine: add pack

    @josephjclark
    josephjclark committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    8cd3008 View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2023

  1. engine: api tests, fix ava issue

    @josephjclark
    josephjclark committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    de9d597 View commit details
    Browse the repository at this point in the history

  2. engine: more tests, fix tests

    @josephjclark
    josephjclark committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    f8fa02f View commit details
    Browse the repository at this point in the history

  3. engine: split internal and external events

    @josephjclark
    josephjclark committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    ccd4eda View commit details
    Browse the repository at this point in the history

  4. runtime: add callbacks for job execution

    @josephjclark
    josephjclark committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    195f098 View commit details
    Browse the repository at this point in the history

  5. runtime: introduce a singly notify callback

    @josephjclark
    josephjclark committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    99435b6 View commit details
    Browse the repository at this point in the history

  6. runtime: add handlers for lazy loading credentials and state

    @josephjclark
    josephjclark committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    d4fbcfa View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2023

  1. engine: lazy load intial state

    @josephjclark
    josephjclark committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    d3580cb View commit details
    Browse the repository at this point in the history

  2. engine: typings

    @josephjclark
    josephjclark committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    65b87e5 View commit details
    Browse the repository at this point in the history

  3. mock-lightning: break out the lightning mock into its own server. We … 

    …need this for integration tests
    @josephjclark
    josephjclark committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    a4fe705 View commit details
    Browse the repository at this point in the history

  4. lightning-mock: move over socket server tests

    @josephjclark
    josephjclark committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    cd0f3f3 View commit details
    Browse the repository at this point in the history

  5. ws-worker: move lightning mock into a different package

    @josephjclark
    josephjclark committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    397b0a9 View commit details
    Browse the repository at this point in the history

  6. worker: fix close()

    @josephjclark
    josephjclark committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    c138b4b View commit details
    Browse the repository at this point in the history

  7. lightning-mock: new events

    @josephjclark
    josephjclark committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    b5ad0c0 View commit details
    Browse the repository at this point in the history

  8. engine-multi: ensure listen can be called before execute

    @josephjclark
    josephjclark committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    ef5883d View commit details
    Browse the repository at this point in the history

  9. worker-tests: added some basic integration tests

    @josephjclark
    josephjclark committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    697533a View commit details
    Browse the repository at this point in the history

  10. engine: tidying

    @josephjclark
    josephjclark committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    8d1683e View commit details
    Browse the repository at this point in the history

  11. lightning-mock: remove logging

    @josephjclark
    josephjclark committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    224f8d9 View commit details
    Browse the repository at this point in the history

  12. cli-tests: update package name

    @josephjclark
    josephjclark committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    84d3d20 View commit details
    Browse the repository at this point in the history

  13. engine: emit event after autoinstall

    @josephjclark
    josephjclark committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    4db3042 View commit details
    Browse the repository at this point in the history

  14. worker: fix events for autoinstall 

    Also an emitted event no longer has to include workflowId
    @josephjclark
    josephjclark committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    fdf4785 View commit details
    Browse the repository at this point in the history

  15. engine: refactor ExecutionContext into its own file

    @josephjclark
    josephjclark committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    2cb974a View commit details
    Browse the repository at this point in the history

  16. worker-tests: add autoinstall test

    @josephjclark
    josephjclark committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    2efbb06 View commit details
    Browse the repository at this point in the history

  17. runtime: update job start and complete events

    @josephjclark
    josephjclark committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    d736b46 View commit details
    Browse the repository at this point in the history

  18. engine: map job start and complete events properly

    @josephjclark
    josephjclark committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    f5cf94f View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2023

  1. lightning-mock: update tests 

    Fix an issue where events wasnt passed into socket tests, and add a getResult test
    @josephjclark
    josephjclark committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    08c44bb View commit details
    Browse the repository at this point in the history

  2. runtime: be less eager to default initial state 

    Basically if the incoming plan has initial state, the runtime should not override it
    @josephjclark
    josephjclark committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    8244663 View commit details
    Browse the repository at this point in the history

  3. various: update worker integration tests 

    Initial state test
    @josephjclark
    josephjclark committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    bc01d18 View commit details
    Browse the repository at this point in the history

  4. integration-tests: dockerise worker tests, update command to run mult… 

    …iples suites
    @josephjclark
    josephjclark committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    7136bc8 View commit details
    Browse the repository at this point in the history

  5. various: fix initial state in worker, upate typings

    @josephjclark
    josephjclark committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    fec2405 View commit details
    Browse the repository at this point in the history

  6. update lockfile

    @josephjclark
    josephjclark committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    f375765 View commit details
    Browse the repository at this point in the history

  7. bump node versions

    @josephjclark
    josephjclark committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    3b7317b View commit details
    Browse the repository at this point in the history

  8. lightning-mock: quick type fix

    @josephjclark
    josephjclark committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    c688468 View commit details
    Browse the repository at this point in the history

  9. engine: don't take an id

    @josephjclark
    josephjclark committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    13554c3 View commit details
    Browse the repository at this point in the history

  10. worker: better error handling

    @josephjclark
    josephjclark committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    ff5b7e9 View commit details
    Browse the repository at this point in the history

  11. worker: map error event to complete

    @josephjclark
    josephjclark committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    6705d71 View commit details
    Browse the repository at this point in the history

  12. worker-tests: handle an error

    @josephjclark
    josephjclark committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    ee0830a View commit details
    Browse the repository at this point in the history

  13. trypings

    @josephjclark
    josephjclark committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    808d6b6 View commit details
    Browse the repository at this point in the history

  14. engine: preload credentials instead of loading on demand

    @josephjclark
    josephjclark committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    9b16a8d View commit details
    Browse the repository at this point in the history

  15. types

    @josephjclark
    josephjclark committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    466ff01 View commit details
    Browse the repository at this point in the history

  16. worker-tests: add a sort of working credential test

    @josephjclark
    josephjclark committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    17ebba6 View commit details
    Browse the repository at this point in the history

  17. types

    @josephjclark
    josephjclark committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    13e824d View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2023

  1. runtime: support disabled edges

    @josephjclark
    josephjclark committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    8e9251d View commit details
    Browse the repository at this point in the history

  2. worker: handle incoming enabled flag

    @josephjclark
    josephjclark committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    6075065 View commit details
    Browse the repository at this point in the history

  3. engine: resolveCredential should be singular

    @josephjclark
    josephjclark committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    ed34d04 View commit details
    Browse the repository at this point in the history

  4. various: fixing resolver types and values

    @josephjclark
    josephjclark committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    3f62a4b View commit details
    Browse the repository at this point in the history

  5. worker: fix more typings

    @josephjclark
    josephjclark committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    525745a View commit details
    Browse the repository at this point in the history

  6. engine: lock down child process.env

    @josephjclark
    josephjclark committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    3f21314 View commit details
    Browse the repository at this point in the history

  7. workers: skip flaky test

    @josephjclark
    josephjclark committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    e4a4f86 View commit details
    Browse the repository at this point in the history

  8. worker: add API to close workers

    @josephjclark
    josephjclark committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    f8517b8 View commit details
    Browse the repository at this point in the history

  9. engine: make engine creation async

    @josephjclark
    josephjclark committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    4fb9388 View commit details
    Browse the repository at this point in the history

  10. ws-worker: handle async engine creation

    @josephjclark
    josephjclark committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    8e0826f View commit details
    Browse the repository at this point in the history

  11. worker-tests: adapt to async engine

    @josephjclark
    josephjclark committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    fe17e9a View commit details
    Browse the repository at this point in the history

  12. engine: run a little validation script on startup

    @josephjclark
    josephjclark committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    6348a34 View commit details
    Browse the repository at this point in the history

  13. worker: types

    @josephjclark
    josephjclark committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    5f708e3 View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2023

  1. engine: add workerpool tests, update docs

    @josephjclark
    josephjclark committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    8937fec View commit details
    Browse the repository at this point in the history

  2. engine: more security tests

    @josephjclark
    josephjclark committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    266128e View commit details
    Browse the repository at this point in the history

  3. engine: update worker functions

    @josephjclark
    josephjclark committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    269ec33 View commit details
    Browse the repository at this point in the history

  4. engine: allow min-max workers to be passed

    @josephjclark
    josephjclark committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    0e2d510 View commit details
    Browse the repository at this point in the history

  5. engine: pass whitelist down from the API and expand run options to in… 

    …clude it
    @josephjclark
    josephjclark committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    2f07d90 View commit details
    Browse the repository at this point in the history

  6. engine: do not try to install blacklisted modules

    @josephjclark
    josephjclark committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    488ebfa View commit details
    Browse the repository at this point in the history

  7. engine: update repo env var; big docs update

    @josephjclark
    josephjclark committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    673cc11 View commit details
    Browse the repository at this point in the history

  8. worker docs

    @josephjclark
    josephjclark committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    f95d589 View commit details
    Browse the repository at this point in the history

  9. logger: export sanitize policies

    @josephjclark
    josephjclark committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    7e4529e View commit details
    Browse the repository at this point in the history

  10. worker: feed attempt options through to engine.execute 

    Not as easy as it looked...
    @josephjclark
    josephjclark committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    643e35a View commit details
    Browse the repository at this point in the history

  11. engine: support sanitize option (and a bit of option reworking)

    @josephjclark
    josephjclark committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    d5ad41b View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2023

  1. worker-tests: experimental dummy repo

    @josephjclark
    josephjclark committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    c7d3321 View commit details
    Browse the repository at this point in the history

  2. worker-tests: get test working (and failing sadly)

    @josephjclark
    josephjclark committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    8e1d9e0 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2023

  1. worker: tests to prove that worker threads isolate modules

    @josephjclark
    josephjclark committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    881bf90 View commit details
    Browse the repository at this point in the history

  2. engine: experiment with terminating threads. Didn't work.

    @josephjclark
    josephjclark committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    3e378c0 View commit details
    Browse the repository at this point in the history

  3. runtime: support a cacheKey in linker opts

    @josephjclark
    josephjclark committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    4631699 View commit details
    Browse the repository at this point in the history

  4. runtime: changeset

    @josephjclark
    josephjclark committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    d2360d4 View commit details
    Browse the repository at this point in the history

  5. worker: use plan id as a cache key

    @josephjclark
    josephjclark committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    4686508 View commit details
    Browse the repository at this point in the history

  6. worker-tests: add stateful adaptor test 

    tests are failing but unrelated
    @josephjclark
    josephjclark committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    107ed75 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2023

  1. engine: support timeout on the attempt

    @josephjclark
    josephjclark committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    1117ec8 View commit details
    Browse the repository at this point in the history

  2. worker-tests: restore tests

    @josephjclark
    josephjclark committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    a6d5318 View commit details
    Browse the repository at this point in the history

  3. runtime: comment

    @josephjclark
    josephjclark committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    e24df80 View commit details
    Browse the repository at this point in the history

  4. engine: remove test event

    @josephjclark
    josephjclark committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    f10fdf7 View commit details
    Browse the repository at this point in the history

  5. engine: try to purge workers after every run

    @josephjclark
    josephjclark committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    caab7a7 View commit details
    Browse the repository at this point in the history

  6. docs

    @josephjclark
    josephjclark committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    bc8f531 View commit details
    Browse the repository at this point in the history

  7. engine: prep for release

    @josephjclark
    josephjclark committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    e4a16e6 View commit details
    Browse the repository at this point in the history

  8. pnpm: exclude dummy repo from workspace

    @josephjclark
    josephjclark committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    719ff4b View commit details
    Browse the repository at this point in the history

  9. Engine: refactor timeout error

    @josephjclark
    josephjclark committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    dc4a197 View commit details
    Browse the repository at this point in the history