-
Notifications
You must be signed in to change notification settings - Fork 10
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #404 from OpenFn/engine
Runtime Engine
- Loading branch information
Showing
120 changed files
with
5,505 additions
and
1,758 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
--- | ||
'@openfn/logger': patch | ||
--- | ||
|
||
Export SanitizePolicies type |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
--- | ||
'@openfn/runtime': patch | ||
--- | ||
|
||
Support a cacheKey to bust cached modules in long-running processes |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
--- | ||
'@openfn/runtime': patch | ||
--- | ||
|
||
Trigger callbacks on job start, complete and init |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1 +1 @@ | ||
nodejs 18.12.1 | ||
nodejs 18.18.2 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,2 @@ | ||
node_modules | ||
repo |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,15 @@ | ||
# This dockerfile allows us to run tests against the build in isolation | ||
# (I'm not really sure we need it but it's been a useful dev tool) | ||
FROM node:18.12.0 | ||
|
||
ENV NODE_ENV=production | ||
|
||
WORKDIR /app | ||
|
||
COPY . . | ||
|
||
COPY ./package.json.container ./package.json | ||
|
||
RUN npm install --production | ||
|
||
CMD ["npm", "test"] |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,13 @@ | ||
export default { | ||
extensions: { | ||
ts: 'module', | ||
}, | ||
|
||
environmentVariables: { | ||
TS_NODE_TRANSPILE_ONLY: 'true', | ||
}, | ||
|
||
nodeArguments: ['--loader=ts-node/esm', '--no-warnings'], | ||
|
||
files: ['test/**/*test.ts'], | ||
}; |
6 changes: 6 additions & 0 deletions
6
integration-tests/worker/dummy-repo/node_modules/@openfn/stateful-test_1.0.0/index.js
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Oops, something went wrong.
7 changes: 7 additions & 0 deletions
7
integration-tests/worker/dummy-repo/node_modules/@openfn/stateful-test_1.0.0/package.json
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,8 @@ | ||
{ | ||
"name": "test-repo", | ||
"private": true, | ||
"version": "1.0.0", | ||
"dependencies": { | ||
"@openfn/stateful-test_1.0.0": "@npm:@openfn/stateful-test@1.0.0" | ||
} | ||
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,35 @@ | ||
{ | ||
"name": "@openfn/integration-tests-worker", | ||
"private": true, | ||
"version": "1.0.0", | ||
"description": "Lightning WOrker integration tests", | ||
"author": "Open Function Group <admin@openfn.org>", | ||
"license": "ISC", | ||
"type": "module", | ||
"scripts": { | ||
"clean": "rimraf dist tmp/repo/*", | ||
"build:pack": "pnpm clean && cd ../.. && pnpm pack:local integration-tests/worker/dist --no-version", | ||
"build": "pnpm build:pack && docker build --tag worker-integration-tests .", | ||
"start": "docker run worker-integration-tests", | ||
"test": "pnpm clean && npx ava -s --timeout 2m" | ||
}, | ||
"dependencies": { | ||
"@openfn/engine-multi": "workspace:^", | ||
"@openfn/lightning-mock": "workspace:^", | ||
"@openfn/logger": "workspace:^", | ||
"@openfn/ws-worker": "workspace:^", | ||
"@types/node": "^18.15.13", | ||
"@types/rimraf": "^3.0.2", | ||
"ava": "5.3.1", | ||
"date-fns": "^2.30.0", | ||
"koa": "^2.13.4", | ||
"rimraf": "^3.0.2", | ||
"ts-node": "10.8.1", | ||
"tslib": "^2.4.0", | ||
"typescript": "^5.1.6" | ||
}, | ||
"files": [ | ||
"dist", | ||
"README.md" | ||
] | ||
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,34 @@ | ||
{ | ||
"name": "@openfn/integration-tests-worker", | ||
"private": true, | ||
"version": "1.0.0", | ||
"description": "Lightning WOrker integration tests", | ||
"author": "Open Function Group <admin@openfn.org>", | ||
"license": "ISC", | ||
"type": "module", | ||
"scripts": { | ||
"clean": "rimraf dist tmp/repo/*", | ||
"build:pack": "npm run clean && cd ../.. && npm run pack:local integration-tests/worker/dist --no-version", | ||
"build": "npm run build:pack && docker build --tag worker-integration-tests .", | ||
"start": "docker run worker-integration-tests", | ||
"test": "npm run clean && npx ava -s --timeout 2m" | ||
}, | ||
"dependencies": { | ||
"@openfn/engine-multi": "./dist/openfn-engine-multi.tgz", | ||
"@openfn/lightning-mock": "./dist/openfn-lightning-mock.tgz", | ||
"@openfn/logger": "./dist/openfn-logger.tgz", | ||
"@openfn/ws-worker": "./dist/openfn-ws-worker.tgz", | ||
"@types/node": "^18.15.13", | ||
"ava": "5.3.1", | ||
"date-fns": "^2.30.0", | ||
"rimraf": "^3.0.2", | ||
"ts-node": "10.8.1", | ||
"tslib": "^2.4.0", | ||
"typescript": "^5.1.6", | ||
"@types/rimraf": "^3.0.2" | ||
}, | ||
"files": [ | ||
"dist", | ||
"README.md" | ||
] | ||
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
Integration tests for Lightning Worker architecture. |
Oops, something went wrong.