Skip to content

Add runLambdaWorker helper#326

Merged
twelch merged 7 commits intodevfrom
lambdaWorkerHelpers
Aug 20, 2024
Merged

Add runLambdaWorker helper#326
twelch merged 7 commits intodevfrom
lambdaWorkerHelpers

Conversation

@avmey
Copy link
Copy Markdown
Contributor

@avmey avmey commented Aug 15, 2024

Removes the need for projects to directly import aws-sdk and invoke a worker lambda

@twelch twelch added this to the 7.0 milestone Aug 15, 2024
@avmey avmey requested a review from twelch August 15, 2024 17:51
@twelch
Copy link
Copy Markdown
Contributor

twelch commented Aug 18, 2024

@avmey I think the rollback commits should be moved off of this branch so this PR can be merged as a distinct piece of work, what do you think?

Comment thread packages/geoprocessing/src/aws/helpers.ts Outdated
@twelch twelch changed the title Add lambda worker helpers to framework Add runLambdaWorker helper Aug 20, 2024
@twelch twelch merged commit 63a0d88 into dev Aug 20, 2024
@twelch twelch deleted the lambdaWorkerHelpers branch August 20, 2024 04:57
twelch pushed a commit that referenced this pull request Aug 28, 2024
* Add lambda worker helpers

* Add functions to export index

* Fix location bug with runLambdaWorker

* Use more accurate byteSize measurements

* Downgrade aws-sdk, avoids socket error

* Small gp bump to match rollback

* Name adjustments. Remove package downgrade from this branch, update smoke timeouts for blank-template
twelch added a commit that referenced this pull request Sep 3, 2024
* upgrade commander and migrate to read-package-up, bump clipToGeography timeout, rebuild lockfile

* Creates clipped bboxes in clipToGeography. Fixes bug with dashes in dynamodb local access keys (#325)

* Add runLambdaWorker helper (#326)

* Add lambda worker helpers

* Add functions to export index

* Fix location bug with runLambdaWorker

* Use more accurate byteSize measurements

* Downgrade aws-sdk, avoids socket error

* Small gp bump to match rollback

* Name adjustments. Remove package downgrade from this branch, update smoke timeouts for blank-template

* tasks: switch to storing dynamodb results as JSON string chunks, remove unused correlationId attribute, drop peerDependencies was causing weird copying of conditionals to dependencies section (#330)

* add task debug

* add debug

* bug: incorrect table name for task get method

* add service filter to task get

* add perf logging to GeoprocessingHandler

* add chunk state logging to GeoprocessingHandler

* add overall handler perf logging to GeoprocessingHandler, including socket message payload timestamp

* useFunction: log socket latency

* useFunction: add serviceName to log message

* tasks add debug performance logging to complete method

* debug string split performance

* timeEnd

* Switch to faster string chunker that chunks on spaces

* update package lock

* tasks: filter first on get, add debug

* tasks: use serviceItems properly

* tasks: get add orig item debug

* include service name in cache key  as local cache was already doing, to prevent hot partition key in dynamodb

* improve filter for chunk items

* useFunction debug

* tasks: add more debug on cache string merge

* add paging to tasks.get

* comment out logging not needed all the time

* Upgrade dependencies (#337)

* minor dep upgrade

* bump react-i18next, typedoc, drop unused languagedetector

* bump vitest and some lesser dependencies, drop val-loader and magicast

* comment out logging not needed all the time

* update lockfile

* update package lockfile

* more dep upgrades

* rollback cdk and ws

* upgrade aws and not ws

---------

Co-authored-by: Abby Meyer <avmey98@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Development

Successfully merging this pull request may close these issues.

2 participants