Skip to content

Switch tasks class to storing dynamodb results as JSON string chunks, drop correlationId and peerDependencies#330

Merged
twelch merged 3 commits intodevfrom
task-string-split
Aug 27, 2024
Merged

Switch tasks class to storing dynamodb results as JSON string chunks, drop correlationId and peerDependencies#330
twelch merged 3 commits intodevfrom
task-string-split

Conversation

@twelch
Copy link
Copy Markdown
Contributor

@twelch twelch commented Aug 17, 2024

dropped peerDependencies because was causing weird copying of conditionals to dependencies section on npm install

@twelch twelch changed the title tasks: switch to storing dynamodb results as JSON string chunks, drop correlationId and peerDependencies Switch tasks class to storing dynamodb results as JSON string chunks, drop correlationId and peerDependencies Aug 27, 2024
@twelch twelch merged commit a2a1146 into dev Aug 27, 2024
@twelch twelch deleted the task-string-split branch August 27, 2024 22:32
twelch added a commit that referenced this pull request Aug 28, 2024
…ve unused correlationId attribute, drop peerDependencies was causing weird copying of conditionals to dependencies section (#330)
twelch added a commit that referenced this pull request Sep 3, 2024
* upgrade commander and migrate to read-package-up, bump clipToGeography timeout, rebuild lockfile

* Creates clipped bboxes in clipToGeography. Fixes bug with dashes in dynamodb local access keys (#325)

* Add runLambdaWorker helper (#326)

* Add lambda worker helpers

* Add functions to export index

* Fix location bug with runLambdaWorker

* Use more accurate byteSize measurements

* Downgrade aws-sdk, avoids socket error

* Small gp bump to match rollback

* Name adjustments. Remove package downgrade from this branch, update smoke timeouts for blank-template

* tasks: switch to storing dynamodb results as JSON string chunks, remove unused correlationId attribute, drop peerDependencies was causing weird copying of conditionals to dependencies section (#330)

* add task debug

* add debug

* bug: incorrect table name for task get method

* add service filter to task get

* add perf logging to GeoprocessingHandler

* add chunk state logging to GeoprocessingHandler

* add overall handler perf logging to GeoprocessingHandler, including socket message payload timestamp

* useFunction: log socket latency

* useFunction: add serviceName to log message

* tasks add debug performance logging to complete method

* debug string split performance

* timeEnd

* Switch to faster string chunker that chunks on spaces

* update package lock

* tasks: filter first on get, add debug

* tasks: use serviceItems properly

* tasks: get add orig item debug

* include service name in cache key  as local cache was already doing, to prevent hot partition key in dynamodb

* improve filter for chunk items

* useFunction debug

* tasks: add more debug on cache string merge

* add paging to tasks.get

* comment out logging not needed all the time

* Upgrade dependencies (#337)

* minor dep upgrade

* bump react-i18next, typedoc, drop unused languagedetector

* bump vitest and some lesser dependencies, drop val-loader and magicast

* comment out logging not needed all the time

* update lockfile

* update package lockfile

* more dep upgrades

* rollback cdk and ws

* upgrade aws and not ws

---------

Co-authored-by: Abby Meyer <avmey98@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant