Skip to content

Fix task caching, additional dep upgrades and logging#336

Merged
twelch merged 33 commits intodevfrom
restabilize-3
Sep 3, 2024
Merged

Fix task caching, additional dep upgrades and logging#336
twelch merged 33 commits intodevfrom
restabilize-3

Conversation

@twelch
Copy link
Copy Markdown
Contributor

@twelch twelch commented Aug 29, 2024

This PR

  • rolls back the ws dependency, addressing an issue with socket messages being sent by sendmessage handler to browser clients being delayed by multiple minutes. Unclear what is happening.
  • adds paging to tasks.get for result chunks that altogether are more than 1MB allowed by Amazon.
  • resolves hot partition key issue in tasks table (throughput error) caused by number of items being stored under a single ID, which consisted of only the sketch id and update timestamp. All results for all reports for a given sketch, including workers, were put under a single ID and useFunction calls for all reports were hitting this ID at the same time. By adding the serving name to the ID, it spread the results out over more keys and aligned how data is stored with how it is queried (give me all items for a single sketch and service).
  • rebuilds lockfile

twelch and others added 9 commits August 27, 2024 19:18
* Add lambda worker helpers

* Add functions to export index

* Fix location bug with runLambdaWorker

* Use more accurate byteSize measurements

* Downgrade aws-sdk, avoids socket error

* Small gp bump to match rollback

* Name adjustments. Remove package downgrade from this branch, update smoke timeouts for blank-template
…ve unused correlationId attribute, drop peerDependencies was causing weird copying of conditionals to dependencies section (#330)
@twelch twelch changed the title Restabilize 3 Revert upgrades, fix cached task retrieval, rebuild lockfile Aug 29, 2024
@twelch twelch marked this pull request as ready for review August 29, 2024 21:06
twelch added 5 commits August 31, 2024 18:15
* minor dep upgrade

* bump react-i18next, typedoc, drop unused languagedetector

* bump vitest and some lesser dependencies, drop val-loader and magicast

* comment out logging not needed all the time

* update lockfile

* update package lockfile
@twelch twelch changed the title Revert upgrades, fix cached task retrieval, rebuild lockfile Fix task caching, additional dep upgrades and logging Sep 1, 2024
@twelch twelch merged commit 2e696f1 into dev Sep 3, 2024
@twelch twelch deleted the restabilize-3 branch September 3, 2024 18:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants