Skip to content

Commit

Permalink
Put underlying reason for not using file storage
Browse files Browse the repository at this point in the history
  • Loading branch information
connorads committed May 25, 2024
1 parent d1c4ef4 commit 70a4fdd
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions website/versioned_docs/version-3.10/deployment/aws-cheerio.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ Locally, we can conveniently create a Crawlee project with `npx crawlee create`.

Whenever we instantiate a new crawler, we have to pass a unique `Configuration` instance to it. By default, all the Crawlee crawler instances share the same storage - this can be convenient, but would also cause “statefulness” of our Lambda, which would lead to hard-to-debug problems.

Also, when creating this Configuration instance, make sure to pass the `persistStorage: false` option. This tells Crawlee to use in-memory storage, as the default storage directory for Crawlee is read-only on the Lambda Filesystem.
Also, when creating this Configuration instance, make sure to pass the `persistStorage: false` option. This tells Crawlee to use in-memory storage, which will also prevent Lambda "statefulness" and its potential issues.

```javascript title="src/main.js"
// For more information, see https://crawlee.dev/
Expand Down Expand Up @@ -123,4 +123,4 @@ The memory size can greatly affect the execution speed of your Lambda.

See the [official documentation](https://docs.aws.amazon.com/lambda/latest/operatorguide/computing-power.html) to see how the performance and cost scale with more memory.

:::
:::

0 comments on commit 70a4fdd

Please sign in to comment.