You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm currently running replibyte trying to subset my database.
My config is something like:
source:
connection_uri: $DB_URL
database_subset:
database: public
table: cart
strategy_name: random
strategy_options:
percent: 20
passthrough_tables:
- country
....
<30 more tables>
transformers:
- database: public
table: customer
columns:
- name: email
transformer_name: email
...
<23 columns and 8 tables>
This results in replibyte running out of memory (I'm guessing given the screenshot of the process from my activity montitor below, taken right before the process crashed)
Is there any way to reduce the memory consumption, the database is in total around 250mb (148mb if asking postgres with: SELECT pg_size_pretty( pg_database_size('dbname') )) and 51gb of memory taken up seems excessive.
The text was updated successfully, but these errors were encountered:
I'm currently running replibyte trying to subset my database.
My config is something like:
This results in replibyte running out of memory (I'm guessing given the screenshot of the process from my activity montitor below, taken right before the process crashed)
Is there any way to reduce the memory consumption, the database is in total around 250mb (148mb if asking postgres with:
SELECT pg_size_pretty( pg_database_size('dbname') )
) and 51gb of memory taken up seems excessive.The text was updated successfully, but these errors were encountered: