Bug Report
Describe the bug
When processing datasets over 1GB, the application gradually consumes more memory until it crashes with OOM.
Steps to Reproduce
- Load a dataset larger than 1GB
- Run the data processing pipeline
- Monitor memory usage with
top
- Observe memory climbing until OOM
Expected Behavior
Memory should stay stable during processing by properly releasing intermediate data.
Environment
- OS: Ubuntu 22.04
- Python: 3.11
- Package version: 2.1.0
Bug Report
Describe the bug
When processing datasets over 1GB, the application gradually consumes more memory until it crashes with OOM.
Steps to Reproduce
topExpected Behavior
Memory should stay stable during processing by properly releasing intermediate data.
Environment