[BUG] Rcursion Error

[ChawDoe]

Severity

P0 - Critical breaking issue or missing functionality

Current Behavior

/lib/python3.10/site-packages/deeplake/core/version_control/commit_node.py", line 28, in copy
    node = CommitNode(self.branch, self.commit_id)
RecursionError: maximum recursion depth exceeded

i used 4 gpus to pre-compute the data tensor and save it into deeplake dataset.
the workflow like this:

a = deeplake('xxx', overwrite=False)
for i in range(100000):
  a.extend(xxx)
  if i % 100 == 0:
    a.commit()

Steps to Reproduce

a = deeplake('xxx', overwrite=False)
for i in range(100000):
  a.extend(xxx)
  if i % 100 == 0:
    a.commit()

Expected/Desired Behavior

/lib/python3.10/site-packages/deeplake/core/version_control/commit_node.py", line 28, in copy
node = CommitNode(self.branch, self.commit_id)
RecursionError: maximum recursion depth exceeded

Python Version

No response

OS

No response

IDE

No response

Packages

No response

Additional Context

No response

Possible Solution

No response

Are you willing to submit a PR?

• I'm willing to submit a PR (Thank you!)

[davidbuniat]

Thanks @ChawDoe for reporting the issue! Adding @FayazRahman to deep dive on the problem.