You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It is possible for a token counter to return zero tokens, leading to a division by zero error in the merge_splits function:
File "C:\Users\user\miniconda3\envs\project\Lib\site-packages\semchunk\semchunk.py", line 78, in merge_splits
average = cumulative_lengths[midpoint] / tokens if cumulative_lengths[midpoint] else average
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~
ZeroDivisionError: division by zero
The text was updated successfully, but these errors were encountered:
jcobol
added a commit
to jcobol/semchunk
that referenced
this issue
May 27, 2024
It is possible for a token counter to return zero tokens, leading to a division by zero error in the
merge_splits
function:The text was updated successfully, but these errors were encountered: