Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TypeError #57

Open
symphorien opened this issue May 16, 2021 · 2 comments
Open

TypeError #57

symphorien opened this issue May 16, 2021 · 2 comments
Assignees
Labels
bug Something isn't working
Projects

Comments

@symphorien
Copy link

$ dduper --device /dev/mapper/vg-root --dir /nix/store/*llvm*-lib --recurse
[...]
Dedupe completed for /nix/store/1xcwdxx002a70ml4h1k0byciidbsnx2n-llvm-8.0.1-lib/lib/libLLVM-8.so:/nix/store/hpa2wxp7cjxgb5bn44wnhb4aig65s1kg-llvm-8.0.1-lib/lib/libLLVM.so
Summary
blk_size : 4KB  chunksize : 128KB
/nix/store/1xcwdxx002a70ml4h1k0byciidbsnx2n-llvm-8.0.1-lib/lib/libLLVM-8.so has 646 chunks
/nix/store/hpa2wxp7cjxgb5bn44wnhb4aig65s1kg-llvm-8.0.1-lib/lib/libLLVM.so has 643 chunks
Matched chunks: 1
Unmatched chunks: 642
Total size(KB) deduped: 128
************************
error([Errno 22] Invalid argument)
Traceback (most recent call last):
  File "/nix/store/ldmj09d7pfyircf1j34m8rhpy0qxlj2l-dduper-v0.04/bin//dduper", line 594, in <module>
    main(results)
  File "/nix/store/ldmj09d7pfyircf1j34m8rhpy0qxlj2l-dduper-v0.04/bin//dduper", line 465, in main
    dedupe_dir(results.dir_path, results.dry_run, results.recurse)
  File "/nix/store/ldmj09d7pfyircf1j34m8rhpy0qxlj2l-dduper-v0.04/bin//dduper", line 456, in dedupe_dir
    dedupe_files(file_list, dry_run)
  File "/nix/store/ldmj09d7pfyircf1j34m8rhpy0qxlj2l-dduper-v0.04/bin//dduper", line 410, in dedupe_files
    ret = do_dedupe(src_file, dst_file, dry_run)
  File "/nix/store/ldmj09d7pfyircf1j34m8rhpy0qxlj2l-dduper-v0.04/bin//dduper", line 281, in do_dedupe
    bytes_deduped,status = ioctl_fideduperange(src_fd, s)
TypeError: cannot unpack non-iterable NoneType object
@Lakshmipathi
Copy link
Owner

Could you please try with --dir /nix/store/ instead of --dir /nix/store/*llvm*-lib ? Let me know if you still face this issue.

@Lakshmipathi Lakshmipathi self-assigned this May 18, 2021
@Lakshmipathi Lakshmipathi added the bug Something isn't working label May 18, 2021
@symphorien
Copy link
Author

Well it takes infinite time without crashing because this folder contains millions of files and dduper is quadratic(!).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
dduper
  
Awaiting triage
Development

No branches or pull requests

2 participants