Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Attic corrupts archive during creation #185

Closed
rbu opened this issue Jan 23, 2015 · 5 comments
Closed

Attic corrupts archive during creation #185

rbu opened this issue Jan 23, 2015 · 5 comments

Comments

@rbu
Copy link

rbu commented Jan 23, 2015

I have created an Attic archive like this:

attic init backup
attic create backup::mysql-2015-01-23_17-32-33.sql /root/mysqldump
attic create backup::varfiles-2015-01-23_17-32-33 /home/zope/instances

Which succeeded after about 10 minutes, no error. The resulting repo was 17 GB, whereas the production data is 28 GB (possible duplication, gzip -1 creates a 26 GB file though).

Then attic list backup::varfiles-2015-01-23_17-32-33 fails:

(databackup)[root@camembert ~]# attic list backup::copydir-2015-01-23_17-32-33
drwxr-xr-x zope   zope          0 Nov 14 19:43 home/zope/instances
drwxrwxr-x zope   zope          0 Nov 05 17:04 home/zope/instances/production
drwxr-xr-x zope   zope          0 Nov 13 12:54 home/zope/instances/production/Products
-rw-r--r-- zope   zope        189 Nov 04 09:42 home/zope/instances/production/Products/README.txt
-rw-r--r-- zope   zope        244 Nov 04 09:42 home/zope/instances/production/Products/__init__.py
-rw-r--r-- zope   zope        430 Nov 04 09:42 home/zope/instances/production/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/bin
-rwx------ zope   zope        227 Nov 04 09:42 home/zope/instances/production/bin/runzope
-rwx------ zope   zope        200 Nov 04 09:42 home/zope/instances/production/bin/runzope.bat
-rwx------ zope   zope        255 Nov 04 09:42 home/zope/instances/production/bin/zope2.wsgi
-rwx------ zope   zope        277 Nov 04 09:42 home/zope/instances/production/bin/zopectl
-rwx------ zope   zope        239 Nov 04 09:42 home/zope/instances/production/bin/zopectl.bat
drwxr-xr-x zope   zope          0 Nov 18 11:50 home/zope/instances/production/etc
-rw-r--r-- zope   zope        760 Nov 04 09:42 home/zope/instances/production/etc/site.zcml
-rw-rw-r-- zope   zope       1408 Nov 18 11:50 home/zope/instances/production/etc/zope.conf
-rw-r--r-- zope   zope      31161 Nov 04 09:42 home/zope/instances/production/etc/zope.conf.bak
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/import
-rwxr-xr-x zope   zope        211 Nov 04 09:42 home/zope/instances/production/import/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib/python
-rw-r--r-- zope   zope        336 Nov 04 09:42 home/zope/instances/production/lib/python/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/log
-rw-r--r-- zope   zope         57 Nov 04 09:42 home/zope/instances/production/log/README.txt
-rw-r--r-- zope   zope    1369781 Jan 23 17:29 home/zope/instances/production/log/Z2.log
-rw-r--r-- zope   zope    4339066 Jan 23 17:29 home/zope/instances/production/log/event.log
drwxrwxr-x zope   zope          0 Nov 14 18:28 home/zope/instances/production/var
drwxr-xr-x zope   zope          0 Nov 14 19:43 home/zope/instances
drwxrwxr-x zope   zope          0 Nov 05 17:04 home/zope/instances/production
drwxr-xr-x zope   zope          0 Nov 13 12:54 home/zope/instances/production/Products
-rw-r--r-- zope   zope        189 Nov 04 09:42 home/zope/instances/production/Products/README.txt
-rw-r--r-- zope   zope        244 Nov 04 09:42 home/zope/instances/production/Products/__init__.py
-rw-r--r-- zope   zope        430 Nov 04 09:42 home/zope/instances/production/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/bin
-rwx------ zope   zope        227 Nov 04 09:42 home/zope/instances/production/bin/runzope
-rwx------ zope   zope        200 Nov 04 09:42 home/zope/instances/production/bin/runzope.bat
-rwx------ zope   zope        255 Nov 04 09:42 home/zope/instances/production/bin/zope2.wsgi
-rwx------ zope   zope        277 Nov 04 09:42 home/zope/instances/production/bin/zopectl
-rwx------ zope   zope        239 Nov 04 09:42 home/zope/instances/production/bin/zopectl.bat
drwxr-xr-x zope   zope          0 Nov 18 11:50 home/zope/instances/production/etc
-rw-r--r-- zope   zope        760 Nov 04 09:42 home/zope/instances/production/etc/site.zcml
-rw-rw-r-- zope   zope       1408 Nov 18 11:50 home/zope/instances/production/etc/zope.conf
-rw-r--r-- zope   zope      31161 Nov 04 09:42 home/zope/instances/production/etc/zope.conf.bak
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/import
-rwxr-xr-x zope   zope        211 Nov 04 09:42 home/zope/instances/production/import/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib/python
-rw-r--r-- zope   zope        336 Nov 04 09:42 home/zope/instances/production/lib/python/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/log
-rw-r--r-- zope   zope         57 Nov 04 09:42 home/zope/instances/production/log/README.txt
-rw-r--r-- zope   zope    1369781 Jan 23 17:29 home/zope/instances/production/log/Z2.log
-rw-r--r-- zope   zope    4339066 Jan 23 17:29 home/zope/instances/production/log/event.log
drwxrwxr-x zope   zope          0 Nov 14 18:28 home/zope/instances/production/var
drwxr-xr-x zope   zope          0 Nov 14 19:43 home/zope/instances
drwxrwxr-x zope   zope          0 Nov 05 17:04 home/zope/instances/production
drwxr-xr-x zope   zope          0 Nov 13 12:54 home/zope/instances/production/Products
-rw-r--r-- zope   zope        189 Nov 04 09:42 home/zope/instances/production/Products/README.txt
-rw-r--r-- zope   zope        244 Nov 04 09:42 home/zope/instances/production/Products/__init__.py
-rw-r--r-- zope   zope        430 Nov 04 09:42 home/zope/instances/production/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/bin
-rwx------ zope   zope        227 Nov 04 09:42 home/zope/instances/production/bin/runzope
-rwx------ zope   zope        200 Nov 04 09:42 home/zope/instances/production/bin/runzope.bat
-rwx------ zope   zope        255 Nov 04 09:42 home/zope/instances/production/bin/zope2.wsgi
-rwx------ zope   zope        277 Nov 04 09:42 home/zope/instances/production/bin/zopectl
-rwx------ zope   zope        239 Nov 04 09:42 home/zope/instances/production/bin/zopectl.bat
drwxr-xr-x zope   zope          0 Nov 18 11:50 home/zope/instances/production/etc
-rw-r--r-- zope   zope        760 Nov 04 09:42 home/zope/instances/production/etc/site.zcml
-rw-rw-r-- zope   zope       1408 Nov 18 11:50 home/zope/instances/production/etc/zope.conf
-rw-r--r-- zope   zope      31161 Nov 04 09:42 home/zope/instances/production/etc/zope.conf.bak
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/import
-rwxr-xr-x zope   zope        211 Nov 04 09:42 home/zope/instances/production/import/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib/python
-rw-r--r-- zope   zope        336 Nov 04 09:42 home/zope/instances/production/lib/python/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/log
-rw-r--r-- zope   zope         57 Nov 04 09:42 home/zope/instances/production/log/README.txt
-rw-r--r-- zope   zope    1369781 Jan 23 17:29 home/zope/instances/production/log/Z2.log
-rw-r--r-- zope   zope    4339066 Jan 23 17:29 home/zope/instances/production/log/event.log
drwxrwxr-x zope   zope          0 Nov 14 18:28 home/zope/instances/production/var
drwxr-xr-x zope   zope          0 Nov 14 19:43 home/zope/instances
drwxrwxr-x zope   zope          0 Nov 05 17:04 home/zope/instances/production
drwxr-xr-x zope   zope          0 Nov 13 12:54 home/zope/instances/production/Products
-rw-r--r-- zope   zope        189 Nov 04 09:42 home/zope/instances/production/Products/README.txt
-rw-r--r-- zope   zope        244 Nov 04 09:42 home/zope/instances/production/Products/__init__.py
-rw-r--r-- zope   zope        430 Nov 04 09:42 home/zope/instances/production/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/bin
-rwx------ zope   zope        227 Nov 04 09:42 home/zope/instances/production/bin/runzope
-rwx------ zope   zope        200 Nov 04 09:42 home/zope/instances/production/bin/runzope.bat
-rwx------ zope   zope        255 Nov 04 09:42 home/zope/instances/production/bin/zope2.wsgi
-rwx------ zope   zope        277 Nov 04 09:42 home/zope/instances/production/bin/zopectl
-rwx------ zope   zope        239 Nov 04 09:42 home/zope/instances/production/bin/zopectl.bat
drwxr-xr-x zope   zope          0 Nov 18 11:50 home/zope/instances/production/etc
-rw-r--r-- zope   zope        760 Nov 04 09:42 home/zope/instances/production/etc/site.zcml
-rw-rw-r-- zope   zope       1408 Nov 18 11:50 home/zope/instances/production/etc/zope.conf
-rw-r--r-- zope   zope      31161 Nov 04 09:42 home/zope/instances/production/etc/zope.conf.bak
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/import
-rwxr-xr-x zope   zope        211 Nov 04 09:42 home/zope/instances/production/import/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib/python
-rw-r--r-- zope   zope        336 Nov 04 09:42 home/zope/instances/production/lib/python/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/log
-rw-r--r-- zope   zope         57 Nov 04 09:42 home/zope/instances/production/log/README.txt
-rw-r--r-- zope   zope    1369781 Jan 23 17:29 home/zope/instances/production/log/Z2.log
-rw-r--r-- zope   zope    4339066 Jan 23 17:29 home/zope/instances/production/log/event.log
drwxrwxr-x zope   zope          0 Nov 14 18:28 home/zope/instances/production/var
drwxr-xr-x zope   zope          0 Nov 14 19:43 home/zope/instances
drwxrwxr-x zope   zope          0 Nov 05 17:04 home/zope/instances/production
drwxr-xr-x zope   zope          0 Nov 13 12:54 home/zope/instances/production/Products
-rw-r--r-- zope   zope        189 Nov 04 09:42 home/zope/instances/production/Products/README.txt
-rw-r--r-- zope   zope        244 Nov 04 09:42 home/zope/instances/production/Products/__init__.py
-rw-r--r-- zope   zope        430 Nov 04 09:42 home/zope/instances/production/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/bin
-rwx------ zope   zope        227 Nov 04 09:42 home/zope/instances/production/bin/runzope
-rwx------ zope   zope        200 Nov 04 09:42 home/zope/instances/production/bin/runzope.bat
-rwx------ zope   zope        255 Nov 04 09:42 home/zope/instances/production/bin/zope2.wsgi
-rwx------ zope   zope        277 Nov 04 09:42 home/zope/instances/production/bin/zopectl
-rwx------ zope   zope        239 Nov 04 09:42 home/zope/instances/production/bin/zopectl.bat
drwxr-xr-x zope   zope          0 Nov 18 11:50 home/zope/instances/production/etc
-rw-r--r-- zope   zope        760 Nov 04 09:42 home/zope/instances/production/etc/site.zcml
-rw-rw-r-- zope   zope       1408 Nov 18 11:50 home/zope/instances/production/etc/zope.conf
-rw-r--r-- zope   zope      31161 Nov 04 09:42 home/zope/instances/production/etc/zope.conf.bak
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/import
-rwxr-xr-x zope   zope        211 Nov 04 09:42 home/zope/instances/production/import/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib/python
-rw-r--r-- zope   zope        336 Nov 04 09:42 home/zope/instances/production/lib/python/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/log
-rw-r--r-- zope   zope         57 Nov 04 09:42 home/zope/instances/production/log/README.txt
-rw-r--r-- zope   zope    1369781 Jan 23 17:29 home/zope/instances/production/log/Z2.log
-rw-r--r-- zope   zope    4339066 Jan 23 17:29 home/zope/instances/production/log/event.log
drwxrwxr-x zope   zope          0 Nov 14 18:28 home/zope/instances/production/var
drwxr-xr-x zope   zope          0 Nov 14 19:43 home/zope/instances
drwxrwxr-x zope   zope          0 Nov 05 17:04 home/zope/instances/production
drwxr-xr-x zope   zope          0 Nov 13 12:54 home/zope/instances/production/Products
-rw-r--r-- zope   zope        189 Nov 04 09:42 home/zope/instances/production/Products/README.txt
-rw-r--r-- zope   zope        244 Nov 04 09:42 home/zope/instances/production/Products/__init__.py
-rw-r--r-- zope   zope        430 Nov 04 09:42 home/zope/instances/production/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/bin
-rwx------ zope   zope        227 Nov 04 09:42 home/zope/instances/production/bin/runzope
-rwx------ zope   zope        200 Nov 04 09:42 home/zope/instances/production/bin/runzope.bat
-rwx------ zope   zope        255 Nov 04 09:42 home/zope/instances/production/bin/zope2.wsgi
-rwx------ zope   zope        277 Nov 04 09:42 home/zope/instances/production/bin/zopectl
-rwx------ zope   zope        239 Nov 04 09:42 home/zope/instances/production/bin/zopectl.bat
drwxr-xr-x zope   zope          0 Nov 18 11:50 home/zope/instances/production/etc
-rw-r--r-- zope   zope        760 Nov 04 09:42 home/zope/instances/production/etc/site.zcml
-rw-rw-r-- zope   zope       1408 Nov 18 11:50 home/zope/instances/production/etc/zope.conf
-rw-r--r-- zope   zope      31161 Nov 04 09:42 home/zope/instances/production/etc/zope.conf.bak
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/import
-rwxr-xr-x zope   zope        211 Nov 04 09:42 home/zope/instances/production/import/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib/python
-rw-r--r-- zope   zope        336 Nov 04 09:42 home/zope/instances/production/lib/python/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/log
-rw-r--r-- zope   zope         57 Nov 04 09:42 home/zope/instances/production/log/README.txt
-rw-r--r-- zope   zope    1369781 Jan 23 17:29 home/zope/instances/production/log/Z2.log
-rw-r--r-- zope   zope    4339066 Jan 23 17:29 home/zope/instances/production/log/event.log
drwxrwxr-x zope   zope          0 Nov 14 18:28 home/zope/instances/production/var
drwxr-xr-x zope   zope          0 Nov 14 19:43 home/zope/instances
drwxrwxr-x zope   zope          0 Nov 05 17:04 home/zope/instances/production
drwxr-xr-x zope   zope          0 Nov 13 12:54 home/zope/instances/production/Products
-rw-r--r-- zope   zope        189 Nov 04 09:42 home/zope/instances/production/Products/README.txt
-rw-r--r-- zope   zope        244 Nov 04 09:42 home/zope/instances/production/Products/__init__.py
-rw-r--r-- zope   zope        430 Nov 04 09:42 home/zope/instances/production/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/bin
-rwx------ zope   zope        227 Nov 04 09:42 home/zope/instances/production/bin/runzope
-rwx------ zope   zope        200 Nov 04 09:42 home/zope/instances/production/bin/runzope.bat
-rwx------ zope   zope        255 Nov 04 09:42 home/zope/instances/production/bin/zope2.wsgi
-rwx------ zope   zope        277 Nov 04 09:42 home/zope/instances/production/bin/zopectl
-rwx------ zope   zope        239 Nov 04 09:42 home/zope/instances/production/bin/zopectl.bat
drwxr-xr-x zope   zope          0 Nov 18 11:50 home/zope/instances/production/etc
-rw-r--r-- zope   zope        760 Nov 04 09:42 home/zope/instances/production/etc/site.zcml
-rw-rw-r-- zope   zope       1408 Nov 18 11:50 home/zope/instances/production/etc/zope.conf
-rw-r--r-- zope   zope      31161 Nov 04 09:42 home/zope/instances/production/etc/zope.conf.bak
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/import
-rwxr-xr-x zope   zope        211 Nov 04 09:42 home/zope/instances/production/import/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib/python
-rw-r--r-- zope   zope        336 Nov 04 09:42 home/zope/instances/production/lib/python/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/log
-rw-r--r-- zope   zope         57 Nov 04 09:42 home/zope/instances/production/log/README.txt
-rw-r--r-- zope   zope    1369781 Jan 23 17:29 home/zope/instances/production/log/Z2.log
-rw-r--r-- zope   zope    4339066 Jan 23 17:29 home/zope/instances/production/log/event.log
drwxrwxr-x zope   zope          0 Nov 14 18:28 home/zope/instances/production/var
drwxr-xr-x zope   zope          0 Nov 14 19:43 home/zope/instances
drwxrwxr-x zope   zope          0 Nov 05 17:04 home/zope/instances/production
drwxr-xr-x zope   zope          0 Nov 13 12:54 home/zope/instances/production/Products
-rw-r--r-- zope   zope        189 Nov 04 09:42 home/zope/instances/production/Products/README.txt
-rw-r--r-- zope   zope        244 Nov 04 09:42 home/zope/instances/production/Products/__init__.py
-rw-r--r-- zope   zope        430 Nov 04 09:42 home/zope/instances/production/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/bin
-rwx------ zope   zope        227 Nov 04 09:42 home/zope/instances/production/bin/runzope
-rwx------ zope   zope        200 Nov 04 09:42 home/zope/instances/production/bin/runzope.bat
-rwx------ zope   zope        255 Nov 04 09:42 home/zope/instances/production/bin/zope2.wsgi
-rwx------ zope   zope        277 Nov 04 09:42 home/zope/instances/production/bin/zopectl
-rwx------ zope   zope        239 Nov 04 09:42 home/zope/instances/production/bin/zopectl.bat
drwxr-xr-x zope   zope          0 Nov 18 11:50 home/zope/instances/production/etc
-rw-r--r-- zope   zope        760 Nov 04 09:42 home/zope/instances/production/etc/site.zcml
-rw-rw-r-- zope   zope       1408 Nov 18 11:50 home/zope/instances/production/etc/zope.conf
-rw-r--r-- zope   zope      31161 Nov 04 09:42 home/zope/instances/production/etc/zope.conf.bak
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/import
-rwxr-xr-x zope   zope        211 Nov 04 09:42 home/zope/instances/production/import/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib/python
-rw-r--r-- zope   zope        336 Nov 04 09:42 home/zope/instances/production/lib/python/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/log
-rw-r--r-- zope   zope         57 Nov 04 09:42 home/zope/instances/production/log/README.txt
-rw-r--r-- zope   zope    1369781 Jan 23 17:29 home/zope/instances/production/log/Z2.log
-rw-r--r-- zope   zope    4339066 Jan 23 17:29 home/zope/instances/production/log/event.log
drwxrwxr-x zope   zope          0 Nov 14 18:28 home/zope/instances/production/var
drwxr-xr-x zope   zope          0 Nov 14 19:43 home/zope/instances
drwxrwxr-x zope   zope          0 Nov 05 17:04 home/zope/instances/production
drwxr-xr-x zope   zope          0 Nov 13 12:54 home/zope/instances/production/Products
-rw-r--r-- zope   zope        189 Nov 04 09:42 home/zope/instances/production/Products/README.txt
-rw-r--r-- zope   zope        244 Nov 04 09:42 home/zope/instances/production/Products/__init__.py
-rw-r--r-- zope   zope        430 Nov 04 09:42 home/zope/instances/production/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/bin
-rwx------ zope   zope        227 Nov 04 09:42 home/zope/instances/production/bin/runzope
-rwx------ zope   zope        200 Nov 04 09:42 home/zope/instances/production/bin/runzope.bat
-rwx------ zope   zope        255 Nov 04 09:42 home/zope/instances/production/bin/zope2.wsgi
-rwx------ zope   zope        277 Nov 04 09:42 home/zope/instances/production/bin/zopectl
-rwx------ zope   zope        239 Nov 04 09:42 home/zope/instances/production/bin/zopectl.bat
drwxr-xr-x zope   zope          0 Nov 18 11:50 home/zope/instances/production/etc
-rw-r--r-- zope   zope        760 Nov 04 09:42 home/zope/instances/production/etc/site.zcml
-rw-rw-r-- zope   zope       1408 Nov 18 11:50 home/zope/instances/production/etc/zope.conf
-rw-r--r-- zope   zope      31161 Nov 04 09:42 home/zope/instances/production/etc/zope.conf.bak
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/import
-rwxr-xr-x zope   zope        211 Nov 04 09:42 home/zope/instances/production/import/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib/python
-rw-r--r-- zope   zope        336 Nov 04 09:42 home/zope/instances/production/lib/python/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/log
-rw-r--r-- zope   zope         57 Nov 04 09:42 home/zope/instances/production/log/README.txt
-rw-r--r-- zope   zope    1369781 Jan 23 17:29 home/zope/instances/production/log/Z2.log
-rw-r--r-- zope   zope    4339066 Jan 23 17:29 home/zope/instances/production/log/event.log
drwxrwxr-x zope   zope          0 Nov 14 18:28 home/zope/instances/production/var
drwxr-xr-x zope   zope          0 Nov 14 19:43 home/zope/instances
drwxrwxr-x zope   zope          0 Nov 05 17:04 home/zope/instances/production
drwxr-xr-x zope   zope          0 Nov 13 12:54 home/zope/instances/production/Products
-rw-r--r-- zope   zope        189 Nov 04 09:42 home/zope/instances/production/Products/README.txt
-rw-r--r-- zope   zope        244 Nov 04 09:42 home/zope/instances/production/Products/__init__.py
-rw-r--r-- zope   zope        430 Nov 04 09:42 home/zope/instances/production/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/bin
-rwx------ zope   zope        227 Nov 04 09:42 home/zope/instances/production/bin/runzope
-rwx------ zope   zope        200 Nov 04 09:42 home/zope/instances/production/bin/runzope.bat
-rwx------ zope   zope        255 Nov 04 09:42 home/zope/instances/production/bin/zope2.wsgi
-rwx------ zope   zope        277 Nov 04 09:42 home/zope/instances/production/bin/zopectl
-rwx------ zope   zope        239 Nov 04 09:42 home/zope/instances/production/bin/zopectl.bat
drwxr-xr-x zope   zope          0 Nov 18 11:50 home/zope/instances/production/etc
-rw-r--r-- zope   zope        760 Nov 04 09:42 home/zope/instances/production/etc/site.zcml
-rw-rw-r-- zope   zope       1408 Nov 18 11:50 home/zope/instances/production/etc/zope.conf
-rw-r--r-- zope   zope      31161 Nov 04 09:42 home/zope/instances/production/etc/zope.conf.bak
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/import
-rwxr-xr-x zope   zope        211 Nov 04 09:42 home/zope/instances/production/import/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib/python
-rw-r--r-- zope   zope        336 Nov 04 09:42 home/zope/instances/production/lib/python/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/log
-rw-r--r-- zope   zope         57 Nov 04 09:42 home/zope/instances/production/log/README.txt
-rw-r--r-- zope   zope    1369781 Jan 23 17:29 home/zope/instances/production/log/Z2.log
-rw-r--r-- zope   zope    4339066 Jan 23 17:29 home/zope/instances/production/log/event.log
drwxrwxr-x zope   zope          0 Nov 14 18:28 home/zope/instances/production/var
drwxr-xr-x zope   zope          0 Nov 14 19:43 home/zope/instances
drwxrwxr-x zope   zope          0 Nov 05 17:04 home/zope/instances/production
drwxr-xr-x zope   zope          0 Nov 13 12:54 home/zope/instances/production/Products
-rw-r--r-- zope   zope        189 Nov 04 09:42 home/zope/instances/production/Products/README.txt
-rw-r--r-- zope   zope        244 Nov 04 09:42 home/zope/instances/production/Products/__init__.py
-rw-r--r-- zope   zope        430 Nov 04 09:42 home/zope/instances/production/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/bin
-rwx------ zope   zope        227 Nov 04 09:42 home/zope/instances/production/bin/runzope
-rwx------ zope   zope        200 Nov 04 09:42 home/zope/instances/production/bin/runzope.bat
-rwx------ zope   zope        255 Nov 04 09:42 home/zope/instances/production/bin/zope2.wsgi
-rwx------ zope   zope        277 Nov 04 09:42 home/zope/instances/production/bin/zopectl
-rwx------ zope   zope        239 Nov 04 09:42 home/zope/instances/production/bin/zopectl.bat
drwxr-xr-x zope   zope          0 Nov 18 11:50 home/zope/instances/production/etc
-rw-r--r-- zope   zope        760 Nov 04 09:42 home/zope/instances/production/etc/site.zcml
-rw-rw-r-- zope   zope       1408 Nov 18 11:50 home/zope/instances/production/etc/zope.conf
-rw-r--r-- zope   zope      31161 Nov 04 09:42 home/zope/instances/production/etc/zope.conf.bak
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/import
-rwxr-xr-x zope   zope        211 Nov 04 09:42 home/zope/instances/production/import/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib/python
-rw-r--r-- zope   zope        336 Nov 04 09:42 home/zope/instances/production/lib/python/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/log
-rw-r--r-- zope   zope         57 Nov 04 09:42 home/zope/instances/production/log/README.txt
-rw-r--r-- zope   zope    1369781 Jan 23 17:29 home/zope/instances/production/log/Z2.log
-rw-r--r-- zope   zope    4339066 Jan 23 17:29 home/zope/instances/production/log/event.log
drwxrwxr-x zope   zope          0 Nov 14 18:28 home/zope/instances/production/var
drwxr-xr-x zope   zope          0 Nov 14 19:43 home/zope/instances
drwxrwxr-x zope   zope          0 Nov 05 17:04 home/zope/instances/production
drwxr-xr-x zope   zope          0 Nov 13 12:54 home/zope/instances/production/Products
-rw-r--r-- zope   zope        189 Nov 04 09:42 home/zope/instances/production/Products/README.txt
-rw-r--r-- zope   zope        244 Nov 04 09:42 home/zope/instances/production/Products/__init__.py
-rw-r--r-- zope   zope        430 Nov 04 09:42 home/zope/instances/production/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/bin
-rwx------ zope   zope        227 Nov 04 09:42 home/zope/instances/production/bin/runzope
-rwx------ zope   zope        200 Nov 04 09:42 home/zope/instances/production/bin/runzope.bat
-rwx------ zope   zope        255 Nov 04 09:42 home/zope/instances/production/bin/zope2.wsgi
-rwx------ zope   zope        277 Nov 04 09:42 home/zope/instances/production/bin/zopectl
-rwx------ zope   zope        239 Nov 04 09:42 home/zope/instances/production/bin/zopectl.bat
drwxr-xr-x zope   zope          0 Nov 18 11:50 home/zope/instances/production/etc
-rw-r--r-- zope   zope        760 Nov 04 09:42 home/zope/instances/production/etc/site.zcml
-rw-rw-r-- zope   zope       1408 Nov 18 11:50 home/zope/instances/production/etc/zope.conf
-rw-r--r-- zope   zope      31161 Nov 04 09:42 home/zope/instances/production/etc/zope.conf.bak
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/import
-rwxr-xr-x zope   zope        211 Nov 04 09:42 home/zope/instances/production/import/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib/python
-rw-r--r-- zope   zope        336 Nov 04 09:42 home/zope/instances/production/lib/python/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/log
-rw-r--r-- zope   zope         57 Nov 04 09:42 home/zope/instances/production/log/README.txt
-rw-r--r-- zope   zope    1369781 Jan 23 17:29 home/zope/instances/production/log/Z2.log
-rw-r--r-- zope   zope    4339066 Jan 23 17:29 home/zope/instances/production/log/event.log
drwxrwxr-x zope   zope          0 Nov 14 18:28 home/zope/instances/production/var
drwxr-xr-x zope   zope          0 Nov 14 19:43 home/zope/instances
drwxrwxr-x zope   zope          0 Nov 05 17:04 home/zope/instances/production
drwxr-xr-x zope   zope          0 Nov 13 12:54 home/zope/instances/production/Products
-rw-r--r-- zope   zope        189 Nov 04 09:42 home/zope/instances/production/Products/README.txt
-rw-r--r-- zope   zope        244 Nov 04 09:42 home/zope/instances/production/Products/__init__.py
-rw-r--r-- zope   zope        430 Nov 04 09:42 home/zope/instances/production/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/bin
-rwx------ zope   zope        227 Nov 04 09:42 home/zope/instances/production/bin/runzope
-rwx------ zope   zope        200 Nov 04 09:42 home/zope/instances/production/bin/runzope.bat
-rwx------ zope   zope        255 Nov 04 09:42 home/zope/instances/production/bin/zope2.wsgi
-rwx------ zope   zope        277 Nov 04 09:42 home/zope/instances/production/bin/zopectl
-rwx------ zope   zope        239 Nov 04 09:42 home/zope/instances/production/bin/zopectl.bat
drwxr-xr-x zope   zope          0 Nov 18 11:50 home/zope/instances/production/etc
-rw-r--r-- zope   zope        760 Nov 04 09:42 home/zope/instances/production/etc/site.zcml
-rw-rw-r-- zope   zope       1408 Nov 18 11:50 home/zope/instances/production/etc/zope.conf
-rw-r--r-- zope   zope      31161 Nov 04 09:42 home/zope/instances/production/etc/zope.conf.bak
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/import
-rwxr-xr-x zope   zope        211 Nov 04 09:42 home/zope/instances/production/import/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/lib/python
-rw-r--r-- zope   zope        336 Nov 04 09:42 home/zope/instances/production/lib/python/README.txt
drwxr-xr-x zope   zope          0 Nov 04 09:42 home/zope/instances/production/log
-rw-r--r-- zope   zope         57 Nov 04 09:42 home/zope/instances/production/log/README.txt
-rw-r--r-- zope   zope    1369781 Jan 23 17:29 home/zope/instances/production/log/Z2.log
-rw-r--r-- zope   zope    4339066 Jan 23 17:29 home/zope/instances/production/log/event.log
drwxrwxr-x zope   zope          0 Nov 14 18:28 home/zope/instances/production/var
-rw-r--r-- zope   zope   853717054 Dec 03 10:54 home/zope/instances/production/var/Data.fs
-rw-r--r-- zope   zope     995501 Nov 13 12:54 home/zope/instances/production/var/Data.fs.index
-rw-rw-r-- zope   zope          7 Nov 13 12:54 home/zope/instances/production/var/Data.fs.lock
-rw-r--r-- zope   zope      16987 Dec 03 10:54 home/zope/instances/production/var/Data.fs.tmp
Traceback (most recent call last):
  File "/usr/virtualenv/databackup/bin/attic", line 3, in <module>
    main()
  File "/usr/virtualenv/databackup/lib/python3.3/site-packages/attic/archiver.py", line 727, in main
    exit_code = archiver.run(sys.argv[1:])
  File "/usr/virtualenv/databackup/lib/python3.3/site-packages/attic/archiver.py", line 717, in run
    return args.func(args)
  File "/usr/virtualenv/databackup/lib/python3.3/site-packages/attic/archiver.py", line 275, in do_list
    for item in archive.iter_items():
  File "/usr/virtualenv/databackup/lib/python3.3/site-packages/attic/archive.py", line 167, in iter_items
    for item in self.pipeline.unpack_many(self.metadata[b'items'], filter=filter, preload=preload):
  File "/usr/virtualenv/databackup/lib/python3.3/site-packages/attic/archive.py", line 45, in unpack_many
    items = [decode_dict(item, (b'path', b'source', b'user', b'group')) for item in unpacker]
  File "/usr/virtualenv/databackup/lib/python3.3/site-packages/attic/archive.py", line 45, in <listcomp>
    items = [decode_dict(item, (b'path', b'source', b'user', b'group')) for item in unpacker]
  File "/usr/virtualenv/databackup/lib/python3.3/site-packages/attic/helpers.py", line 490, in decode_dict
    if isinstance(d.get(key), bytes):
AttributeError: 'int' object has no attribute 'get'

I added a breakpoint when that exception occurs and stepped up to here:

(Pdb) list
 40  
 41         def unpack_many(self, ids, filter=None, preload=False):
 42             unpacker = msgpack.Unpacker(use_list=False)
 43             for data in self.fetch_many(ids):
 44                 unpacker.feed(data)
 45  ->             items = [decode_dict(item, (b'path', b'source', b'user', b'group')) for item in unpacker]
 46                 if filter:
 47                     items = [item for item in items if filter(item)]
 48                 if preload:
 49                     for item in items:
 50                         if b'chunks' in item:
(Pdb) p list(unpacker)[0]
79
(Pdb) p list(unpacker)[1]
28
(Pdb) p list(unpacker)[2]
{b'\xd4)\xb2\xee\x89\x1d\xa4\xc6\x87W\xf3\x9b\xbd\xce\x00\x02Z': 20, 154189: (b'\xdc}\n\x9b\x16\xfb\xb7h%\xa4\xc8\xc13\xbe\x9f\x949E\xee\xfa\x8e\xfc}\x10\x9e\xad\x87\xcdsY\xcd0', 12723, 12735)}
(Pdb) p list(unpacker)[90]
(b'W`\xc4\xf2\xd4\x87h\xadq\xed\xcd\xe6\x0f\xd5\x9e<\xd7\xb2\x83\x04\x05\xcd>\x84?E;xc\x8f\xa1\x04', 43675, 43697)
(Pdb) p list(unpacker)[-1]
{b'group': b'zope', b'path': b'home/zope/instances/production/var/Data.fs.tmp', b'user': b'zope', b'chunks': ((b'\xf3\xf4kOa\x9d\xb1\t \x03T\xce&R\xa0\xc7\xb5o\xd1@\xc0\xde\xd8\x85]\x99&\x15f*\x95o', 16987, 1315),), b'uid': 1001, b'mtime': 1417600461487400749, b'mode': 33188, b'gid': 1001}

The same error occurs on extract.

attic info yields this:

Traceback (most recent call last):
  File "/usr/virtualenv/databackup/bin/attic", line 3, in <module>
    main()
  File "/usr/virtualenv/databackup/lib/python3.3/site-packages/attic/archiver.py", line 727, in main
    exit_code = archiver.run(sys.argv[1:])
  File "/usr/virtualenv/databackup/lib/python3.3/site-packages/attic/archiver.py", line 717, in run
    return args.func(args)
  File "/usr/virtualenv/databackup/lib/python3.3/site-packages/attic/archiver.py", line 307, in do_info
    stats = archive.calc_stats(cache)
  File "/usr/virtualenv/databackup/lib/python3.3/site-packages/attic/archive.py", line 223, in calc_stats
    add_file_chunks(item[b'chunks'])
  File "/usr/virtualenv/databackup/lib/python3.3/site-packages/attic/archive.py", line 210, in add_file_chunks
    add(id)
  File "/usr/virtualenv/databackup/lib/python3.3/site-packages/attic/archive.py", line 205, in add
    count, size, csize = self.cache.chunks[id]
  File "hashindex.pyx", line 152, in attic.hashindex.ChunkIndex.__getitem__ (attic/hashindex.c:3023)
KeyError
@rbu
Copy link
Author

rbu commented Jan 23, 2015

This is on CentOS 7, Python 3.3.2 and Attic 0.14 fromm PyPI.

@rbu
Copy link
Author

rbu commented Jan 23, 2015 

# attic check backup/
Starting repository check...
Repository check complete, no problems found.
Starting archive consistency check...
Analyzing archive varfiles-2015-01-23_17-32-33 (1/2)
Traceback (most recent call last):
  File "/usr/virtualenv/databackup/bin/attic", line 3, in <module>
    main()
  File "/usr/virtualenv/databackup/lib/python3.3/site-packages/attic/archiver.py", line 727, in main
    exit_code = archiver.run(sys.argv[1:])
  File "/usr/virtualenv/databackup/lib/python3.3/site-packages/attic/archiver.py", line 717, in run
    return args.func(args)
  File "/usr/virtualenv/databackup/lib/python3.3/site-packages/attic/archiver.py", line 84, in do_check
    if not args.repo_only and not ArchiveChecker().check(repository, repair=args.repair):
  File "/usr/virtualenv/databackup/lib/python3.3/site-packages/attic/archive.py", line 536, in check
    self.rebuild_refcounts()
  File "/usr/virtualenv/databackup/lib/python3.3/site-packages/attic/archive.py", line 686, in rebuild_refcounts
    if b'chunks' in item:
TypeError: argument of type 'int' is not iterable

@rbu
Copy link
Author

rbu commented Jan 23, 2015

This may be related to or a duplicate of #171 and #127, but I am running a completely local backup.

@rbu rbu mentioned this issue Jan 26, 2015
Closed
@jborg
Copy link
Owner

jborg commented Jan 29, 2015

The underlying msgpack-python bug seems to be fixed now (msgpack/msgpack-python#124)

@jborg jborg closed this as completed Jan 29, 2015
@ThomasWaldmann
Copy link
Contributor

See PR #230.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@jborg @rbu @ThomasWaldmann