Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

zfs ubuntu build completely unstable. #605

Closed
mikhmv opened this issue Mar 15, 2012 · 4 comments
Closed

zfs ubuntu build completely unstable. #605

mikhmv opened this issue Mar 15, 2012 · 4 comments
Labels
Type: Building Indicates an issue related to building binaries
Milestone
0.6.0-rc8

Comments

@mikhmv
Copy link

mikhmv commented Mar 15, 2012

zfs mount -a
took more than 10 min
not all volumes mounted.
delete operations for large files take ages.
@behlendorf
Copy link
Contributor

Use the daily for now not the stable. Hopefully the stable will get an update soonish.

@mikhmv
Copy link
Author

mikhmv commented Mar 15, 2012

I am using daily. and upgraded 1 hour ago. It is completely unstable. I cannot mount one volume at all.

Here the system info:
max@s0:~$ uname -a
Linux s0 3.0.0-16-server #29-Ubuntu SMP Tue Feb 14 13:08:12 UTC 2012 x86_64 x86_64 x86_64 GNU/Linux

It doesn't work on 3.0.0-17-server too

max@s0:$ dpkg -s ubuntu-zfs
Package: ubuntu-zfs
Status: install ok installed
Priority: optional
Section: metapackages
Installed-Size: 52
Maintainer: Darik Horn dajhorn@vanadac.com
Architecture: amd64
Version: 6oneiric
Depends: spl, spl-dkms, zfs-dkms, zfsutils
Suggests: zfs-auto-snapshot
Conffiles:
/etc/apt/preferences.d/pin-zfs-native c6baef8ec363af26cfbcaac996d12fb1
Description: Native ZFS filesystem metapackage for Ubuntu

max@s0:$ dpkg -s zfsutils
Package: zfsutils
Status: install ok installed
Priority: extra
Section: admin
Installed-Size: 904
Maintainer: Darik Horn dajhorn@vanadac.com
Architecture: amd64
Source: zfs-linux
Version: 0.6.0.53-0ubuntu1oneiric1
Replaces: zfs
Depends: libc6 (>= 2.8), libnvpair1, libselinux1 (>= 1.32), libuuid1 (>= 2.16), libuutil1, libzfs1, libzpool1
Recommends: zfs-dkms
Suggests: nfs-kernel-server, zfs-initramfs
Conflicts: zfs, zfs-fuse
Conffiles:
/etc/bash_completion.d/zfs 3e1c4a29c4f7d590e6a3041f2c61d6ff
/etc/zfs/zdev.conf b006284e64b215ca619aeb56d2df9bf5
/etc/default/zfs a36d4561e19974d80a7b6cec75639c24
/etc/init.d/zfs-share 003fc628cf32324eefe6ad6239a0ed80
/etc/init.d/zfs-mount cb9c3d88deeef1356198e8c5ca913ed4
Description: Native ZFS management utilities for Linux
This package provides the zpool and zfs commands that are used to
manage ZFS filesystems.

max@s0:$ dpkg -s zfs-dkms
Package: zfs-dkms
Status: install ok installed
Priority: extra
Section: kernel
Installed-Size: 10868
Maintainer: Darik Horn dajhorn@vanadac.com
Architecture: amd64
Source: zfs-linux
Version: 0.6.0.53-0ubuntu1oneiric1
Replaces: lzfs, lzfs-dkms
Provides: lustre-backend-fs, lzfs, lzfs-dkms
Depends: dkms (>> 2.1.1.2-5ubuntu1), spl-dkms (>= 0.6.0.53)
Conflicts: lzfs, lzfs-dkms
Description: Native ZFS filesystem kernel modules for Linux
An advanced integrated volume manager and filesystem that is designed for
performance and data integrity. Snapshots, clones, checksums, deduplication,
compression, and RAID redundancy are built-in features..
.
Includes the SPA, DMU, ZVOL, and ZPL components of ZFS.

max@s0:$ dpkg -s spl
Package: spl
Status: install ok installed
Priority: extra
Section: kernel
Installed-Size: 96
Maintainer: Darik Horn dajhorn@vanadac.com
Architecture: amd64
Source: spl-linux
Version: 0.6.0.53-0ubuntu1oneiric1
Depends: libc6 (>= 2.7)
Recommends: spl-dkms
Conflicts: spl-dev
Conffiles:
/etc/hostid a54f0041a9e15b050f25c463f1db7449
Description: Solaris Porting Layer utilities for Linux
This package provides the userspace utilities for the SPL and SPLAT Linux
kernel modules.
Homepage: http://www.zfsonlinux.org/

max@s0:$ dpkg -s spl-dkms
Package: spl-dkms
Status: install ok installed
Priority: extra
Section: kernel
Installed-Size: 2716
Maintainer: Darik Horn dajhorn@vanadac.com
Architecture: all
Source: spl-linux
Version: 0.6.0.53-0ubuntu1oneiric1
Depends: dkms (>> 2.1.1.2-5ubuntu1), lsb-release
Recommends: spl
Description: Solaris Porting Layer kernel modules for Linux
The Solaris Porting Layer (SPL) is a Linux kernel module which provides many of
the Solaris kernel APIs. This shim layer makes it possible to run Solaris
kernel code in the Linux kernel with relatively minimal modification.
.
The Solaris Porting LAyer Tests (SPLAT) is a Linux kernel module which provides
a testing harness for the SPL module.
Homepage: http://www.zfsonlinux.org/

@mikhmv
Copy link
Author

mikhmv commented Mar 15, 2012

I upgraded ubuntu to 12.04.
ZFS is working here. For me this issue resolved but for users 11.10 could be not.

@behlendorf
Copy link
Contributor

I'm closing the issue since you now have it working under 12.04.

pcd1193182 pushed a commit to pcd1193182/zfs that referenced this issue Sep 26, 2023
@ahrens
DLPX-81891 agent panicked in reclaim_frees_object(): blocks_size vs n…
a18cf9e 
…um_bytes mismatch (openzfs#605)

Whenever we do a PutObject, we use a timeout of `PER_REQUEST_TIMEOUT` which is
2 seconds.  The timeout is implemented via `tokio::time::timeout()`, which
drops the Future if the timeout expires.  See `object_access::retry()`.  When
this happens, we don't have visibility into the internal state of S3.  In
particular, we don't know if the PutObject was ignored, actually completed
(e.g. we timed out just as it was sending a response to us), or if it will
complete at some point of time in the future.

The problem occurs when a later PutObject (e.g. due to reclaiming freed blocks)
overwrites the same object with different data, and the first, timed-out
PutObject is applied at a later time, overwriting the second PutObject's data.
This looks like the second PutObject had no effect, but in fact it did take
effect, but was later overwritten by the first, timed-out PutObject.

If the overwritten data contains blocks from a different (consolidated) object,
those blocks will be lost.  To mitigate the problem, in this commit we disable
object consolidation.  In other words, when reclaiming freed space, a given
object may be overwritten only with a subset of its original blocks, with no
additional blocks added.  This way, if a timed-out PutObject takes effect
later, the reverted state of the object only contains additional blocks (which
will be leaked, at least until the entire object is deleted).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Type: Building Indicates an issue related to building binaries
Projects
None yet
Milestone
0.6.0-rc8
Development

No branches or pull requests
2 participants
@behlendorf @mikhmv