Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue 5050 - bdb bulk op fails if fs page size > 8K #5150

Merged
merged 1 commit into from Feb 4, 2022

Conversation

progier389
Copy link
Contributor

Issue: Getting replication failure when db is set on file system having page size greater than 8K
libdb - BDB0623 DB_MULTIPLE/DB_MULTIPLE_KEY buffers must be aligned, at least page size and multiples of 1KB
bdb_map_error - bdb_public_cursor_bulkop failed with db error 22 : Invalid argument

because when using bdb, db bulk operation (that retrieve several records in a single operation) must have a buffer size that is both 1024 bytes aligned and greater of equal to the db page size which default to the underlying file system page size
(and the initial buffer size is hardcoded to 8K in ds389)

Solution is to alloc a new buffer if the provided buffer does not fulfill the requirements.

Issue: 5050

Reviewed by:

@progier389 progier389 linked an issue Feb 3, 2022 that may be closed by this pull request
Copy link
Contributor

@Firstyear Firstyear left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ack from me, @Nascire or @croadfeldt if you are able to test this that would be lovely!

@croadfeldt
Copy link

You fine folks don't happen to have a pre-built container for this PR by chance do you? Otherwise, will try to spin one up myself.

@vashirov
Copy link
Member

vashirov commented Feb 4, 2022

There are rpms for F35 built from this PR: https://github.com/389ds/389-ds-base/suites/5165071779/artifacts/156447124
So you can try to add them on top of you existing freeipa container image (ADD dist/rpms /tmp, RUN dnf install -y /tmp/rpms/*, etc.)

I'll try the reproducer with proxmox later today as well.

@vashirov
Copy link
Member

vashirov commented Feb 4, 2022

I gave it a spin, now it's a different error message:

[04/Feb/2022:08:02:57.593587150 +0000] - ERR - libdb - BDB0621 DB_MULTIPLE/DB_MULTIPLE_KEY require DB_DBT_USERMEM be set
[04/Feb/2022:08:02:57.602052204 +0000] - ERR - bdb_map_error - bdb_public_cursor_bulkop failed with db error 22 : Invalid argument

@progier389
Copy link
Contributor Author

Thank you Victor !
FYI: I fixed the second issue. Could you test it please ?

@vashirov
Copy link
Member

vashirov commented Feb 4, 2022

Thank you, Pierre!

The ipa-replica-install command was successful

@progier389 progier389 merged commit db69930 into 389ds:master Feb 4, 2022
progier389 added a commit that referenced this pull request Feb 4, 2022
mreynolds389 pushed a commit that referenced this pull request Apr 14, 2022
@progier389 progier389 deleted the i5050 branch July 27, 2022 16:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Unable to create replica between 2 Fedora 35 LXC containers
4 participants