New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

qa/tasks: S3A hadoop task to test s3a with Ceph #14624

Merged
merged 3 commits into from Jun 23, 2017

Conversation

Projects
None yet
4 participants
@vasukulkarni
Member

vasukulkarni commented Apr 18, 2017

S3A Hadoop task to test S3A with Ceph, still in Testing..

Signed-off-by: Vasu Kulkarni vasu@redhat.com

@vasukulkarni vasukulkarni requested review from mattbenjamin and cbodley Apr 18, 2017

usage:
-tasks:
ceph-ansible:
s3a-hapoop:

This comment has been minimized.

@cbodley

cbodley Apr 19, 2017

Contributor

💩

bucket = conn.create_bucket('{bucket_name}')
for bucket in conn.get_all_buckets():
print bucket.name + "\t" + bucket.creation_date
""".format(access_key=access_key, secret_key=secret_key, dns_name=dns_name, bucket_name=bucket_name)

This comment has been minimized.

@cbodley

cbodley Apr 19, 2017

Contributor

this stuff is necessary to run boto from virtualenv, instead of importing it in the task?

This comment has been minimized.

@vasukulkarni

vasukulkarni Apr 19, 2017

Member

yeah i thought about that, the only reason i am running this script from rgw node is to also test out the dnsmasq name(s3.ceph.com) that is later used by the s3a test, but i think we can also make this a function within task.

@mattbenjamin mattbenjamin requested a review from mdw-at-linuxbox Apr 19, 2017

@vasukulkarni vasukulkarni changed the title from [DNM] qa/tasks: S3A hadoop task to test s3a with Ceph to qa/tasks: S3A hadoop task to test s3a with Ceph Apr 19, 2017

@vasukulkarni

This comment has been minimized.

Member

vasukulkarni commented Apr 19, 2017

There is a issue with ceph-ansible on master, but with jewel I can recreate the issue which I am seeing with multipart upload. Removing the DNM so that we can keep this testing in smoke.

http://qa-proxy.ceph.com/teuthology/vasu-2017-04-19_18:08:33-smoke-jewel---basic-vps/1045371/teuthology.log

@mattbenjamin

This comment has been minimized.

Contributor

mattbenjamin commented Apr 20, 2017

@thanks, vasu; marcus is reviewing in detail pursuant to bz

@vasukulkarni

This comment has been minimized.

Member

vasukulkarni commented Apr 25, 2017

Since the fix has been checked in, can this be merged to test on regular basis?

@mattbenjamin

This comment has been minimized.

Contributor

mattbenjamin commented Apr 27, 2017

@vasukulkarni, per @cbodley, we're waiting for a result from a teuthology run with jewel as the --ceph branch; we're discussing in #ceph-devel whether this is in the right suite--we are willing to merge with jewel validation presuming we won't immediately induce failures due to (e.g., the already known ceph-ansible issue) when it merges to master

@cbodley

This comment has been minimized.

Contributor

cbodley commented Apr 27, 2017

@vasukulkarni i'm curious why this is under the qa/suites/smoke - is there a reason to keep it outside of qa/suites/rgw?

@vasukulkarni

This comment has been minimized.

Member

vasukulkarni commented Apr 27, 2017

@cbodley I added in smoke first because its scheduled for nightly run and will be run daily, but I can also add this to rgw suite because i believe not many folks run smoke. right now I have scheduled a centos run which is yet to run, I will also add the yaml in rgw and update this pr.

theanalyst added a commit to theanalyst/ceph that referenced this pull request May 11, 2017

qa: setup dnsmasq for s3tests
if s3tests is using a non path style calling format, then dnsmasq needs
to be setup on the machine running s3tests. The code is borrowed from
s3a hadoop pr ceph#14624

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Fix RGW config in ceph.conf, we need rgw dns name entry
and also modify the port to use :80 for s3a tests to work
"""
rgw_dns_name = 'rgw dns name = {name}'.format(name=name)

This comment has been minimized.

@cbodley

cbodley May 12, 2017

Contributor

can you set this with ceph_conf_overrides in yaml?

This comment has been minimized.

@vasukulkarni

vasukulkarni May 12, 2017

Member

since ceph-ansible sets up the rgw config and the section name is custom built [client.hostname] I am not sure how it works, the rgw configs are here https://github.com/ceph/ceph-ansible/blob/master/group_vars/rgws.yml.sample

This comment has been minimized.

@vasukulkarni

vasukulkarni May 12, 2017

Member

also the current ceph-ansible task has option to set in globals, so it still need to fixed on ceph-ansible task

This comment has been minimized.

@vasukulkarni

vasukulkarni May 12, 2017

Member

It is in all.yml, so should be doable for dns name and port, will try that https://github.com/ceph/ceph-ansible/blob/master/group_vars/all.yml.sample#L318

@vasukulkarni

This comment has been minimized.

Member

vasukulkarni commented May 12, 2017

I am planning to redo this for jewel first, since I am blocked on few issues on ceph-ansible master(mgr related) and there are pending issues i raised on ceph-ansible github.

- [mgr.x]
tasks:
- ssh-keys:
- ceph-ansible:

This comment has been minimized.

@cbodley

cbodley Jun 19, 2017

Contributor

if you're blocked on issues related to ceph-ansible, you could use the install, ceph, and rgw tasks that our other suites use. see https://github.com/ceph/ceph/blob/master/qa/suites/rgw/verify/tasks/rgw_s3tests.yaml for an example

@vasukulkarni

This comment has been minimized.

Member

vasukulkarni commented Jun 19, 2017

@cbodley @mattbenjamin I will work with @andrewschoen to get this issue ceph/ceph-ansible#1498 fixed in ceph-ansible, It would be nice to use ceph-ansible due to systemd units that are setup, If not, I will just move to old ways to install and move forward.

@mattbenjamin

This comment has been minimized.

Contributor

mattbenjamin commented Jun 19, 2017

@vasukulkarni sounds good!

@vasukulkarni

This comment has been minimized.

Member

vasukulkarni commented Jun 20, 2017

The issue on master is resolved, I just need to add 2.8.0 hadoop tests and commit cleanup and is probably good to merge!
http://pulpito.ceph.com/vasu-2017-06-20_21:18:49-smoke-master---basic-vps/1306490/

vasukulkarni added some commits Jun 20, 2017

s3a task to test radosgw compatibility with hadoop s3a interface
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
hadoop s3a '2.7.3' tests
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
s3a hadoop '2.8.0' tests
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
@vasukulkarni

This comment has been minimized.

Member

vasukulkarni commented Jun 21, 2017

@mattbenjamin @cbodley here is the latest runs, the one with 2.8.0 the intergration tests are failing, probably needs to be checked from rgw side
http://pulpito.ceph.com/vasu-2017-06-21_18:56:04-rgw-master---basic-vps/

@vasukulkarni

This comment has been minimized.

Member

vasukulkarni commented Jun 22, 2017

@mattbenjamin @cbodley , I would like to get this merged, all the work is done, there was missing log collection, but I have added in the wip branch and will merge in teuthology. Here is the latest runs that shows few failures

http://pulpito.ceph.com/vasu-2017-06-22_21:30:50-rgw-master-distro-basic-vps/

All the rgw logs are collected here(so there should be no need to recreate, if the logs are not sufficient to debug, let me know)

http://qa-proxy.ceph.com/teuthology/vasu-2017-06-22_21:30:50-rgw-master-distro-basic-vps/1317423/remote/vpm137/log/ ( test was run on vpm137)

@cbodley

This comment has been minimized.

Contributor

cbodley commented Jun 23, 2017

I have added in the wip branch and will merge in teuthology

can you link here when there's a pr?

@cbodley cbodley merged commit 6b42352 into master Jun 23, 2017

4 checks passed

Signed-off-by all commits in this PR are signed
Details
Unmodified Submodules submodules for project are unmodified
Details
arm64 make check arm64 make check succeeded
Details
make check make check succeeded
Details

@liewegas liewegas deleted the wip-s3a-hadoop branch Aug 25, 2017

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment