Release version 0.7.0 #624

Closed
risdenk opened this Issue Feb 15, 2016 · 42 comments

Comments

Projects
None yet
8 participants
@risdenk
Collaborator

risdenk commented Feb 15, 2016

For the next release, 0.7.0, the following items have already been merged:

Breaking changes:

  • gemfire binding changed to geode

Bindings to test:

  • Solr [newly added]
  • GemFire -> Geode [newly added]
  • OrientDB [fixes]
  • HBase [fixes]
  • Accumulo [fixes]
  • JDBC [fixes]
  • Couchbase [fixes]
  • MongoDB [fixes]
  • DynamoDB [version bump]
  • Elasticsearch [version bump]

Release plan:

  • RC1 - Tues Feb 16th
  • 0.7.0 - by Fri Feb 26th
@risdenk

This comment has been minimized.

Show comment
Hide comment
@risdenk

This comment has been minimized.

Show comment
Hide comment
@risdenk

risdenk Feb 16, 2016

Collaborator

First draft of release notes (a bit early but figured I'd get a start on it): https://gist.github.com/risdenk/2c739719a815c4e74c64

Collaborator

risdenk commented Feb 16, 2016

First draft of release notes (a bit early but figured I'd get a start on it): https://gist.github.com/risdenk/2c739719a815c4e74c64

@busbey

This comment has been minimized.

Show comment
Hide comment
@busbey

busbey Feb 16, 2016

Collaborator

Excellent! thanks for driving this Kevin.

I can take care of Accumulo and Windows platform testing.

  • @ghaughian could you test out the Release Candidate to make sure it works with SOLR?
  • @sbawaska could you check out the Release Candidate to make sure the new geode binding works?
Collaborator

busbey commented Feb 16, 2016

Excellent! thanks for driving this Kevin.

I can take care of Accumulo and Windows platform testing.

  • @ghaughian could you test out the Release Candidate to make sure it works with SOLR?
  • @sbawaska could you check out the Release Candidate to make sure the new geode binding works?
@risdenk

This comment has been minimized.

Show comment
Hide comment
@risdenk

risdenk Feb 16, 2016

Collaborator

@kruthar Can you take care of testing OrientDB, JDBC, and Couchbase bindings?

Collaborator

risdenk commented Feb 16, 2016

@kruthar Can you take care of testing OrientDB, JDBC, and Couchbase bindings?

@sbawaska

This comment has been minimized.

Show comment
Hide comment
@sbawaska

sbawaska Feb 19, 2016

Contributor

The Geode binding looks good.

On Tue, Feb 16, 2016 at 7:33 AM, Kevin Risden notifications@github.com
wrote:

@kruthar https://github.com/kruthar Can you take care of testing
OrientDB, JDBC, and Couchbase bindings?


Reply to this email directly or view it on GitHub
#624 (comment)
.

Contributor

sbawaska commented Feb 19, 2016

The Geode binding looks good.

On Tue, Feb 16, 2016 at 7:33 AM, Kevin Risden notifications@github.com
wrote:

@kruthar https://github.com/kruthar Can you take care of testing
OrientDB, JDBC, and Couchbase bindings?


Reply to this email directly or view it on GitHub
#624 (comment)
.

@busbey

This comment has been minimized.

Show comment
Hide comment
@busbey

busbey Feb 22, 2016

Collaborator

I tried building on windows and ran into #617 again. submitted PR #626 to skip the Accumulo tests on windows. We should cherry-pick that back for the 0.7.0 release to make sure building from source on windows works.

Collaborator

busbey commented Feb 22, 2016

I tried building on windows and ran into #617 again. submitted PR #626 to skip the Accumulo tests on windows. We should cherry-pick that back for the 0.7.0 release to make sure building from source on windows works.

@risdenk

This comment has been minimized.

Show comment
Hide comment
@risdenk

risdenk Feb 22, 2016

Collaborator

@busbey Merged #626. I'll cherry-pick that commit back to 0.7.0 and respin the RC.

Collaborator

risdenk commented Feb 22, 2016

@busbey Merged #626. I'll cherry-pick that commit back to 0.7.0 and respin the RC.

@risdenk

This comment has been minimized.

Show comment
Hide comment
@risdenk

risdenk Feb 22, 2016

Collaborator

@busbey had to back out #626. When it is fixed I can merge it and respin the RC.

Collaborator

risdenk commented Feb 22, 2016

@busbey had to back out #626. When it is fixed I can merge it and respin the RC.

@risdenk

This comment has been minimized.

Show comment
Hide comment
@risdenk

risdenk Feb 22, 2016

Collaborator

RC2 is out: https://github.com/brianfrankcooper/YCSB/releases/tag/0.7.0-RC2

Fixes from @busbey for Accumulo and @kruthar for OrientDB readallfields

Collaborator

risdenk commented Feb 22, 2016

RC2 is out: https://github.com/brianfrankcooper/YCSB/releases/tag/0.7.0-RC2

Fixes from @busbey for Accumulo and @kruthar for OrientDB readallfields

@busbey

This comment has been minimized.

Show comment
Hide comment
@busbey

busbey Feb 23, 2016

Collaborator

RC2 builds on windows fine. running tests through accumulo now.

Collaborator

busbey commented Feb 23, 2016

RC2 builds on windows fine. running tests through accumulo now.

@busbey

This comment has been minimized.

Show comment
Hide comment
@busbey

busbey Feb 23, 2016

Collaborator

Accumulo works. I had a server-side issue while running through the workload a loading phase and everything properly tracked the failures and continued on.

Running HBase10 next.

Collaborator

busbey commented Feb 23, 2016

Accumulo works. I had a server-side issue while running through the workload a loading phase and everything properly tracked the failures and continued on.

Running HBase10 next.

@kruthar

This comment has been minimized.

Show comment
Hide comment
@kruthar

kruthar Feb 23, 2016

Collaborator

I tested a few dbs, everything looks ok to me:

jdbc MySQL 5.1.73
cassandra2-cql Cassandra 2.0.17
couchbase Couchbase 4.0.0
memcached Memcached 1.4.4
orientdb OrientDB 2.1.2 (remote and local)
mongodb MongoDB 3.0.9

For the curious, I'm running:

bin/ycsb load mongodb -P ~/projects/YCSB/testing/testworkload
bin/ycsb run mongodb -P ~/projects/YCSB/testing/testworkload

testworkload:

operationcount=10000
recordcount=10000
fieldcount=3
fieldlength=20
dataintegrity=true
writeallfields=true
readallfields=true
insertorder=ordered
maxscanlength=100
threadcount=1
workload=com.yahoo.ycsb.workloads.CoreWorkload

scanproportion=0.3
readproportion=0.3
updateproportion=0.4
insertproportion=0.0

hdrhistogram.percentiles=50,75,95

# mysql
db.driver=com.mysql.jdbc.Driver
db.url=jdbc:mysql://mysql.vagrant:3306/ycsb
db.user=admin
db.passwd=admin

# cassandra
hosts=cassandra.vagrant

# couchbase
couchbase.url=http://couchbase.vagrant:8091/pools
couchbase.bucket=usertable
couchbase.ddoc=ycsb_ddoc
couchbase.view=ycsb_view

# memcached
memcached.hosts=memcached.vagrant

# orientdb
# orientdb.url=plocal:ycsb
orientdb.url=remote:orientdb.vagrant/ycsb
orientdb.user=root
orientdb.password=password
orientdb.remote.storagetype=plocal

# mongodb
mongodb.url=mongodb://mongodb.vagrant:27017/ycsb?w=1
Collaborator

kruthar commented Feb 23, 2016

I tested a few dbs, everything looks ok to me:

jdbc MySQL 5.1.73
cassandra2-cql Cassandra 2.0.17
couchbase Couchbase 4.0.0
memcached Memcached 1.4.4
orientdb OrientDB 2.1.2 (remote and local)
mongodb MongoDB 3.0.9

For the curious, I'm running:

bin/ycsb load mongodb -P ~/projects/YCSB/testing/testworkload
bin/ycsb run mongodb -P ~/projects/YCSB/testing/testworkload

testworkload:

operationcount=10000
recordcount=10000
fieldcount=3
fieldlength=20
dataintegrity=true
writeallfields=true
readallfields=true
insertorder=ordered
maxscanlength=100
threadcount=1
workload=com.yahoo.ycsb.workloads.CoreWorkload

scanproportion=0.3
readproportion=0.3
updateproportion=0.4
insertproportion=0.0

hdrhistogram.percentiles=50,75,95

# mysql
db.driver=com.mysql.jdbc.Driver
db.url=jdbc:mysql://mysql.vagrant:3306/ycsb
db.user=admin
db.passwd=admin

# cassandra
hosts=cassandra.vagrant

# couchbase
couchbase.url=http://couchbase.vagrant:8091/pools
couchbase.bucket=usertable
couchbase.ddoc=ycsb_ddoc
couchbase.view=ycsb_view

# memcached
memcached.hosts=memcached.vagrant

# orientdb
# orientdb.url=plocal:ycsb
orientdb.url=remote:orientdb.vagrant/ycsb
orientdb.user=root
orientdb.password=password
orientdb.remote.storagetype=plocal

# mongodb
mongodb.url=mongodb://mongodb.vagrant:27017/ycsb?w=1
@risdenk

This comment has been minimized.

Show comment
Hide comment
@risdenk

risdenk Feb 23, 2016

Collaborator

@ghaughian - Do you have time to test out the new Solr bindings? If not I can take a look at testing it.

Collaborator

risdenk commented Feb 23, 2016

@ghaughian - Do you have time to test out the new Solr bindings? If not I can take a look at testing it.

@risdenk

This comment has been minimized.

Show comment
Hide comment
@risdenk

risdenk Feb 23, 2016

Collaborator

@kruthar Thanks!

Collaborator

risdenk commented Feb 23, 2016

@kruthar Thanks!

@ghaughian

This comment has been minimized.

Show comment
Hide comment
@ghaughian

ghaughian Feb 23, 2016

Contributor

@risdenk it would be Thursday before I get a chance to test the Solr binding unfortunately. Would that work?

Contributor

ghaughian commented Feb 23, 2016

@risdenk it would be Thursday before I get a chance to test the Solr binding unfortunately. Would that work?

@risdenk

This comment has been minimized.

Show comment
Hide comment
@risdenk

risdenk Feb 23, 2016

Collaborator

@ghaughian Thanks! That should work. I'll update this thread if I get around to testing the Solr binding before you do.

Collaborator

risdenk commented Feb 23, 2016

@ghaughian Thanks! That should work. I'll update this thread if I get around to testing the Solr binding before you do.

@busbey

This comment has been minimized.

Show comment
Hide comment
@busbey

busbey Feb 24, 2016

Collaborator

Tested hbase10 and hbase098 bindings against a small (7 worker) cluster. Both work fine.

Collaborator

busbey commented Feb 24, 2016

Tested hbase10 and hbase098 bindings against a small (7 worker) cluster. Both work fine.

@busbey

This comment has been minimized.

Show comment
Hide comment
@busbey

busbey Feb 24, 2016

Collaborator

@yuyantingzero do you think you could check out the release candidate and make sure the updated DynamoDB client works as expected?

Collaborator

busbey commented Feb 24, 2016

@yuyantingzero do you think you could check out the release candidate and make sure the updated DynamoDB client works as expected?

@busbey

This comment has been minimized.

Show comment
Hide comment
@busbey

busbey Feb 24, 2016

Collaborator

@magicbane could you spare some time to validate the release candidate works with ElasticSearch with the newer version?

Collaborator

busbey commented Feb 24, 2016

@magicbane could you spare some time to validate the release candidate works with ElasticSearch with the newer version?

@busbey

This comment has been minimized.

Show comment
Hide comment
@busbey

busbey Feb 24, 2016

Collaborator

@allanbank do you think we need the full mongodb battery of tests given the changes that happened?

@risdenk I just want to confirm that the plan is to keep these previously listed "tested supported" bindings from 0.6.0 as some form of "supported / expected to work" for this release:

  • S3
  • Google Cloud Datastore
  • Apache Kudu (incubating)
  • Aerospike
  • Tarantool
Collaborator

busbey commented Feb 24, 2016

@allanbank do you think we need the full mongodb battery of tests given the changes that happened?

@risdenk I just want to confirm that the plan is to keep these previously listed "tested supported" bindings from 0.6.0 as some form of "supported / expected to work" for this release:

  • S3
  • Google Cloud Datastore
  • Apache Kudu (incubating)
  • Aerospike
  • Tarantool
@risdenk

This comment has been minimized.

Show comment
Hide comment
@risdenk

risdenk Feb 24, 2016

Collaborator

@busbey Yes going to keep the bindings that haven't changed from 0.6.0 as Supported but not listed as tested for this release.

I need to make a few minor edits still to the release notes, but draft release notes are here: https://gist.github.com/risdenk/2c739719a815c4e74c64

Collaborator

risdenk commented Feb 24, 2016

@busbey Yes going to keep the bindings that haven't changed from 0.6.0 as Supported but not listed as tested for this release.

I need to make a few minor edits still to the release notes, but draft release notes are here: https://gist.github.com/risdenk/2c739719a815c4e74c64

@busbey

This comment has been minimized.

Show comment
Hide comment
@busbey

busbey Feb 24, 2016

Collaborator

I also tested the HBase 098 binding, so it should be in "tested supported". @kruthar mentioned testing Memcached, so it should be in "tested supported".

Technically, the version of HBase I ran against was the CDH5.5.1 version (which is 1.0.0 based). Similarly, the Accumulo version was the Cloudera packaging 1.6.0-CDH5.1.4 (which is 1.6.0 based). I don't think the distinction is worth calling out, but now folks can find it later if I'm wrong. :)

The JDBC note should probably include what backing database it was used against because that can make a big difference in how tolerant of correctness things are.

I haven't seen anyone test DynamoDB or ElasticSearch yet. More importantly, I haven't seen anyone agree to test them.

Collaborator

busbey commented Feb 24, 2016

I also tested the HBase 098 binding, so it should be in "tested supported". @kruthar mentioned testing Memcached, so it should be in "tested supported".

Technically, the version of HBase I ran against was the CDH5.5.1 version (which is 1.0.0 based). Similarly, the Accumulo version was the Cloudera packaging 1.6.0-CDH5.1.4 (which is 1.6.0 based). I don't think the distinction is worth calling out, but now folks can find it later if I'm wrong. :)

The JDBC note should probably include what backing database it was used against because that can make a big difference in how tolerant of correctness things are.

I haven't seen anyone test DynamoDB or ElasticSearch yet. More importantly, I haven't seen anyone agree to test them.

@risdenk

This comment has been minimized.

Show comment
Hide comment
@risdenk

risdenk Feb 24, 2016

Collaborator

@busbey yea agreed on all your comments. Those were the edits that I was planning to make to the release notes. Just waiting to see what other testing comes in.

Collaborator

risdenk commented Feb 24, 2016

@busbey yea agreed on all your comments. Those were the edits that I was planning to make to the release notes. Just waiting to see what other testing comes in.

@risdenk

This comment has been minimized.

Show comment
Hide comment
@risdenk

risdenk Feb 24, 2016

Collaborator

Updated release notes based on comments from @busbey https://gist.github.com/risdenk/2c739719a815c4e74c64

Currently waiting on testing for Solr.

Collaborator

risdenk commented Feb 24, 2016

Updated release notes based on comments from @busbey https://gist.github.com/risdenk/2c739719a815c4e74c64

Currently waiting on testing for Solr.

@yuyantingzero

This comment has been minimized.

Show comment
Hide comment
@yuyantingzero

yuyantingzero Feb 24, 2016

Contributor

Sry for the late reply. I just tested dynamodb binding with workloada as well as some manual testing using ycsb shell for both HASH and HASH_AND_RANGE key mode.

Contributor

yuyantingzero commented Feb 24, 2016

Sry for the late reply. I just tested dynamodb binding with workloada as well as some manual testing using ycsb shell for both HASH and HASH_AND_RANGE key mode.

@busbey

This comment has been minimized.

Show comment
Hide comment
@busbey

busbey Feb 24, 2016

Collaborator

excellent! thanks for checking it.

Collaborator

busbey commented Feb 24, 2016

excellent! thanks for checking it.

@ghaughian

This comment has been minimized.

Show comment
Hide comment
@ghaughian

ghaughian Feb 25, 2016

Contributor

@risdenk Tested the Solr binding, everything looks good!

Contributor

ghaughian commented Feb 25, 2016

@risdenk Tested the Solr binding, everything looks good!

@risdenk

This comment has been minimized.

Show comment
Hide comment
@risdenk

risdenk Feb 25, 2016

Collaborator

thanks @yuyantingzero and @ghaughian.

@yuyantingzero - Which version of DynamoDB did you test?

@ghaughian - Which version of Solr did you test?

Collaborator

risdenk commented Feb 25, 2016

thanks @yuyantingzero and @ghaughian.

@yuyantingzero - Which version of DynamoDB did you test?

@ghaughian - Which version of Solr did you test?

@ghaughian

This comment has been minimized.

Show comment
Hide comment
@ghaughian

ghaughian Feb 25, 2016

Contributor

@risdenk Solr 5.4.0

Contributor

ghaughian commented Feb 25, 2016

@risdenk Solr 5.4.0

@risdenk

This comment has been minimized.

Show comment
Hide comment
@risdenk

risdenk Feb 25, 2016

Collaborator

All testing for RC2 has been completed. Draft release notes: https://gist.github.com/risdenk/2c739719a815c4e74c64

Collaborator

risdenk commented Feb 25, 2016

All testing for RC2 has been completed. Draft release notes: https://gist.github.com/risdenk/2c739719a815c4e74c64

@busbey

This comment has been minimized.

Show comment
Hide comment
@busbey

busbey Feb 25, 2016

Collaborator

+1 release notes look good to me.

Collaborator

busbey commented Feb 25, 2016

+1 release notes look good to me.

@risdenk

This comment has been minimized.

Show comment
Hide comment
@risdenk

risdenk Feb 25, 2016

Collaborator

Thanks @busbey. Going ahead with the steps for releasing 0.7.0.

Collaborator

risdenk commented Feb 25, 2016

Thanks @busbey. Going ahead with the steps for releasing 0.7.0.

@cmatser

This comment has been minimized.

Show comment
Hide comment
@cmatser

cmatser Feb 25, 2016

Collaborator

+1 Nice work handling this release.

Collaborator

cmatser commented Feb 25, 2016

+1 Nice work handling this release.

@risdenk

This comment has been minimized.

Show comment
Hide comment
@risdenk

This comment has been minimized.

Show comment
Hide comment
@risdenk

risdenk Feb 25, 2016

Collaborator

Starting release announcements. Will close out this issue when announcements are done.

Collaborator

risdenk commented Feb 25, 2016

Starting release announcements. Will close out this issue when announcements are done.

@busbey

This comment has been minimized.

Show comment
Hide comment
@busbey

busbey Feb 25, 2016

Collaborator

excellent!

one nit on the release: the elasticsearch binding ended up in the untested category, so it shouldn't have convenience binaries included.

Collaborator

busbey commented Feb 25, 2016

excellent!

one nit on the release: the elasticsearch binding ended up in the untested category, so it shouldn't have convenience binaries included.

@risdenk

This comment has been minimized.

Show comment
Hide comment
@risdenk

risdenk Feb 25, 2016

Collaborator

Oops thanks @busbey. Removed the elasticsearch convenience binary.

Collaborator

risdenk commented Feb 25, 2016

Oops thanks @busbey. Removed the elasticsearch convenience binary.

@magicbane

This comment has been minimized.

Show comment
Hide comment
@magicbane

magicbane Feb 25, 2016

Sorry I'm currently traveling, so I didn't have time to test it. I can see
if I have time later today.
On Feb 25, 2016 12:00 PM, "Sean Busbey" notifications@github.com wrote:

excellent!

one nit on the release: the elasticsearch binding ended up in the untested
category, so it shouldn't have convenience binaries included.


Reply to this email directly or view it on GitHub
#624 (comment)
.

Sorry I'm currently traveling, so I didn't have time to test it. I can see
if I have time later today.
On Feb 25, 2016 12:00 PM, "Sean Busbey" notifications@github.com wrote:

excellent!

one nit on the release: the elasticsearch binding ended up in the untested
category, so it shouldn't have convenience binaries included.


Reply to this email directly or view it on GitHub
#624 (comment)
.

@busbey

This comment has been minimized.

Show comment
Hide comment
@busbey

busbey Feb 25, 2016

Collaborator

No worries @magicbane. We'll start another release in a few weeks and can get it tested in that release cycle.

Collaborator

busbey commented Feb 25, 2016

No worries @magicbane. We'll start another release in a few weeks and can get it tested in that release cycle.

@yuyantingzero

This comment has been minimized.

Show comment
Hide comment
@yuyantingzero

yuyantingzero Feb 25, 2016

Contributor

@risdenk dynamodb is managed, doesn't have a version. But the aws sdk version is 1.10.48.

Contributor

yuyantingzero commented Feb 25, 2016

@risdenk dynamodb is managed, doesn't have a version. But the aws sdk version is 1.10.48.

@risdenk

This comment has been minimized.

Show comment
Hide comment
@risdenk

risdenk Feb 25, 2016

Collaborator

@yuyantingzero Thanks yea my mistake when asking. I knew that but just blanked when responding to this thread.

Collaborator

risdenk commented Feb 25, 2016

@yuyantingzero Thanks yea my mistake when asking. I knew that but just blanked when responding to this thread.

@risdenk

@risdenk risdenk closed this Feb 26, 2016

@risdenk risdenk added the release label Nov 15, 2016

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment