forked from strategist922/hbase-0.94-panthera
-
Notifications
You must be signed in to change notification settings - Fork 0
/
CHANGES.txt
5069 lines (4953 loc) · 300 KB
/
CHANGES.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
HBase Change Log
Release 0.94.1 - 7/24/2012
Sub-task
[HBASE-5342] - Grant/Revoke global permissions
[HBASE-5372] - Table mutation operations should check table level rights, not global rights
[HBASE-5385] - Delete table/column should delete stored permissions on -acl- table
[HBASE-5659] - TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[HBASE-6061] - Fix ACL "Admin" Table inconsistent permission check
[HBASE-6062] - preCheckAndPut/Delete() checks for READ when also a WRITE is performed
[HBASE-6092] - Authorize flush, split, compact operations in AccessController
[HBASE-6157] - Revoke of Global permission is not taking effect without restart.
[HBASE-6181] - TestStoreFile fails with jdk1.7
[HBASE-6188] - Remove the concept of table owner
[HBASE-6209] - ACL Corrections for AccessControllerProtocol apis
[HBASE-6224] - add Pre and Post coprocessor hooks for BulkLoad
[HBASE-6238] - Grant on META not taking effect
[HBASE-6252] - TABLE ADMIN should be allowed to relocate regions
[HBASE-6253] - Do not allow user to disable or drop ACL table
[HBASE-6292] - Compact can skip the security access control
[HBASE-6355] - Allow HBase to compile against JDK7
Bug
[HBASE-4379] - [hbck] Does not complain about tables with no end region [Z,]
[HBASE-4470] - ServerNotRunningException coming out of assignRootAndMeta kills the Master
[HBASE-4891] - HTable.ClientScanner needs to clone the Scan object
[HBASE-5546] - Master assigns region in the original region server when opening region failed
[HBASE-5722] - NPE in ZKUtil#getChildDataAndWatchForNewChildren when ZK not available or NW down.
[HBASE-5733] - AssignmentManager#processDeadServersAndRegionsInTransition can fail with NPE.
[HBASE-5741] - ImportTsv does not check for table existence
[HBASE-5757] - TableInputFormat should handle as many errors as possible
[HBASE-5806] - Handle split region related failures on master restart and RS restart
[HBASE-5840] - Open Region FAILED_OPEN doesn't clear the TaskMonitor Status, keeps showing the old status
[HBASE-5853] - java.lang.RuntimeException: readObject can't find class org.apache.hadoop.hdfs.protocol.HdfsFileStatus
[HBASE-5874] - When 'fs.default.name' not configured, the hbck tool and Merge tool throw IllegalArgumentException.
[HBASE-5875] - Process RIT and Master restart may remove an online server considering it as a dead server
[HBASE-5876] - TestImportExport has been failing against hadoop 0.23 profile
[HBASE-5883] - Backup master is going down due to connection refused exception
[HBASE-5894] - Table deletion failed but HBaseAdmin#deletetable reports it as success
[HBASE-5902] - Some scripts are not executable
[HBASE-5909] - SlabStats should be a daemon thread
[HBASE-5916] - RS restart just before master intialization we make the cluster non operative
[HBASE-5918] - Master will block forever at startup if root server dies between assigning root and assigning meta
[HBASE-5922] - HalfStoreFileReader seekBefore causes StackOverflowError
[HBASE-5927] - SSH and DisableTableHandler happening together does not clear the znode of the region and RIT map.
[HBASE-5928] - Hbck shouldn't npe when there are no tables.
[HBASE-5955] - Guava 11 drops MapEvictionListener and Hadoop 2.0.0-alpha requires it
[HBASE-5963] - ClassCastException: FileSystem$Cache$ClientFinalizer cannot be cast to Thread
[HBASE-5964] - HFileSystem: "No FileSystem for scheme: hdfs"
[HBASE-5966] - MapReduce based tests broken on Hadoop 2.0.0-alpha
[HBASE-5975] - Failed suppression of fs shutdown hook with Hadoop 2.0.0
[HBASE-5986] - Clients can see holes in the META table when regions are being split
[HBASE-6002] - Possible chance of resource leak in HlogSplitter
[HBASE-6011] - Unable to start master in local mode
[HBASE-6016] - ServerShutdownHandler#processDeadRegion could return false for disabling table regions
[HBASE-6018] - hbck fails with a RejectedExecutionException when >50 regions present
[HBASE-6021] - NullPointerException when running LoadTestTool without specifying compression type
[HBASE-6029] - HBCK doesn't recover Balance switch if exception occurs in onlineHbck()
[HBASE-6046] - Master retry on ZK session expiry causes inconsistent region assignments.
[HBASE-6047] - Put.has() can't determine result correctly
[HBASE-6049] - Serializing "List" containing null elements will cause NullPointerException in HbaseObjectWritable.writeObject()
[HBASE-6050] - HLogSplitter renaming recovered.edits and CJ removing the parent directory race, making the HBCK think cluster is inconsistent.
[HBASE-6056] - Restore hbase-default version check
[HBASE-6065] - Log for flush would append a non-sequential edit in the hlog, leading to possible data loss
[HBASE-6068] - Secure HBase cluster : Client not able to call some admin APIs
[HBASE-6069] - TableInputFormatBase#createRecordReader() doesn't initialize TableRecordReader which causes NPE
[HBASE-6070] - AM.nodeDeleted and SSH races creating problems for regions under SPLIT
[HBASE-6088] - Region splitting not happened for long time due to ZK exception while creating RS_ZK_SPLITTING node
[HBASE-6089] - SSH and AM.joinCluster causes Concurrent Modification exception.
[HBASE-6095] - ActiveMasterManager NullPointerException
[HBASE-6115] - NullPointerException is thrown when root and meta table regions are assigning to another RS.
[HBASE-6122] - Backup master does not become Active master after ZK exception
[HBASE-6126] - Fix broke TestLocalHBaseCluster in 0.92/0.94
[HBASE-6133] - TestRestartCluster failing in 0.92
[HBASE-6141] - InterfaceAudience breaks 0.94 on older versions of hadoop
[HBASE-6146] - Disabling of Catalog tables should not be allowed
[HBASE-6158] - Data loss if the words 'merges' or 'splits' are used as Column Family name
[HBASE-6160] - META entries from daughters can be deleted before parent entries
[HBASE-6164] - Correct the bug in block encoding usage in bulkload
[HBASE-6185] - Update javadoc for ConstantSizeRegionSplitPolicy class
[HBASE-6195] - Increment data will be lost when the memstore is flushed
[HBASE-6200] - KeyComparator.compareWithoutRow can be wrong when families have the same prefix
[HBASE-6210] - Backport HBASE-6197 to 0.94
[HBASE-6227] - SSH and cluster startup causes data loss
[HBASE-6229] - AM.assign() should not set table state to ENABLED directly.
[HBASE-6236] - Offline meta repair fails if the HBase base mount point is on a different cluster/volume than its parent in a ViewFS or similar FS
[HBASE-6237] - Fix race on ACL table creation in TestTablePermissions
[HBASE-6240] - Race in HCM.getMaster stalls clients
[HBASE-6246] - Admin.move without specifying destination does not go through AccessController
[HBASE-6248] - Jetty init may fail if directory name contains "master"
[HBASE-6265] - Calling getTimestamp() on a KV in cp.prePut() causes KV not to be flushed
[HBASE-6269] - Lazyseek should use the maxSequenseId StoreFile's KeyValue as the latest KeyValue
[HBASE-6281] - Assignment need not be called for disabling table regions during clean cluster start up.
[HBASE-6284] - Introduce HRegion#doMiniBatchMutation()
[HBASE-6293] - HMaster does not go down while splitting logs even if explicit shutdown is called.
[HBASE-6303] - HCD.setCompressionType should use Enum support for storing compression types as strings
[HBASE-6311] - Data error after majorCompaction caused by keeping MVCC for opened scanners
[HBASE-6313] - Client hangs because the client is not notified
[HBASE-6319] - ReplicationSource can call terminate on itself and deadlock
[HBASE-6325] - [replication] Race in ReplicationSourceManager.init can initiate a failover even if the node is alive
[HBASE-6326] - Avoid nested retry loops in HConnectionManager
[HBASE-6328] - FSHDFSUtils#recoverFileLease tries to rethrow InterruptedException but actually shallows it
[HBASE-6329] - Stopping META regionserver when splitting region could cause daughter region to be assigned twice
[HBASE-6337] - [MTTR] Remove renaming tmp log file in SplitLogManager
[HBASE-6357] - Failed distributed log splitting stuck on master web UI
[HBASE-6369] - HTable is not closed in AggregationClient
[HBASE-6375] - Master may be using a stale list of region servers for creating assignment plan during startup
[HBASE-6377] - HBASE-5533 metrics miss all operations submitted via MultiAction
[HBASE-6380] - bulkload should update the store.storeSize
[HBASE-6392] - UnknownRegionException blocks hbck from sideline big overlap regions
[HBASE-6394] - verifyrep MR job map tasks throws NullPointerException
[HBASE-6397] - [hbck] print out bulk load commands for sidelined regions if necessary
[HBASE-6406] - TestReplicationPeer.testResetZooKeeperSession and TestZooKeeper.testClientSessionExpired fail frequently
[HBASE-6420] - Gracefully shutdown logsyncer
[HBASE-6426] - Add Hadoop 2.0.x profile to 0.92+
[HBASE-6440] - SplitLogManager - log the exception when failed to finish split log file
[HBASE-6443] - HLogSplitter should ignore 0 length files
[HBASE-6445] - rat check fails if hs_err_pid26514.log dropped in tests
Improvement
[HBASE-4720] - Implement atomic update operations (checkAndPut, checkAndDelete) for REST client/server
[HBASE-5360] - [uberhbck] Add options for how to handle offline split parents.
[HBASE-5630] - hbck should disable the balancer using synchronousBalanceSwitch.
[HBASE-5802] - Change the default metrics class to NullContextWithUpdateThread
[HBASE-5838] - Add an LZ4 compression option to HFile
[HBASE-5887] - Make TestAcidGuarantees usable for system testing.
[HBASE-5892] - [hbck] Refactor parallel WorkItem* to Futures.
[HBASE-5913] - Speed up the full scan of META
[HBASE-5973] - Add ability for potentially long-running IPC calls to abort if client disconnects
[HBASE-6010] - Security audit logger configuration for log4j
[HBASE-6013] - Polish sharp edges from CopyTable
[HBASE-6022] - Include Junit in the libs when packaging so that TestAcidGaurntee can run
[HBASE-6023] - Normalize security audit logging level with Hadoop
[HBASE-6040] - Use block encoding and HBase handled checksum verification in bulk loading using HFileOutputFormat
[HBASE-6067] - HBase won't start when hbase.rootdir uses ViewFileSystem
[HBASE-6114] - CacheControl flags should be tunable per table schema per CF
[HBASE-6124] - Backport HBASE-6033 to 0.90, 0.92 and 0.94
[HBASE-6161] - Log Error when thrift server fails to start up.
[HBASE-6173] - hbck check specified tables only
[HBASE-6207] - Add jitter to client retry timer
[HBASE-6214] - Backport HBASE-5998 to 94.1
[HBASE-6244] - [REST] Result generators do not need to query table schema
[HBASE-6247] - [REST] HTablePool.putTable is deprecated
[HBASE-6267] - hbase.store.delete.expired.storefile should be true by default
[HBASE-6283] - [region_mover.rb] Add option to exclude list of hosts on unload instead of just assuming the source node.
[HBASE-6314] - Fast fail behavior for unauthenticated user
[HBASE-6332] - Improve POM for better integration with downstream ivy projects
[HBASE-6334] - TestImprovement for TestHRegion.testWritesWhileGetting
[HBASE-6341] - Publicly expose HConnectionKey
[HBASE-6363] - HBaseConfiguration can carry a main method that dumps XML output for debug purposes
[HBASE-6382] - Upgrade Jersey to 1.8 to match Hadoop 1 and 2
[HBASE-6384] - hbck should group together those sidelined regions need to be bulk loaded later
[HBASE-6433] - Improve HBaseServer#getRemoteAddress by utilizing HBaseServer.Connection.hostAddress
New Feature
[HBASE-2730] - Expose RS work queue contents on web UI
[HBASE-4956] - Control direct memory buffer consumption by HBaseClient
[HBASE-5609] - Add the ability to pass additional information for slow query logging
[HBASE-5886] - Add new metric for possible data loss due to puts without WAL
[HBASE-6044] - copytable: remove rs.* parameters
Task
[HBASE-6001] - Upgrade slf4j to 1.6.1
[HBASE-6034] - Upgrade Hadoop dependencies
[HBASE-6077] - Document the most common secure RPC troubleshooting resolutions
[HBASE-6129] - Backport of Add Increment Coalescing in thrift.
[HBASE-6131] - Add attribution for code added by HBASE-5533 metrics
Test
[HBASE-5985] - TestMetaMigrationRemovingHTD failed with HADOOP 2.0.0
Release 0.94.0 - 5/1/2012
Sub-task
[HBASE-4343] - Get the TestAcidGuarantee unit test to fail consistently
[HBASE-4345] - Ensure that Scanners that read from the storefiles respect MVCC
[HBASE-4346] - Optimise the storage that we use for storing MVCC information.
[HBASE-4485] - Eliminate window of missing Data
[HBASE-4517] - Document new replication features in 0.92
[HBASE-4544] - Rename RWCC to MVCC
[HBASE-4594] - Ensure that KV's newer than the oldest-living-scanner is not accounted for the maxVersions during flush/compaction.
[HBASE-4661] - Ability to export the list of files for a some or all column families for a given region
[HBASE-4682] - Support deleted rows using Import/Export
[HBASE-4908] - HBase cluster test tool (port from 0.89-fb)
[HBASE-4911] - Clean shutdown
[HBASE-4979] - Setting KEEP_DELETE_CELLS fails in shell
[HBASE-4981] - add raw scan support to shell
[HBASE-4998] - Support deleted rows in CopyTable
[HBASE-5005] - Add DEFAULT_MIN_VERSIONS to HColumnDescriptor.DEFAULT_VALUES
[HBASE-5058] - Allow HBaseAdmin to use an existing connection
[HBASE-5096] - Replication does not handle deletes correctly.
[HBASE-5118] - Fix Scan documentation
[HBASE-5143] - Fix config typo in pluggable load balancer factory
[HBASE-5203] - Group atomic put/delete operation into a single WALEdit to handle region server failures.
[HBASE-5266] - Add documentation for ColumnRangeFilter
[HBASE-5346] - Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
[HBASE-5368] - Move PrefixSplitKeyPolicy out of the src/test into src, so it is accessible in HBase installs
[HBASE-5371] - Introduce AccessControllerProtocol.checkPermissions(Permission[] permissons) API
[HBASE-5413] - Rename RowMutation to RowMutations
[HBASE-5431] - Improve delete marker handling in Import M/R jobs
[HBASE-5460] - Add protobuf as M/R dependency jar
[HBASE-5497] - Add protobuf as M/R dependency jar (mapred)
[HBASE-5523] - Fix Delete Timerange logic for KEEP_DELETED_CELLS
[HBASE-5541] - Avoid holding the rowlock during HLog sync in HRegion.mutateRowWithLocks
[HBASE-5638] - Backport to 0.90 and 0.92 - NPE reading ZK config in HBase
[HBASE-5641] - decayingSampleTick1 prevents HBase from shutting down.
[HBASE-5793] - TestHBaseFsck#TestNoHdfsTable test hangs after client retries increased
Bug
[HBASE-2856] - TestAcidGuarantee broken on trunk
[HBASE-3443] - ICV optimization to look in memstore first and then store files (HBASE-3082) does not work when deletes are in the mix
[HBASE-3690] - Option to Exclude Bulk Import Files from Minor Compaction
[HBASE-3987] - Fix a NullPointerException on a failure to load Bloom filter data
[HBASE-4065] - TableOutputFormat ignores failure to create table instance
[HBASE-4078] - Silent Data Offlining During HDFS Flakiness
[HBASE-4105] - Stargate does not support Content-Type: application/json and Content-Encoding: gzip in parallel
[HBASE-4116] - [stargate] StringIndexOutOfBoundsException in row spec parse
[HBASE-4326] - Tests that use HBaseTestingUtility.startMiniCluster(n) should shutdown with HBaseTestingUtility.shutdownMiniCluster.
[HBASE-4397] - -ROOT-, .META. tables stay offline for too long in recovery phase after all RSs are shutdown at the same time
[HBASE-4398] - If HRegionPartitioner is used in MapReduce, client side configurations are overwritten by hbase-site.xml.
[HBASE-4476] - Compactions must fail if column tracker gets columns out of order
[HBASE-4496] - HFile V2 does not honor setCacheBlocks when scanning.
[HBASE-4607] - Split log worker should terminate properly when waiting for znode
[HBASE-4609] - ThriftServer.getRegionInfo() is expecting old ServerName format, need to use new Addressing class instead
[HBASE-4610] - Port HBASE-3380 (Master failover can split logs of live servers) to 92/trunk (definitely bring in config params, decide if we need to do more to fix the bug)
[HBASE-4626] - Filters unnecessarily copy byte arrays...
[HBASE-4645] - Edits Log recovery losing data across column families
[HBASE-4648] - Bytes.toBigDecimal() doesn't use offset
[HBASE-4658] - Put attributes are not exposed via the ThriftServer
[HBASE-4673] - NPE in HFileReaderV2.close during major compaction when hfile.block.cache.size is set to 0
[HBASE-4679] - Thrift null mutation error
[HBASE-4691] - Remove more unnecessary byte[] copies from KeyValues
[HBASE-4729] - Clash between region unassign and splitting kills the master
[HBASE-4745] - LRU Statistics thread should be daemon
[HBASE-4769] - Abort RegionServer Immediately on OOME
[HBASE-4776] - HLog.closed should be checked inside of updateLock
[HBASE-4778] - Don't ignore corrupt StoreFiles when opening a region
[HBASE-4790] - Occasional TestDistributedLogSplitting failure
[HBASE-4792] - SplitRegionHandler doesn't care if it deletes the znode or not, leaves the parent region stuck offline
[HBASE-4795] - Fix TestHFileBlock when running on a 32-bit JVM
[HBASE-4797] - [availability] Skip recovered.edits files with edits we know older than what region currently has
[HBASE-4805] - Allow better control of resource consumption in HTable
[HBASE-4819] - TestShell broke in trunk; typo
[HBASE-4825] - TestRegionServersMetrics and TestZKLeaderManager are not categorized (small/medium/large)
[HBASE-4826] - Modify hbasetests.sh to take into account the new pom.xml with surefire
[HBASE-4832] - TestRegionServerCoprocessorExceptionWithAbort fails if the region server stops too fast
[HBASE-4853] - HBASE-4789 does overzealous pruning of seqids
[HBASE-4874] - Run tests with non-secure random, some tests hang otherwise
[HBASE-4878] - Master crash when splitting hlog may cause data loss
[HBASE-4886] - truncate fails in HBase shell
[HBASE-4890] - fix possible NPE in HConnectionManager
[HBASE-4932] - Block cache can be mistakenly instantiated by tools
[HBASE-4936] - Cached HRegionInterface connections crash when getting UnknownHost exceptions
[HBASE-4937] - Error in Quick Start Shell Exercises
[HBASE-4942] - HMaster is unable to start of HFile V1 is used
[HBASE-4946] - HTable.coprocessorExec (and possibly coprocessorProxy) does not work with dynamically loaded coprocessors (from hdfs or local system), because the RPC system tries to deserialize an unknown class.
[HBASE-4993] - Performance regression in minicluster creation
[HBASE-5003] - If the master is started with a wrong root dir, it gets stuck and can't be killed
[HBASE-5010] - Filter HFiles based on TTL
[HBASE-5015] - Remove some leaks in tests due to lack of HTable.close()
[HBASE-5026] - Add coprocessor hook to HRegionServer.ScannerListener.leaseExpired()
[HBASE-5027] - HConnection.create(final Connection conf) does not clone, it creates a new Configuration reading *.xmls and then does a merge.
[HBASE-5038] - Some tests leak connections
[HBASE-5041] - Major compaction on non existing table does not throw error
[HBASE-5051] - HBaseTestingUtility#getHBaseAdmin() creates a new HBaseAdmin instance at each call
[HBASE-5053] - HCM Tests leak connections
[HBASE-5055] - Build against hadoop 0.22 broken
[HBASE-5068] - RC1 can not build its hadoop-0.23 profile
[HBASE-5085] - fix test-patch script from setting the ulimit
[HBASE-5088] - A concurrency issue on SoftValueSortedMap
[HBASE-5091] - [replication] Update replication doc to reflect current znode structure
[HBASE-5097] - RegionObserver implementation whose preScannerOpen and postScannerOpen Impl return null can stall the system initialization through NPE
[HBASE-5099] - ZK event thread waiting for root region assignment may block server shutdown handler for the region sever the root region was on
[HBASE-5100] - Rollback of split could cause closed region to be opened again
[HBASE-5103] - Fix improper master znode deserialization
[HBASE-5120] - Timeout monitor races with table disable handler
[HBASE-5121] - MajorCompaction may affect scan's correctness
[HBASE-5141] - Memory leak in MonitoredRPCHandlerImpl
[HBASE-5152] - Region is on service before completing initialization when doing rollback of split, it will affect read correctness
[HBASE-5163] - TestLogRolling#testLogRollOnDatanodeDeath fails sometimes on Jenkins or hadoop QA ("The directory is already locked.")
[HBASE-5172] - HTableInterface should extend java.io.Closeable
[HBASE-5176] - AssignmentManager#getRegion: logging nit adds a redundant '+'
[HBASE-5182] - TBoundedThreadPoolServer threadKeepAliveTimeSec is not configured properly
[HBASE-5195] - [Coprocessors] preGet hook does not allow overriding or wrapping filter on incoming Get
[HBASE-5196] - Failure in region split after PONR could cause region hole
[HBASE-5200] - AM.ProcessRegionInTransition() and AM.handleRegion() race thus leaving the region assignment inconsistent
[HBASE-5206] - Port HBASE-5155 to 0.92, 0.94, and TRUNK
[HBASE-5212] - Fix test TestTableMapReduce against 0.23.
[HBASE-5213] - "hbase master stop" does not bring down backup masters
[HBASE-5221] - bin/hbase script doesn't look for Hadoop jars in the right place in trunk layout
[HBASE-5228] - [REST] Rip out "transform" feature
[HBASE-5267] - Add a configuration to disable the slab cache by default
[HBASE-5271] - Result.getValue and Result.getColumnLatest return the wrong column.
[HBASE-5278] - HBase shell script refers to removed "migrate" functionality
[HBASE-5281] - Should a failure in creating an unassigned node abort the master?
[HBASE-5282] - Possible file handle leak with truncated HLog file.
[HBASE-5283] - Request counters may become negative for heavily loaded regions
[HBASE-5286] - bin/hbase's logic of adding Hadoop jar files to the classpath is fragile when presented with split packaged Hadoop 0.23 installation
[HBASE-5288] - Security source code dirs missing from 0.92.0 release tarballs.
[HBASE-5290] - [FindBugs] Synchronization on boxed primitive
[HBASE-5292] - getsize per-CF metric incorrectly counts compaction related reads as well
[HBASE-5317] - Fix TestHFileOutputFormat to work against hadoop 0.23
[HBASE-5327] - Print a message when an invalid hbase.rootdir is passed
[HBASE-5331] - Off by one bug in util.HMerge
[HBASE-5345] - CheckAndPut doesn't work when value is empty byte[]
[HBASE-5348] - Constraint configuration loaded with bloat
[HBASE-5350] - Fix jamon generated package names
[HBASE-5351] - hbase completebulkload to a new table fails in a race
[HBASE-5364] - Fix source files missing licenses in 0.92 and trunk
[HBASE-5384] - Up heap used by hadoopqa
[HBASE-5387] - Reuse compression streams in HFileBlock.Writer
[HBASE-5398] - HBase shell disable_all/enable_all/drop_all promp wrong tables for confirmation
[HBASE-5415] - FSTableDescriptors should handle random folders in hbase.root.dir better
[HBASE-5420] - TestImportTsv does not shut down MR Cluster correctly (fails against 0.23 hadoop)
[HBASE-5423] - Regionserver may block forever on waitOnAllRegionsToClose when aborting
[HBASE-5425] - Punt on the timeout doesn't work in BulkEnabler#waitUntilDone (master's EnableTableHandler)
[HBASE-5437] - HRegionThriftServer does not start because of a bug in HbaseHandlerMetricsProxy
[HBASE-5466] - Opening a table also opens the metatable and never closes it.
[HBASE-5470] - Make DataBlockEncodingTool work correctly with no native compression codecs loaded
[HBASE-5473] - Metrics does not push pread time
[HBASE-5477] - Cannot build RPM for hbase-0.92.0
[HBASE-5480] - Fixups to MultithreadedTableMapper for Hadoop 0.23.2+
[HBASE-5481] - Uncaught UnknownHostException prevents HBase from starting
[HBASE-5484] - Spelling mistake in error message in HMasterCommandLine
[HBASE-5485] - LogCleaner refers to non-existant SnapshotLogCleaner
[HBASE-5488] - OfflineMetaRepair doesn't support hadoop 0.20's fs.default.name property
[HBASE-5499] - dev-support/test-patch.sh does not have execute perms
[HBASE-5502] - region_mover.rb fails to load regions back to original server for regions only containing empty tables.
[HBASE-5507] - ThriftServerRunner.HbaseHandler.getRegionInfo() and getTableRegions() do not use ByteBuffer correctly
[HBASE-5514] - Compile against hadoop 0.24-SNAPSHOT
[HBASE-5522] - hbase 0.92 test artifacts are missing from Maven central
[HBASE-5524] - Add a couple of more filters to our rat exclusion set
[HBASE-5529] - MR test failures becuase MALLOC_ARENA_MAX is not set
[HBASE-5531] - Maven hadoop profile (version 23) needs to be updated with latest 23 snapshot
[HBASE-5535] - Make the functions in task monitor synchronized
[HBASE-5537] - MXBean shouldn't have a dependence on InterfaceStability until 0.96
[HBASE-5545] - region can't be opened for a long time. Because the creating File failed.
[HBASE-5552] - Clean up our jmx view; its a bit of a mess
[HBASE-5562] - test-patch.sh reports a javadoc warning when there are no new javadoc warnings
[HBASE-5563] - HRegionInfo#compareTo should compare regionId as well
[HBASE-5567] - test-patch.sh has logic error in findbugs check
[HBASE-5568] - Multi concurrent flushcache() for one region could cause data loss
[HBASE-5569] - Do not collect deleted KVs when they are still in use by a scanner.
[HBASE-5574] - DEFAULT_MAX_FILE_SIZE defaults to a negative value
[HBASE-5579] - A Delete Version could mask other values
[HBASE-5581] - Creating a table with invalid syntax does not give an error message when it fails
[HBASE-5586] - [replication] NPE in ReplicationSource when creating a stream to an inexistent cluster
[HBASE-5596] - Few minor bugs from HBASE-5209
[HBASE-5597] - Findbugs check in test-patch.sh always fails
[HBASE-5603] - rolling-restart.sh script hangs when attempting to detect expiration of /hbase/master znode.
[HBASE-5606] - SplitLogManger async delete node hangs log splitting when ZK connection is lost
[HBASE-5611] - Replayed edits from regions that failed to open during recovery aren't removed from the global MemStore size
[HBASE-5613] - ThriftServer getTableRegions does not return serverName and port
[HBASE-5623] - Race condition when rolling the HLog and hlogFlush
[HBASE-5624] - Aborting regionserver when splitting region, may cause daughter region not assigned by ServerShutdownHandler.
[HBASE-5633] - NPE reading ZK config in HBase
[HBASE-5635] - If getTaskList() returns null, splitlogWorker would go down and it won't serve any requests
[HBASE-5636] - TestTableMapReduce doesn't work properly.
[HBASE-5639] - The logic used in waiting for region servers during startup is broken
[HBASE-5656] - LoadIncrementalHFiles createTable should detect and set compression algorithm
[HBASE-5663] - MultithreadedTableMapper doesn't work.
[HBASE-5665] - Repeated split causes HRegionServer failures and breaks table
[HBASE-5669] - AggregationClient fails validation for open stoprow scan
[HBASE-5680] - Improve compatibility warning about HBase with Hadoop 0.23.x
[HBASE-5689] - Skipping RecoveredEdits may cause data loss
[HBASE-5690] - compression does not work in Store.java of 0.94
[HBASE-5694] - getRowsWithColumnsTs() in Thrift service handles timestamps incorrectly
[HBASE-5701] - Put RegionServerDynamicStatistics under RegionServer in MBean hierarchy rather than have it as a peer.
[HBASE-5717] - Scanner metrics are only reported if you get to the end of a scanner
[HBASE-5720] - HFileDataBlockEncoderImpl uses wrong header size when reading HFiles with no checksums
[HBASE-5722] - NPE in ZKUtil#getChildDataAndWatchForNewChildren when ZK not available or NW down.
[HBASE-5724] - Row cache of KeyValue should be cleared in readFields().
[HBASE-5736] - ThriftServerRunner.HbaseHandler.mutateRow() does not use ByteBuffer correctly
[HBASE-5743] - Support GIT patches
[HBASE-5773] - HtablePool constructor not reading config files in certain cases
[HBASE-5780] - Fix race in HBase regionserver startup vs ZK SASL authentication
[HBASE-5781] - Zookeeper session got closed while trying to assign the region to RS using hbck -fix
[HBASE-5782] - Edits can be appended out of seqid order since HBASE-4487
[HBASE-5787] - Table owner can't disable/delete his/her own table
[HBASE-5795] - HServerLoad$RegionLoad breaks 0.92<->0.94 compatibility
[HBASE-5825] - TestHLog not running any tests; fix
[HBASE-5833] - 0.92 build has been failing pretty consistently on TestMasterFailover....
[HBASE-5848] - Create table with EMPTY_START_ROW passed as splitKey causes the HMaster to abort
[HBASE-5849] - On first cluster startup, RS aborts if root znode is not available
[HBASE-5850] - Refuse operations from Admin before master is initialized - fix for all branches.
[HBASE-5857] - RIT map in RS not getting cleared while region opening
[HBASE-5861] - Hadoop 23 compilation broken due to tests introduced in HBASE-5604
[HBASE-5864] - Error while reading from hfile in 0.94
[HBASE-5865] - test-util.sh broken with unittest updates
[HBASE-5866] - Canary in tool package but says its in tools.
[HBASE-5871] - Usability regression, we don't parse compression algos anymore
[HBASE-5873] - TimeOut Monitor thread should be started after atleast one region server registers.
[HBASE-5884] - MapReduce package info has broken link to bulk-loads
[HBASE-5885] - Invalid HFile block magic on Local file System
[HBASE-5893] - Allow spaces in coprocessor conf (aka trim() className)
[HBASE-5897] - prePut coprocessor hook causing substantial CPU usage
[HBASE-5908] - TestHLogSplit.testTralingGarbageCorruptionFileSkipErrorsPasses should not use append to corrupt the HLog
[HBASE-6265] - Calling getTimestamp() on a KV in cp.prePut() causes KV not to be flushed
[HBASE-6357] - Failed distributed log splitting stuck on master web UI
Improvement
[HBASE-1744] - Thrift server to match the new java api.
[HBASE-2418] - add support for ZooKeeper authentication
[HBASE-3373] - Allow regions to be load-balanced by table
[HBASE-3433] - Remove the KV copy of every KV in Scan; introduced by HBASE-3232
[HBASE-3512] - Coprocessors: Shell support for listing currently loaded coprocessor set
[HBASE-3565] - Add metrics to keep track of slow HLog appends
[HBASE-3763] - Add Bloom Block Index Support
[HBASE-3850] - Log more details when a scanner lease expires
[HBASE-3924] - Improve Shell's CLI help
[HBASE-3949] - Add "Master" link to RegionServer pages
[HBASE-4058] - Extend TestHBaseFsck with a complete .META. recovery scenario
[HBASE-4062] - Multi-column scanner unit test
[HBASE-4070] - [Coprocessors] Improve region server metrics to report loaded coprocessors to master
[HBASE-4076] - hbase should pick up HADOOP_CONF_DIR on its classpath
[HBASE-4131] - Make the Replication Service pluggable via a standard interface definition
[HBASE-4132] - Extend the WALActionsListener API to accomodate log archival
[HBASE-4145] - Provide metrics for hbase client
[HBASE-4213] - Support for fault tolerant, instant schema updates with out master's intervention (i.e with out enable/disable and bulk assign/unassign) through ZK.
[HBASE-4218] - Data Block Encoding of KeyValues (aka delta encoding / prefix compression)
[HBASE-4365] - Add a decent heuristic for region size
[HBASE-4418] - Show all the hbase configuration in the web ui
[HBASE-4439] - Move ClientScanner out of HTable
[HBASE-4440] - add an option to presplit table to PerformanceEvaluation
[HBASE-4461] - Expose getRowOrBefore via Thrift
[HBASE-4463] - Run more aggressive compactions during off peak hours
[HBASE-4465] - Lazy-seek optimization for StoreFile scanners
[HBASE-4469] - Avoid top row seek by looking up ROWCOL bloomfilter
[HBASE-4480] - Testing script to simplify local testing
[HBASE-4487] - The increment operation can release the rowlock before sync-ing the Hlog
[HBASE-4489] - Better key splitting in RegionSplitter
[HBASE-4519] - 25s sleep when expiring sessions in tests
[HBASE-4522] - Make hbase-site-custom.xml override the hbase-site.xml
[HBASE-4528] - The put operation can release the rowlock before sync-ing the Hlog
[HBASE-4532] - Avoid top row seek by dedicated bloom filter for delete family bloom filter
[HBASE-4542] - add filter info to slow query logging
[HBASE-4554] - Allow set/unset coprocessor table attributes from shell.
[HBASE-4568] - Make zk dump jsp response more quickly
[HBASE-4585] - Avoid next operations (and instead reseek) when current kv is deleted
[HBASE-4591] - TTL for old HLogs should be calculated from last modification time.
[HBASE-4612] - Allow ColumnPrefixFilter to support multiple prefixes
[HBASE-4627] - Ability to specify a custom start/end to RegionSplitter
[HBASE-4628] - Enhance Table Create Presplit Functionality within the HBase Shell
[HBASE-4640] - Catch ClosedChannelException and document it
[HBASE-4657] - Improve the efficiency of our MR jobs with a few configurations
[HBASE-4669] - Add an option of using round-robin assignment for enabling table
[HBASE-4696] - HRegionThriftServer' might have to indefinitely do redirtects
[HBASE-4704] - A JRuby script for identifying active master
[HBASE-4737] - Categorize the tests into small/medium/large; allow small tests to be run in parallel within a single JVM
[HBASE-4746] - Use a random ZK client port in unit tests so we can run them in parallel
[HBASE-4752] - Don't create an unnecessary LinkedList when evicting from the BlockCache
[HBASE-4760] - Add Developer Debug Options to HBase Config
[HBASE-4761] - Add Developer Debug Options to HBase Config
[HBASE-4764] - naming errors for TestHLogUtils and SoftValueSortedMapTest
[HBASE-4779] - TestHTablePool, TestScanWithBloomError, TestRegionSplitCalculator are not tagged and TestPoolMap should not use TestSuite
[HBASE-4780] - Lower mini cluster shutdown time in HRegionServer#waitOnAllRegionsToClose and ServerManager#letRegionServersShutdown
[HBASE-4781] - Pom update to use the new versions of surefire & junit
[HBASE-4783] - Improve RowCounter to count rows in a specific key range.
[HBASE-4787] - Make corePool as a configurable parameter in HTable
[HBASE-4798] - Sleeps and synchronisation improvements for tests
[HBASE-4809] - Per-CF set RPC metrics
[HBASE-4820] - Distributed log splitting coding enhancement to make it easier to understand, no semantics change
[HBASE-4847] - Activate single jvm for small tests on jenkins
[HBASE-4863] - Make Thrift server thread pool bounded and add a command-line UI test
[HBASE-4884] - Allow environment overrides for various HBase processes
[HBASE-4933] - Ability to calculate the blockcache hit ratio for the last few minutes
[HBASE-4938] - Create a HRegion.getScanner public method that allows reading from a specified readPoint
[HBASE-4940] - hadoop-metrics.properties can include configuration of the "rest" context for ganglia
[HBASE-4957] - Clean up some log messages, code in RecoverableZooKeeper
[HBASE-4964] - Add builddate, make less sections in toc, and add header and footer customizations
[HBASE-4965] - Monitor the open file descriptors and the threads counters during the unit tests
[HBASE-4970] - Add a parameter so that keepAliveTime of Htable thread pool can be changed
[HBASE-4971] - Useless sleeps in TestTimestampsFilter and TestMultipleTimestamps
[HBASE-4973] - On failure, HBaseAdmin sleeps one time too many
[HBASE-4989] - Metrics to measure sequential reads and random reads separately
[HBASE-4995] - Increase zk maxClientCnxns to give us some head room
[HBASE-5014] - PutSortReducer should adhere to memory limits
[HBASE-5017] - Bump the default hfile.block.cache.size because of HFileV2
[HBASE-5021] - Enforce upper bound on timestamp
[HBASE-5033] - Opening/Closing store in parallel to reduce region open/close time
[HBASE-5064] - utilize surefire tests parallelization
[HBASE-5072] - Support Max Value for Per-Store Metrics
[HBASE-5074] - support checksums in HBase block cache
[HBASE-5134] - Remove getRegionServerWithoutRetries and getRegionServerWithRetries from HConnection Interface
[HBASE-5166] - MultiThreaded Table Mapper analogous to MultiThreaded Mapper in hadoop
[HBASE-5167] - We shouldn't be injecting 'Killing [daemon]' into logs, when we aren't doing that.
[HBASE-5186] - Add metrics to ThriftServer
[HBASE-5189] - Add metrics to keep track of region-splits in RS
[HBASE-5190] - Limit the IPC queue size based on calls' payload size
[HBASE-5193] - Use TBoundedThreadPoolServer in HRegionThriftServer
[HBASE-5197] - [replication] Handle socket timeouts in ReplicationSource to prevent DDOS
[HBASE-5199] - Delete out of TTL store files before compaction selection
[HBASE-5201] - Utilize TThreadedSelectorServer and remove redundant code in ThriftServer and HRegionThriftServer
[HBASE-5209] - HConnection/HMasterInterface should allow for way to get hostname of currently active master in multi-master HBase setup
[HBASE-5246] - Regenerate code with thrift 0.8.0
[HBASE-5255] - Use singletons for OperationStatus to save memory
[HBASE-5259] - Normalize the RegionLocation in TableInputFormat by the reverse DNS lookup.
[HBASE-5297] - Update metrics numOpenConnections and callQueueLen directly in HBaseServer
[HBASE-5298] - Add thrift metrics to thrift2
[HBASE-5304] - Pluggable split key policy
[HBASE-5310] - HConnectionManager server cache key enhancement
[HBASE-5325] - Expose basic information about the master-status through jmx beans
[HBASE-5332] - Deterministic Compaction Jitter
[HBASE-5358] - HBaseObjectWritable should be able to serialize/deserialize generic arrays
[HBASE-5363] - Automatically run rat check on mvn release builds
[HBASE-5388] - Tune HConnectionManager#getCachedLocation method
[HBASE-5393] - Consider splitting after flushing
[HBASE-5394] - Add ability to include Protobufs in HbaseObjectWritable
[HBASE-5395] - CopyTable needs to use GenericOptionsParser
[HBASE-5411] - Add more metrics for ThriftMetrics
[HBASE-5421] - use hadoop-client/hadoop-minicluster artifacts for Hadoop 0.23 build
[HBASE-5428] - Allow for custom filters to be registered within the Thrift interface
[HBASE-5433] - [REST] Add metrics to keep track of success/failure count
[HBASE-5434] - [REST] Include more metrics in cluster status request
[HBASE-5436] - Right-size the map when reading attributes.
[HBASE-5439] - Fix some performance findbugs issues
[HBASE-5440] - Allow Import to optionally use HFileOutputFormat
[HBASE-5442] - Use builder pattern in StoreFile and HFile
[HBASE-5454] - Refuse operations from Admin before master is initialized
[HBASE-5464] - Log warning message when thrift calls throw exceptions
[HBASE-5483] - Allow configurable host to bind to for starting REST server from commandline
[HBASE-5489] - Add HTable accessor to get regions for a key range
[HBASE-5508] - Add an option to allow test output to show on the terminal
[HBASE-5520] - Support reseek() at RegionScanner
[HBASE-5533] - Add more metrics to HBase
[HBASE-5551] - Some functions should not be used by customer code and must be deprecated in 0.94
[HBASE-5560] - Avoid RegionServer GC caused by timed-out calls
[HBASE-5588] - Deprecate/remove AssignmentManager#clearRegionFromTransition
[HBASE-5589] - Add of the offline call to the Master Interface
[HBASE-5592] - Make it easier to get a table from shell
[HBASE-5618] - SplitLogManager - prevent unnecessary attempts to resubmits
[HBASE-5670] - Have Mutation implement the Row interface.
[HBASE-5671] - hbase.metrics.showTableName should be true by default
[HBASE-5682] - Allow HConnectionImplementation to recover from ZK connection loss (for 0.94 only)
[HBASE-5706] - "Dropping fs latency stats since buffer is full" spam
[HBASE-5712] - Parallelize load of .regioninfo files in diagnostic/repair portion of hbck.
[HBASE-5734] - Change hbck sideline root
[HBASE-5735] - Clearer warning message when connecting a non-secure HBase client to a secure HBase server
[HBASE-5737] - Minor Improvements related to balancer.
[HBASE-5748] - Enable lib directory in jar file for coprocessor
[HBASE-5770] - Add a clock skew warning threshold
[HBASE-5775] - ZKUtil doesn't handle deleteRecurisively cleanly
[HBASE-5823] - Hbck should be able to print help
[HBASE-5862] - After Region Close remove the Operation Metrics.
[HBASE-5863] - Improve the graceful_stop.sh CLI help (especially about reloads)
[HBASE-6173] - hbck check specified tables only
[HBASE-5360] - [uberhbck] Add options for how to handle offline split parents.
New Feature
[HBASE-2947] - MultiIncrement/MultiAppend (MultiGet functionality for increments and appends)
[HBASE-3134] - [replication] Add the ability to enable/disable streams
[HBASE-3584] - Allow atomic put/delete in one call
[HBASE-3856] - Build a tree structure data block index inside of the HFile
[HBASE-4102] - atomicAppend: A put that appends to the latest version of a cell; i.e. reads current value then adds the bytes offered by the client to the tail and writes out a new entry
[HBASE-4219] - Add Per-Column Family Metrics
[HBASE-4393] - Implement a canary monitoring program
[HBASE-4460] - Support running an embedded ThriftServer within a RegionServer
[HBASE-4536] - Allow CF to retain deleted rows
[HBASE-4608] - HLog Compression
[HBASE-4629] - enable automated patch testing for hbase
[HBASE-4683] - Always cache index and bloom blocks
[HBASE-4698] - Let the HFile Pretty Printer print all the key values for a specific row.
[HBASE-4768] - Per-(table, columnFamily) metrics with configurable table name inclusion
[HBASE-5128] - [uber hbck] Online automated repair of table integrity and region consistency problems
[HBASE-5177] - HTable needs a non cached version of getRegionLocation
[HBASE-5229] - Provide basic building blocks for "multi-row" local transactions.
[HBASE-5526] - Configurable file and directory based umask
[HBASE-5599] - [hbck] handle NO_VERSION_FILE and SHOULD_NOT_BE_DEPLOYED inconsistencies
[HBASE-5604] - M/R tool to replay WAL files
[HBASE-5719] - Enhance hbck to sideline overlapped mega regions
Task
[HBASE-4256] - Intra-row scanning (part deux)
[HBASE-4429] - Provide synchronous balanceSwitch()
[HBASE-4611] - Add support for Phabricator/Differential as an alternative code review tool
[HBASE-4712] - Document rules for writing tests
[HBASE-4751] - Make TestAdmin#testEnableTableRoundRobinAssignment friendly to concurrent tests
[HBASE-4968] - Add to troubleshooting workaround for direct buffer oome's.
[HBASE-5011] - Move test-util.sh from src/test/bin to dev-tools
[HBASE-5084] - Allow different HTable instances to share one ExecutorService
[HBASE-5111] - Upgrade zookeeper to 3.4.2 release
[HBASE-5173] - Commit hbase-4480 findHangingTest.sh script under dev-support
[HBASE-5256] - Use WritableUtils.readVInt() in RegionLoad.readFields()
[HBASE-5264] - Add 0.92.0 upgrade guide
[HBASE-5294] - Make sure javadoc is included in tarball bundle when we release
[HBASE-5400] - Some tests does not have annotations for (Small|Medium|Large)Tests
[HBASE-5427] - Upgrade our zk to 3.4.3
[HBASE-5511] - More doc on maven release process
[HBASE-5715] - Revert 'Instant schema alter' for now, HBASE-4213
[HBASE-5721] - Update bundled hadoop to be 1.0.2 (it was just released)
[HBASE-5758] - Forward port "HBASE-4109 Hostname returned via reverse dns lookup contains trailing period if configured interface is not 'default'"
[HBASE-5836] - Backport per region metrics from HBASE-3614 to 0.94.1
Test
[HBASE-4516] - HFile-level load tester with compaction and random-read workloads
[HBASE-4534] - A new unit test for lazy seek and StoreScanner in general
[HBASE-4545] - TestHLog doesn't clean up after itself
[HBASE-4772] - Utility to Create StoreFiles
[HBASE-4808] - Test to Ensure Expired Deletes Don't Override Puts
[HBASE-4864] - TestMasterObserver#testRegionTransitionOperations occasionally fails
[HBASE-4868] - TestOfflineMetaRebuildBase#testMetaRebuild occasionally fails
[HBASE-5150] - Failure in a thread may not fail a test, clean up log splitting test
[HBASE-5223] - TestMetaReaderEditor is missing call to CatalogTracker.stop()
[HBASE-5455] - Add test to avoid unintentional reordering of items in HbaseObjectWritable
[HBASE-5792] - HLog Performance Evaluation Tool
Release 0.92.1 - Unreleased
BUG FIXES
HBASE-5176 AssignmentManager#getRegion: logging nit adds a redundant '+' (Karthik K)
HBASE-5237 Addendum for HBASE-5160 and HBASE-4397 (Ram)
HBASE-5235 HLogSplitter writer thread's streams not getting closed when any
of the writer threads has exceptions. (Ram)
HBASE-5243 LogSyncerThread not getting shutdown waiting for the interrupted flag (Ram)
HBASE-5255 Use singletons for OperationStatus to save memory (Benoit)
HBASE-5345 CheckAndPut doesn't work when value is empty byte[] (Evert Arckens)
HBASE-5466 Opening a table also opens the metatable and never closes it
(Ashley Taylor)
TESTS
HBASE-5223 TestMetaReaderEditor is missing call to CatalogTracker.stop()
Release 0.92.0 - 01/23/2012
INCOMPATIBLE CHANGES
HBASE-2002 Coprocessors: Client side support; Support RPC interface
changes at runtime (Gary Helmling via Andrew Purtell)
HBASE-3677 Generate a globally unique cluster ID (changed
ClusterStatus serialization)
HBASE-3762 HTableFactory.releaseHTableInterface() should throw IOException
instead of wrapping in RuntimeException (Ted Yu via garyh)
HBASE-3629 Update our thrift to 0.6 (Moaz Reyad)
HBASE-1502 Remove need for heartbeats in HBase
HBASE-451 Remove HTableDescriptor from HRegionInfo (Subbu M Iyer)
HBASE-451 Remove HTableDescriptor from HRegionInfo
addendum that fixes TestTableMapReduce
HBASE-3534 Action should not store or serialize regionName (Ted Yu)
HBASE-4197 RegionServer expects all scanner to be subclasses of
HRegion.RegionScanner (Lars Hofhansl)
HBASE-4233 Update protobuf dependency to 2.4.0a (todd)
HBASE-4299 Update to Avro 1.5.3 and use Avro Maven plugin to generate
Avro classes. (Alejandro Abdelnur)
HBASE-4369 Deprecate HConnection#getZookeeperWatcher in prep for HBASE-1762
HBASE-4247 Add isAborted method to the Abortable interface
(Akash Ashok)
HBASE-4503 Purge deprecated HBaseClusterTestCase
HBASE-4374 Up default regions size from 256M to 1G
HBASE-4648 Bytes.toBigDecimal() doesn't use offset (Bryan Keller via Lars H)
HBASE-4715 Remove stale broke .rb scripts from bin dir
HBASE-3433 Remove the KV copy of every KV in Scan; introduced by HBASE-3232 (Lars H)
HBASE-5017 Bump the default hfile.block.cache.size because of HFileV2
BUG FIXES
HBASE-3280 YouAreDeadException being swallowed in HRS getMaster
HBASE-3282 Need to retain DeadServers to ensure we don't allow
previously expired RS instances to rejoin cluster
HBASE-3283 NPE in AssignmentManager if processing shutdown of RS who
doesn't have any regions assigned to it
HBASE-3173 HBase 2984 breaks ability to specify BLOOMFILTER &
COMPRESSION via shell
HBASE-3310 Failing creating/altering table with compression agrument from
the HBase shell (Igor Ranitovic via Stack)
HBASE-3317 Javadoc and Throws Declaration for Bytes.incrementBytes() is
Wrong (Ed Kohlwey via Stack)
HBASE-1888 KeyValue methods throw NullPointerException instead of
IllegalArgumentException during parameter sanity check
HBASE-3337 Restore HBCK fix of unassignment and dupe assignment for new
master
HBASE-3332 Regions stuck in transition after RS failure
HBASE-3418 Increment operations can break when qualifiers are split
between memstore/snapshot and storefiles
HBASE-3403 Region orphaned after failure during split
HBASE-3492 NPE while splitting table with empty column family store
HBASE-3400 Coprocessor Support for Generic Interfaces
(Ed Kohlwey via Gary Helmling)
HBASE-3552 Coprocessors are unable to load if RegionServer is launched
using a different classloader than system default
HBASE-3578 TableInputFormat does not setup the configuration for HBase
mapreduce jobs correctly (Dan Harvey via Stack)
HBASE-3601 TestMasterFailover broken in TRUNK
HBASE-3605 Fix balancer log message
HBASE-3538 Column families allow to have slashes in name (Ian Knome via Stack)
HBASE-3313 Table name isn't checked in isTableEnabled/isTableDisabled
(Ted Yu via Stack)
HBASE-3514 Speedup HFile.Writer append (Matteo Bertozzi via Ryan)
HBASE-3665 tighten assertions for testBloomFilterSize
HBASE-3662 REST server does not respect client supplied max versions when
creating scanner
HBASE-3641 LruBlockCache.CacheStats.getHitCount() is not using the
correct variable
HBASE-3532 HRegion#equals is broken (Ted Yu via Stack)
HBASE-3697 Admin actions that use MetaReader to iterate regions need to
skip offline ones
HBASE-3583 Coprocessors: scannerNext and scannerClose hooks are called
when HRegionInterface#get is invoked (Mingjie Lai via
Andrew Purtell)
HBASE-3688 Setters of class HTableDescriptor do not work properly
HBASE-3702 Fix NPE in Exec method parameter serialization
HBASE-3709 HFile compression not sharing configuration
HBASE-3711 importtsv fails if rowkey length exceeds MAX_ROW_LENGTH
(Kazuki Ohta via todd)
HBASE-3716 Intermittent TestRegionRebalancing failure
(Ted Yu via Stack)
HBASE-3712 HTable.close() doesn't shutdown thread pool
(Ted Yu via Stack)
HBASE-3238 HBase needs to have the CREATE permission on the parent of its
ZooKeeper parent znode (Alex Newman via Stack)
HBASE-3728 NPE in HTablePool.closeTablePool (Ted Yu via Stack)
HBASE-3733 MemStoreFlusher.flushOneForGlobalPressure() shouldn't
be using TreeSet for HRegion (Ted Yu via J-D)
HBASE-3739 HMaster.getProtocolVersion() should distinguish
HMasterInterface and HMasterRegionInterface versions
HBASE-3723 Major compact should be done when there is only one storefile
and some keyvalue is outdated (Zhou Shuaifeng via Stack)
HBASE-3624 Only one coprocessor of each priority can be loaded for a table
HBASE-3598 Broken formatting in LRU stats output (Erik Onnen)
HBASE-3758 Delete triggers pre/postScannerOpen upcalls of RegionObserver
(Mingjie Lai via garyh)
HBASE-3790 Fix NPE in ExecResult.write() with null return value
HBASE-3781 hbase shell cannot start "NoMethodError: undefined method
`close' for nil:NilClass" (Mikael Sitruk)
HBASE-3802 Redundant list creation in HRegion
HBASE-3788 Two error handlings in AssignmentManager.setOfflineInZooKeeper()
(Ted Yu)
HBASE-3800 HMaster is not able to start due to AlreadyCreatedException
HBASE-3806 distributed log splitting double escapes task names
(Prakash Khemani)
HBASE-3819 TestSplitLogWorker has too many SLWs running -- makes for
contention and occasional failures
HBASE-3210 HBASE-1921 for the new master
HBASE-3827 hbase-1502, removing heartbeats, broke master joining a running
cluster and was returning master hostname for rs to use
HBASE-3829 TestMasterFailover failures in jenkins
HBASE-3843 splitLogWorker starts too early (Prakash Khemani)
HBASE-3838 RegionCoprocesorHost.preWALRestore throws npe in case there is
no RegionObserver registered (Himanshu Vashishtha)
HBASE-3847 Turn off DEBUG logging of RPCs in WriteableRPCEngine on TRUNK
HBASE-3777 Redefine Identity Of HBase Configuration (Karthick Sankarachary)
HBASE-3849 Fix master ui; hbase-1502 broke requests/second
HBASE-3853 Fix TestInfoServers to pass after HBASE-3835 (todd)
HBASE-3862 Race conditions in aggregate calculation (John Heitmann)
HBASE-3865 Failing TestWALReplay
HBASE-3864 Rename of hfile.min.blocksize.size in HBASE-2899 reverted in
HBASE-1861 (Aaron T. Myers)
HBASE-3876 TestCoprocessorInterface.testCoprocessorInterface broke on
jenkins and local
HBASE-3897 Docs (notsoquick guide) suggest invalid XML (Philip Zeyliger)
HBASE-3898 TestSplitTransactionOnCluster broke in TRUNK
HBASE-3826 Minor compaction needs to check if still over
compactionThreshold after compacting (Nicolas Spiegelberg)
HBASE-3912 [Stargate] Columns not handle by Scan
HBASE-3903 A successful write to client write-buffer may be lost or not
visible (Doug Meil)
HBASE-3894 Thread contention over row locks set monitor (Dave Latham)
HBASE-3959 hadoop-snappy version in the pom.xml is incorrect
(Alejandro Abdelnur)
HBASE-3971 Compression.java uses ClassLoader.getSystemClassLoader()
to load codec (Alejandro Abdelnur)
HBASE-3979 Trivial fixes in code, document (Ming Ma)
HBASE-3794 Ability to Discard Bad HTable Puts
HBASE-3923 HBASE-1502 Broke Shell's status 'simple' and 'detailed'
HBASE-3978 Rowlock lease renew doesn't work when custom coprocessor
indicates to bypass default action (Ming Ma)
HBASE-3963 Schedule all log-spliiting at startup all at once (mingjian)
HBASE-3983 list command in shell seems broken
HBASE-3793 HBASE-3468 Broke checkAndPut with null value (Ming Ma)
HBASE-3889 NPE in Distributed Log Splitting (Anirudh Todi)
HBASE-4000 You can't specify split points when you create a table in
the shell (Joey Echeverria)
HBASE-4029 Inappropriate checking of Logging Mode in HRegionServer
(Akash Ashok via Ted Yu)
HBASE-4037 Add timeout annotations to preempt surefire killing
all tests
HBASE-4024 Major compaction may not be triggered, even though region
server log says it is triggered (Ted Yu)
HBASE-4016 HRegion.incrementColumnValue() doesn't have a consistent
behavior when the field that we are incrementing is less
than 8 bytes long (Li Pi)
HBASE-4012 Further optimize byte comparison methods (Ted Yu)
HBASE-4037 Add timeout annotations to preempt surefire killing
all tests - TestFullLogReconstruction
HBASE-4051 [Coprocessors] Table coprocessor loaded twice when region is
initialized
HBASE-4059 If a region is split during RS shutdown process, the daughter
regions are NOT made online by master
HBASE-3904 HBA.createTable(final HTableDescriptor desc, byte [][] splitKeys)
should be synchronous
HBASE-4053 Most of the regions were added into AssignmentManager#servers twice
HBASE-4061 getTableDirs is missing directories to skip
HBASE-3867 when cluster is stopped and server which hosted meta region is
removed from cluster, master breaks down after restarting cluster.
HBASE-4074 When a RS has hostname with uppercase letter, there are two
RS entries in master (Weihua via Ted Yu)
HBASE-4077 Deadlock if WrongRegionException is thrown from getLock in
HRegion.delete (Adam Warrington via Ted Yu)
HBASE-3893 HRegion.internalObtainRowLock shouldn't wait forever
HBASE-4075 A bug in TestZKBasedOpenCloseRegion (Jieshan Bean via Ted Yu)
HBASE-4087 HBaseAdmin should perform validation of connection it holds
HBASE-4052 Enabling a table after master switch does not allow table scan,
throwing NotServingRegionException (ramkrishna via Ted Yu)
HBASE-4112 Creating table may throw NullPointerException (Jinchao via Ted Yu)
HBASE-4093 When verifyAndAssignRoot throws exception, the deadServers state
cannot be changed (fulin wang via Ted Yu)
HBASE-4118 method regionserver.MemStore#updateColumnValue: the check for
qualifier and family is missing (N Keywal via Ted Yu)
HBASE-4127 Don't modify table's name away in HBaseAdmin
HBASE-4105 Stargate does not support Content-Type: application/json and
Content-Encoding: gzip in parallel
HBASE-4116 [stargate] StringIndexOutOfBoundsException in row spec parse
(Allan Yan)
HBASE-3845 data loss because lastSeqWritten can miss memstore edits
(Prakash Khemani and ramkrishna.s.vasudevan)
HBASE-4083 If Enable table is not completed and is partial, then scanning of
the table is not working (ramkrishna.s.vasudevan)
HBASE-4138 If zookeeper.znode.parent is not specifed explicitly in Client
code then HTable object loops continuously waiting for the root region
by using /hbase as the base node.(ramkrishna.s.vasudevan)
HBASE-4032 HBASE-451 improperly breaks public API HRegionInfo#getTableDesc
HBASE-4003 Cleanup Calls Conservatively On Timeout (Karthick)
HBASE-3857 Fix TestHFileBlock.testBlockHeapSize test failure (Mikhail)
HBASE-4150 Don't enforce pool size limit with ThreadLocalPool
(Karthick Sankarachary via garyh)
HBASE-4171 HBase shell broken in trunk (Lars Hofhansl)
HBASE-4162 Fix TestHRegionInfo.testGetSetOfHTD: delete /tmp/hbase-<username>
if it already exists (Mikhail Bautin)
HBASE-4179 Failed to run RowCounter on top of Hadoop branch-0.22
(Michael Weng)
HBASE-4181 HConnectionManager can't find cached HRegionInterface and makes clients
work very slow (Jia Liu)
HBASE-4156 ZKConfig defaults clientPort improperly (Michajlo Matijkiw)
HBASE-4184 CatalogJanitor doesn't work properly when "fs.default.name" isn't
set in config file (Ming Ma)
HBASE-4186 No region is added to regionsInTransitionInRS
HBASE-4194 RegionSplitter: Split on under-loaded region servers first
HBASE-2399 Forced splits only act on the first family in a table (Ming Ma)
HBASE-4211 Do init-sizing of the StringBuilder making a ServerName
(Benoît Sigoure)
HBASE-4175 Fix FSUtils.createTableDescriptor() (Ramkrishna)
HBASE-4008 Problem while stopping HBase (Akash Ashok)
HBASE-4065 TableOutputFormat ignores failure to create table instance
(Brock Noland)
HBASE-4167 Potential leak of HTable instances when using HTablePool with
PoolType.ThreadLocal (Karthick Sankarachary)
HBASE-4239 HBASE-4012 introduced duplicate variable Bytes.LONG_BYTES
HBASE-4225 NoSuchColumnFamilyException in multi doesn't say which family
is bad (Ramkrishna Vasudevan)
HBASE-4220 Lots of DNS queries from client
HBASE-4253 Intermittent test failure because of missing config parameter in new
HTable(tablename) (Ramkrishna)
HBASE-4217 HRS.closeRegion should be able to close regions with only
the encoded name (ramkrishna.s.vasudevan)
HBASE-3229 HBASE-3229 Table creation, though using "async" call to master,
can actually run for a while and cause RPC timeout (Ming Ma)
HBASE-4252 TestLogRolling's low-probability failure (Jieshan Bean)
HBASE-4278 Race condition in Slab.java that occurs due to spinlock unlocking
early (Li Pi)
HBASE-4269 Add tests and restore semantics to TableInputFormat/TableRecordReader
(Jonathan Hsieh)
HBASE-4290 HLogSplitter doesn't mark its MonitoredTask as complete in
non-distributed case (todd)
HBASE-4303 HRegionInfo.toString has bad quoting (todd)
HBASE-4307 race condition in CacheTestUtils (Li Pi)
HBASE-4310 SlabCache metrics bugfix (Li Pi)
HBASE-4283 HBaseAdmin never recovers from restarted cluster (Lars Hofhansl)
HBASE-4315 RPC logging too verbose (todd)
HBASE-4273 java.lang.NullPointerException when a table is being disabled and
HMaster restarts (Ming Ma)
HBASE-4027 Off Heap Cache never creates Slabs (Li Pi)
HBASE-4265 zookeeper.KeeperException$NodeExistsException if HMaster restarts
while table is being disabled (Ming Ma)
HBASE-4338 Package build for rpm and deb are broken (Eric Yang)
HBASE-4309 slow query log metrics spewing warnings (Riley Patterson)
HBASE-4302 Only run Snappy compression tests if Snappy is available
(Alejandro Abdelnur via todd)
HBASE-4271 Clean up coprocessor handling of table operations
(Ming Ma via garyh)
HBASE-4341 HRS#closeAllRegions should take care of HRS#onlineRegions's
weak consistency (Jieshan Bean)
HBASE-4297 TableMapReduceUtil overwrites user supplied options
(Jan Lukavsky)
HBASE-4015 Refactor the TimeoutMonitor to make it less racy
(ramkrishna.s.vasudevan)
HBASE-4350 Fix a Bloom filter bug introduced by HFile v2 and
TestMultiColumnScanner that caught it (Mikhail Bautin)
HBASE-4007 distributed log splitting can get indefinitely stuck
(Prakash Khemani)
HBASE-4301 META migration from 0.90 to trunk fails (Subbu Iyer)
HBASE-4331 Bypassing default actions in prePut fails sometimes with
HTable client (Lars Hofhansl via garyh)
HBASE-4340 Hbase can't balance if ServerShutdownHandler encountered
exception (Jinchao Gao)
HBASE-4394 Add support for seeking hints to FilterList
HBASE-4406 TestOpenRegionHandler failing after HBASE-4287 (todd)
HBASE-4330 Fix races in slab cache (Li Pi & Todd)
HBASE-4383 SlabCache reports negative heap sizes (Li Pi)
HBASE-4351 If from Admin we try to unassign a region forcefully,
though a valid region name is given the master is not able
to identify the region to unassign (Ramkrishna)
HBASE-4363 [replication] ReplicationSource won't close if failing
to contact the sink (JD and Lars Hofhansl)
HBASE-4390 [replication] ReplicationSource's UncaughtExceptionHandler
shouldn't join
HBASE-4395 EnableTableHandler races with itself
HBASE-4414 Region splits by size not being triggered
HBASE-4322 HBASE-4322 [hbck] Update checkIntegrity/checkRegionChain
to present more accurate region split problem
(Jon Hseih)
HBASE-4417 HBaseAdmin.checkHBaseAvailable() doesn't close ZooKeeper connections
(Stefan Seelmann)
HBASE-4195 Possible inconsistency in a memstore read after a reseek,
possible performance improvement (nkeywal)
HBASE-4420 MasterObserver preMove() and postMove() should throw
IOException instead of UnknownRegionException
HBASE-4419 Resolve build warning messages (Praveen Patibandia)
HBASE-4428 Two methods in CacheTestUtils don't call setDaemon() on the threads
HBASE-4400 .META. getting stuck if RS hosting it is dead and znode state is in
RS_ZK_REGION_OPENED (Ramkrishna)
HBASE-3421 Very wide rows -- 30M plus -- cause us OOME (Nate Putnam)
HBASE-4153 Handle RegionAlreadyInTransitionException in AssignmentManager
(Ramkrishna)
HBASE-4452 Possibility of RS opening a region though tickleOpening fails due to
znode version mismatch (Ramkrishna)
HBASE-4446 Rolling restart RSs scenario, regions could stay in OPENING state
(Ming Ma)
HBASE-4468 Wrong resource name in an error massage: webapps instead of
hbase-webapps (nkeywal)
HBASE-4472 MiniHBaseCluster.shutdown() doesn't work if no active master
HBASE-4455 Rolling restart RSs scenario, -ROOT-, .META. regions are lost in
AssignmentManager (Ming Ma)
HBASE-4513 NOTICES.txt refers to Facebook for Thrift
HBASE-3130 [replication] ReplicationSource can't recover from session
expired on remote clusters (Chris Trezzo via JD)
HBASE-4212 TestMasterFailover fails occasionally (Gao Jinchao)
HBASE-4412 No need to retry scan operation on the same server in case of
RegionServerStoppedException (Ming Ma)
HBASE-4476 Compactions must fail if column tracker gets columns out of order
(Mikhail Bautin)
HBASE-4209 The HBase hbase-daemon.sh SIGKILLs master when stopping it
(Roman Shaposhnik)
HBASE-4496 HFile V2 does not honor setCacheBlocks when scanning (Lars and Mikhail)
HBASE-4531 hbase-4454 failsafe broke mvn site; back it out or fix
(Akash Ashok)
HBASE-4334 HRegion.get never validates row (Lars Hofhansl)
HBASE-4494 AvroServer:: get fails with NPE on a non-existent row
(Kay Kay)
HBASE-4481 TestMergeTool failed in 0.92 build 20
HBASE-4386 Fix a potential NPE in TaskMonitor (todd)
HBASE-4402 Retaining locality after restart broken
HBASE-4482 Race Condition Concerning Eviction in SlabCache (Li Pi)
HBASE-4547 TestAdmin failing in 0.92 because .tableinfo not found
HBASE-4540 OpenedRegionHandler is not enforcing atomicity of the operation
it is performing(Ram)
HBASE-4335 Splits can create temporary holes in .META. that confuse clients
and regionservers (Lars H)
HBASE-4555 TestShell seems passed, but actually errors seen in test output
file (Mingjie Lai)
HBASE-4582 Store.java cleanup (failing TestHeapSize and has warnings)
HBASE-4556 Fix all incorrect uses of InternalScanner.next(...) (Lars H)
HBASE-4078 Validate store files after flush/compaction
HBASE-3417 CacheOnWrite is using the temporary output path for block
names, need to use a more consistent block naming scheme (jgray)
HBASE-4551 Fix pom and some test cases to compile and run against
Hadoop 0.23 (todd)
HBASE-3446 ProcessServerShutdown fails if META moves, orphaning lots of
regions
HBASE-4589 CacheOnWrite broken in some cases because it can conflict
with evictOnClose (jgray)
HBASE-4579 CST.requestCompaction semantics changed, logs are now
spammed when too many store files
HBASE-4620 I broke the build when I submitted HBASE-3581 (Send length
of the rpc response)
HBASE-4621 TestAvroServer fails quite often intermittently (Akash Ashok)
HBASE-4378 [hbck] Does not complain about regions with startkey==endkey.
(Jonathan Hsieh)
HBASE-4459 HbaseObjectWritable code is a byte, we will eventually run out of codes
HBASE-4430 Disable TestSlabCache and TestSingleSizedCache temporarily to
see if these are cause of build box failure though all tests
pass (Li Pi)
HBASE-4510 Check and workaround usage of internal HDFS APIs in HBase
(Harsh)
HBASE-4595 HFilePrettyPrinter Scanned kv count always 0 (Matteo Bertozzi)
HBASE-4580 Some invalid zk nodes were created when a clean cluster restarts
(Gaojinchao)
HBASE-4588 The floating point arithmetic to validate memory allocation
configurations need to be done as integers (dhruba)
HBASE-4647 RAT finds about 40 files missing licenses
HBASE-4642 Add Apache License Header
HBASE-4591 TTL for old HLogs should be calculated from last modification time.
HBASE-4578 NPE when altering a table that has moving regions (gaojinchao)