-
Notifications
You must be signed in to change notification settings - Fork 445
/
CHANGES
627 lines (585 loc) · 40.6 KB
/
CHANGES
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
Release Notes - Accumulo - Version 1.4.5
** Sub-task
* [ACCUMULO-1686] - loggers die when the zookeeper they are using disconnects
* [ACCUMULO-1688] - Ensure ZooLock.watchParent is properly set in case of Connection loss
* [ACCUMULO-1792] - Backport changes for Hadoop 2.0 from 1.5 to 1.4
* [ACCUMULO-1793] - Update Hadoop 2.0 profile to Hadoop 2.2.0
* [ACCUMULO-1794] - Add tests that flex Hadoop 2 features
* [ACCUMULO-1795] - ensure 1.4 remains compatible with Hadoop 0.20.203
* [ACCUMULO-1796] - packaging for multiple supported Hadoops
* [ACCUMULO-2011] - LaTeX broken by ACCUMULO-1956
* [ACCUMULO-2015] - GC does not start when running in standalone mode
* [ACCUMULO-2378] - Fix use of LOGNAME in functional tests under MR
* [ACCUMULO-2380] - Update functional test MR job to indicate failed tests
* [ACCUMULO-2450] - Backport ACCUMULO-2438 to 1.4
* [ACCUMULO-2534] - README's converted to markdown do not contain copyright headers
** Bug
* [ACCUMULO-1434] - NullPointerException thrown by ColumnVisibility#flatten() with empty visibility
* [ACCUMULO-1472] - MiniAccumulo cluster improperly configures classpaths
* [ACCUMULO-1556] - Initialize could use a better warning when HDFS dir is already populated
* [ACCUMULO-1563] - Have BulkSplitOptimization and Compaction functional tests not write to hdfs root dir.
* [ACCUMULO-1572] - single node zookeeper failure kills connected accumulo servers
* [ACCUMULO-1584] - ACCUMULO_CONF_DIR not respected for accumulo-metrics.xml
* [ACCUMULO-1591] - Upgrading Accumulo with different zookeeper secret causes issues
* [ACCUMULO-1593] - Looking up instanceName in ZK doesn't use consistent encoding
* [ACCUMULO-1698] - stop-here doesn't consider system hostname
* [ACCUMULO-1775] - zooCacheTest fails due to missing /tmp/zcTest-42
* [ACCUMULO-1786] - MiniAccumuloClusterGCTest fails if GC is already running
* [ACCUMULO-1791] - status command for init.d script doesn't work with service command
* [ACCUMULO-1800] - delete mutations not working through the Proxy
* [ACCUMULO-1819] - NativeMap Makefile doesn't work with newest OSX/Xcode
* [ACCUMULO-1821] - master recovers new WAL on recovering tablets
* [ACCUMULO-1854] - AccumuloInputFormat can be less strict about contents of Configuration
* [ACCUMULO-1858] - Backport fix for Accumulo-1379 PermGen Leak to 1.4 and 1.5
* [ACCUMULO-1868] - Distro built from clean checkout misses several directories
* [ACCUMULO-1870] - Functional tests don't configure Monitor log
* [ACCUMULO-1873] - start-all.sh's zookeeper version check is lacking
* [ACCUMULO-1876] - Problem using accumulo artifacts from ivy
* [ACCUMULO-1878] - Functional test for Examples doesn't check return codes; many examples don't run
* [ACCUMULO-1889] - ZooKeeperInstance close method should mark instance closed.
* [ACCUMULO-1891] - AccumuloSecurityException doesn't properly handle null error codes.
* [ACCUMULO-1892] - examples.simple.RandomBatchWriter might not write the specified number of rowids
* [ACCUMULO-1893] - BulkSplitOptimization and Compaction functional tests still writing to root of HDFS in 1.4.x
* [ACCUMULO-1896] - Build on clean checkout fails
* [ACCUMULO-1901] - start-here.sh starts only one GC process even if more are defined
* [ACCUMULO-1903] - Monitor creates a new ZK object to fetch gc status and doesn't wait for it to connect.
* [ACCUMULO-1914] - MetadataTableUtil.removeUnusedEntries() should use one mutation
* [ACCUMULO-1920] - monitor not seeing zookeeper updates
* [ACCUMULO-1934] - lots of simple warnings in 1.4 branch
* [ACCUMULO-1940] - Data file in !METADATA differs from in memory data
* [ACCUMULO-1944] - Cobertura not working for functional tests in 1.5.x and earlier
* [ACCUMULO-1958] - Range constructor lacks key checks, should be non-public
* [ACCUMULO-1967] - magitator should respect presence or lack of gc file
* [ACCUMULO-1968] - The FileDataIngest example creates MD5 hash keys, but the javadoc says it creates SHA1 hash keys.
* [ACCUMULO-1986] - Validity checks missing for readFields and Thrift deserialization
* [ACCUMULO-1993] - proxy classes conflict with Ruby system classes
* [ACCUMULO-1994] - proxy does not handle Key timestamps correctly
* [ACCUMULO-1997] - Perform validation on ACCUMULO_HOME
* [ACCUMULO-2027] - ZooKeeperInstance.close() not freeing resources in multithreaded env
* [ACCUMULO-2037] - Tablets not assigned to last location
* [ACCUMULO-2042] - Scalability test does not run
* [ACCUMULO-2057] - found two last locations for the same extent
* [ACCUMULO-2058] - Shell Env interpolation lacking for kerberos configuration
* [ACCUMULO-2078] - ACCUMULO_LOG_HOST is incorrectly computed
* [ACCUMULO-2109] - functional tests do not clean up generated test site.xml files
* [ACCUMULO-2112] - master does not balance after intermittent communication failure
* [ACCUMULO-2116] - Examples functional test only works when run from ACCUMULO_HOME
* [ACCUMULO-2117] - ClassLoaderIT fails
* [ACCUMULO-2127] - example accumulo-site.xmls put Hadoop 2 jars ahead of Accumulo jars on classpath
* [ACCUMULO-2128] - Provide resource cleanup via static utility rather than Instance.close
* [ACCUMULO-2146] - typo in continuous-env.sh.example
* [ACCUMULO-2152] - start-all.sh does not work for gc and tracer roles when there are multiples given in conf files
* [ACCUMULO-2176] - ExecfileCommand#execute() should close scanner
* [ACCUMULO-2179] - CreateTableCommand#execute() should close Scanner
* [ACCUMULO-2182] - Backport randomwalk changes
* [ACCUMULO-2184] - "Unknown" HDFS usage on monitor
* [ACCUMULO-2194] - Back-to-back Security randomwalk tests fail
* [ACCUMULO-2198] - Concurrent randomwalk fails with unbalanced servers
* [ACCUMULO-2201] - Compilation error in 1.4.5-SNAPSHOT from ACCUMULO-2184
* [ACCUMULO-2202] - Bloom loader missleading ERROR
* [ACCUMULO-2211] - Security randomwalk fails "User doesn't exist and they SHOULD"
* [ACCUMULO-2213] - tracer reports: IllegalStateException: Closed
* [ACCUMULO-2220] - CloudStone Benchmarks do not respect ACCUMULO_CONF_DIR
* [ACCUMULO-2221] - CloudStone Benchmarks should accept ZKs as parameter
* [ACCUMULO-2224] - ZooSession should be more robust to transient DNS issues
* [ACCUMULO-2225] - Need to better handle DNS failure propagation from Hadoop
* [ACCUMULO-2227] - Concurrent randomwalk fails when namenode dies after bulk import step
* [ACCUMULO-2228] - Security randomwalk fails when namenode dies before bulk import
* [ACCUMULO-2233] - Continuous Verify job should find ranges on cloned table
* [ACCUMULO-2234] - Cannot run offline mapreduce over non-default instance.dfs.dir value
* [ACCUMULO-2252] - Backport ACCUMULO-684 to 1.4.x
* [ACCUMULO-2281] - Building creates a src/lib directory with a log4j jar
* [ACCUMULO-2285] - stop-all.sh in 1.4.x requires tracers and gc files
* [ACCUMULO-2301] - Monitor should not list jetty as provided
* [ACCUMULO-2319] - TabletServerResourceManager MemoryManagementFramework constructor starts threads
* [ACCUMULO-2390] - TraceProxy.trace should not throw InvocationTargetException
* [ACCUMULO-2399] - BatchWalkers die when started before Ingesters
* [ACCUMULO-2404] - Main.main can log cleaner messages when underlying process has errors
* [ACCUMULO-2408] - metadata table not assigned after root table is loaded
* [ACCUMULO-2512] - MAC stop should waitFor processes
* [ACCUMULO-2520] - Garbage collector deleted everything when given bad input
* [ACCUMULO-2524] - ProblemReport needs to check for nulls on construction
* [ACCUMULO-2539] - SummingCombiner does not adhere to Combiner#COLUMNS_OPTION
* [ACCUMULO-2566] - Utilities and examples should maintain binary compatibility between Hadoop 1 and Hadoop 2
** Improvement
* [ACCUMULO-1069] - InstanceOperations get/set/remove Property methods are ambiguous
* [ACCUMULO-1452] - Automate cleanup of old rf_tmp files
* [ACCUMULO-1576] - add CONTINUOUS_CONF_DIR environment variable for continuous ingest test
* [ACCUMULO-1633] - BatchWriter and variants don't assert maxMemory as a positive, non-zero value
* [ACCUMULO-1658] - System integration tests should default ACCUMULO_CONF_DIR to ACCUMULO_HOME/conf
* [ACCUMULO-1689] - Add option to run GC in MiniAccumuloCluster
* [ACCUMULO-1733] - Better error message on minicluster failure to initialize
* [ACCUMULO-1785] - Alter config.sh to optionally just verify environment instead of making changes
* [ACCUMULO-1790] - Hadoop 2 support for 1.4.x
* [ACCUMULO-1835] - Update test/system/auto/README for -f, -x, etc.
* [ACCUMULO-1890] - MiniAccumloClusterGCTest failing on limited resource machine.
* [ACCUMULO-1933] - Make unit on memory parameters case-insensitive
* [ACCUMULO-1945] - bin/accumulo help should print usage
* [ACCUMULO-1946] - Include dfs.datanode.synconclose in hdfs configuration documentation
* [ACCUMULO-1973] - Log better message when Hadoop configuration files are not found
* [ACCUMULO-1984] - Clean up Instance closing
* [ACCUMULO-2004] - LIB_PATH for Hadoop native libs is lacking
* [ACCUMULO-2060] - Improve example general.classpath
* [ACCUMULO-2064] - Include Git SHA1 in artifacts
* [ACCUMULO-2108] - Reduce number of repeated project versions
* [ACCUMULO-2120] - Fix maven warnings introduced declaration of mavanagaiata
* [ACCUMULO-2126] - Hadoop profile names should be consistent across branches
* [ACCUMULO-2132] - Prevent dock element in OSX from launching with MAC
* [ACCUMULO-2163] - Always run GC in mini accumulo
* [ACCUMULO-2239] - Reformat test README files to Markdown
* [ACCUMULO-2262] - Include java.net.preferIPv4Stack=true in process startup
* [ACCUMULO-2314] - Minor typo/grammatical nits.
* [ACCUMULO-2564] - Backport changes needed to unify Hadoop 1 and Hadoop 2 support on 1.4
** New Feature
* [ACCUMULO-1639] - Server-side iterator/filter that allows you to specify a lexicographical range of column qualifier values you want to retrieve from a Scanner (ColumnSliceFilter)
** Task
* [ACCUMULO-1690] - Update Apache RAT plugin to 0.10
* [ACCUMULO-1910] - Add source to jar files used for testing
* [ACCUMULO-1956] - Add section on decomissioning or adding nodes to an Accumulo cluster
* [ACCUMULO-1961] - Fix trivial compiler/javadoc warnings
* [ACCUMULO-2010] - Remove resource leak warnings
* [ACCUMULO-2113] - Verify that The Hammer approach to resource leak is a viable short term fix
** Test
* [ACCUMULO-1829] - Increase test timeouts for Accumulo 1.4.x
* [ACCUMULO-2005] - Provide a scaling factor for mapred.task.timeout inside functional test's RunTests.java
* [ACCUMULO-2138] - Backport ACCUMULO-679 to 1.4.x
* [ACCUMULO-2216] - Randomwalk module to run each test once
* [ACCUMULO-2488] - Concurrent randomwalk balance check needs refinement
* [ACCUMULO-2491] - Backport ACCUMULO-1162 to 1.4
* [ACCUMULO-2508] - Security randomwalk fails "BAD_CREDENTIALS - Username or Password is Invalid"
Release Notes - Accumulo - Version 1.4.4
** Sub-task
* [ACCUMULO-895] - MiniAccumuloCluster does not work on Windows
* [ACCUMULO-1305] - Shorten prefix in proxy properties file
* [ACCUMULO-1338] - closeScanner in Accumulo proxy does not work
* [ACCUMULO-1340] - calling update() on proxy with unknown scanner derails thrift session
* [ACCUMULO-1341] - mini accumulo cluster 1.4 does not pick random port for logger
* [ACCUMULO-1352] - filter on !METADATA can prematurely delete loaded flags
* [ACCUMULO-1380] - Add MiniAccumuloCluster to the Accumulo documentation
* [ACCUMULO-1467] - Port proxy tframedtransport setting to 1.4
** Bug
* [ACCUMULO-1059] - monitor displays GC status using 12-hour time, not 24
* [ACCUMULO-1227] - simple.largeRow.LargeRowTest FAILED due to out of range exception
* [ACCUMULO-1235] - tablet fails to load after split fix
* [ACCUMULO-1267] - InputFormatBase always sets a regex filter at level 50 during initialize()
* [ACCUMULO-1277] - Race condition between master and tserver when acquiring tserver lock
* [ACCUMULO-1365] - proxy SimpleTest fails trying to get a port
* [ACCUMULO-1418] - RestoreZookeeper does not work
* [ACCUMULO-1424] - proxy TFramedTransport max size too small (should be configurable)
* [ACCUMULO-1429] - setscaniter doesn't work from different table context
* [ACCUMULO-1432] - FindOfflineTablets requires 4 arguments but only uses 2
* [ACCUMULO-1433] - Upgrading from 1.3 to 1.4 leaves deprecated properties
* [ACCUMULO-1473] - FindOfflineTablets is broken
* [ACCUMULO-1477] - Make master use new connections for tserver info
* [ACCUMULO-1505] - MockTable's addMutation does not check for empty mutation
* [ACCUMULO-1518] - FileOperations expects RFile filenames to contain only 1 dot.
* [ACCUMULO-1519] - CloudStone tests broken for < 1.5
* [ACCUMULO-1552] - minor typo in continuous-env.sh.example and run-verify.sh
* [ACCUMULO-1560] - Generated RPMs are not compatible with yum on 64-bit architectures
* [ACCUMULO-1572] - single node zookeeper failure kills connected accumulo servers
* [ACCUMULO-1605] - stack overflow MilliSpan.java:113
* [ACCUMULO-1626] - Mutation equals() method does not always work
* [ACCUMULO-1628] - NPE on deep copied dumped memoy iterator
* [ACCUMULO-1646] - pom.xml scm section should point at git
** Improvement
* [ACCUMULO-14] - Transition from full Accumulo mocking
* [ACCUMULO-1237] - Back port the MiniAccumuloCluster from 1.5 to 1.4.*
* [ACCUMULO-1289] - Re-establish SimpleTest for Proxy against MiniAccumuloCluster
* [ACCUMULO-1324] - MiniAccumuloCluster should be supported as a configuration property in the ProxyServer 1.4 backport
* [ACCUMULO-1375] - Update README files in proxy module.
* [ACCUMULO-1381] - Allow PrintInfo to fall back to the local filesystem
* [ACCUMULO-1394] - Allow RegExFilter subclass to call setNegate.
* [ACCUMULO-1414] - Add proxy to user manual documentation
* [ACCUMULO-1438] - Move MiniAccumuloCluster & Runner packaging to it's own module.
* [ACCUMULO-1504] - IteratorSetting missing equals and hashCode methods
* [ACCUMULO-1526] - add option for xml report format so that functional tests runs can be used by jenkins ci
* [ACCUMULO-1550] - Create ACCUMULO_CONF_DIR environment variable
* [ACCUMULO-1557] - [system/auto] if zooCacheTest.py fails, subsequent runs will fail due to /tmp/zkTest-42 dir existing with data
* [ACCUMULO-1561] - Update maven-rpm-plugin version
* [ACCUMULO-1603] - Lack of permission to start Tracer doesn't log actual reason
* [ACCUMULO-1633] - BatchWriter and variants don't assert maxMemory as a positive, non-zero value
* [ACCUMULO-1645] - Provide better information on unassigned tablets on the monitor
** New Feature
* [ACCUMULO-1200] - Back port the ProxySever from 1.5 to support 1.4.* as well.
Release Notes - Apache Accumulo - Version 1.4.3
**Bug
* [ACCUMULO-906] - Combiners documention could be improved
* [ACCUMULO-954] - ZooLock watcher can stop watching
* [ACCUMULO-844] - VisibilityFilter does not catch BadArgumentException
* [ACCUMULO-1062] - large numbers of threads make in-memory updates slow
* [ACCUMULO-977] - listscans and listcompaction commands can get stuck on bad server
* [ACCUMULO-921] - Stop-server has unecessary SSHs
* [ACCUMULO-915] - os.getlogin is not portable python code
* [ACCUMULO-912] - getConnector in MockAccumulo clobber's existing user authorizations
* [ACCUMULO-914] - Junit tests in eclipse fail due to Classloader poorly parsing classpath locations
* [ACCUMULO-907] - stacking combiners produces a strange result
* [ACCUMULO-889] - Update jar regex in examples and scripts
* [ACCUMULO-873] - Remove hadoop boxes from monitor
* [ACCUMULO-848] - sometimes loggers don't stop
* [ACCUMULO-789] - Native debian package won't install due to make or makefile error
* [ACCUMULO-788] - Debian native package postinst scripts reference a bare $JAVA_HOME environment variable
* [ACCUMULO-787] - Debian packages rely on old hadoop-zookeeper package
* [ACCUMULO-1125] - DistributedWorkQueue not releasing lock on failure
* [ACCUMULO-965] - Zookeeper session ids created as unsigned long, parsed in ZooUtils.java as signed long
* [ACCUMULO-897] - Port CloudStone fixes to 1.4.x branch
* [ACCUMULO-872] - both accumulo and accumulo-native contain native libs
* [ACCUMULO-776] - TimestampFilter should serialize start and end as longs in the IteratorSetting
* [ACCUMULO-364] - Security Policy file should be an example
* [ACCUMULO-1173] - NPE in tracer on zookeeper disconnect
**Improvement
* [ACCUMULO-1049] - Master does not need to get tserver lock
* [ACCUMULO-909] - NPE thrown for tablet readahead thread
* [ACCUMULO-824] - Tweak the rc.d levels to have tserver come up before tracers
Release Notes - Apache Accumulo - Version 1.4.2
** Bug
* [ACCUMULO-131] - ZookeeperInstance gets stuck when given bad host
* [ACCUMULO-409] - Failed bulk import files are copied through master
* [ACCUMULO-410] - Bulk import may copy successful files into fail dir
* [ACCUMULO-557] - unexpected behavior in the shell with special characters
* [ACCUMULO-642] - BatchVerify randomwalk test does not close its scanner
* [ACCUMULO-643] - CheckBalance in randomwalk tests is too sensitive
* [ACCUMULO-644] - randomwalk won't run out of a codebase served on a shared filesystem
* [ACCUMULO-654] - OfflineIterator does not bound range
* [ACCUMULO-675] - WrappingIterator's seenSeek should be protected
* [ACCUMULO-676] - root tablet taken off line before non-root metadata tables
* [ACCUMULO-678] - tablet server shutdown may not work through a master failure
* [ACCUMULO-681] - close consistency check failure
* [ACCUMULO-682] - Native library compiling fails on OS X 10.7 (Lion)
* [ACCUMULO-683] - Accumulo ignores HDFS max replication configuration
* [ACCUMULO-719] - Failure compiling native libraries on Mac OSX 10.7.4
* [ACCUMULO-753] - root tablet reference is not consulted during file gc
* [ACCUMULO-764] - stack overflow when starting tablet server after recent java update to 1.6.0_35
* [ACCUMULO-766] - master is "leaking" ZooLock objects
* [ACCUMULO-768] - Typo in User Manual on MapReduce Analytics
* [ACCUMULO-770] - TableLoadBalancer / DefaultLoadBalancer assigns tables unevenly
* [ACCUMULO-772] - Unexpected insert error not displayed in shell
* [ACCUMULO-777] - isLockHeld needs better bullet-proofing against transient errors
* [ACCUMULO-779] - ZooStore can starve completed Repos
* [ACCUMULO-782] - MockConnector returns a MockInstance that is not equivalent to it's parent MockInstance
* [ACCUMULO-784] - agitator maxkill/minkill issue
* [ACCUMULO-794] - FirstEntryInRowIterator can scan through entire last row in range
* [ACCUMULO-795] - MockTable doesn't obey useVersions parameter
* [ACCUMULO-798] - large ParNew can cause long-term stop-the-world java GC
* [ACCUMULO-800] - don't log the instance.secret
* [ACCUMULO-801] - Cobertura coverage not generated
* [ACCUMULO-805] - stack trace in MockTableOperationsTest
* [ACCUMULO-806] - tablet locator fails when the metadata table has empty sections
* [ACCUMULO-815] - timing too tight on LargeRowTest functional test
* [ACCUMULO-823] - /bin/start-server.sh: line 40: ifconfig: command not found
* [ACCUMULO-826] - MapReduce over accumlo fails if process that started job is killed
** Improvement
* [ACCUMULO-364] - Security Policy file should be an example
* [ACCUMULO-663] - RegexFilter make unecessary object creations
* [ACCUMULO-674] - Convert default log4j to use log4j date formatters
* [ACCUMULO-752] - Add support for importDirectory to the mock instance
* [ACCUMULO-810] - Add authorizations to continuous ingest test
* [ACCUMULO-812] - create a utility to find unhosted tablets
Release Notes - Apache Accumulo - Version 1.4.1
** Bug
* [ACCUMULO-355] - functional tests should run under a non-hadoop user
* [ACCUMULO-398] - Table tablets not evenly spread.
* [ACCUMULO-428] - loggers are not closed when high hold times are detected
* [ACCUMULO-449] - Failed log copy is not restarted
* [ACCUMULO-468] - low-memory warning message is incorrect
* [ACCUMULO-487] - Batch Scanner can get stuck when external thread closes scanner
* [ACCUMULO-488] - InputFormats' RecordReaders should call Context.progress
* [ACCUMULO-496] - Cloudtrace.thrift needs to have it's namespace updated to the new package
* [ACCUMULO-499] - Garbage collector should call Tracer.offNoFlush instead of Tracer.off
* [ACCUMULO-505] - "% of Used DFS" is overflowing on a large cluster
* [ACCUMULO-509] - default walog copy/sort uses replication of 1
* [ACCUMULO-512] - DEFAULT_MAX_LATENCY in AccumuloOutputFormat wrong units
* [ACCUMULO-516] - Column family search with sparse files is painfully long
* [ACCUMULO-520] - assigned tablets are not considered offline
* [ACCUMULO-521] - examples functional test is using the wrong class name
* [ACCUMULO-533] - make system iterators thread-safer
* [ACCUMULO-542] - with a large root tablet, tablet servers will get stuck loading other metadata tablets
* [ACCUMULO-561] - Monitor scan mb/s does not show batch scan activity
* [ACCUMULO-562] - Multi term grep in shell fails
* [ACCUMULO-566] - monitor should display zero tablet servers as red, even if there's only one tablet server configured
* [ACCUMULO-570] - dirlist example README is a little inconsistent
* [ACCUMULO-585] - Complain loudly when env file is missing
* [ACCUMULO-591] - Need to clear tablet location cache before computing input splits in input format
* [ACCUMULO-592] - We lost the security policy example
* [ACCUMULO-601] - client fails to resolve master hostname when not using fully qualified domain name
* [ACCUMULO-615] - accumulo runs fine on Hadoop 1.0
* [ACCUMULO-633] - FirstEntryInRowIterator is broken and has no test
** Improvement
* [ACCUMULO-337] - Make logging an example file
* [ACCUMULO-364] - Security Policy file should be an example
* [ACCUMULO-399] - need a randomwalk node that checks tablet balance
* [ACCUMULO-459] - Accumulo init should fail fast
* [ACCUMULO-471] - allow wikisearch ingest to run on uncompressed input
* [ACCUMULO-480] - config.html should be more clear with regards to "needs restart"
* [ACCUMULO-489] - Input Format puts Base64 encoded passwords in Configuration, which is world readable
* [ACCUMULO-494] - Document relationship between max walogs and max tserver memory
* [ACCUMULO-502] - Document what replaces the deprecated PerColumnIteratorConfig class.
* [ACCUMULO-503] - start-here does unecessary SSHs
* [ACCUMULO-510] - Rename scanner threads to identify table being scanned
* [ACCUMULO-550] - Colocate rfile index entries within file
* [ACCUMULO-554] - monitor should display red when time-since last report is higher than a few minutes
* [ACCUMULO-573] - Fix grammar in shell commands
* [ACCUMULO-574] - Document reseek of iterators
* [ACCUMULO-637] - Make entries written configurable for continuous ingest
** New Feature
* [ACCUMULO-49] - optionally monitor swappiness on every server
* [ACCUMULO-404] - Support running on-top of Kerberos-enabled HDFS
* [ACCUMULO-492] - Provide method for gathering system stats to API
** Task
* [ACCUMULO-491] - Manual has UTF8 characters
* [ACCUMULO-546] - User manual inconsistencies
Release notes for Apache Accumulo 1.4.0
Major features added prior to Incubation
* Tablet merging
* Efficient deletion of row range
* Compaction of row range
* Table cloning
* FATE : Fault Tolerant Executor. Used to make table operation survive master restart.
* Concurrent table operation execute correctly
* Bulk load is now done by master and tablet servers and uses FATE to survive server restarts.
* Multi-level RFile index
* Merging minor compactions
* Logical time for bulk import
Minor features added prior to Incubation
* Monitor will display tablet server and loggers that have died
* Shell and CloudbaseInputFormat will test extension classes before using them
* Empty tablet directories will be removed
* ZooKeeper ACLs prevent accidental disclosure of user passwords
* Compact and flush can wait for completion
* Additional test to verify master persistent state and concurrent table operations
* Added security checks to limit runtime environment of pluggable components
* Made monitor page display cache info
* Made file limit configuration less confusing
* Easily iterate over rows with new row iterator that wraps a scanner
* New row input format for mapre reduce jobs
* Execute iterators in a client client side iterator
* Introduced file archive example
* Added getMaxRow table operation
* Replaced Aggregators with Combiners which are iterators
* Made Filters Iterators
* New API for configuring iterators
* Added visibility constraint, it prevents users from writing data they can not read
* Removed dependency on accumulo-site.xml from client library.
* Improved tracing granularty
* Added information about running scans to monitor page
Preformance improvements added prior to incubation
* Cache no longer accesses Namenode when data is in cache. Now all file names generated by Accumulo are unique over time.
* No longer use file flage in HDFS, reducing pressure on Namenode.
* Shorter tablet dir names, saves namenode memory.
* Logger can write to multiple drives.
The following is a list of changes made during incubation.
** Sub-task
* [ACCUMULO-305] - Log context before starting major compaction
** Bug
* [ACCUMULO-3] - MockConnector should return a MockDeleter
* [ACCUMULO-5] - Log recovery fails with IllegalStateException
* [ACCUMULO-6] - Files deleted while in use by scan
* [ACCUMULO-7] - tablet is both assigned and hosted
* [ACCUMULO-9] - FATE Threads die when zookeeper shutdown
* [ACCUMULO-11] - unique server id is not constructed consistently
* [ACCUMULO-16] - Master uses wrong path to remove tserver lock from zookeeper
* [ACCUMULO-17] - MockScanner and MockBatchScanner do not seek their Filters
* [ACCUMULO-32] - Clean up bin dir
* [ACCUMULO-46] - Fix functional tests
* [ACCUMULO-53] - Multiple deletes cause a RuntimeException
* [ACCUMULO-54] - monitor doesn't provide web service if zookeeper is down
* [ACCUMULO-55] - Accumulo Output Format can create numerous empty files
* [ACCUMULO-56] - Merge tablet fails when tablet have empty files
* [ACCUMULO-60] - the digest used to protect data in zookeeper is "cb:password"; change this to "accumulo:password"
* [ACCUMULO-62] - Random walk logging config wrong
* [ACCUMULO-63] - Unable to build git mirror
* [ACCUMULO-64] - general.dynamic.classpaths property exists but is never used
* [ACCUMULO-65] - missing minor compaction files under heavy namenode load
* [ACCUMULO-71] - developer's manual is out of date
* [ACCUMULO-72] - Logical time not considered in merge
* [ACCUMULO-79] - LiveTServerSet.scanServers makes connections at scan time
* [ACCUMULO-93] - listscans in the shell attempts to contact tablet servers that do not hold locks
* [ACCUMULO-94] - createMultiTableBatchWriter has arguments that are inconsistent with createTableBatchWriter
* [ACCUMULO-95] - MockConnector does not implement createMultiTableBatchWriter
* [ACCUMULO-98] - Bloom filter should ignore duplicate inserts
* [ACCUMULO-100] - Accumulo system tests (SunnyDay at least) are locking up
* [ACCUMULO-107] - shell's GrepCommand sets options under same flag
* [ACCUMULO-108] - simple.gc.GCLotsOfCandidatesTest does not use the TestUtils settings properly
* [ACCUMULO-109] - KilledTabletServerSplit functional test fails
* [ACCUMULO-110] - Scanner creates threads too frequently
* [ACCUMULO-113] - servers are exiting without logging an unexpected exception
* [ACCUMULO-117] - all files in the tarball are executable.
* [ACCUMULO-126] - ZooKeeperInstance should use site configuration for ZK timeout
* [ACCUMULO-128] - close consistency check fails: Start key must be less than end key
* [ACCUMULO-130] - accumulo_sample/ingest/bin/ingest.sh is not executable
* [ACCUMULO-151] - Combiner default behavior is dangerous
* [ACCUMULO-158] - Add aggregator adds versioning iterator to the iterator tree.
* [ACCUMULO-165] - spell check the documentation
* [ACCUMULO-168] - Bulk import may not use configured file system
* [ACCUMULO-170] - NPE in shell when trying to get help for non-existant command
* [ACCUMULO-176] - subheading text falls outside header border
* [ACCUMULO-178] - Off-by-one error in FamilyIntersectingIterator
* [ACCUMULO-179] - Install script is missing
* [ACCUMULO-184] - update documentation and prompt for the initial configuration of the trace table
* [ACCUMULO-189] - RegExFilter deepCopy NullPointerException
* [ACCUMULO-192] - if accumulo is run as a non-hadoop user, the monitor says the NameNode is down
* [ACCUMULO-193] - key.followingKey(PartialKey.ROW_COLFAM_COLQUAL_COLVIS) can produce a key with an invalid COLVIS
* [ACCUMULO-194] - need a simple way to add tracing to clients
* [ACCUMULO-195] - FATE operations do not preserve trace information
* [ACCUMULO-209] - RegExFilter does not properly regex when using multi-byte characters
* [ACCUMULO-213] - compact tables by pattern only compacts the METADATA table
* [ACCUMULO-214] - took a table offline, remaining tablets did not balance
* [ACCUMULO-215] - tracer continues to get errors writing to an online trace table
* [ACCUMULO-216] - MockAccumulo does not support InstanceOperations
* [ACCUMULO-217] - MockAccumulo doesn't throw informative errors
* [ACCUMULO-218] - Mock Accumulo Inverts order of mutations w/ same timestamp
* [ACCUMULO-226] - BatchScanner iterator implementation erroneously returns true for hasNext upon subsequent hasNext calls
* [ACCUMULO-230] - problems found in accumulo_sample
* [ACCUMULO-264] - Users with the create permission but no tthe grant permission have the ability to create a new user with arbitrary scan authorizations
* [ACCUMULO-267] - Mapreduce API should not use JobContext to set configuration information
* [ACCUMULO-270] - Cache consistency bug in ClientServiceHandler.checkTableId()
* [ACCUMULO-271] - WholeRowIterator may call hasTop on unseeked source
* [ACCUMULO-281] - ArrayIndexOutOfBoundsException running examples.shard.ContinuousQuery.
* [ACCUMULO-292] - Accumulo examples tests are loud and (partially) broken
* [ACCUMULO-293] - bulk loading causing an consistency check failure
* [ACCUMULO-297] - User could delete table after permission to do so was removed
* [ACCUMULO-299] - tracing not working
* [ACCUMULO-300] - monitor page warns if the number of tablets goes into the hundreds of thousands: this is no longer a significant limitation to scalability
* [ACCUMULO-301] - TApplicationException running example in README.shard
* [ACCUMULO-304] - shell not connecting
* [ACCUMULO-308] - Isolation example is broken
* [ACCUMULO-310] - AccumuloInputFormat and AccumuloOutputFormat configuration methods don't match
* [ACCUMULO-314] - Re-queue tablets immediately after major compaction if there is more work
* [ACCUMULO-315] - Hole in metadata table occurred during random walk test
* [ACCUMULO-316] - Master has thousands of threads while running random walk
* [ACCUMULO-317] - Managing FATE operations is difficult
* [ACCUMULO-327] - master lost all tablet servers
* [ACCUMULO-328] - NPE when getting user authorizations
* [ACCUMULO-329] - tablet being unassigned/reassigned frequently
* [ACCUMULO-333] - Shell 'help' should wrap more cleanly
* [ACCUMULO-334] - Bulk random walk test failed
* [ACCUMULO-338] - Combiners lose data when reading off of disk
* [ACCUMULO-345] - fix random walk start script to not require environment variables
* [ACCUMULO-346] - button color is too dark
* [ACCUMULO-356] - merge failed to complete
* [ACCUMULO-357] - NPE in hasSystemPermission
* [ACCUMULO-365] - randomwalk bulk test verify failed
* [ACCUMULO-366] - master killed a tablet server
* [ACCUMULO-368] - tablet had location but was not loaded
* [ACCUMULO-373] - file missing during a major compaction
* [ACCUMULO-374] - wikisearch-ingest stop list should be removed
* [ACCUMULO-380] - UnsupportedOperation exception on wikisearch example
* [ACCUMULO-393] - Master not balancing after agitation
* [ACCUMULO-395] - Map reduce reading from Accumulo is not running mapper locally
* [ACCUMULO-405] - References to accumulo-examples still exist
* [ACCUMULO-412] - importdirectory failing on split table
* [ACCUMULO-413] - DeleteMany breaks with aggregators/combiners
* [ACCUMULO-414] - Make sure iterators handle deletion entries properly
* [ACCUMULO-422] - Bulk import failing when tablet server dies
* [ACCUMULO-424] - data lost during merge
* [ACCUMULO-427] - Data lost when tablets moving around frequently
* [ACCUMULO-435] - Accumulo debian packaging does not handle JAVA_HOMEs properly
* [ACCUMULO-436] - tablet merge stuck
* [ACCUMULO-444] - Data loss possible when tablet killed immediately after recovery
* [ACCUMULO-446] - boolean logic iterators do not correctly "jump()"
* [ACCUMULO-447] - BooleanLogicIterator cannot handle ORs correctly
* [ACCUMULO-476] - java.lang.ClassCastException: com.mapr.fs.MapRFileSystem cannot be cast to org.apache.hadoop.hdfs.DistributedFileSystem
* [ACCUMULO-484] - root tablet fails to load after recovery when all minor compaction threads are busy
* [ACCUMULO-486] - tablet server runs out of memory after 8 hours of continuous ingest
** Improvement
* [ACCUMULO-10] - tablet server bulk import methods should only be callable by system user
* [ACCUMULO-15] - Define expected iterator behavior
* [ACCUMULO-20] - Tablet constructor and run cleanup
* [ACCUMULO-21] - Remove extra ScannerOptions creation in BatchReader
* [ACCUMULO-22] - top level pom.xml should point to URLs that are useful
* [ACCUMULO-24] - Improve messaging regarding non-native map memory use
* [ACCUMULO-27] - issues found during scale random-walk testing
* [ACCUMULO-28] - make tserver client timeout configurable
* [ACCUMULO-30] - thrift generated code produces hundreds of warnings
* [ACCUMULO-38] - Add svnignores for eclipse specific files/folders
* [ACCUMULO-44] - RowIterator and AccumuloRowInputFormat require row to fit in memory
* [ACCUMULO-50] - Add Security Randomwalk to All Randomwalk test
* [ACCUMULO-67] - zookeeper session id encoded in metadata in two different ways
* [ACCUMULO-68] - Document new 1.4 features in user manual
* [ACCUMULO-69] - Document how Accumulo uses Zookeeper and HDFS
* [ACCUMULO-87] - Accumulo needs a logo
* [ACCUMULO-90] - add ":" to the legal character making up the term in a visibility expression
* [ACCUMULO-101] - Include tserver.memory.maps.max in the example xml file
* [ACCUMULO-103] - Unify examples
* [ACCUMULO-106] - non-native In memory map warning does not accurate check memory
* [ACCUMULO-114] - hide passwords when logging the configuration at start-up
* [ACCUMULO-127] - Environment settings should be set in the accumulo-env.sh and we should document as such
* [ACCUMULO-129] - shell requires iterators to implement OptionDescriber
* [ACCUMULO-139] - Add Snappy support
* [ACCUMULO-153] - Iterator options for input formats can't contain certain characters
* [ACCUMULO-154] - Combiner configuration is confusing
* [ACCUMULO-156] - Refactor Trie
* [ACCUMULO-162] - TimestampFilter requires both start and end timestamps
* [ACCUMULO-167] - Add static configuration methods to all user iterators
* [ACCUMULO-188] - Need functional test to test reloading iterators
* [ACCUMULO-224] - Add configurable banner to monitor page
* [ACCUMULO-239] - Add .gitignore to svn tree
* [ACCUMULO-245] - Add convenient methods to TypedValueCombiner
* [ACCUMULO-248] - In user manual, please define 'Mutation' before using it.
* [ACCUMULO-251] - Add wording to README.bloom about reason for flushing.
* [ACCUMULO-252] - Improve start-up scripts to avoid common errors
* [ACCUMULO-256] - Monitor page needs uptime
* [ACCUMULO-265] - Fix iterator priority conflict in README.combiner
* [ACCUMULO-273] - Report stuck random walk test
* [ACCUMULO-274] - Add descriptions to README.filedata
* [ACCUMULO-275] - README.filter refers to non-existing interface: org.apache.accumulo.core.iterators.iterators.filter.Filter
* [ACCUMULO-277] - Change helloworld.InsertWithBatchWriter example so table name is last command-line parameter
* [ACCUMULO-278] - Example in README.mapred produces "aggregators are deprecated" message.
* [ACCUMULO-280] - Create an example that explains visibilities and authorizations
* [ACCUMULO-284] - Provide usage example for isolation.InterferenceTest
* [ACCUMULO-287] - Enable AccumuloOutputFormat to use a mock instance
* [ACCUMULO-289] - Allow Combiner to work on all columns
* [ACCUMULO-291] - Iterator attachment and removal should be more atomic
* [ACCUMULO-303] - Implement per-table persistent formatters
* [ACCUMULO-307] - Combiner needs a deepCopy method
* [ACCUMULO-318] - Add Bulk random walk test to All.xml
* [ACCUMULO-319] - Provide optional stricness for SummingCombiner
* [ACCUMULO-326] - Lower replication on write ahead log archive
* [ACCUMULO-336] - Change default amount of logs kept
* [ACCUMULO-339] - Add lib and target directories to .gitignore file.
* [ACCUMULO-341] - Use -e shell command to make README.bloom simpler
* [ACCUMULO-342] - Incorrect path to accumulo in README.bloom
* [ACCUMULO-344] - In user manual mention why [] is displayed by scan command.
* [ACCUMULO-354] - Create combiners for wikisearch example
* [ACCUMULO-371] - Please discuss client classpath in the doc
* [ACCUMULO-372] - Deprecate selectrow add row option to scan
* [ACCUMULO-377] - Shell scan command needs support for multiple columns
* [ACCUMULO-379] - lower the noise for randomwalk tests
* [ACCUMULO-381] - wikisearch-ingest should not have runtime dependencies on ACCUMULO_HOME or ZOOKEEPER_HOME
* [ACCUMULO-389] - Update .gitignore
* [ACCUMULO-390] - Provide examples for different configurations
* [ACCUMULO-407] - Look into on the fly log4j configuration
* [ACCUMULO-460] - zookeeper jar and ubuntu
* [ACCUMULO-474] - wikisearch against an unindexed field causes tablet servers to run out of memory, or stop-the-world-gc
* [ACCUMULO-477] - inconsistent names and duplicate methods in IteratorSettings
* [ACCUMULO-485] - reduce the debugging level for the examples
** New Feature
* [ACCUMULO-19] - Debian packaging support
* [ACCUMULO-387] - Support map reduce directly over files
* [ACCUMULO-403] - Create general row selection iterator
* [ACCUMULO-431] - Add server status visualization to the monitor
** Task
* [ACCUMULO-4] - Remove jfreechart dependency
* [ACCUMULO-41] - Conform to a uniform style
* [ACCUMULO-42] - Apply apache license to code
* [ACCUMULO-45] - Remove unneeded MockEntry
* [ACCUMULO-61] - Add files generated by c++ code to svn ignore
* [ACCUMULO-92] - Contrib accumulo_sample for 1.4 has GPL dependencies
* [ACCUMULO-116] - Enabling debugging in shell does not work
* [ACCUMULO-145] - Release Accumulo 1.4
* [ACCUMULO-148] - Transition aggregation and filter documentation
* [ACCUMULO-155] - Deprecate things in 1.4
* [ACCUMULO-169] - Create 1.3 to 1.4 upgrade process
* [ACCUMULO-200] - Undefined behavior when adding an iterator that conflicts with existing iterators
* [ACCUMULO-242] - Make appropriate references to Apache Accumulo
* [ACCUMULO-285] - move accumulo_sample into the examples directory
* [ACCUMULO-306] - Deprecate mapfileoperations functionality removed in 1.5
* [ACCUMULO-411] - Improve javadocs and post to web site
* [ACCUMULO-438] - Rename cloudtrace package to org.apache.accumulo.cloudtrace
* [ACCUMULO-440] - Check 1.4 examples before release
* [ACCUMULO-469] - Java files are missing license headers
* [ACCUMULO-472] - Simple examples sources jar is in the wrong place
* [ACCUMULO-475] - Update LICENSE and NOTICE
* [ACCUMULO-481] - accumulo graduates: remove "incubating" flavor from project name
** Test
* [ACCUMULO-426] - Create shuffling load balancer
* [ACCUMULO-433] - Create functional test using chaotic load balancer