forked from apache/eagle
-
Notifications
You must be signed in to change notification settings - Fork 0
/
CHANGELOG.txt
327 lines (301 loc) · 20.7 KB
/
CHANGELOG.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
Release Notes - Apache Eagle 0.4.0 (incubating)
** Highlights **
* JBDC Metadata Storage Extension
* Topology management in remote mode including start/stop/status operations
* Auditlogparser for MapR's audit log
* Oozie auditlog integration for Oozie security monitoring
* Add applicaiton "maprFSAuditLog"
* Refactor bin/eagle-sandbox-starter.sh to make it easier to use
** New Feature
* [EAGLE-169] - Dynamic security event correlation in Eagle
* [EAGLE-203] - Metrics feature support merge chart
* [EAGLE-225] - Create eagle bootstrap scripts for examples
* [EAGLE-226] - Refactor Eagle scripts to avoid heavily depending on Hortonworks Sandbox
* [EAGLE-232] - Create local Kafka/Zookeeper/Storm runner tools for quickstart examples and add related scripts to start/top zk/kafka
* [EAGLE-238] - Support scheduling topology in local mode including start/stop/status operations
* [EAGLE-266] - Integrate MkDocs for eagle-docs: http://www.mkdocs.org/
* [EAGLE-271] - Topology management in remote mode including start/stop/status operations
* [EAGLE-272] - Support topology management in UI including creating topology and monitoring status
* [EAGLE-282] - Auditlogparser for MapR's audit log
* [EAGLE-284] - Connect to MapR's CLDB service
* [EAGLE-298] - Oozie auditlog integration for Oozie security monitoring
* [EAGLE-307] - Add applicaiton "maprFSAuditLog"
** Improvement
* [EAGLE-103] - add comments to readme to tell users: currently, eagle is tested under jdk1.7.x, may have compile error with jdk1.8.x
* [EAGLE-182] - Replace Legacy "dataSource" field with "application" in UI request
* [EAGLE-185] - UI create cache after building
* [EAGLE-190] - JBDC Metadata Storage Extension
* [EAGLE-193] - UI metric dashboard support sortable
* [EAGLE-194] - UI show exception alert if service error
* [EAGLE-195] - policy metric display with interval of 5 min or customized interval
* [EAGLE-196] - eagle-topology.sh should have jar file path as parameter
* [EAGLE-201] - Change maven group name to org.apache.eagle instead of eagle
* [EAGLE-205] - Metric dashboard support multi metrics
* [EAGLE-207] - Management page add tips
* [EAGLE-208] - UI metric dashboard should support order & rename
* [EAGLE-216] - Added RM Policy and GC Policies in Resource
* [EAGLE-223] - Notification plugin to enable multiple instance of given alert plugin
* [EAGLE-237] - Add development tools for quickly starting zookeeper, kafka and webservice without depending on sandbox
* [EAGLE-248] - Rename directories according industrial common sense
* [EAGLE-287] - Make EagleStore as the default notification method
* [EAGLE-288] - Need to add "Alert De-Dup Interval" setting in "PolicyObjectBase"
* [EAGLE-295] - Add configuration value to enable application Manager
* [EAGLE-303] - Refactor message format in the email template.
* [EAGLE-305] - Add a config tip to the document for "Application Manager Tutorial" - setting "appCommandLoaderEnabled=true"
* [EAGLE-306] - add metadata for showing "Topology" tab in left-nav by default
* [EAGLE-315] - Add tutorial for mapr audit log monitoring
* [EAGLE-316] - Feature topology should not be added into an application
* [EAGLE-339] - Create HBase tables if not exists
* [EAGLE-340] - refactor bin/eagle-sandbox-starter.sh to make it easier to use
** Bug
* [EAGLE-8] - In eagle-check-env.sh shell , Itbad way to check kafka installation
* [EAGLE-18] - Follow up with infra about website creation
* [EAGLE-157] - policy metric should be refreshed every minute
* [EAGLE-171] - Policy listing table is messed up by too long policy name.
* [EAGLE-172] - Scripting string is allowed to create policy rules.
* [EAGLE-173] - Mark/Un-mark a sensitivity type does not sync status mark in the table list.
* [EAGLE-176] - Metric dashboard UI keep api refresh after page switch
* [EAGLE-192] - Uncaught ReferenceError: damControllers is not defined (doc.js:7628)
* [EAGLE-200] - GC Log Monitoring Not Working
* [EAGLE-210] - UI application group not display correctly
* [EAGLE-211] - Fix sometime unit test failing at TestSiddhiStateSnapshotAndRestore
* [EAGLE-212] - Fix AlertDataSourceEntity Bug in Hive web
* [EAGLE-213] - Updates fail for MySql
* [EAGLE-214] - Policy edit page need auto switch application
* [EAGLE-217] - Fix unstable unit tests about state snapshot management
* [EAGLE-224] - Column not found to EAGLE_METRIC when using JDBC
* [EAGLE-227] - java.lang.NoClassDefFoundError: org/apache/commons/pool/impl/CursorableLinkedList$ListIter
* [EAGLE-228] - org.apache.eagle.notification.plugin.NotificationPluginManagerImpl - fail invoking plugin's onAlert, continue java.lang.NullPointerException: null
* [EAGLE-229] - java.lang.IncompatibleClassChangeError: class net.sf.extcos.internal.JavaResourceAccessor$AnnotatedClassVisitor has interface org.objectweb.asm.ClassVisitor as super class
* [EAGLE-230] - Exception in persisting entitiesService side exception: org.codehaus.jackson.map.JsonMappingException: Conflicting setter definitions for property "alertContext"
* [EAGLE-235] - org.codehaus.jackson.map.JsonMappingException: Conflicting setter definitions for property "alertContext"
* [EAGLE-239] - Alert list and details are not correctly displayed
* [EAGLE-240] - java.lang.ArrayIndexOutOfBoundsException thrown by MetricKeyCodeDecoder
* [EAGLE-242] - Import the notification plugin metadata when initializing
* [EAGLE-254] - HdfsAuditLog topology keeps alerting for one piece of log
* [EAGLE-258] - Automatically add apache-github and apache-git in pr tools
* [EAGLE-269] - Comparisons between 'LONG VARCHAR (UCS_BASIC)' and 'LONG VARCHAR (UCS_BASIC)' are not supported
* [EAGLE-270] - JDBC: Create table fail for some of the tables
* [EAGLE-273] - Issue with creating MySql tables , only 14 were created out of 24, reason being varchar(30000) for multiple columns lead to exceeding the maximum row size of 65,535 bytes.
* [EAGLE-274] - 2016-04-15 15:50:20 b.s.d.worker [ERROR] Error on initialization of server mk-worker java.lang.RuntimeException: java.lang.ClassNotFoundException: org.slf4j.impl.Log4jLoggerAdapter
* [EAGLE-275] - Eagle email alert bug: $elem["dataSource"] Alert Detected
* [EAGLE-291] - JDBC: Update transactions fail in PostgreSQL
* [EAGLE-292] - Updated hbase policy failed: Data too long for column 'policyDef' when using mysql storage
* [EAGLE-294] - If a policy metadata field is not set, null attributes can not be able to add into input stream for SiddhiCEP
* [EAGLE-297] - Email with authentication can not be validated and sent out.
* [EAGLE-300] - Disable spring debug log by default in webservice
* [EAGLE-301] - Tables omitted for using mysql
* [EAGLE-304] - Enable Advanced dedup configuration in policy definition
* [EAGLE-308] - Consistency issue: deleting a topology doesn't delete existing topology-execution bound to it.
* [EAGLE-310] - already existing active topology status not displayed when a deleted topology+execution re-created with same name
* [EAGLE-311] - operations of items listed on topology-management monitoring page require buffering loading approaches
* [EAGLE-313] - normally stopped topology-execution shows error message in the description column
* [EAGLE-319] - java.sql.SQLSyntaxErrorException caught when querying from table topologyExecutionEntity
* [EAGLE-321] - java.lang.NoSuchMethodError: com.google.protobuf.LazyStringList.getUnmodifiableView
* [EAGLE-326] - typo found in eagle documentation
* [EAGLE-327] - java.lang.ClassCastException: java.lang.String cannot be cast to java.lang.Integer
* [EAGLE-330] - Hive ql.Parser can't parser a hive query sql with keywords
* [EAGLE-338] - fix topology-assembly build issue because of module name change
* [EAGLE-346] - ClassNotFoundException thrown out when topology is executing
* [EAGLE-355] - UI advanced policy expression can't parse
* [EAGLE-356] - Fix Authentication problem to query resource manager web service
** Task
* [EAGLE-73] - Put docker steps to site tutorial
* [EAGLE-221] - Support cusomized notification type in policy editor
* [EAGLE-222] - Documentation for eagle alert plugin mechnism
* [EAGLE-280] - Update logstash-kafka-conf.md
* [EAGLE-309] - Add code formatter template
** Sub-task
* [EAGLE-219] - Use PUT method for updating request when possible in front-end.
Release Notes - Apache Eagle 0.3.1 (incubating)
** Highlights **
* Hadoop JMX metric monitoring.
* NameNode log monitoring for GC alerts.
* Eagle UI Modularization (With new customizable UI options).
* Generic Notification Plugin Framework for integrating alerts with various third parties.
* Docker Image for Eagle.
* Provide analytic DSL support.
** New Feature
* [EAGLE-15] - HBase auditlog integration for HBase security monitoring
* [EAGLE-17] - HDFS security log integration for HDFS security monitoring
* [EAGLE-46] - track the work before moving code to apache site
* [EAGLE-47] - Ability to audit who made changes to Eagle policies
* [EAGLE-53] - Docker Image for Eagle
* [EAGLE-79] - Provide analytic DSL support
* [EAGLE-81] - Notification Plugin Framework
* [EAGLE-100] - provide tools to collect hadoop jmx metrics
* [EAGLE-122] - Create a generic notification plugin for integrating alerts
** Bug
* [EAGLE-4] - configure parallelism with bolt/spout friendly name
* [EAGLE-6] - group-by user between bolts and spouts for hdfs/hive audit log monitoring
* [EAGLE-10] - Bad way to check kafka installation in eagle-check-env.sh
* [EAGLE-28] - Znode root should be configurable.
* [EAGLE-30] - Topology run in storm local mode should not terminate after Integer.MAX_VALUE milliseconds
* [EAGLE-41] - Eagle policy engine supports customizable ExceptionHandler instead of using FetalExceptionHandler
* [EAGLE-48] - Alert message time is wrong in some cases
* [EAGLE-56] - Building failed for artifact jdk.tools:jdk.tools:jar:1.7 not found
* [EAGLE-69] - http 404 bug in accessing http://localhost:9099/eagle-service
* [EAGLE-70] - Fix Goovy into Groovy in pom
* [EAGLE-74] - in sandbox setup, change package name from eagle. to org.apache.eagle
* [EAGLE-76] - Disable creating newStream for common user role
* [EAGLE-85] - Fix unit test failure.
* [EAGLE-94] - fix the bug of eagle docker in Mac
* [EAGLE-95] - DAM HDFS topology fails to start, if there is invalid policy.
* [EAGLE-104] - Fix the unit test TestHDFSSecuritylogParser
* [EAGLE-118] - Siddhi contains is neither a function extension nor an aggregated attribute extension
* [EAGLE-119] - fix unit testing bugs
* [EAGLE-125] - Add LICENSE in eagle external
* [EAGLE-128] - Fix unit test failure
* [EAGLE-141] - fix some unit testing exception which is thrown within annoymous class
* [EAGLE-142] - Replace AlertDefinitionDAOImpl with PolicyDefinitionDAOImpl
* [EAGLE-148] - Master build failure due to siddhi ql test
* [EAGLE-163] - HDFS topology not working.
** Improvement
* [EAGLE-7] - expose storm config as individual eagle topology config
* [EAGLE-13] - Eagle machine learning no longer needs hourly aggregation
* [EAGLE-14] - Re-assemble high level hdfs commands for better policy
* [EAGLE-24] - Load skew issue when partition by user
* [EAGLE-29] - Update Alert page for display more infomation
* [EAGLE-38] - reminder for Alerts in the UI
* [EAGLE-40] - Policy detail page support alert list display
* [EAGLE-42] - Customized partition support for Kafka spout
* [EAGLE-44] - previous page should be reloaded after login session is timed out and re-login
* [EAGLE-50] - Eagle internal metric framework
* [EAGLE-52] - Eagle framework should support custom group by function in addition to group by fields
* [EAGLE-55] - JobCompletedConfigServiceURLBuilderImpl in hive running spout miss anonymous paramter
* [EAGLE-58] - Enhance Hive query parse model
* [EAGLE-62] - Add jshint for front end UI building
* [EAGLE-66] - Eagle TypeSafe Stream Processing DSL
* [EAGLE-80] - remove httpd directory
* [EAGLE-86] - Rewrite HDFSAuditLogParser to a non-regular expression version
* [EAGLE-88] - Eagle web-service should have status url
* [EAGLE-99] - policy distribution statistics to be printed in log
* [EAGLE-106] - UI use same chart component
* [EAGLE-107] - Build Status Icon has been enabled for our github repo, please apply it to readme.md
* [EAGLE-108] - a tool tests performace between mongodb3.0 and couchDB1.6.1
* [EAGLE-109] - add hdfs related ports mapping from docker container to host
* [EAGLE-112] - Should support sum aggregation in front end for slide window function
* [EAGLE-114] - Enable RAT check and fix missing license headers
* [EAGLE-138] - Extend JMX Collector to support "hadoop.namenode.JournalTransaction"
* [EAGLE-143] - Create Eagle release 0.3.1
* [EAGLE-149] - Enable hadoop jmx metric cases
* [EAGLE-152] - hadoop-metric monitoring automation script
* [EAGLE-158] - Disable org.apache.eagle.datastream.EagleTuple
* [EAGLE-166] - Enhance metric collector script to extract hadoop ha status as metric
** Task
* [EAGLE-83] - Integrate Jenkins with GitHub for checking pull requests
* [EAGLE-84] - Create scripts for merging PRs automatically
* [EAGLE-102] - ask jenkins-admin's help to setup "Embeddable Build Status Plugin" and make the status visible in Readme.md of incubator-eagle.git
* [EAGLE-117] - update Build Status Link and make it point to CI job building upon master
* [EAGLE-131] - make eagle main CI build pass
* [EAGLE-136] - Setup hadoop metric application
* [EAGLE-154] - hadoop-metric monitoring sandbox starter script
* [EAGLE-164] - Tutorial for setting up the development environment on mac
* [EAGLE-165] - Add more jmx metric cases
** Sub-task
* [EAGLE-51] - Clean and manage external licensed static resource dependencies in eagle web with npm and grunt
* [EAGLE-60] - HBase sensitivity UI
* [EAGLE-63] - Improve docker image for quick preview
* [EAGLE-64] - Push eagle docker image to docker hub
* [EAGLE-65] - Eagle docker consistent port mapping
* [EAGLE-71] - Fix eagle docker run command
* [EAGLE-75] - Leverage dropwizard metrics for generating Eagle Topology and DataSource Metrics
* [EAGLE-78] - eagle-lib.sh script not work for mac osx and windows
* [EAGLE-130] - Eagle Pipeline DSL: Parser, Compiler, Runner
* [EAGLE-140] - Eagle Pipeline Package and Script
Release Notes - Apache Eagle 0.3.0 (incubating)
** Highlights **
* Hadoop JMX metric monitoring.
* NameNode log monitoring for GC alerts.
* Eagle UI Modularization (With new customizable UI options).
* Generic Notification Plugin Framework for integrating alerts with various third parties.
* Docker Image for Eagle.
* Provide analytic DSL support.
** New Feature
* [EAGLE-15] - HBase auditlog integration for HBase security monitoring
* [EAGLE-17] - HDFS security log integration for HDFS security monitoring
* [EAGLE-46] - track the work before moving code to apache site
* [EAGLE-47] - Ability to audit who made changes to Eagle policies
* [EAGLE-53] - Docker Image for Eagle
* [EAGLE-79] - Provide analytic DSL support
* [EAGLE-81] - Notification Plugin Framework
* [EAGLE-100] - provide tools to collect hadoop jmx metrics
* [EAGLE-122] - Create a generic notification plugin for integrating alerts
** Bug
* [EAGLE-4] - configure parallelism with bolt/spout friendly name
* [EAGLE-6] - group-by user between bolts and spouts for hdfs/hive audit log monitoring
* [EAGLE-10] - Bad way to check kafka installation in eagle-check-env.sh
* [EAGLE-28] - Znode root should be configurable.
* [EAGLE-30] - Topology run in storm local mode should not terminate after Integer.MAX_VALUE milliseconds
* [EAGLE-41] - Eagle policy engine supports customizable ExceptionHandler instead of using FetalExceptionHandler
* [EAGLE-48] - Alert message time is wrong in some cases
* [EAGLE-56] - Building failed for artifact jdk.tools:jdk.tools:jar:1.7 not found
* [EAGLE-69] - http 404 bug in accessing http://localhost:9099/eagle-service
* [EAGLE-70] - Fix Goovy into Groovy in pom
* [EAGLE-74] - in sandbox setup, change package name from eagle. to org.apache.eagle
* [EAGLE-76] - Disable creating newStream for common user role
* [EAGLE-85] - Fix unit test failure.
* [EAGLE-94] - fix the bug of eagle docker in Mac
* [EAGLE-95] - DAM HDFS topology fails to start, if there is invalid policy.
* [EAGLE-104] - Fix the unit test TestHDFSSecuritylogParser
* [EAGLE-118] - Siddhi contains is neither a function extension nor an aggregated attribute extension
* [EAGLE-119] - fix unit testing bugs
* [EAGLE-125] - Add LICENSE in eagle external
* [EAGLE-128] - Fix unit test failure
* [EAGLE-141] - fix some unit testing exception which is thrown within annoymous class
* [EAGLE-142] - Replace AlertDefinitionDAOImpl with PolicyDefinitionDAOImpl
* [EAGLE-148] - Master build failure due to siddhi ql test
* [EAGLE-163] - HDFS topology not working.
** Improvement
* [EAGLE-7] - expose storm config as individual eagle topology config
* [EAGLE-13] - Eagle machine learning no longer needs hourly aggregation
* [EAGLE-14] - Re-assemble high level hdfs commands for better policy
* [EAGLE-24] - Load skew issue when partition by user
* [EAGLE-29] - Update Alert page for display more infomation
* [EAGLE-38] - reminder for Alerts in the UI
* [EAGLE-40] - Policy detail page support alert list display
* [EAGLE-42] - Customized partition support for Kafka spout
* [EAGLE-44] - previous page should be reloaded after login session is timed out and re-login
* [EAGLE-50] - Eagle internal metric framework
* [EAGLE-52] - Eagle framework should support custom group by function in addition to group by fields
* [EAGLE-55] - JobCompletedConfigServiceURLBuilderImpl in hive running spout miss anonymous paramter
* [EAGLE-58] - Enhance Hive query parse model
* [EAGLE-62] - Add jshint for front end UI building
* [EAGLE-66] - Eagle TypeSafe Stream Processing DSL
* [EAGLE-80] - remove httpd directory
* [EAGLE-86] - Rewrite HDFSAuditLogParser to a non-regular expression version
* [EAGLE-88] - Eagle web-service should have status url
* [EAGLE-99] - policy distribution statistics to be printed in log
* [EAGLE-106] - UI use same chart component
* [EAGLE-107] - Build Status Icon has been enabled for our github repo, please apply it to readme.md
* [EAGLE-108] - a tool tests performace between mongodb3.0 and couchDB1.6.1
* [EAGLE-109] - add hdfs related ports mapping from docker container to host
* [EAGLE-112] - Should support sum aggregation in front end for slide window function
* [EAGLE-114] - Enable RAT check and fix missing license headers
* [EAGLE-138] - Extend JMX Collector to support "hadoop.namenode.JournalTransaction"
* [EAGLE-143] - Create Eagle release 0.3.0
* [EAGLE-149] - Enable hadoop jmx metric cases
* [EAGLE-152] - hadoop-metric monitoring automation script
* [EAGLE-158] - Disable org.apache.eagle.datastream.EagleTuple
* [EAGLE-166] - Enhance metric collector script to extract hadoop ha status as metric
** Task
* [EAGLE-83] - Integrate Jenkins with GitHub for checking pull requests
* [EAGLE-84] - Create scripts for merging PRs automatically
* [EAGLE-102] - ask jenkins-admin's help to setup "Embeddable Build Status Plugin" and make the status visible in Readme.md of incubator-eagle.git
* [EAGLE-117] - update Build Status Link and make it point to CI job building upon master
* [EAGLE-131] - make eagle main CI build pass
* [EAGLE-136] - Setup hadoop metric application
* [EAGLE-154] - hadoop-metric monitoring sandbox starter script
* [EAGLE-164] - Tutorial for setting up the development environment on mac
* [EAGLE-165] - Add more jmx metric cases
** Sub-task
* [EAGLE-51] - Clean and manage external licensed static resource dependencies in eagle web with npm and grunt
* [EAGLE-60] - HBase sensitivity UI
* [EAGLE-63] - Improve docker image for quick preview
* [EAGLE-64] - Push eagle docker image to docker hub
* [EAGLE-65] - Eagle docker consistent port mapping
* [EAGLE-71] - Fix eagle docker run command
* [EAGLE-75] - Leverage dropwizard metrics for generating Eagle Topology and DataSource Metrics
* [EAGLE-78] - eagle-lib.sh script not work for mac osx and windows
* [EAGLE-130] - Eagle Pipeline DSL: Parser, Compiler, Runner
* [EAGLE-140] - Eagle Pipeline Package and Script