Version 1.1.39 (#69)

* Version 1.1.39 - Feature: Improvements on Confluent Interceptor UI and related Overview page subcomponents * dev in progress: * Version 1.1.40 - Feature: OS Main KPIs views in each component dashboard * Version 1.1.40 * Version 1.1.40 * Version 1.1.39
guilhemmarchand · Nov 9, 2020 · 4c53f16 · 4c53f16
1 parent 14a964b
commit 4c53f16
Show file tree

Hide file tree

Showing 25 changed files with 1,797 additions and 345 deletions.
diff --git a/docs/about.rst b/docs/about.rst
@@ -17,11 +17,11 @@ About
 
 * Telegraf Zookeeper input plugin (https://github.com/influxdata/telegraf/tree/master/plugins/inputs/zookeeper)
 
-* LinkedIn Kafka monitor to provide end to end monitoring (https://github.com/linkedin/kafka-monitor)
+* Optional: Xinfra Kafka monitor to provide end to end monitoring (https://github.com/linkedin/kafka-monitor)
 
-* Confluent Interceptors Monitoring (https://docs.confluent.io/current/control-center/installation/clients.html)
+* Optional: Confluent Interceptors Monitoring (https://docs.confluent.io/current/control-center/installation/clients.html)
 
-* Kafka Consumers lag monitoring with Burrow (https://github.com/linkedin/Burrow)
+* Optional: Kafka Consumers lag monitoring with Burrow (https://github.com/linkedin/Burrow)
 
 **An ITSI module is also available:** https://da-itsi-telegraf-kafka.readthedocs.io
 

diff --git a/docs/compatibility.rst b/docs/compatibility.rst
@@ -4,7 +4,10 @@ Compatibility
 Splunk compatibility
 ####################
 
-All the metrics are ingested into the high performance Splunk metric store, Splunk 7.0.x or higher is required.
+.. admonition:: Splunk core version
+
+    - metrics are ingested into the high performance Splunk metric store, Splunk 7.0.x or later is required
+    - some queries are built using the latest syntax for metrics, Splunk 7.2.x or later is recommended
 
 Telegraf compatibility
 ######################
@@ -23,7 +26,9 @@ If you are running Kafka in containers, you are at the right place, all of the c
 Kafka and Confluent compatibility
 #################################
 
-Qualification and certification is made against Kafka V2.x and Confluent V5.x, earlier versions might however work with no issues but are not being tested.
+.. admonition:: Apache Kafka and Confluent compatibility
+
+    - Qualification and certification is made against Kafka V2.x and Confluent V6.x, earlier versions might however work with no issues but are not being tested
 
 Web Browser compatibility
 #########################

diff --git a/docs/deployment.rst b/docs/deployment.rst
@@ -14,7 +14,20 @@ Deployment matrix
 
 If Splunk search heads are running in Search Head Cluster (SHC), the Splunk application must be deployed by the SHC deployer.
 
-The deployment and configuration requires the creation of a dedicated metric index (by default called **telegraf_kafka**), see the implementation section.
+Indexes creation
+================
+
+.. admonition:: indexes
+
+    - Kafka SDM expects the creation of a metric index, by default ``telegraf_kafka`` which can be configured by customizing the macro ``telegraf_kafka_index``
+    - If you use Confluent interceptors, the application expects the creation of a metric index ``confluent_interceptor_metrics`` which can be configured by customizing the macro ``confluent_interceptor_index`` 
+
+Dependencies
+============
+
+**The application depends on:**
+
+- Horseshoe Meter - Custom Visualization, Splunk Base: https://splunkbase.splunk.com/app/3166
 
 Initial deployment
 ==================

diff --git a/docs/implementation.rst b/docs/implementation.rst
diff --git a/docs/releasenotes.rst b/docs/releasenotes.rst
@@ -1,6 +1,14 @@
 Release notes
 #############
 
+==============
+Version 1.1.39
+==============
+
+- Feature: Improvements on Confluent Interceptor UI and related Overview page subcomponents
+- Feature: OS Main KPIs views in each component dashboard
+- Change: navigation bar review
+
 ==============
 Version 1.1.38
 ==============

diff --git a/docs/support.rst b/docs/support.rst
@@ -5,14 +5,14 @@ The Splunk application for Kafka monitoring with Telegraf is community supported
 
 To get support, use of one the following options:
 
-Splunk Answers
-==============
+Splunk community
+================
 
-Open a question in Splunk answers for the application:
+Open a question in Splunk Community:
 
-- https://answers.splunk.com/app/questions/4268.html
+- https://community.splunk.com
 
-Splunk community slack
+Splunk community Slack
 ======================
 
 Contact me on Splunk community slack, or even better, ask the community !

diff --git a/telegraf-kafka/appserver/static/table_bar.css b/telegraf-kafka/appserver/static/table_bar.css
@@ -0,0 +1,20 @@
+td.data-bar-cell {
+    padding: 4px 8px;
+}
+
+td.data-bar-cell .data-bar-wrapper .data-bar {
+    height: 16px;
+    min-width: 1px;
+    background-color: #5479AF;
+
+	font-weight: bold;
+}
+
+.data-bar-over { color: #FFFFFF; }
+.data-bar-under { color: #FFFFFF; }
+
+.data-bar-wrapper {
+
+	border-style: solid;
+	border-width: 1px;
+}
diff --git a/telegraf-kafka/appserver/static/table_bar.js b/telegraf-kafka/appserver/static/table_bar.js
@@ -0,0 +1,30 @@
+require([
+    'jquery',
+    'underscore',
+    'splunkjs/mvc',
+    'views/shared/results_table/renderers/BaseCellRenderer',
+    'splunkjs/mvc/simplexml/ready!'
+], function($, _, mvc, BaseCellRenderer) {
+
+    var DataBarCellRenderer = BaseCellRenderer.extend({
+        canRender: function(cell) {
+            return (cell.field === 'used_pct');
+        },
+        render: function($td, cell) {
+var pColor="data-bar-under"
+if(cell.value > 15){ pColor="data-bar-over" }
+            $td.addClass('data-bar-cell').html(_.template('<div class="data-bar-wrapper"><div class="data-bar <%- pColor %>" style="width:<%- percent %>%">&nbsp;<%- ppp %>%</div></div>', {
+                percent: Math.min(Math.max(parseFloat(cell.value), 0), 100),
+ppp: parseFloat(cell.value).toFixed(2),
+pColor: pColor
+            }));
+        }
+    });
+
+    mvc.Components.get('tablebar').getVisualization(function(tableView) {
+        tableView.table.addCellRenderer(new DataBarCellRenderer());
+        tableView.table.render();
+    });
+
+});
+
diff --git a/telegraf-kafka/default/app.conf b/telegraf-kafka/default/app.conf
@@ -16,4 +16,4 @@ label = Kafka Smart Monitoring
 [launcher]
 author = Guilhem Marchand
 description = Kafka Smart Monitoring provides advanced and fast monitoring of Kafka and Confluent streaming platform
-version = 1.1.38
+version = 1.1.39
diff --git a/telegraf-kafka/default/data/ui/nav/default.xml b/telegraf-kafka/default/data/ui/nav/default.xml
@@ -31,7 +31,9 @@
     ####################################################################################################################
     -->
 
-    <collection label="Kafka monitoring">
+    <a href="telegraf-kafka-alerting">Manage components</a>
+
+    <collection label="Kafka monitoring &amp; logging">
 
         <collection label="Zookeeper servers">
             <view name="telegraf-kafka-zookeeper" />
@@ -75,40 +77,34 @@
             <view name="telegraf-kafka-kafka-monitor" />
         </collection>
 
-    </collection>
+        <collection label="Kafka logging">
 
-    <!--
-    ####################################################################################################################
-    KAFKA LOGS
-    ####################################################################################################################
-    -->
-
-    <collection label="Kafka logging">
+            <collection label="Zookeeper servers">
+                <a href="search?q=search%20eventtype%3Dzookeeper">eventtype=zookeeper</a>
+            </collection>
 
-        <collection label="Zookeeper servers">
-            <a href="search?q=search%20eventtype%3Dzookeeper">eventtype=zookeeper</a>
-        </collection>
+            <collection label="Kafka Brokers">
+                <a href="search?q=search%20eventtype%3Dkafka_broker">eventtype=kafka_broker</a>
+            </collection>
 
-        <collection label="Kafka Brokers">
-            <a href="search?q=search%20eventtype%3Dkafka_broker">eventtype=kafka_broker</a>
-        </collection>
+            <collection label="Kafka Connect">
+                <a href="search?q=search%20eventtype%3Dkafka_connect">eventtype=kafka_connect</a>
+                <a href="search?q=search%20eventtype%3Dkafka_connect_source">eventtype=kafka_connect_source</a>
+                <a href="search?q=search%20eventtype%3Dkafka_connect_sink">eventtype=kafka_connect_sink</a>
+            </collection>
 
-        <collection label="Kafka Connect">
-            <a href="search?q=search%20eventtype%3Dkafka_connect">eventtype=kafka_connect</a>
-            <a href="search?q=search%20eventtype%3Dkafka_connect_source">eventtype=kafka_connect_source</a>
-            <a href="search?q=search%20eventtype%3Dkafka_connect_sink">eventtype=kafka_connect_sink</a>
-        </collection>
+            <collection label="Confluent schema-registry">
+                <a href="search?q=search%20eventtype%3Dkafka_schema_registry">eventtype=kafka_schema_registry</a>
+            </collection>
 
-        <collection label="Confluent schema-registry">
-            <a href="search?q=search%20eventtype%3Dkafka_schema_registry">eventtype=kafka_schema_registry</a>
-        </collection>
+            <collection label="Confluent kafka-rest">
+                <a href="search?q=search%20eventtype%3Dkafka_rest">eventtype=kafka_rest</a>
+            </collection>
 
-        <collection label="Confluent kafka-rest">
-            <a href="search?q=search%20eventtype%3Dkafka_rest">eventtype=kafka_rest</a>
-        </collection>
+            <collection label="Confluent ksql-server">
+                <a href="search?q=search%20eventtype%3Dkafka_ksql_server">eventtype=kafka_ksql_server</a>
+            </collection>
 
-        <collection label="Confluent ksql-server">
-            <a href="search?q=search%20eventtype%3Dkafka_ksql_server">eventtype=kafka_ksql_server</a>
         </collection>
 
     </collection>