Skip to content

Manage Elastic Application Performance Monitoring integration for Apache JMeter to see the page timeline in Kibana APM

Notifications You must be signed in to change notification settings

vdaburon/jmeter-elastic-apm

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

23 Commits
 
 
 
 
 
 
 
 

Repository files navigation

jmeter-elastic-apm logo

Manages the integration of ElasticSearch Application Performance Monitoring API in the Apache JMeter.

Link to github project jmeter-elastic-apm

Apache JMeter with integration of ElasticSearch Application Performance Monitoring

This tool manages the integration of ElasticSearch Application Performance Monitoring API in the Apache JMeter.

The main goal is to show the timeline of pages declared in JMeter script in the Kibana APM. For each page on the JMeter side, have all the server-side calls grouped together, the SQL queries and the inter-application exchanges in the notion of page.

This tool adds JSR223 groovy sampler to create a new APM Transaction before a JMeter Transaction Controller and adds JSR223 groovy sampler to end the transaction after the JMeter Transaction Controller

This tool adds also User Defined Variables for elastic APM configuration

This tool could remove all JSR223 groovy that contains api calls to return to the initial JMeter script.

Example

A simple JMeter script with 3 Transaction Controller corresponding to 3 different pages

Simple script

Launch the tool to modify the script : script1.jmx

java -jar jmeter-elastic-apm-<version>-jar-with-dependencies.jar -file_in script1.jmx -file_out script1_add.jmx -action ADD -regex SC.*

and the script (script1_add.jmx) after action = ADD

Each JMeter Transaction Controller (page) is surround with a begin transaction and an end transaction (use groovy api call).

In the "groovy begin transaction apm", the groovy code calls the ElasticApm API (simplified code) :

Transaction transaction = ElasticApm.startTransaction();
Scope scope = transaction.activate();
transaction.setName(transactionName); // contains the JMeter Transaction Controller Name

And in the "groovy end transaction apm", the groovy code calls the ElasticApmp API (simplified code):

transaction.end();

Script with elastic APM configuration and groovy code

In View Results Tree, you will see new request headers (traceparent and elastic-apm-traceparent) automatically added by the elastic apm agent with the transaction id (e.g: 4443e451a1f7d42abdfbd739d455eac5) created by the jsr223 groovy begin transaction apm.

View Results Tree with traceparent

You will see all Transactions in Kibana with the vision of the page in JMeter (JMeter Transaction Controller usually == page) (click on image to see the full size image)

kibana jmeter page

And the TIMELINE for JMeter Transaction Controller, you see the JMeter Page and the web application gestdoc running in Tomcat (click on image to see the full size image)

kibana timeline_tc

Simplified architecture diagram

The simplified architecture : Apache JMeter and a java apm agent, Apache Tomcat and the java apm agent with web application gestdoc, ElasticSearch suite with ElasticSearch, APM Server and Kibana, a user views the Kibana Dashboards with navigator.

simplified architecture

License

See the LICENSE file Apache 2 https://www.apache.org/licenses/LICENSE-2.0

Ready to use

In the Release of the project you will find the tool compiled in one (uber) jar file which is directly usable.

Help

[main] INFO io.github.vdaburon.jmeter.elasticapmxml.ElasticApmJMeterManager - main begin
usage: io.github.vdaburon.jmeter.elasticapmxml.ElasticApmJMeterManager -action <action> [-extract_end <extract_end>]
       [-extract_start <extract_start>] [-extract_udv <extract_udv>] -file_in <file_in> -file_out <file_out> [-help]
       [-regex <regex>]
io.github.vdaburon.jmeter.elasticapmxml.ElasticApmJMeterManager
 -action <action>                 action ADD or REMOVE, ADD : add groovy api call and REMOVE : remove groovy api call
 -extract_end <extract_end>       optional, file contains groovy end call api (e.g : extract_end.xml), default read file
                                  in the jar
 -extract_start <extract_start>   optional, file contains groovy start call api (e.g : extract_start.xml), default read
                                  file in the jar
 -extract_udv <extract_udv>       optional, file contains User Defined Variables (e.g : extract_udv.xml), default read
                                  file in the jar
 -file_in <file_in>               JMeter file to read (e.g : script.jmx)
 -file_out <file_out>             JMeter file modified to write (e.g : script_add.jmx)
 -help                            Help and show parameters
 -regex <regex>                   regular expression matches Transaction Controller Label (default .*) (e.g : SC[0-9]+_.
                                  for SC01_P01_HOME or SC09_P12_LOGOUT)
E.g : java -jar jmeter-elastic-apm-<version>-jar-with-dependencies.jar -file_in script1.jmx -file_out script1_add.jmx
-action ADD -regex SC.*
E.g : java -jar jmeter-elastic-apm-<version>-jar-with-dependencies.jar -file_in script1_add.jmx -file_out
script1_remove.jmx -action REMOVE -regex .*
[main] INFO io.github.vdaburon.jmeter.elasticapmxml.ElasticApmJMeterManager - main end (exit 1) ERROR

Properties in the User Defined Variables

This tool add "User Defined Variables" with default value

User Defined Variables for elastic APM

This variables could be changed with JMeter properties at launch time, this properties could be set with -J<property>

elastic APM properties are :

property name comment
param_apm_active default : TRUE , TRUE OR FALSE, if TRUE then api is call
param_apm_prefix default : TR_ , Prefix of the transaction name, could be empty, SC01_LOGIN will be TR_SC01_LOGIN

E.g : jmeter -Jparam_apm_prefix=TRANS_ , SC01_LOGIN will be TRANS_SC01_LOGIN in Kibana transactions list

Limitation at one level Transaction Controller

The main limitation of this tool is only one Transaction Controller level. You can't instrument a Transaction Controller that contains others Transaction Controller because the groovy script use ONE variable to save the Transaction Controller Label. The Parent Transaction Controller set the label and the children Transaction Controller set the same variable and overwrite previous parent label. As a result, the parent will not have an end of transaction.

You can manually remove the groovy code before the parent Transaction Controller or give the regular expression for only children Transaction Controller.

Start Apache JMeter with ELASTIC APM agent and ELASTIC APM api library

Declare the ELASTIC APM Agent

Url to find the apm agent : https://mvnrepository.com/artifact/co.elastic.apm/elastic-apm-agent

Add the ELASTIC APM Agent somewhere in the filesystem (could be in the <JMETER_HOME>\lib but not mandatory)

In <JMETER_HOME>\bin modify the jmeter.bat or setenv.bat

Add ELASTIC APM configuration likes :

set APM_SERVICE_NAME=yourServiceName
set APM_ENVIRONMENT=yourEnvironment
set APM_SERVER_URL=http://apm_host:8200

set JVM_ARGS=-javaagent:<PATH_TO_AGENT_APM_JAR>\elastic-apm-agent-<version>.jar -Delastic.apm.service_name=%APM_SERVICE_NAME% -Delastic.apm.environment=%APM_ENVIRONMENT% -Delastic.apm.server_urls=%APM_SERVER_URL%

Another solution, create a windows shell likes jmeter_with_elasticapm.bat in the <JMETER_HOME>\bin:

set APM_SERVICE_NAME=yourServiceName
set APM_ENVIRONMENT=yourEnvironment
set APM_SERVER_URL=http://apm_host:8200
set JVM_ARGS=-javaagent:<PATH_TO_AGENT_APM_JAR>\elastic-apm-agent-<version>.jar -Delastic.apm.service_name=%APM_SERVICE_NAME% -Delastic.apm.environment=%APM_ENVIRONMENT% -Delastic.apm.server_urls=%APM_SERVER_URL% & jmeter.bat 

Remark the & jmeter.bat at end of the line with set JVM_ARGS

Add the ELASTIC APM library

Add the ELASTIC APM api library in the <JMETER_HOME>\lib\apm-agent-api-<version>.jar

This library is use by JSR223 groovy code.

Url to find the ELASTIC APM library : https://mvnrepository.com/artifact/co.elastic.apm/apm-agent-api

Use jmeter maven plugin and elastic java agent

You could launch a load test with the jmeter maven plugin and ELASTIC APM Agent

https://github.com/jmeter-maven-plugin/jmeter-maven-plugin

Paths are relative to the home maven project

  • Put your csv files in /src/test/jmeter directory (e.g : logins.csv)
  • Put the apm-agent-api-${elastic_apm_version}.jar in /src/test/jmeter directory
  • Put your jmeter script that contains groovy code added with jmeter-elastic-apm tool in /src/test/jmeter directory (e.g : script1_add.jmx)
  • In the maven build section, in the configuration > testPlanLibraries > declare the apm api library co.elastic.apm:apm-agent-api:${elastic_apm_version}
  • In the jMeterProcessJVMSettings > arguments add apm agent configuration likes:
-javaagent:${project.build.directory}/jmeter/testFiles/elastic-apm-agent-${elastic_apm_version}.jar
-Delastic.apm.service_name=${elastic_apm_service_name}
-Delastic.apm.environment=${elastic_apm_environment}
-Delastic.apm.server_urls=${elastic_apm_urls}


A pom.xml example, the elastic_apm_version is set to "1.37.0" for the ELASTIC APM Agent agent and the ELASTIC APM library but you could choose another version :

<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 https://maven.apache.org/xsd/maven-4.0.0.xsd">
    <modelVersion>4.0.0</modelVersion>
    <groupId>io.github.vdaburon.jmeter</groupId>
    <artifactId>gestdoc-maven-launch-loadtest-apm</artifactId>
    <version>1.0</version>
    <properties>
        <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
        <maven.compiler.source>1.8</maven.compiler.source>
        <maven.compiler.target>1.8</maven.compiler.target>
        <jvm_xms>256</jvm_xms>
        <jvm_xmx>756</jvm_xmx>

        <!-- elastic APM -->
        <elastic_apm_version>1.37.0</elastic_apm_version>
        <elastic_apm_service_name>YourServiceNane</elastic_apm_service_name>
        <elastic_apm_environment>YourEnvironment</elastic_apm_environment>
        <elastic_apm_urls>http://apm_server:8200</elastic_apm_urls>
    </properties>

    <build>
        <plugins>
            <plugin>
                <!-- launch test : mvn clean verify -->
                <groupId>com.lazerycode.jmeter</groupId>
                <artifactId>jmeter-maven-plugin</artifactId>
                <version>3.6.1</version>
                <executions>
                    <!-- Generate JMeter configuration -->
                    <execution>
                        <id>configuration</id>
                        <goals>
                            <goal>configure</goal>
                        </goals>
                    </execution>
                    <!-- Run JMeter tests -->
                    <execution>
                        <id>jmeter-tests</id>
                        <goals>
                            <goal>jmeter</goal>
                        </goals>
                    </execution>
                </executions>
                <configuration>
                    <jmeterVersion>5.5</jmeterVersion>
                    <testPlanLibraries>
                        <artifact>co.elastic.apm:apm-agent-api:${elastic_apm_version}</artifact>
                    </testPlanLibraries>
                    <downloadExtensionDependencies>false</downloadExtensionDependencies>
                    <jMeterProcessJVMSettings>
                        <xms>${jvm_xms}</xms>
                        <xmx>${jvm_xmx}</xmx>
                        <arguments>
                            <argument>-javaagent:${project.build.directory}/jmeter/testFiles/elastic-apm-agent-${elastic_apm_version}.jar</argument>
                            <argument>-Delastic.apm.service_name=${elastic_apm_service_name}</argument>
                            <argument>-Delastic.apm.environment=${elastic_apm_environment}</argument>
                            <argument>-Delastic.apm.server_urls=${elastic_apm_urls}</argument>
                            <argument>-Duser.language=en</argument>
                        </arguments>
                    </jMeterProcessJVMSettings>
                    <testFilesIncluded>
                        <jMeterTestFile>script1_add.jmx</jMeterTestFile>
                    </testFilesIncluded>
                    <generateReports>false</generateReports>
                    <testResultsTimestamp>false</testResultsTimestamp>
                    <resultsFileFormat>csv</resultsFileFormat>
                </configuration>
            </plugin>
        </plugins>
    </build>
</project>

Usage Maven

The maven groupId, artifactId and version, this plugin is in the Maven Central Repository Maven Central jmeter-elastic-apm

<groupId>io.github.vdaburon</groupId>
<artifactId>jmeter-elastic-apm</artifactId>
<version>1.3</version>

Advanced usage

Change the XML extract file

The action ADD of this tool is reading 3 XML files that contains extract of the XML JMeter script to add the 1) "User Defined Variables", 2) "JSR223 groovy begin transaction apm" and 3) "JRS223 groovy end transaction apm".

This files are include in the tool jar file.

You can change the XML files to include by indicating the path to the new XML files with the parameters -extract_udv or -extract_start or -extract_end

You want to change the "JSR223 start transaction apm" with your own file.

E.g. :

java -jar jmeter-elastic-apm-<version>-jar-with-dependencies.jar -file_in script1.jmx -file_out script1_add.jmx -action ADD -regex SC.* -extract_start my_xml_file.xml

You want to change all 3 files with yours XML files.

E.g. :

java -jar jmeter-elastic-apm-<version>-jar-with-dependencies.jar -file_in script1.jmx -file_out script1_add.jmx
-action ADD -regex SC.* -extract_start my_xml_start_file.xml -extract_end my_xml_end_file.xml -extract_udv my_xml_udv_file.xml

Another solution is to open the tool jar file with 7zip and replace the 3 files by yours files but keep the same XML file name and save the new jar.

Reserved tags

This tool is looking to reserved tags or special string in the XML extract files or in the JMeter script to REMOVE previously add JSR223 Samplers and User Defined Variables.

This tags are :

  • In the "JSR223 groovy start transaction apm", the reserved tags are : "@@TC_NAME" in the Parameters text field, this string will be replaced by the label of the following Transaction Controller and the "@@ELASTIC_APM_BEGIN" in the Comment text field
  • In the "JRS223 groovy end transaction apm", the reserved tag is "@@ELASTIC_APM_END" in the Comment text field
  • In the "User Defined Variables", the reserved tag is "@@ELASTIC_APM_UDV" in the Comment text field

Call this tool likes a library

To call this tool in an other tool, add the jar jmeter-elastic-apm-<version>-jar and this 2 libraries dependence (common-cli and org.slf4j) in the classpath and :

import io.github.vdaburon.jmeter.elasticapmxml.ElasticApmJMeterManager;

String sRegexTc = ".*";
String sFileIn = "script1.jmx";
String sFileOut = "script1_add.jmx";
ElasticApmJMeterManager.modifyAddSamplerForElasticApm(sFileIn, sFileOut, ElasticApmJMeterManager.ACTION_ADD, sRegexTc, ElasticApmJMeterManager.EXTRACT_START_JSR223, ElasticApmJMeterManager.EXTRACT_END_JSR223, ElasticApmJMeterManager.EXTRACT_UDV_ELASTIC);

Version

Version 1.3 change method name ELK to ELASTIC et file name tp extract_udv_elastic_under_testplan.jmx

Version 1.2 change globally ELK to ELASTIC

Version 1.1 correct the class name in the uber jar and correct REMOVE result

Version 1.0 first version of this tool.

About

Manage Elastic Application Performance Monitoring integration for Apache JMeter to see the page timeline in Kibana APM

Topics

Resources

Stars

Watchers

Forks

Packages

No packages published

Languages