An extensible Windows agent that ingests logs and metrics to AWS services such as Kinesis Stream, Kinesis Firehose, CloudWatch Logs and CloudWatch.
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
.github Creating initial file from template Aug 14, 2018
Amazon.KinesisTap.AWS Added the ability to add header when replicating files. Oct 30, 2018
Amazon.KinesisTap.AutoUpdate Added the ability to add header when replicating files. Oct 30, 2018
Amazon.KinesisTap.Common Added the ability to add header when replicating files. Oct 30, 2018
Amazon.KinesisTap.Core.Test Added the ability to add header when replicating files. Oct 30, 2018
Amazon.KinesisTap.Core Added the ability to add header when replicating files. Oct 30, 2018
Amazon.KinesisTap.Deploy 1.0.0.115 Fixed the performance counter sink name of the external ver… Oct 29, 2018
Amazon.KinesisTap.DiagnosticTool Added the ability to add header when replicating files. Oct 30, 2018
Amazon.KinesisTap.EtwEvent.Test Added the ability to add header when replicating files. Oct 30, 2018
Amazon.KinesisTap.ExchangeSource Added the ability to add header when replicating files. Oct 30, 2018
Amazon.KinesisTap.Hosting Added the ability to add header when replicating files. Oct 30, 2018
Amazon.KinesisTap.Test.Common Added the ability to add header when replicating files. Oct 30, 2018
Amazon.KinesisTap.Uls.Test Added the ability to add header when replicating files. Oct 30, 2018
Amazon.KinesisTap.Uls Added the ability to add header when replicating files. Oct 30, 2018
Amazon.KinesisTap.Windows.Test Added the ability to add header when replicating files. Oct 30, 2018
Amazon.KinesisTap.Windows Added the ability to add header when replicating files. Oct 30, 2018
Amazon.KinesisTap Added the ability to add header when replicating files. Oct 30, 2018
ChocolateyTemplate 1.0.0.115 Fixed the performance counter sink name of the external ver… Oct 29, 2018
.gitattributes 1.0.0.115 Fixed the performance counter sink name of the external ver… Oct 29, 2018
.gitignore 1.0.0.115 Fixed the performance counter sink name of the external ver… Oct 29, 2018
AWSKinesisTap.sln 1.0.0.115 Fixed the performance counter sink name of the external ver… Oct 29, 2018
CODE_OF_CONDUCT.md Creating initial file from template Aug 14, 2018
CONTRIBUTING.md Creating initial file from template Aug 14, 2018
LICENSE Creating initial file from template Aug 14, 2018
NOTICE Creating initial file from template Aug 14, 2018
README.md Updated README.md Nov 6, 2018
build.ps1 1.0.0.115 Fixed the performance counter sink name of the external ver… Oct 29, 2018
buildspec.yml 1.0.0.115 Fixed the performance counter sink name of the external ver… Oct 29, 2018

README.md

Amazon Kinesis Agent for Microsoft Windows

The Amazon Kinesis Agent for Microsoft Windows is a configurable and extensible agent. It runs on Windows systems, either on-premises or in the AWS Cloud. Kinesis Agent efficiently and reliably gathers, parses, transforms, and streams logs, events, and metrics to various AWS services, including Amazon Kinesis Data Streams, Amazon Kinesis Data Firehose, Amazon CloudWatch, and Amazon CloudWatch Logs.

Features

  • Monitors log files, Windows Event Logs, Event Tracing for Windows (ETW), Windows Performance Counters and sends data records to AWS services
  • Parses generic logs formats as well as special log formats commonly found in Windows environments, Domain Controllers, Internet Information (IIS)/W3SVC, Exchange family of logs, SharePoint, DHCP, Radius, and SQL Server
  • Performs data extraction, filtering, decoration, and formats data as structure logs.
  • Handles different kinds of log rotation approaches and accessing log files even when those logs files are locked by log writers
  • Provides data about the health of the agent itself which confirms the accuracy and completeness of the data collected and streamed

Getting started

  1. Minimum requirements — To start the Amazon Kinesis Agent for Windows, you need Microsoft .NET Framework 4.6.
  2. Installing, configurating and starting Kinesis Agent for Windows — For more information, see Kinesis Agent for Windows User Guide.

Installing Amazon Kinesis Agent for Windows

From an elevated PowerShell command prompt window, execute the following command:

Invoke-Expression ((New-Object System.Net.WebClient).DownloadString('https://s3-us-west-2.amazonaws.com/kinesis-agent-windows/downloads/InstallKinesisAgent.ps1'))

For other installation options, visit the Kinesis Agent for Windows download page.

Configuring and starting Amazon Kinesis Agent for Windows

Note: During the development of Kinesis Agent for Windows, the internal name was "AWSKinesisTap". To maintain backward compatibility, we have maintained this terminology within the agent's configuration.

After the Kinesis Agent for Windows is installed, the configuration file can be found in C:\Program Files\Amazon\AWSKinesisTap\appsettings.json. You need to modify this configuration file to set the data destinations and AWS credentials, and to point the agent to the data sources to push. After you complete the configuration, you can start the agent using the following command from an elevated PowerShell command prompt window:

Start-Service -Name AWSKinesisTap

You can make sure the agent is running with the following command:

Get-Service -Name AWSKinesisTap

To stop the agent, use the following command:

Stop-Service -Name AWSKinesisTap

Viewing the Amazon Kinesis Agent for Windows log file

The agent writes its logs to C:\ProgramData\Amazon\AWSKinesisTap\logs\KinesisTap.log.

Uninstalling Amazon Kinesis Agent for Windows

To uninstall the agent, go to “Add or remove program” applet, locate AWSKinesisTap and click Uninstall.

Telemetry

So that we can provide better support, by default, Amazon Kinesis Agent for Microsoft Windows collects statistics about the operation of the agent and sends them to AWS. This information contains no personally identifiable information, and it doesn't include any data that you gather or stream to AWS services. You can opt-out of telemetry collection.

Building from the source code

You need Visual Studio 2017 Community, Professional or Enterprise on Windows to build the project. To run and debug the project in Visual Studio, open AWSKinesisTap.sln in the project root directory. To build the nuget package, make sure you have nuget.exe in the path, open an elevated PowerShell command prompt, navigate to the project root directory, and run “.\build.ps1”.

Release Notes

Release 1.0.0.115 (November 6, 2018)

  • This is the first release.

Other resources