This changelog is intended for community Beat developers. It covers the major
breaking changes to the internal APIs in the official Beats and changes related
to developing a Beat like code generators or fields.yml
. Only the major
changes will be covered in this changelog that are expected to affect community
developers. Each breaking change added here should have an explanation on how
other Beats should be migrated.
Note: This changelog documents the current changes which are not yet present in an actual release.
The list below covers the major changes between 7.0.0-rc2 and master only.
-
Move Fields from package libbeat/common to libbeat/mapping. 11198
-
For "metricbeat style" generated custom beats, the mage target
GoTestIntegration
has changed toGoIntegTest
andGoTestUnit
has changed toGoUnitTest
. 13341 -
Build docker and kubernetes features only on supported platforms. 13509
-
Need to register new processors to be used in the JS processor in their
init
functions. 13509 -
The custom beat generator now uses mage instead of python,
mage GenerateCustomBeat
can be used to create a new beat, andmage vendorUpdate
to update the vendored libbeat in a custom beat. 13610 -
Altered all remaining uses of mapval to use the renamed and enhanced version: go-lookslike instead, which is a separate project. The mapval tree is now gone. 14165
-
Move light modules to OSS. 14369
-
Stop using
mage:import
in community beats. This was ignoring the vendorized beats directory for some mage targets, using the code available in GOPATH, this causes inconsistencies and compilation problems if the version of the code in the GOPATH is different to the vendored one. Use ofmage:import
will continue to be unsupported in custom beats till beats is migrated to go modules, or mage supports vendored dependencies. 13998 14162
-
Make the behavior of clientWorker and netClientWorker consistent when error is returned from publisher pipeline
-
Metricset generator generates beta modules by default now. 10657
-
The
beat.Event
accessor methods now support@metadata
keys. 10761 -
Assertion for documented fields in tests fails if any of the fields in the tested event is documented as an alias. 10921
-
Support for Logger in the Metricset base instance. 11106
-
Filebeat modules can now use ingest pipelines in YAML format. 11209
-
Prometheus helper for metricbeat contains now
Namespace
field forprometheus.MetricsMappings
11424 -
Update Jinja2 version to 2.10.1. 11817
-
Reduce idxmgmt.Supporter interface and rework export commands to reuse logic. 11777,elastic#12065
-
Update urllib3 version to 1.24.2 11930
-
Add libbeat/common/cleanup package. 12134
-
New helper to check for leaked goroutines on tests. 12106
-
Only Load minimal template if no fields are provided. 12103
-
Add new option
IgnoreAllErrors
tolibbeat.common.schema
for skipping fields that failed while converting. 12089 -
Deprecate setup cmds for
template
andilm-policy
. Add new setup cmd forindex-management
. 12132 -
Use the go-lookslike library for testing in heartbeat. Eventually the mapval package will be replaced with it. 12540
-
New ReporterV2 interfaces that can receive a context on
Fetch(ctx, reporter)
, orRun(ctx, reporter)
. 11981 -
Generate configuration from
mage
for all Beats. 12618 -
Add ClientFactory to TCP input source to add SplitFunc/NetworkFuncs per client. 8543
-
Introduce beat.OutputChooses publisher mode. 12996
-
Ensure that beat.Processor, beat.ProcessorList, and processors.ProcessorList are compatible and can be composed more easily. 12996
-
Add support to close beat.Client via beat.CloseRef (a subset of context.Context). 13031
-
Add checks for types and formats used in fields definitions in
fields.yml
files. 13188 -
Makefile included in generator copies files from beats repository using
git archive
instead of cp. 13193 -
Strip debug symbols from binaries to reduce binary sizes. 12768
-
Compare event by event in
testadata
framework to avoid sorting problems 13747 -
Added a
default_field
option to fields in fields.yml to offer a way to exclude fields from the default_field list. 14262 14341 -
supported-versions.yml
can be used in metricbeat python system tests to obtain the build args for docker compose builds. 14520