Skip to content

Commit

Permalink
[filebeat][azure-blob-storage] - Made input GA and updated logs accor…
Browse files Browse the repository at this point in the history
…dingly (elastic#37128)

* made azure blob storage input ga and updated logs accordingly

* updated changelog

---------

Co-authored-by: Bharat Pasupula <123897612+bhapas@users.noreply.github.com>
  • Loading branch information
2 people authored and Scholar-Li committed Feb 5, 2024
1 parent 0b31f6c commit 5809bb1
Show file tree
Hide file tree
Showing 3 changed files with 3 additions and 6 deletions.
1 change: 1 addition & 0 deletions CHANGELOG.next.asciidoc
Expand Up @@ -210,6 +210,7 @@ Setting environmental variable ELASTIC_NETINFO:false in Elastic Agent pod will d
- Add network processor in addition to interface based direction resolution. {pull}37023[37023]
- Add setup option `--force-enable-module-filesets`, that will act as if all filesets have been enabled in a module during setup. {issue}30915[30915] {pull}99999[99999]
- Make CEL input log current transaction ID when request tracing is turned on. {pull}37065[37065]
- Made Azure Blob Storage input GA and updated docs accordingly. {pull}37128[37128]
- Add request trace logging to http_endpoint input. {issue}36951[36951] {pull}36957[36957]
- Made GCS input GA and updated docs accordingly. {pull}37127[37127]

Expand Down
Expand Up @@ -9,8 +9,6 @@
<titleabbrev>Azure Blob Storage</titleabbrev>
++++

Beta[Input]

Use the `azure blob storage input` to read content from files stored in containers which reside on your Azure Cloud.
The input can be configured to work with and without polling, though currently, if polling is disabled it will only
perform a one time passthrough, list the file contents and end the process. Polling is generally recommented for most cases
Expand All @@ -27,8 +25,6 @@ even though it can get expensive with dealing with a very large number of files.
3. If any major error occurs which stops the main thread, the logs will be appropriately generated,
describing said error.

NOTE: In the latest update the partial save mechanism has been removed for now due to concurrency issues, but will be added back in the future.

[id="supported-types"]
NOTE: NOTE: Currently only `JSON` and `NDJSON` are supported blob/file formats. Blobs/files may be also be gzip compressed.
As for authentication types, we currently have support for `shared access keys` and `connection strings`.
Expand Down Expand Up @@ -364,4 +360,4 @@ In this configuration even though we have specified `max_workers = 10`, `poll =
will override these values with their own respective values which are defined as part of their sub attibutes.


NOTE: Since this is a beta input, any feedback is welcome, which will help us optimise and make it better going forward.
NOTE: Any feedback is welcome which will help us further optimize this input. Please feel free to open a github issue for any bugs or feature requests.
2 changes: 1 addition & 1 deletion x-pack/filebeat/input/azureblobstorage/input.go
Expand Up @@ -36,7 +36,7 @@ const (
func Plugin(log *logp.Logger, store cursor.StateStore) v2.Plugin {
return v2.Plugin{
Name: inputName,
Stability: feature.Beta,
Stability: feature.Stable,
Deprecated: false,
Info: "Azure Blob Storage logs",
Doc: "Collect logs from Azure Blob Storage Service",
Expand Down

0 comments on commit 5809bb1

Please sign in to comment.