v0.14.0-victorialogs

Released at 2024-05-29

• FEATURE: allow specifying fields, which must be packed into JSON in pack_json pipe via pack_json fields (field1, ..., fieldN) syntax.

• BUGFIX: properly apply if (...) filters to calculated results in stats pipe when grouping by fields is enabled. For example, _time:5m | stats by (host) count() logs, count() if (error) errors now properly calculates per-host errors.

v0.13.0-victorialogs

Released at 2024-05-28

• FEATURE: add extract_regexp pipe for extracting arbitrary substrings from log fields with RE2 egular expressions.
• FEATURE: add math pipe for mathematical calculations over log fields.
• FEATURE: add field_values pipe, which returns unique values for the given log field.
• FEATURE: allow omitting stats prefix in stats pipe. For example, _time:5m | count() rows is a valid query now. It is equivalent to _time:5m | stats count() as rows.
• FEATURE: allow omitting filter prefix in filter pipe if the filter doesn't clash with pipe names. For example, _time:5m | stats by (host) count() rows | rows:>1000 is a valid query now. It is equivalent to _time:5m | stats by (host) count() rows | filter rows:>1000.
• FEATURE: allow head pipe without number. For example, error | head. In this case 10 last values are returned as head Unix command does by default.
• FEATURE: allow using comparison filters with strings. For example, some_text_field:>="foo" matches log entries with some_text_field field values bigger or equal to foo.

v0.12.1-victorialogs

Released at 2024-05-26

• FEATURE: add support for comments in multi-line LogsQL queries. See these docs.

• BUGFIX: properly apply in(...) filter inside if (...) conditions at various pipes. This bug has been introduced in v0.12.0.

v0.12.0-victorialogs

Released at 2024-05-26

• FEATURE: add pack_json pipe, which packs all the log fields into a JSON object and stores it into the given field.

• FEATURE: add unroll pipe, which can be used for unrolling JSON arrays stored in log fields.

• FEATURE: add replace_regexp pipe, which allows updating log fields with regular expressions.

• FEATURE: improve performance for format and extract pipes.

• FEATURE: improve performance for /select/logsql/field_names HTTP API.

• BUGFIX: prevent from panic in sort pipe when VictoriaLogs runs on a system with one CPU core.

• BUGFIX: do not return referenced fields if they weren't present in the original logs. For example, _time:5m | format if (non_existing_field:"") "abc" could return empty non_exiting_field, while it shuldn't be returned because it is missing in the original logs.

• BUGFIX: properly initialize values for in(...) filter inside filter pipe if the in(...) contains other filters. For example, _time:5m | filter ip:in(user_type:admin | fields ip) now works correctly.

v0.11.0-victorialogs

Released at 2024-05-25

• FEATURE: add replace pipe, which allows replacing substrings in log fields.
• FEATURE: support comparing log field values with special numeric values. For example, duration:>1.5s and response_size:<15KiB are valid filters now.
• FEATURE: properly sort durations and short numeric values in sort pipe. For example, 10s goes in front of 1h, while 10KB goes in front of 1GB.
• FEATURE: add an ability to preserve the original non-empty field values when executing extract, unpack_json, unpack_logfmt and format pipes.
• FEATURE: add an ability to preserve the original field values if the corresponding unpacked values are empty when executing extract, unpack_json, unpack_logfmt and format pipes.

v0.10.0-victorialogs

Released at 2024-05-24

• FEATURE: return the number of matching log entries per returned value in HTTP API results. This simplifies detecting field / stream values with the biggest number of logs for the given LogsQL query.

• FEATURE: improve performance for regexp filter in the following cases:

  • If the regexp contains just a phrase without special regular expression chars. For example, ~"foo".
  • If the regexp starts with .* or ends with .*. For example, ~".*foo.*".
  • If the regexp contains multiple strings delimited by |. For example, ~"foo|bar|baz".
  • If the regexp contains multiple words. For example, ~"foo bar baz".

• FEATURE: allow disabling automatic unquoting of the matched placeholders in extract pipe. See these docs.

• BUGFIX: properly parse ! in front of exact filter, exact-prefix filter and regexp filter. For example, !~"some regexp" is properly parsed as not ="some regexp". Previously it was incorrectly parsed as '~="some regexp"' phrase filter.

• BUGFIX: properly sort results by _time field when limit pipe is applied. For example, _time:5m | sort by (_time) desc | limit 10 properly works now.

v0.9.1-victorialogs

Released at 2024-05-22

• BUGFIX: web UI: fix loading web UI, which has been broken in v0.9.0.

v0.9.0-victorialogs

Released at 2024-05-22

• FEATURE: allow using ~"some_regexp" regexp filter instead of re("some_regexp").

• FEATURE: allow using ="some phrase" exact filter instead of exact("some phrase").

• FEATURE: allow using ="some prefix"* exact prefix filter instead of exact("some prefix"*).

• FEATURE: add ability to generate output fields according to the provided format string. See these docs.

• FEATURE: add ability to extract fields with extract pipe only if the given condition is met. See these docs.

• FEATURE: add ability to unpack JSON fields with unpack_json pipe only if the given condition is met. See these docs.

• FEATURE: add ability to unpack logfmt fields with unpack_logfmt pipe only if the given condition is met. See these docs.

• FEATURE: add fields_min and fields_max functions for stats pipe, which allow returning all the log fields for the log entry with the minimum / maximum value at the given field.

• FEATURE: add /select/logsql/streams HTTP endpoint for returning streams from results of the given query. See these docs for details.

• FEATURE: add /select/logsql/stream_label_names HTTP endpoint for returning stream label names from results of the given query. See these docs for details.

• FEATURE: add /select/logsql/stream_label_values HTTP endpoint for returning stream label values for the given label from results of the given query. See these docs for details.

• FEATURE: web UI: change time range limitation from _time in the expression to start and end query args.

• BUGFIX: fix invalid memory address or nil pointer dereference panic when using extract, unpack_json or unpack_logfmt pipes. See this issue.

• BUGFIX: web UI: fix an issue where logs with long _msg values might not display. See this issue.

• BUGFIX: properly handle time range boundaries with millisecond precision. See this issue.

v0.8.0-victorialogs

Released at 2024-05-20

• FEATURE: add ability to extract JSON fields from log fields. See these docs.

• FEATURE: add ability to extract logfmt fields from log fields. See these docs.

• FEATURE: add ability to extract arbitrary text from log fields into the output fields. See these docs.

• FEATURE: add ability to put arbitrary queries inside in() filter.

• FEATURE: add support for post-filtering of query results with filter pipe.

• FEATURE: allow applying individual filters per each stats function. See these docs.

• FEATURE: allow passing string values to min and max functions. Previously only numeric values could be passed to them.

• FEATURE: speed up sort ... limit N pipe for typical cases.

• FEATURE: allow using more convenient syntax for range filters if upper or lower bound isn't needed. For example, it is possible to write response_size:>=10KiB instead of response_size:range[10KiB, inf), or temperature:<42 instead of temperature:range(-inf, 42).

• FEATURE: add /select/logsql/hits HTTP endpoint for returning the number of matching logs per the given time bucket over the selected time range. See tese docs for details.

• FEATURE: add /select/logsql/field_names HTTP endpoint for returning field names from results of the given query. See these docs for details.

• FEATURE: add /select/logsql/field_values HTTP endpoint for returning unique values for the given field obtained from results of the given query. See these docs for details.

• BUGFIX: properly take into account offset sort pipe when it already has limit. For example, _time:5m | sort by (foo) offset 20 limit 10.

v0.7.0-victorialogs

Released at 2024-05-15

• FEATURE: add support for optional start and end query args to HTTP querying API, which can be used for limiting the time range for LogsQL query.
• FEATURE: add ability to return the first N results from sort pipe. This is useful when N biggest or N smallest values must be returned from large amounts of logs.
• FEATURE: add quantile and median stats functions.