Release v0.10.5

What's Changed

• fix: include all search events in usage reporting by @Subhra264 in #3370
• fix: same role and group name in rbac with diff org conflicts by @Subhra264 in #3359
• fix: introduce realtime alert triggers cache by @Subhra264 in #3340
• perf: improve wal parquet load speed by @hengfeiyang in #3376
• perf: improve wal parquet load speed by @hengfeiyang in #3378
• chore(deps): bump EmbarkStudios/cargo-deny-action from 1.6.2 to 1.6.3 by @dependabot in #3377
• perf: optimize compactor reduce some optimizers for datafusion by @hengfeiyang in #3382
• fix: removed clear localstorage for 401 redirection. Selected local s… by @bjp232004 in #3384
• fix: schema version on new field addition by @oasisk in #3385
• fix: include next_run_at in the realtime triggers usage reporting by @Subhra264 in #3383

🐳 Docker Images

Available at:

• https://gallery.ecr.aws/zinclabs/openobserve
• https://hub.docker.com/r/openobserve/openobserve/tags

Version tags:

• public.ecr.aws/zinclabs/openobserve:v0.10.5
• public.ecr.aws/zinclabs/openobserve:v0.10.5-simd
• openobserve/openobserve:v0.10.5
• openobserve/openobserve:v0.10.5-simd

📒 Documentation: https://openobserve.ai/docs/

Full Changelog: v0.10.4...v0.10.5

Release v0.10.4

What's Changed

• fix: apply saved view error fix by @bjp232004 in #3350
• fix: traces duration conflict by @hengfeiyang in #3351
• fix: isDashboardLoaded flag issue for print mode by @ktx-abhay in #3354
• fix: for report generation, headless chrome should first navigate to the given org by @Subhra264 in #3352
• feat: UI for CloudWatch Metrics ingestion by @taimingl in #3349
• fix: remove duplicated stream name on cloudwatch logs endpoint by @taimingl in #3356
• fix: added compressed size by @bjp232004 in #3357
• fix: user login flow fixes by @oasisk in #3358
• fix: load disk query cache by @hengfeiyang in #3361
• fix: id token length issue by @oasisk in #3360
• feat: add support for smtp 'reply to' for alerts and reports by @Subhra264 in #3363
• fix: Add logo settings to rbac by @Subhra264 in #3366
• fix: value API is always waiting by @hengfeiyang in #3364
• fix: enrichment table field name format by @hengfeiyang in #3369
• fix: format stream name for _bulk api by @oasisk in #3371

🐳 Docker Images

Available at:

• https://gallery.ecr.aws/zinclabs/openobserve
• https://hub.docker.com/r/openobserve/openobserve/tags

Version tags:

• public.ecr.aws/zinclabs/openobserve:v0.10.4
• public.ecr.aws/zinclabs/openobserve:v0.10.4-simd
• openobserve/openobserve:v0.10.4
• openobserve/openobserve:v0.10.4-simd

📒 Documentation: https://openobserve.ai/docs/

Full Changelog: v0.10.3...v0.10.4

Release v0.10.3

What's Changed

• fix: schema cache error with prefix by @hengfeiyang in #3338
• feat: introduce cached_ratio to usage reporting for search usage type by @Subhra264 in #3341
• fix: remove unused code by @hengfeiyang in #3342
• fix: report headless chrome url by @Subhra264 in #3344
• fix: histogram pagination fix by @bjp232004 in #3339
• fix: user session id by @oasisk in #3343
• fix: extrace field name in where clause by @haohuaijin in #3346
• feat: CloudWatch metrics ingestion by @taimingl in #3322
• fix: report cache and alert manager should install chrome by @Subhra264 in #3348

🐳 Docker Images

Available at:

• https://gallery.ecr.aws/zinclabs/openobserve
• https://hub.docker.com/r/openobserve/openobserve/tags

Version tags:

• public.ecr.aws/zinclabs/openobserve:v0.10.3
• public.ecr.aws/zinclabs/openobserve:v0.10.3-simd
• openobserve/openobserve:v0.10.3
• openobserve/openobserve:v0.10.3-simd

📒 Documentation: https://openobserve.ai/docs/

Full Changelog: v0.10.2...v0.10.3

Release v0.10.2

What's Changed

• feat: add a new option for limit merge on ingester by @hengfeiyang in #3279
• chore: fix some typos in comments by @goodactive in #3281
• fix: add more debug logs for search by @hengfeiyang in #3280
• ci: integrate an ok-to-test pull-request command by @ansrivas in #3287
• ci: bump up the dependencies of ok-to-test by @ansrivas in #3292
• fix: for forked pull-requests pick up the correct git ref by @ansrivas in #3293
• ci: try to fetch the git-tag early with merge-commit by @ansrivas in #3294
• ci: force retrieve the missing tags by @ansrivas in #3295
• ci: force retrieve the missing tags and use v3 of checkout by @ansrivas in #3296
• ci: force retrieve the missing tags with git-describe by @ansrivas in #3297
• ci: update the status of the run by @ansrivas in #3298
• ci: update the status of the run by @ansrivas in #3299
• ci: try with actions v4 by @ansrivas in #3300
• ci: use the sha as the ref by @ansrivas in #3301
• ci: use the sha as the ref by @ansrivas in #3302
• ci: use the GIT_SHA which was requested by the /ok-to-test cmd by @ansrivas in #3303
• perf: improve json->recordbatch speed by @haohuaijin in #3278
• fix: sql fields parse error by @hengfeiyang in #3304
• chore(deps): bump rustls from 0.21.10 to 0.21.11 by @dependabot in #3286
• feat: improve tokio-console config by @domyway in #3274
• fix: added check for duplicate config api call. by @bjp232004 in #3305
• feat: sync scheduler in super cluster by @hengfeiyang in #3309
• fix: enterprise build by @hengfeiyang in #3312
• fix: don't use stream_type from query params for alert create/update by @Subhra264 in #3311
• fix: API rule optimize let search UI works without ingester by @hengfeiyang in #3314
• fix: show savedview and report resources in role permissions and fix list_objects_for_user for _all_{org} by @Subhra264 in #3284
• docs: added the generated sbom for js by @ansrivas in #3315
• feat: auto complete for promql legend, variables, filters, drilldown variables by @ktx-vaidehi in #3153
• fix: alert url by @hengfeiyang in #3320
• fix: reply wal error by @hengfeiyang in #3323
• fix: alert url query fix by @bjp232004 in #3325
• fix: fixed functions menu visibility by @omkarK06 in #3324
• fix: fix some typos in comments by @findmyhappy in #3328
• fix: #3326 by @hengfeiyang in #3327
• fix: add querier cache hit ratio by @hengfeiyang in #3329
• fix: build for enterprise by @hengfeiyang in #3330

🐳 Docker Images

Available at:

• https://gallery.ecr.aws/zinclabs/openobserve
• https://hub.docker.com/r/openobserve/openobserve/tags

Version tags:

• public.ecr.aws/zinclabs/openobserve:v0.10.2
• public.ecr.aws/zinclabs/openobserve:v0.10.2-simd
• openobserve/openobserve:v0.10.2
• openobserve/openobserve:v0.10.2-simd

📒 Documentation: https://openobserve.ai/docs/

New Contributors

• @goodactive made their first contribution in #3281
• @findmyhappy made their first contribution in #3328

Full Changelog: v0.10.2-rc1...v0.10.2

Release v0.10.2-rc1

What's Changed

• fix: flush usage report data when server is stopped by @Subhra264 in #3255
• feat: add audit trails for enterprise version by @Subhra264 in #3211
• fix: excluded iam route by @bjp232004 in #3257
• fix: dashboard query inspector time based on its time zone by @ktx-vaidehi in #3256
• fix: add order by field to select when need by @haohuaijin in #3259
• chore: fix some typos in comments by @hugehope in #3219
• fix: improve default list of split characters by @prabhatsharma in #3260
• ci: add tokio-console build by @hengfeiyang in #3264
• feat: add new option allow skip disk cache check when cache in memory by @hengfeiyang in #3253
• perf: add a job to clean empty dir to let scan_dir faster by @hengfeiyang in #3266
• docs: fix some typos in comments by @momantech in #3267
• fix: flush triggers usage reporting when server is stopped by @Subhra264 in #3269
• fix: migration from old TRIGGERS to scheduled jobs by @Subhra264 in #3268
• fix: correctly parse old trigger details and migrate into scheduled_jobs by @Subhra264 in #3270
• refactor: trigger migration by @hengfeiyang in #3272
• perf: only register used fields to datafusion by @haohuaijin in #3248
• fix: added ingestion message if no data ingested by @bjp232004 in #3275
• fix: discard the records when found evolution start_dt smaller than current by @hengfeiyang in #3276
• fix: only search longest term in multi-terms by @taimingl in #3261
• feat: routing & user defined schema restrictions by @oasisk in #3254

New Contributors

• @hugehope made their first contribution in #3219
• @momantech made their first contribution in #3267

Full Changelog: v0.10.1...v0.10.2-rc1

Release v0.10.1

What's Changed

• fix: token issue for different provider by @bjp232004 in #3247
• feat: only enable tracing in search by @haohuaijin in #3230
• fix: dashboard view panel scroll issue by @ktx-abhay in #3245
• perf: improve merge parquet speed when fields too many by @haohuaijin in #3231
• fix: cookies issue for SSO by @oasisk in #3244

🐳 Docker Images

Available at:

• https://gallery.ecr.aws/zinclabs/openobserve
• https://hub.docker.com/r/openobserve/openobserve/tags

Version tags:

• public.ecr.aws/zinclabs/openobserve:v0.10.1
• public.ecr.aws/zinclabs/openobserve:v0.10.1-simd
• openobserve/openobserve:v0.10.1
• openobserve/openobserve:v0.10.1-simd

📒 Documentation: https://openobserve.ai/docs/

Full Changelog: v0.10.0...v0.10.1

Release v0.10.0

📢 Breaking change

1. We changed meta table schema and will add start_dt column and also changed the index, we will auto-backup the meta table and do auto-upgrade, but if you can, please backup your metadata. As part of automatic migration we backup meta table to meta_backup_20240330 ,it has all schema versions of a schema in single DB row
2. We no longer support DynamoDB and Sled from this version. If you are using them, please use the old version (<= 0.9.2) and migrate to MySQL or PostgreSQL first.
3. We only support MySQL and PostgreSQL as metadata store for cluster mode from this version, and support SQLite as default for local mode.
4. We support both NATS and Etcd as cluster coordinator from this version. you can set ZO_CLUSTER_COORDINATOR=nats to enable NATS to replace Etcd.
5. ⚠️⚠️⚠️Once you start using this version, you shouldn't rollback to 0.9.x version, this version includes db changes , which are incompatible with previous versions. If applications is running in cluster mode please scale all deployments to zero only use single compactor to upgrade to v0.10.0 after upgrade and everything work well, we can scale up application to desired state.

New Features

• Customization & UI Enhancements:

  • Introduced UI changes for custom logos and interesting fields. Now supports enterprise API for uploading/deleting custom logos. (#3030, #3058, #3034)
  • Dashboard improvements include table text wrap and cascading variables for enhanced user experience. (#3026, #3022)
  • Added regexp_match_to_fields UDF and storage_type label for storage_time to enrich data manipulation capabilities. (#3041, #3063)
  • Implemented dashboard reporting UI for better data visualization and report management. (#3098)
  • Launched super cluster feature for advanced cluster management and performance. (#3039, #3226)
  • Added queue to infrastructure for improved job handling. (#3051)
  • Enhanced trace visibility and added SBOM (Software Bill of Materials) for better security and compliance. (#3095, #3197, #3202)

• Performance & Optimization:

  • Significant performance improvements in field search by hashmap, ingestion load, and disk cache management. (#3096, #3218, #3196)
  • Optimized ingester functions and introduced backend job for loading disk cache to reduce memory usage. (#3201, #3196)
  • Improved database alert table and node cache status for faster access and reliability. (#3168, #3169)

• Security & Stability:

  • Enhanced security measures with CSP unsafe-eval fixes, cookie settings as environment variables, and sanitized HTML rendering. (#3118, #3152, #3167)
  • Stability improvements with fixes to WAL on Windows, schema inference issues, and error handling enhancements. (#3184, #3127, #3128, #3187)

• API & Schema Enhancements:

  • Introduced reports in the backend, replacing TRIGGERS with infra::scheduler, and added new endpoints for health check and logout. (#3086, #3090, #3212)
  • Schema enhancements including lock per request per stream, separate key for schema versions, and complete super cluster implementation. (#3110, #3021, #3226)

• Developer Experience:

  • Improved secret handling in forks, added database lock to replace etcd lock, and enabled query cancellation by session ID for better control. (#3111, #3107, #3130)
  • Code refactoring and debug enhancements for a smoother development process. (#3141, #3194)

Fixes & Improvements

• Multiple bug fixes addressing issues from cache handling, page loading states, to schema settings retention and search functionalities. (e.g., #2955, #2970, #2971, #2972, #2989, #2993, #2998, #2999, #3007, #3008, #3027, #3028, #3032, #3036, #3037, #3040, #3043, #3048, #3049, #3052, #3059, #3064, #3066, #3068, #3072, #3075, #3079, #3082, #3083, #3085, #3093, #3101, #3103, #3105, #3106, #3108, #3114, #3117, #3123, #3126, #3127, #3128, #3133, #3135, #3137, #3138, #3140, #3142, #3144, #3145, #3146, #3147, #3149, #3151, #3155, #3162, #3164, #3166, #3167, #3169, #3170, #3181, #3183, #3184, #3186, #3187, #3189, #3191, #3192, #3193, #3194, #3195, #3196, #3200, #3205, #3206, #3208, #3210, #3213, #3223, #3224, #3225, #3227, #3228, #3229, #3237, #3238, #3239, #3242, #3243)
• Addressed UI issues in RUM error explorer, dashboard variable dropdowns, and custom logo spacing.
• Resolved critical issues such as root user access, duplicate requests, and stream page loading states.
• Corrected typos and updated dependencies for better performance and security.

Testing & Maintenance

• Enhanced test coverage with new test cases for search queries, aggregation queries, drilldown tests, and quick mode. (e.g., #3031, #3046, #3064, #3070, #3115, #3116, #3124, #3145)
• Continuous integration improvements with support for JavaScript license file checker and profiling CPU for OpenObserve. (#3203, #3183)

This release brings a plethora of new features, performance optimizations, and bug fixes aimed at improving the user experience, security, and stability of our platform. We thank our contributors for their hard work and dedication.

🐳 Docker Images

Available at:

• https://gallery.ecr.aws/zinclabs/openobserve
• https://hub.docker.com/r/openobserve/openobserve/tags

Version tags:

• public.ecr.aws/zinclabs/openobserve:v0.10.0
• public.ecr.aws/zinclabs/openobserve:v0.10.0-simd
• openobserve/openobserve:v0.10.0
• openobserve/openobserve:v0.10.0-simd

📒 Documentation: https://openobserve.ai/docs/

New Contributors

• @taimingl made their first contribution in #3041
• @worrycare made their first contribution in #3104
• @deterclosed made their first contribution in #3080
• @RanolP made their first contribution in #3151
• @yonas made their first contribution in #3164

Full Changelog: v0.9.1...v0.10.0

Release v0.9.2-rc1

What's Changed

• fix: cache latest file & cache stream fields by @hengfeiyang in #2955
• fix: allowed "-" & "_" in saved view name by @bjp232004 in #2968
• fix: duplicate request on page refresh while sql mode on by @bjp232004 in #2970
• fix: stream page loading state by @bjp232004 in #2971
• fix: field not found when merging by @hengfeiyang in #2972
• fix: added v-else by @bjp232004 in #2977
• fix: search field not found by @hengfeiyang in #2989
• fix: root user should have access to everything by @oasisk in #2993
• fix: RUM error explorer UI issues (#2990) by @omkarK06 in #2998
• fix: search field not found by @hengfeiyang in #2999
• fix: set rum user for non cloud by @bjp232004 in #3008
• fix: search field not found by @hengfeiyang in #3007
• feat: merge dev into main by @hengfeiyang in #3016
• fix: Disabled user email field for filtering RUM sessions by @omkarK06 in #3027
• fix: loading state while clicking on refresh streams by @bjp232004 in #3028
• fix: removed redirection by @bjp232004 in #3032
• feat: update datafusion to 36 by @hengfeiyang in #3035
• fix: report user email for values & search around by @oasisk in #3036
• test: prepopulate the amount of data for each test #3000 by @ansrivas in #3031
• fix: pagination disable on limit query by @bjp232004 in #3037

🐳 Docker Images

Available at:

• https://gallery.ecr.aws/zinclabs/openobserve
• https://hub.docker.com/r/openobserve/openobserve/tags

Version tags:

• public.ecr.aws/zinclabs/openobserve:v0.9.2-rc1
• public.ecr.aws/zinclabs/openobserve:v0.9.2-rc1-simd
• openobserve/openobserve:v0.9.2-rc1
• openobserve/openobserve:v0.9.2-rc1-simd

📒 Documentation: https://openobserve.ai/docs/

Full Changelog: v0.9.1...v0.9.2-rc1

Release v0.9.1

What's Changed

• feat: Sankey chart by @ktx-vaidehi in #2678
• chore: role mapping issues by @oasisk in #2707
• fix: Update ja.json by @kenshirobot in #2702
• perf: improve traces ingestion by @hengfeiyang in #2708
• fix: pagination sorting issue by @bjp232004 in #2713
• fix: added missing test id's in IAM by @omkarK06 in #2715
• fix: fixed editing non aggregated alerts by @omkarK06 in #2718
• feat: add freqency for alert API by @hengfeiyang in #2719
• fix: added frequency input in alerts by @omkarK06 in #2720
• fix: chart type switching with sankey by @ktx-vaidehi in #2721
• fix: templates & destination permissions by @oasisk in #2724
• fix: fixed filtering on stream resources in IAM by @omkarK06 in #2723
• perf: optimize file_list table index by @hengfeiyang in #2727
• fix: pagination unwanted call by @bjp232004 in #2729
• fix: map group claim to role by @oasisk in #2732
• perf: cache latest files by @hengfeiyang in #2734
• chore(deps): bump EmbarkStudios/cargo-deny-action from 1.5.13 to 1.5.15 by @dependabot in #2730
• fix: added dashboard id in column by @ktx-vaidehi in #2735
• fix: generate password by @oasisk in #2736
• fix(alert): support sql mode in alert_url by @haohuaijin in #2738
• feat: unit for dashboard table chart by @ktx-abhay in #2739
• fix: set node online again by @hengfeiyang in #2741
• feat: dashboard drilldown to another dashboard by @ktx-abhay in #2660
• fix: _value API with query_context by @hengfeiyang in #2744
• fix: capture payment detail by @bjp232004 in #2726
• fix: dashboard permissions issue by @oasisk in #2745
• fix: performance improvement by @bjp232004 in #2743
• feat: IAM adding permissions in JSON format by @omkarK06 in #2742
• perf: improve per thread lock by @hengfeiyang in #2752
• fix: create file logs for ingester by @hengfeiyang in #2753
• fix: streams optimization by @omkarK06 in #2748
• fix: dashboard streams not loaded when switched between chart types like HTML and Markdown by @ktx-kirtan in #2756
• fix: RUM UI fixes by @omkarK06 in #2599
• fix: on chart type change stream field list rendering issue in add panel by @ktx-abhay in #2757
• fix: refresh stats adding streams on list by @bjp232004 in #2758
• fix: unit test issue by @oasisk in #2761
• fix: dashboard maps filters by @ktx-vaidehi in #2522
• fix: dashboard drilldown url creation issue for new tab by @ktx-abhay in #2763
• perf: improve enrichmentTable by @hengfeiyang in #2764
• fix: RBAC get all streams issues by @omkarK06 in #2768
• feat: add an option to enable bloom filter on all fields by @hengfeiyang in #2769
• fix: on folder delete show correct error message by @ktx-abhay in #2766
• fix: rewrite count(distinct(field)) to three phase to get correct result by @haohuaijin in #2770
• fix: dashboard geomap initial saved panels size by @ktx-vaidehi in #2781
• fix: add some debug for stream stats by @hengfeiyang in #2782
• fix: dashboard tooltip and drilldown issue by @ktx-abhay in #2783
• feat: Updated stream creation and stream settings by @omkarK06 in #2778
• fix: list should return only allowed objects by @oasisk in #2785
• fix: can't create same name alerts by @hengfeiyang in #2786
• fix: histogram fix by @bjp232004 in #2791
• fix: Search around logs page by @bjp232004 in #2795
• fix: watchers to read from db by @oasisk in #2798
• fix: fixed issues in add and update streams by @omkarK06 in #2797
• fix: organization change not loads stream data by @bjp232004 in #2802
• fix: change ZO_RESTRICTED_ROUTES_ON_EMPTY_DATA default to false by @prabhatsharma in #2803
• fix: organization change not refresh the page data by @bjp232004 in #2806
• fix: streams filtering by @omkarK06 in #2808
• test: removed stream settings testcase by @neha00290 in #2809
• feat: introduce SMTP env configurations by @Subhra264 in #2810
• perf: add a new configure to enable infer schema in datafusion by @hengfeiyang in #2811
• fix: added test id for stream search input by @omkarK06 in #2814
• perf: Imporve ingester speed by @haohuaijin in #2794
• feat: merge setting fields and default fields by @hengfeiyang in #2816
• fix: issue 2793 by @bjp232004 in #2817
• perf: optimize select * when the table have more than 1000 fields by @haohuaijin in #2813
• feat: inverted index v1 by @ansrivas in #2821
• fix: Improve Korean translations by @lens0021 in #2818
• fix: change value length for meta in MySQL by @hengfeiyang in #2823
• fix: change the placeholders by @oasisk in #2830
• fix: Incorrect logs displayed on switching sql mode on and off & fixe… by @bjp232004 in #2824
• fix: pin rye to 0.27.0 by @ansrivas in #2835
• test: run logs breaking testcase by @neha00290 in #2833
• fix: schema evolution by @hengfeiyang in #2838
• fix: inverted index failure by @oasisk in #2837
• feat: dashboard print by @ktx-vaidehi in #2760
• perf: tradeof between query performance and ingester performance by @haohuaijin in #2842
• feat: introduce alert emails in backend by @Subhra264 in #2825
• feat: impl FIFO for query cache by @haohuaijin in #2834
• chore(deps): bump axios and start-server-and-test in /web by @dependabot in #2754
• fix: some comments by @cuishuang in #2843
• fix: UI improvements in alerts by @omkarK06 in #2845
• fix: inverted index issue by @oasisk in #2847
• perf: let parquet_max_row_group_size configurable by @hengfeiyang in #2850
• fix: inverted index min ts issue by @oasisk in #2854
• chore(deps): bump eifinger/setup-rye from 1 to 2 by @dependabot in #2853
• chore(deps): bump mio from 0.8.10 to 0.8.11 by @dependabot in #2855
• fix: missing drilldown name data-test id by @ktx-abhay in #2859
• fix: search got parquet not found by @hengfeiyang in #2860
• fix: inverted index switch file format by @oasisk in #2857
• fix: pagination issue while histogr...

Release v0.9.0-rc8

What's Changed

• fix: debug inverted index by @hengfeiyang in #2926
• fix: inverted index count by @hengfeiyang in #2928

Full Changelog: v0.9.0-rc7...v0.9.0-rc8