Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Update to latest netdata/master (#5)
* Expose anomaly-bit option to health. (netdata#12835) * Consider ZFS ARC shrinkable as cache on FreeBSD (netdata#12879) * Update dashboard to version v2.25.2. (netdata#12884) Co-authored-by: netdatabot <netdatabot@users.noreply.github.com> * [ci skip] Update changelog and version for nightly build: v1.34.0-148-nightly. * feat(proc/cgroups.plugin): add PSI stall time charts (netdata#12869) * Fix compilation warnings (netdata#12886) * chore(deps): bump docker/setup-buildx-action from 1 to 2 (netdata#12848) Bumps [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action) from 1 to 2. - [Release notes](https://github.com/docker/setup-buildx-action/releases) - [Commits](docker/setup-buildx-action@v1...v2) --- updated-dependencies: - dependency-name: docker/setup-buildx-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * chore(deps): bump docker/setup-qemu-action from 1 to 2 (netdata#12849) Bumps [docker/setup-qemu-action](https://github.com/docker/setup-qemu-action) from 1 to 2. - [Release notes](https://github.com/docker/setup-qemu-action/releases) - [Commits](docker/setup-qemu-action@v1...v2) --- updated-dependencies: - dependency-name: docker/setup-qemu-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * chore(deps): bump docker/login-action from 1 to 2 (netdata#12850) Bumps [docker/login-action](https://github.com/docker/login-action) from 1 to 2. - [Release notes](https://github.com/docker/login-action/releases) - [Commits](docker/login-action@v1...v2) --- updated-dependencies: - dependency-name: docker/login-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * chore(deps): bump docker/build-push-action from 2 to 3 (netdata#12851) Bumps [docker/build-push-action](https://github.com/docker/build-push-action) from 2 to 3. - [Release notes](https://github.com/docker/build-push-action/releases) - [Commits](docker/build-push-action@v2...v3) --- updated-dependencies: - dependency-name: docker/build-push-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Pause alert pushes to the cloud (netdata#12852) * pause and unpause alert pushes to the cloud * move the check to when creating opcode * check for worker * remove previous checks for dbsync_workers. queue and clean aclk_alert tables even if no workers are up. Get wc then check before setting pause * remove sync_syncronize * remove sync_synchronize_2 * Take into account the in queue wait time when executing a data query (netdata#12885) Take into account the in queue wait time when executing a query with a timeout * [ci skip] Update changelog and version for nightly build: v1.34.0-157-nightly. * Return stable or nightly based on version if the file check fails (netdata#12894) * Implements new capability fields in aclk_schemas (netdata#12602) use new capability fields * Remove CPU-specific info from cpuidle dimensions (netdata#12898) * Update reconnect node with kickstart info (netdata#12891) * Update reconnect node with kickstart info * Split stop from start Second change done because restart may very easily result in the agent failing to connect because of problematic handling of reconnections. * fix(cgroups.plugin): use correct identifier when registering the main thread "chart" worker job (netdata#12902) use main thread chart job registration * chore(worker_utilization): log an error when re-registering an already registered job (netdata#12903) * [ci skip] Update changelog and version for nightly build: v1.34.0-164-nightly. * Fix release channel in the node info message (netdata#12905) Fix release channel in the node info message (was hardcoded) * Fix compilation warnings in FreeBSD (netdata#12887) * [ci skip] Update changelog and version for nightly build: v1.34.0-167-nightly. * added worker jobs for cgroup-rename, cgroup-network and cgroup-first-time (netdata#12910) * chore(streaming): bump default "buffer size bytes" to 10MB (netdata#12913) * [ci skip] Update changelog and version for nightly build: v1.34.0-170-nightly. * fix(cgroups.plugin): improve check for uninitialized containers in k8s (netdata#12912) * fix `[global statistics]` section in netdata.conf (netdata#12916) * fix virtualization detection when `systemd-detect-virt` is not available (netdata#12911) * Fix the log entry for incoming cloud start streaming commands (netdata#12908) Add the correct requested chart sequence id from the cloud and also record the local one we have * user configurable sqlite PRAGMAs (netdata#12917) * user configurable sqlite PRAGMAs * added cache size * chore(cgroups.plugin): remove "enable new cgroups detected at run time" config option (netdata#12906) * Restore a broken symbolic link (netdata#12923) * chore(fping.plugin): bump default fping version to 5.1 (netdata#12930) * chore: add links to SQLite init options in the src code (netdata#12920) * collectors: apps.plugin: apps_groups: update net, aws, ha groups (netdata#12921) * [ci skip] Update changelog and version for nightly build: v1.34.0-181-nightly. * Adjust alarms count (netdata#12896) * check for is_available when counting * remove empty line * Remove Alpine 3.12 from CI. (netdata#12919) It went EOL upstream on 2022-05-01. * Adjust the dimension liveness status check (netdata#12933) * Mark a chart to be exposed only if dimension is created or metadata changes * Add a calculate liveness for the dimension for collected to non collected (live -> stale) and vice versa * queue_dimension_to_aclk will have the rrdset and either 0 or last collected time If 0 then it will be marked as live else it will be marked as stale and last collected time will be sent to the cloud * Add an extra parameter to indicate if the payload check should be done in the database or it has been done already * Queue dimension sets dimension liveness and queues the exact payload to store in the database * Fix compilation error when --disable-cloud is specified * Reduce timeout to 1 second for getting cloud instance info (netdata#12941) * feat: move dirs, logs, and env vars config options to separate sections (netdata#12935) * include proper package dependency (netdata#12518) * Add support for installing static builds on systems without usable internet connections. (netdata#12809) * Add code to prepare an offline installation source directory. * Add support to `download` function for `file://` URLs. This will be used to reference local files instead of having to set up a web server or complicate the code for fetching files. * Modify static archive URL handling to use offline install source if present. * Make check for offline install source support more robust. * Fix fetching of files for offline installs. * Fixed installer stub script. * Mark release channel in offline install source directory. To ensure that users are getting what they expect. * Fix handling of option ordering. * Assorted fixes. * Don’t enable auto-updates by defualt for offline installs. * Update documentation. * Add dry run mode support. * Fix checking of SHA256 checksums. * Fix handling of custom install version selection. * Fix CPU architecture selection. * Fix typo. * Fix typos in user-facing messages * Fix broken merge. * Fix incorrect variable name. * Move kickstart argument parsing code to a function. (netdata#12805) Move kickstart argument arsing code to a function. This will make it slightly more maintainable in the long term, and slightly easier for newcomers to understand. * Fix and improve netdata-updater.sh script (netdata#12757) * minor improvement in compatible DISTRO detection * revert distro detection code; added almalinux and rocky distros as centos compatibility distro * [ci skip] Update changelog and version for nightly build: v1.34.0-191-nightly. * Autodetect channel for specific version (netdata#12856) * autodetect channel * fix kickstart.sh * Prevent command_to_be_logged from overflowing (netdata#12947) * prevent command_to_be_logged from overflowing * dont access with size * Update libbpf version (netdata#12945) * detailed dbengine stats (netdata#12948) * Optimize the dimensions option store to the metadata database (netdata#12952) * Add a flag to "cache" the latest hidden status written in the database * rrddim hide and unhide will check "cached" state, update the database if needed and set the cache flag accordingly * Check the dimension option and only do the database update if the cached state is different * Defer the dimension payload check to the ACLK sync thread (netdata#12951) Defer payload check to the aclk sync thread * [ci skip] Update changelog and version for nightly build: v1.34.0-198-nightly. * Suppress warning when freeing a NULL pointer in onewayalloc_freez (netdata#12955) * Cleanup chart hash and map tables on startup (netdata#12956) * statsd sets should count unique values (netdata#12963) statsd set should count unique values * [ci skip] Update changelog and version for nightly build: v1.34.0-202-nightly. * Apply some logic to possible streaming destinations (netdata#12866) * replace connect_to_one_of with connect_to_one_of_destinations * move functions from socket.c * use sizeof * move current destination pointer to host * formatting * use snprintfz * get entries in same order * handle single destination as before (or when it is the last of the list), instead of skiping it every other loop * try other destinations on ssl problem * fix: keep virtualization unknown if all used commands are not available (netdata#12964) * cleanup and optimize rrdeng_load_metric_next() (netdata#12966) * cleanup and optimize rrdeng_load_metric_next() * fixed typo * Don't permanetly disable a destination because of denied access (netdata#12971) dont make denied destination permanent * feat(charts.d/apcupds): add load usage chart (Watts) (netdata#12965) * chore: check link local address before querying cloud instance metadata (netdata#12973) check link local address before querying cloud providers data * [ci skip] Update changelog and version for nightly build: v1.34.0-209-nightly. * optimize poll_events() to spread the work over the threads more evenly (netdata#12975) * optimize poll_events() to spread the work over the threads more evenly * fixed typos, code cleanup * better error handling * prevent crash in case callbacks manipulate the sockets arrays - added warnings * query engine optimizations and cleanup (netdata#12978) * move number unpacking close to next_metric * dont miss group value flags * [ci skip] Update changelog and version for nightly build: v1.34.0-212-nightly. * chore(apps.plugin): change cpu_guest chart context (netdata#12983) * Add automatic retries fo static builds during nightly and release builds. (netdata#12961) * fix(kickstart.sh): handle the case when `tput colors` doesn't return a number (netdata#12979) * fix: don't kill Netdata PIDs if successfully stopped Netdata (netdata#12982) * modify code to resolve compile warning issue (netdata#12969) * Make heartbeat a static chart (netdata#12986) * Improve reconnect node instructions (netdata#12987) * [ci skip] Update changelog and version for nightly build: v1.34.0-220-nightly. * Faster queries (netdata#12988) * faster rrdeng_load_metric_next() * no need to check validity for number - already done at the query side * solve discrepancy between query create and free * inline unpack_storage_number * Stream and advertise metric correlations to the cloud (netdata#12940) * stream and advertise mc to the cloud * better reporting * remove log * remove aclk debug * Return rc->last_update from alarms_values api (netdata#12968) * add rc last_update as when in alarms values api * rename when to last_updated * update swagger * Fix compilation warnings (netdata#12993) * Fix nanosleep on platforms other than Linux (netdata#12991) * Run the /net/dev module of the proc plugin in a separate thread (netdata#12996) * Update dashboard to version v2.25.4. (netdata#13000) Co-authored-by: netdatabot <netdatabot@users.noreply.github.com> * Don't expose the chart definition to streaming if there is no metadata change (netdata#12990) * Only clear the RRDSET_FLAG_UPSTREAM_EXPOSED chart flag if metadata has changed * Handle modification of units as well * Initialize old_units in the chart state * add dictionary support to statsd (netdata#12980) * add dictionary support to statsd * faster statsd sets and dictionaries; disabled events dimensions by default * properly detect tags, even without a sampling rate * statsd assumes a pipe between fields * missing param * allow names without values and support more unknown fields * more parser fixes * support multiple tags; remove the sum from the dimensions of histograms and timers, but keep it for synthetic charts * Parse statsd tags and support changing units of private charts * remove debug code * added support for naming dimensions too * updated docs * added support for family tags * updated docs * [ci skip] Update changelog and version for nightly build: v1.34.0-230-nightly. * Delay children chart obsoletion check (netdata#12992) * wait untill after 2 minutes of last chart received to run obsoletion check * turn write to read locks * Use printf instead of echo for printing collected warnings in kickstart.sh. (netdata#13002) Use printf instead of echo for printing collected warnings. This ensures that the formatting actually happens correctly. * Autodetect coverity install path to increase robustness (netdata#12995) * [ci skip] Update changelog and version for nightly build: v1.34.0-234-nightly. * Alarms py collector add filtering (netdata#12972) add ability to filter alarms in `alarms.conf` * Add Alpine 3.16 to CI and platform support document. (netdata#12997) * fix COVERITY_PATH added with INSTALL_DIR into PATH (netdata#13014) * Cleanup Challenge Response Code (netdata#11730) - Use OpenSSL for Base64 encode/decode - general cleanup of code * Pass the child machine's guid to the goto_url link (netdata#12609) * pass child machine guid * pass parameter * Only try to update repo metadata in updater script if needed. (netdata#13009) * Cache invariant components in static builds to reduce build times. (netdata#12877) * Add basic build caching support to static builds. Cache is store din `artifacts/cache/${BUILDARCH}`. Each third-party component utilizes a separate build cache. Invalidation is only done for version changes (more rigorous invalidation is expected to be handled externally). * Integrate static build caching with CI. * Fix fping cache handling. * Test caching in CI. * Properly skip rebuilds on cache hits. * Remove static build container when done with it. * Reuse existing image automatically if it’s for the correct platform. * Test CI build caching. * Fix static build job names. * Fix coverity issue 378598 (netdata#13022) move appconfig_get before aclk lock * Initialize a pointer and add a check for it (netdata#13023) * prevent gap filling on dbengine gaps (netdata#13027) * Update dashboard to version v2.25.6. (netdata#13028) Co-authored-by: netdatabot <netdatabot@users.noreply.github.com> * [ci skip] Update changelog and version for nightly build: v1.34.0-246-nightly. * add hostname to mirrored hosts (netdata#13030) * [ci skip] Update changelog and version for nightly build: v1.34.0-248-nightly. * Update apps_groups.conf (netdata#13033) * Trigger queue removed alerts on health log exchange with cloud (netdata#12954) trigger queue removed on health log exchange with cloud * Check return value and log an error on failure (netdata#13037) * [ci skip] Update changelog and version for nightly build: v1.34.0-252-nightly. * Fix coverity issue 378617,378615 (netdata#13021) * Fix CID 378617 * Fix CID 378615 * Make sure the ST rrdr lock indicator is set/reset while holding a lock * Switch to int * Skip collecting network interface speed and duplex if carrier is down (netdata#13019) * When sending a dimension for the first time, make sure there is a non zero created_at timestamp (netdata#13035) * Treat dimensions as normal when we don't have enough/valid data. (netdata#13005) Ideally, we'd log such cases but this is not currently feasible because we have to process thousands of dimensions per second. * replace `history` with relevant `dbengine` params (netdata#13041) * Fix the retry count and netdata_exit check when running an sqlite3_step command (netdata#13040) * Move retry count to the header file * Add SQL_MAX_RETRY count and fix the netdata_exit check * Write pid file (needed by logrotate) (netdata#9377) * Add additional metadata to the data response (netdata#13036) * Consolidate query params * Add new option to show full dimensions in the json header (this will include dimensions, charts and chart labels) * Group and pass parameters with query_params * [ci skip] Update changelog and version for nightly build: v1.34.0-261-nightly. * Fix disabled apps (ebpf.plugin) (netdata#13044) * add note about anomaly advisor (netdata#13042) * Schedule retention message calculation to a worker thread (netdata#13039) * Move aclk_update_retention to the proper header file * Do a scan but avoid going through all the dimensions if we have too much to delete -- do not generate a retention message in that case * Schedule the retention calculation to a worker * Adjust messages in the access log * Fix compilation errors with --disable-cloud * Dictionary with JudyHS and double linked list (netdata#13032) * dictionary internals isolation * more dictionary cleanups * added unit test * we should use DICT internally * disable cups in cmake * implement DICTIONARY with Judy arrays * operational JUDY implementation * JUDY cleanup * JUDY summary added * JudyHS implementation with double linked list * test negative searches too * optimize destruction * optimize set to insert first without lookup * updated stats * code cleanup; better organization; updated info * more code cleanup and commenting * more cleanup, renames and comments * fix rename * more cleanups * use Judy.h from system paths * added foreach traversal; added flag to add item in front; isolated locks to their own functions; destruction returns the number of bytes freed * more comments; flags are now 16-bit * completed unittesting * addressed comments and added reference counters maintainance * added unittest in main; tested removal of items in front, back and middle * added read/write walkthrough and foreach; allowed walkthrough and foreach in write mode to delete the current element (used by cups.plugin); referenced counters removed from the API * DICTFE.name should be const too * added API calls for exposing all statistics * dictionary flags as enum and reference counters as atomic operations * more comments; improved error handling at unit tests * added functions to allow unsafe access while traversing the dictionary with locks in place * check for libcups in cmake * added delete callback; implemented statsd with this dictionary * added missing dfe_done() * added alternative implementation with AVL * added documentation * added comments and warning about AVL * dictionary walktrhough on new code * simplified foreach; updated docs * updated docs * AVL is much faster without hashes * AVL should follow DBENGINE * coverity fixes about statsd; removal of strsame (netdata#13049) * Fix dictionary crash walkthrough empty (netdata#13051) fix dictionary walkthrouhg crash when the dictionary is empty * [ci skip] Update changelog and version for nightly build: v1.34.0-268-nightly. * dictionary improvements (netdata#13052) * fix typo in foreach write; added unit tests to traverse empty dictionaries * rename variable dfe in macro to be uniform with name variable * Check for host labels when linking alerts for children (netdata#13053) check for host labels when linking alerts * Fix coverity 378625 (netdata#13055) free jsonb buffer * add the ability to merge dictionary items (netdata#13054) * add the ability to merge old value and new value * docs * merge to conflict * fix(cgroup.plugin): read k8s_cluster_name label from the correct file (netdata#13062) * Initialize chart label key parameter correctly (netdata#13061) Pass chart label key * [ci skip] Update changelog and version for nightly build: v1.34.0-275-nightly. * update codeowners (netdata#13060) * Fix handling of temp directory in kickstart when uninstalling. (netdata#13056) This makes temporary directory creation idempotent, and ensures it’s invoked in each place that needs it. It also tidies up the cleanup code so that it only tries to remove the temporary directory if one was created. * Fix locking access to chart labels (netdata#13064) No write lock required * [ci skip] Update changelog and version for nightly build: v1.34.0-279-nightly. * Allow usage of the new MQTT 5 implementation (netdata#12838) * adds support for new MQTT5 implementation in agent, currently by default disabled as Tech Preview * Added Alma Linux 9 and RHEL 9 support to CI and packaging. (netdata#13058) * Added Alma Linux 9 and RHEL 9 support to CI and packaging. * Fix RPM deps for Alma 9. * Fix package testing code for Alma 9. * Update default value for "host anomaly rate threshold" (netdata#13075) * Add improved reinstall documentation. (netdata#13047) Including explaining how to do a clean reinstall, and how to switch install types. * Fix handling of DEB package naming in CI. (netdata#13076) * Fix handling of DEB package naming in CI. * Bump repoconfig package versions. To ensure naming consistency. * Fix repoconfig package renaming. * [ci skip] Update changelog and version for nightly build: v1.34.0-285-nightly. * fix(updater): don't produce any output if binpkg update completed successfully (netdata#13081) * don't produce any output when binpkg update succeeded * redirect update repo, update netdata output to 3 * Remove Fedora 34 from CI and package builds. (netdata#12875) * Remove Fedora 34 from CI and package builds. EOL date is 2022-06-07. * Update platform support document. * Fix Coverity errors in mqtt_websockets submodule (netdata#13082) - update mqtt_websockets submodule to bring in the Coverity scan fixes * [ci skip] Update changelog and version for nightly build: v1.34.0-289-nightly. * Update README.md (netdata#13088) * Update README.md (netdata#13089) * fix(updater): return 0 on successful update for native packages when running interactively (netdata#13083) return 0 on success in udpate_binpkg * [ci skip] Minor release v1.35.0. * [ci skip] Update changelog and version for nightly build: v1.35.0-1-nightly. * Temporarily disable updates for static builds. (netdata#13100) * Temporarily disable updates for static builds. * Fix typo in warning message. * Remove unnescesary ‘cleanup’ code. (netdata#13103) This was causing the updter to be unconditionally disabled on static builds, and we don’t actually _need_ any of it anymore since we’ve already decoupled the auto-update handling state from the installation process (in fact, this should have been removed then, but it got missed somehow). * [ci skip] Update changelog and version for nightly build: v1.35.0-4-nightly. * Re-enable updates for systems using static builds. (netdata#13110) Revert "Temporarily disable updates for static builds. (netdata#13100)" This reverts commit b67c102. * docs(statsd.plugin): fix indentation (netdata#13096) fix indentation * Add openSUSE Leap 15.4 to CI and package builds. (netdata#12270) Add openSUSE Leap 15.4 t CI and package builds. Expected release date 2022-06-08. * [ci skip] Update changelog and version for nightly build: v1.35.0-8-nightly. * fix virtualization detection on FreeBSD (netdata#13087) * Add user netdata to secondary group in DEB package (netdata#13109) * Add user netdata to secondary group * Update netdata.postinst * Labels with dictionary (netdata#13070) * squashed and rebased to master * fix overflow and single character bug in sanitize; include rrd.h instead of node_info.h * added unittest for UTF-8 multibyte sanitization * Fix unit test compilation * Fix CMake build * remove double sanitizer for opentsdb; cleanup sanitize_json_string() * rename error_description to error_message to avoid conflict with json-c * revert last and undef error_description from json-c * more unittests; attempt to fix protobuf map issue * get rid of rrdlabels_get() and replace it with a safe version that writes the value to a buffer * added dictionary sorting unittest; rrdlabels_to_buffer() now is sorted * better sorted dictionary checking * proper unittesting for sorted dictionaries * call dictionary deletion callback when destroying the dictionary * remove obsolete variable * Fix exporting unit tests * Fix k8s label parsing test * workaround for cmocka and strdupz() * Bypass cmocka memory allocation check * Revert "Bypass cmocka memory allocation check" This reverts commit 4c49923. * Revert "workaround for cmocka and strdupz()" This reverts commit 7bebee0. * Bypass cmocka memory allocation checks * respect json formatting for chart labels * cloud sends colons * print the value only once * allow parenthesis in values and spaces; make stream sender send quotes for values Co-authored-by: Vladimir Kobal <vlad@prokk.net> * 73x times faster metrics correlations at the agent (netdata#13107) * faster correlations * 4x times faster correlations * a little bit more help * 10x times faster metrics correlations * 6 digits precision; better comments * enabled metrics correlations by default * abstracted DIFFS_NUMBER to allow easily changing it * reworked the entire logic to have more accuracy and support a baseline that is power of two multiple of highlight * properly calculate shifts * even more improved version * added support for timeout; fixed another memory leak; skipped hidden dimensions * default timeout 1min * reduce memory even further * use dictionary for the list of charts and optimize locks * return 403 forbidden, when mc is not enabled * added query options * dont process zero dimensions * added volume method as an option to metric correlations ; now metric correlations can support multiple implementations * make sure we will never crash * spread results evenly for both kstwo and volume * fixed bug in query engine that was missing misaligned queries when a single point was requested from the db; improved comments; improved query flags * updated swagger and added sane defaults; query options are now supported, including anomaly-bit * added "raw" option to allow cross node correlations; added "group" option to allow different time aggregations; allowed calling metric correlations without any parameters; allowed calling metric correlations with relative timestamps; added timeout to volume method; properly handled timeout on ks2 method; json output now sends all parameters back - same for json_wrap; modified query engine to use present time for relative timestamps; modified "allow_past" to mean both past backwards and forwards * emulate the old behaviour about zero points * 100% accuracy against python ks_2samp(); now the default is volume and the default points are 500 * added config option to change default metric correlations method * removed work-arounds now that rrdlabels are merged * [ci skip] Update changelog and version for nightly build: v1.35.0-13-nightly. * Ci coverage (netdata#13118) * add check to verify autoupdate is still enabled after netdata update * add script to install CI support packages before installing netdata * Fix typo in release base prep script. (netdata#13098) * fixed coveriry 379136 379135 379134 379133 (netdata#13123) * allow label names to have slashes (netdata#13125) * allow label names to have slashes * fixed flipped comment * buffer overflow detected by the compiler (netdata#13120) * buffer overflow detected by the compiler * also increase the buffer +1 * ACLK statistics on bytes recvd and sent (netdata#13091) * fix(python.d/mongodb): set `serverSelectionTimeoutMS` for pymongo4+ (netdata#13135) fix server_selection_timeout for pymongo4+ * fix(python.d): urllib3 import collection for py3.10+ (netdata#13136) * [ci skip] Update changelog and version for nightly build: v1.35.0-22-nightly. * Use a separate thread for slow mountpoints in the diskspace plugin (netdata#13067) * use ks2 as MC default (netdata#13131) * fix crashes due to misaligned allocations (netdata#13137) * Add missing control to streaming (netdata#13112) fix_tls_stream: Add call to SSL_get_error to avoid an infinite loop * Add an option to use malloc for page cache instead of mmap (netdata#13142) Add an option to switch to using malloc for page cache instead of mmap * Update docs on what to do if collector not there (netdata#13152) * [ci skip] Update changelog and version for nightly build: v1.35.0-29-nightly. * Remove pinned page reference (netdata#13108) * Disable reference to prev_descr as we do not keep two pages pinned * Remove extra pinned page from page cache calculations * Removed invalid comment * Remove unused variable * Add cargo/rustc/bazel/buck to apps_groups.conf (netdata#13143) * revert to default of `host anomaly rate threshold=0.01` (netdata#13150) * fix conditions for nightly build triggers (netdata#13145) * Fix labels unit test (netdata#13156) * add CAP_SYS_RAWIO to Netdata's systemd unit CapabilityBoundingSet (netdata#13154) * Add mem.available chart to FreeBSD (netdata#13140) * Configurable storage engine for Netdata agents: step 3 (netdata#12892) * storage engine: add host context API Add a new API to allow storage engines to manage host contexts. * Replace single global context with per-engine global context * Context is full managed by storage engines: a storage engine can use no context, a global engine context, per host contexts, or a mix of these. * Currently, only dbengine uses contexts. Following the current logic, legacy hosts use their own context, while non-legacy hosts share the global context. * storage engine: use empty function instead of null for context ops * rrdhost: don't check return value for void call * rrdhost: create context with host * storage engine: move rrddim ops to rrddim_mem.{c,h} * storage engine: don't use NULL for end-of-list marker * storage engine: fallback to default engine * Use memset to mark the empty words in the quoted_strings_splitter function (netdata#13161) Use memset to terminate the words * Don’t manipulate positional parameters in DEB postinst script. (netdata#13169) * Fix coverity issues (netdata#13168) * [ci skip] Update changelog and version for nightly build: v1.35.0-41-nightly. * enable ml by default (netdata#13158) * enabled ml by default * Fix data query on stale chart (netdata#13159) * Fix data query on stale chart * Remove more checks vs the last timestamp of a point collected * feat(proc/proc_net_dev): add dim per operstate to the "Interface Operational State" chart (netdata#13167) * Revert "Configurable storage engine for Netdata agents: step 3 (netdata#12892)" (netdata#13171) This reverts commit 100a12c. A couple parent/child startup/shutdown scenarios can lead to crashes. * feat(proc/proc_net_dev): add dim per duplex state to the "Interface Duplex State" chart (netdata#13165) * allow traversing null-value dictionaries (netdata#13162) * allow traversing null-value dictionaries * fix lgtm report * void the value too * removed NEVERNULL directive * Fix coverity 378587 (netdata#13024) * check for return value of sysconf * if sysconf fails set OWA_NATURAL_PAGE_SIZE to 4096 * [ci skip] Update changelog and version for nightly build: v1.35.0-49-nightly. * feat(proc/proc_net_dev): add dim per phys link state to the "Interface Physical Link State" chart (netdata#13176) * add dim per carrier state * fix down state * Update dashboard to version v2.26.2. (netdata#13177) Co-authored-by: netdatabot <netdatabot@users.noreply.github.com> * set default for `minimum num samples to train` to `900` (netdata#13174) This will enable first set of initial models to be trained quicker and makes sense now that ml is enabled by default. * add k8s_state dashboard_info (netdata#13181) * [ci skip] Update changelog and version for nightly build: v1.35.0-54-nightly. * Add ml alerts examples (netdata#13173) * add ml alarm examples * Update Makefile.am * add hyperlinks and node level AR example * fix(freebsd.plugin): fix wired/cached/avail memory calculation on FreeBSD with ZFS (netdata#13183) * [ci skip] Update changelog and version for nightly build: v1.35.0-57-nightly. * Update dashboard to version v2.26.5. (netdata#13192) Co-authored-by: netdatabot <netdatabot@users.noreply.github.com> * Query Engine multi-granularity support (and MC improvements) (netdata#13155) * set grouping functions * storage engine should check the validity of timestamps, not the query engine * calculate and store in RRDR anomaly rates for every query * anomaly rate used by volume metric correlations * mc volume should use absolute data, to avoid cancelling effect * return anomaly-rates in jasonwrap with jw-anomaly-rates option to data queries * dont return null on anomaly rates * allow passing group query options from the URL * added countif to the query engine and used it in metric correlations * fix configure * fix countif and anomaly rate percentages * added group_options to metric correlations; updated swagger * added newline at the end of yaml file * always check the time the highlighted window was above/below the highlighted window * properly track time in memory queries * error for internal checks only * moved pack_storage_number() into the storage engines * moved unpack_storage_number() inside the storage engines * remove old comment * pass unit tests * properly detect zero or subnormal values in pack_storage_number() * fill nulls before the value, not after * make sure math.h is included * workaround for isfinite() * fix for isfinite() * faster isfinite() alternative * fix for faster isfinite() alternative * next_metric() now returns end_time too * variable step implemented in a generic way * remove left-over variables * ensure we always complete the wanted number of points * fixes * ensure no infinite loop * mc-volume-improvements: Add information about invalid condition * points should have a duration in the past * removed unneeded info() line * Fix unit tests for exporting engine * new_point should only be checked when it is fetched from the db; better comment about the premature breaking of the main query loop Co-authored-by: Thiago Marques <thiagoftsm@gmail.com> Co-authored-by: Vladimir Kobal <vlad@prokk.net> * Add type label for network interfaces (netdata#13187) * feat(python.d/smartd_log): add 2nd job that tries to read from '/var/lib/smartmontools/' (netdata#13188) * Fix cgroups netdev chart labels (netdata#13200) * Allow for an easy way to do metadata migrations (netdata#13196) Allow for an easy way to migrate metadata to a new database schema (versioning) * Clean sqlite prepared statements on thread shutdown (netdata#13193) * Clean sqlite prepared statements on thread shutdown * Add note for pending statements to finalize * [ci skip] Update changelog and version for nightly build: v1.35.0-65-nightly. * Add configuration for dbengine page fetch timeout and retry count (netdata#13194) * Add configuration for page cache fetch timeout and retry count Change page cache wait default timeout to 3 seconds * Issue info message in the error.log if values not within expected lower range * Fix compilation errors with --disable-dbengine * Print INTERNAL BUG messages only when NETDATA_INTERNAL_CHECKS is enabled (netdata#13207) put INTERNAL BUG messages inside NETDATA_INTERNAL_CHECKS * chore(netdata-installer): remove a call to 'cleanup_old_netdata_updater()' because it is no longer exists (netdata#13189) * [ci skip] Update changelog and version for nightly build: v1.35.0-69-nightly. * Add user plugin dirs to environment (netdata#13203) Co-authored-by: Ilya Mashchenko <ilya@netdata.cloud> * [ci skip] Update changelog and version for nightly build: v1.35.0-71-nightly. * make configuration example clearer (netdata#13182) make ml configuration example cleare * [ci skip] Update changelog and version for nightly build: v1.35.0-73-nightly. * deduplicate mountinfo based on mount point (netdata#13215) * [ci skip] Update changelog and version for nightly build: v1.35.0-75-nightly. * Use new mqtt implementation as default (netdata#13132) flips mqtt5 to be default instead of mqtt3 * fix(updater): fix updating when using `--force-update` and new version of the updater script is available (netdata#13104) * Ensure tmpdir is set for every function that uses it. (netdata#13206) The set_tmpdir function is idempotent specifically to allow for this type of usage, and this should help avoid bugs involving temporary directory handling going forwards. * Don’t use realpath to find kickstart source path. (netdata#13208) Don’t use realpath to find kcisktart source path. It doesn’t work on macOS and leads to a bogus error message being printed. * Properly handle interactivity in the updater code. (netdata#13209) * Clean up updater option parsing. This will make the remaining changes simpler, and also ease maintenance long-term. * Add updater options to override interactivity detection. * Pass interactivity from kickstart to updater when invoking updater. * Removes Legacy JSON Cloud Protocol Support In Agent (netdata#13111) * removes old protocol support (cloud removed support already) * ci: add issues to the Agent Board project workflow (netdata#13225) * add add issues to Agent Board project workflow * add 'transferred' event * fix(cgroups.plugin): fix qemu VMs and LXC containers name resolution (netdata#13220) * [ci skip] Update changelog and version for nightly build: v1.35.0-84-nightly. * feat(python.d): load modules from user plugin directories (NETDATA_USER_PLUGINS_DIRS) (netdata#13214) * Add more sqlite unittests (netdata#13227) * Bump repoconfig package version used in kickstart.sh (netdata#13235) * Update netdata commands (netdata#13080) * Update netdata commands Adding the `-W buildinfo` options. * Update README.md * Update README.md * Update daemon/README.md Co-authored-by: Ilya Mashchenko <ilya@netdata.cloud> * Update daemon/README.md Co-authored-by: Ilya Mashchenko <ilya@netdata.cloud> * also add the change in the daemon command line help message Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> * remove whitespace Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> Co-authored-by: Ilya Mashchenko <ilya@netdata.cloud> * Use correct PAT for add-to-project workflow. (netdata#13234) * Implement PackageCloud cleanup (netdata#13236) * add script for netdata packagecloud cleanup * add script for netdata packagecloud cleanup * remove old package-cloud cleanup code * add workflow for packagecloud cleanup * Debug msg * allow individual matrix jobs to complete independently to each other * perform cleanup without dry-run * remove debug msg * remove cleanup line from the slack notification * Upload packages to new self-hosted repository infrastructure. (netdata#13240) * Match packaging arches to distro architecture names. This will simplify handling of uploads to our new self-hosted packaging infrastructure. * Add package uploads for RPM packages on new infrastructure. * Add package upload support for DEB packages. * Saner tmpdir handling. * Upload fixes. * Differentiate different DEB distros in package names. * Workflow fixes. * netdata doubles (netdata#13217) * netdata doubles * fix cmocka test * fix cmocka test again * fix left-overs of long double to NETDATA_DOUBLE * RRDDIM detached from disk representation; db settings in [db] section of netdata.conf * update the memory before saving * rrdset is now detached from file structures too * on memory mode map, update the memory mapped structures on every iteration * allow RRD_ID_LENGTH_MAX to be changed * granularity secs, back to update every * fix formatting * more formatting * Dictionaries with reference counters and full deletion support during traversal (netdata#13195) * dont use atomic operations when not needed; detect misuse of the the unsafe functions * use relaxed atomic operations for statistics * use relaxed atomic operations for statistics * dictionaries now use reference counters, allowing deletetions of any item while traversing it * added acquire/release interface to dictionaries * added unittest for reference counters * added NETDATA_INTERNAL_CHECKS logs to detect non-exclusive access to crusial parts of the dictionaries * dictionaries cannot be deleted while there are referenced items in them - they will be deleted once the last item gets unreferenced * cleanup * properly cleanup released items * maintain counters for readers and writers; defer all deletes on sorted walkthrough; cleaner internal_error(); * somewhat faster reference counters on single threaded dictionaries * minor optimizations; allow compiling without internal checks * Delay health until obsoletions check is complete (netdata#13239) * wait until obsoletions check is complete to run health * run the checks 5 minutes after agent connect time * Updates the sqlite version in the agent (netdata#13233) New version sqlite Enabling also #define SQLITE_UDL_CAPABLE_PARSER 1 #define SQLITE_ENABLE_UPDATE_DELETE_LIMIT 1 #define SQLITE_OMIT_LOAD_EXTENSION 1 #define SQLITE_ENABLE_DBSTAT_VTAB 1 * [ci skip] Update changelog and version for nightly build: v1.35.0-96-nightly. * Fix build matrix generation for build workflow. (netdata#13254) * Fix build matrix generation for build workflow. * Fix build matrix sorting. * Fix further typos. * fix: fix a base64_encode bug (netdata#13074) * Use old mqtt implementation as default (netdata#13258) mqtt5 as default off * Add fstype labels to disk charts (netdata#13245) Co-authored-by: vkalintiris <vasilis@netdata.cloud> Co-authored-by: Vladimir Kobal <vlad@prokk.net> Co-authored-by: Netdata bot <43409846+netdatabot@users.noreply.github.com> Co-authored-by: netdatabot <netdatabot@users.noreply.github.com> Co-authored-by: netdatabot <bot@netdata.cloud> Co-authored-by: Ilya Mashchenko <ilya@netdata.cloud> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Emmanuel Vasilakis <mrzammler@mm.st> Co-authored-by: Stelios Fragkakis <52996999+stelfrag@users.noreply.github.com> Co-authored-by: Timotej S <6674623+underhood@users.noreply.github.com> Co-authored-by: Chris Akritidis <43294513+cakrit@users.noreply.github.com> Co-authored-by: Costa Tsaousis <costa@netdata.cloud> Co-authored-by: Konstantin Shalygin <k0ste@k0ste.ru> Co-authored-by: Austin S. Hemmelgarn <austin@netdata.cloud> Co-authored-by: Andika Triwidada <andika@gmail.com> Co-authored-by: Marian Savchuk <Marian.Savchuk@cypress.com> Co-authored-by: maneamarius <locomotion.itservices@gmail.com> Co-authored-by: thiagoftsm <thiagoftsm@gmail.com> Co-authored-by: kklionz <85677209+kklionz@users.noreply.github.com> Co-authored-by: Andrew Maguire <andrewm4894@gmail.com> Co-authored-by: FQX <qfuxiang@gmail.com> Co-authored-by: Luca Olivetti <luca@ventoso.org> Co-authored-by: Shyam Sreevalsan <shyam@netdata.cloud> Co-authored-by: Igor Karpov <iigorkarpov@users.noreply.github.com> Co-authored-by: Adrien Béraud <adrien.beraud@savoirfairelinux.com> Co-authored-by: Tasos Katsoulas <tasos@netdata.cloud>
- Loading branch information
27 people
committed
Jun 30, 2022
1 parent
2cb652c
commit 02b17db