Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pacific: mgr/autoscaler: Introduce noautoscale flag #44540

Merged
merged 3 commits into from Jan 26, 2022

Conversation

kamoltat
Copy link
Member

@kamoltat kamoltat commented Jan 11, 2022

noautoscale flag is a feature where the
user can choose to flip the switch between
turning autoscale on and off for all
pools with a single command.

osd pool set noautoscale will turn all
autoscale modeoff for all pools.

osd pool unset noautoscale will turn all
autoscale mode on for all pools.

Fixes: https://tracker.ceph.com/issues/53769

Backporting the relevant commits from master PR:
#43716

Signed-off-by: Kamoltat ksirivad@redhat.com

Checklist

  • Tracker (select at least one)
    • References tracker ticket
    • Very recent bug; references commit where it was introduced
    • New feature (ticket optional)
    • Doc update (no ticket needed)
    • Code cleanup (no ticket needed)
  • Component impact
    • Affects Dashboard, opened tracker ticket
    • Affects Orchestrator, opened tracker ticket
    • No impact that needs to be tracked
  • Documentation (select at least one)
    • Updates relevant documentation
    • No doc update is appropriate
  • Tests (select at least one)
Show available Jenkins commands
  • jenkins retest this please
  • jenkins test classic perf
  • jenkins test crimson perf
  • jenkins test signed
  • jenkins test make check
  • jenkins test make check arm64
  • jenkins test submodules
  • jenkins test dashboard
  • jenkins test dashboard cephadm
  • jenkins test api
  • jenkins test docs
  • jenkins render docs
  • jenkins test ceph-volume all
  • jenkins test ceph-volume tox

@kamoltat
Copy link
Member Author

jenkins test make check

@kamoltat
Copy link
Member Author

kamoltat commented Jan 12, 2022

Failed: 1/1
https://pulpito.ceph.com/ksirivad-2022-01-12_15:01:03-rados:singleton:all:test-noautoscale-flag.yaml-wip-ksirivad-backport-pacific-43716-distro-basic-smithi/

2022-01-12T16:14:07.118 INFO:tasks.workunit.client.0.smithi124.stderr:+ unset CEPH_CLI_TEST_DUP_COMMAND
2022-01-12T16:14:07.119 INFO:tasks.workunit.client.0.smithi124.stderr:++ ceph osd pool ls
2022-01-12T16:14:07.119 INFO:tasks.workunit.client.0.smithi124.stderr:++ wc -l
2022-01-12T16:14:07.394 INFO:tasks.workunit.client.0.smithi124.stderr:+ NUM_POOLS=1
2022-01-12T16:14:07.394 INFO:tasks.workunit.client.0.smithi124.stderr:+ '[' 1 -gt 0 ']'
2022-01-12T16:14:07.395 INFO:tasks.workunit.client.0.smithi124.stdout:test requires no preexisting pools
2022-01-12T16:14:07.396 DEBUG:teuthology.orchestra.run:got remote process result: 1
2022-01-12T16:14:07.396 INFO:tasks.workunit.client.0.smithi124.stderr:+ echo 'test requires no preexisting pools'
2022-01-12T16:14:07.397 INFO:tasks.workunit.client.0.smithi124.stderr:+ exit 1
2022-01-12T16:14:07.397 INFO:tasks.workunit:Stopping ['mon/test_noautoscale_flag.sh'] on client.0...

test created device_health_metrics, need to modify the test to not create it.

@vumrao vumrao self-requested a review January 12, 2022 16:43
@kamoltat kamoltat force-pushed the wip-ksirivad-backport-pacific-43716 branch from 29db24b to 73bc2a4 Compare January 12, 2022 16:47
@kamoltat
Copy link
Member Author

kamoltat commented Jan 12, 2022

@kamoltat
Copy link
Member Author

Still need to be tested against the rados suite to make sure it's clean

Comment on lines 35 to 42
>=16.2.7
--------

* MGR: The pg_autoscaler can now be turned `on` and `off` globally
with the `noautoscale` flag. By default this flag is unset and
the default pg_autoscale mode remains the same.
For more details, see:

https://docs.ceph.com/en/latest/rados/operations/placement-groups/
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: should be under 16.2.8 now

`noautoscale` flag is a feature where the
user can choose to flip the switch between
turning autoscale `on` and `off` for all
pools with a single command.

`osd pool set noautoscale` will turn all
autoscale mode`off` for all pools.

`osd pool unset noautoscale` will turn all
autoscale mode `on` for all pools.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
(cherry picked from commit be17f04)

Conflicts:
	src/pybind/mgr/pg_autoscaler/module.py - trivial fix
set and unset the noautoscale flag,
evaluate if the results are what
we expected. As well as, evaluate
if the flag is correct when we
create new pools.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
(cherry picked from commit bb42c71)

Conflicts:
        test-noautoscale-flag.yaml
			- modified pre-mgr-command to not create
			  device health monitor
Updated the docs in
https://docs.ceph.com/en/latest/rados/operations/placement-groups/
and updated the release notes to reflect noautoscale flag.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
(cherry picked from commit 9baed03)

Conflicts:
        PendingReleaseNotes - trivial fix
@kamoltat kamoltat force-pushed the wip-ksirivad-backport-pacific-43716 branch from 73bc2a4 to b5fb850 Compare January 25, 2022 20:04
@kamoltat kamoltat requested a review from a team as a code owner January 25, 2022 20:04
@neha-ojha
Copy link
Member

jenkins test api

1 similar comment
@neha-ojha
Copy link
Member

jenkins test api

@yuriw yuriw merged commit 3847801 into ceph:pacific Jan 26, 2022
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
4 participants