New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Recreate disk array on katla as RAID6 #185

Closed
Firefishy opened this Issue Dec 8, 2017 · 3 comments

Comments

Projects
None yet
2 participants
@Firefishy
Member

Firefishy commented Dec 8, 2017

The /dev/sda1 aka /store/arrays/fast is currently a hardware LSI RAID10 array and is very near capacity. The RAID controller does not support migrating or growing RAID10 arrays.

We should rebuild the array as a RAID6.

  1. We'd need to backup / delete all data.
  2. Remove the array
  3. Create new array as RAID6
  4. Restore.
@tomhughes

This comment has been minimized.

Member

tomhughes commented Dec 8, 2017

Sounds like a plan to be - drop the database and reformat then run a new base backup.

Suggest we also move the SSD data from /store/arrays/ssd to that partition at the same time as the SSDs are also going to fill up soon.

We'll have to point the bytemark servers (which aren't actually taking any load) at karm or eddie while katla is rebuilt.

@tomhughes

This comment has been minimized.

Member

tomhughes commented Dec 12, 2017

Query load from bytemark has been moved to eddie and chef and postgres have been stopped on katla so we should be good to go on recreating the array.

@Firefishy

This comment has been minimized.

Member

Firefishy commented Dec 26, 2017

The array was rebuilt as RAID6 and postgresql re-synced.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment