Support PVC for worker tiered store in K8s #11171
Conversation
|
Automated checks report:
Some checks failed. Please fix the reported issues and reply 'alluxio-bot, check this please' to re-run checks. |
| # emptyDir example | ||
| # - level: 0 | ||
| # mediumtype: MEM | ||
| # path: /dev/shm | ||
| # type: emptyDir | ||
| # quota: 1G | ||
| # | ||
| # hostPath example | ||
| # - level: 0 | ||
| # mediumtype: MEM | ||
| # path: /dev/shm | ||
| # type: hostPath | ||
| # quota: 1G | ||
| # | ||
| # persistentVolumeClaim example | ||
| # - level: 1 | ||
| # mediumtype: SSD | ||
| # type: persistentVolumeClaim | ||
| # name: alluxio-ssd | ||
| # path: /dev/ssd | ||
| # quota: 10G | ||
| # | ||
| # multi-part mediumtype example | ||
| # - level: 1 | ||
| # mediumtype: SSD,HDD | ||
| # type: persistentVolumeClaim | ||
| # name: alluxio-ssd,alluxio-hdd | ||
| # path: /dev/ssd,/dev/hdd | ||
| # quota: 10G,10G |
There was a problem hiding this comment.
Added a few examples here
There was a problem hiding this comment.
@jiacheliu3 please also update the docs section "Example: Alluxio Storage Management"
|
I will (rebase and) bump up the version once #11080 is merged. |
|
Merged build finished. Test PASSed. |
|
Test PASSed. |
|
Automated checks report:
All checks passed! |
| # emptyDir example | ||
| # - level: 0 | ||
| # mediumtype: MEM | ||
| # path: /dev/shm | ||
| # type: emptyDir | ||
| # quota: 1G | ||
| # | ||
| # hostPath example | ||
| # - level: 0 | ||
| # mediumtype: MEM | ||
| # path: /dev/shm | ||
| # type: hostPath | ||
| # quota: 1G | ||
| # | ||
| # persistentVolumeClaim example | ||
| # - level: 1 | ||
| # mediumtype: SSD | ||
| # type: persistentVolumeClaim | ||
| # name: alluxio-ssd | ||
| # path: /dev/ssd | ||
| # quota: 10G | ||
| # | ||
| # multi-part mediumtype example | ||
| # - level: 1 | ||
| # mediumtype: SSD,HDD | ||
| # type: persistentVolumeClaim | ||
| # name: alluxio-ssd,alluxio-hdd | ||
| # path: /dev/ssd,/dev/hdd | ||
| # quota: 10G,10G |
There was a problem hiding this comment.
@jiacheliu3 please also update the docs section "Example: Alluxio Storage Management"
| # | ||
| # persistentVolumeClaim example | ||
| # - level: 1 | ||
| # mediumtype: SSD |
There was a problem hiding this comment.
is mediumtype MEM possible with pv? If not please explicitly state that in the doc page and why
There was a problem hiding this comment.
What this PVC's mediumtype should be really depends on what PV it binds to. So it can actually be MEM as hostPath and emptyDir. I put a level 1 SSD here just trying to illustrate it can have level > 0 like being a SSD or HDD.
Is there a particular scenario you are thinking about? Or how do you think this can be illustrated more clearly?
|
Merged build finished. Test PASSed. |
|
Test PASSed. |
|
Merged build finished. Test FAILed. |
|
Test FAILed. |
|
alluxio-bot, test this please. |
|
alluxio-bot triggering jenkins retest: 0/3 |
|
jenkins, test this please |
|
Merged build finished. Test PASSed. |
|
Test PASSed. |
|
alluxio-bot, merge this please. |
This resolves worker tiered storage using PVC, as point 4 in #10253
The PVC will be satisfied by either
hostPathorlocalunder the hood to provide local storage to the worker.