Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[juicefs] fix worker cache when set option #2563

Merged

Conversation

zwwhdls
Copy link
Member

@zwwhdls zwwhdls commented Feb 6, 2023

Signed-off-by: zwwhdls zww@hdls.me

Ⅰ. Describe what this PR does

When set cache-dir in worker options, juicefs worker will use different caches with fuse pod, and mount cache-dir in hostPath.

Ⅱ. Does this pull request fix one issue?

fixes #2564

Ⅲ. List the added test cases (unit test/integration test) if any, please explain if no tests are needed.

Ⅳ. Describe how to verify it

Ⅴ. Special notes for reviews

Signed-off-by: zwwhdls <zww@hdls.me>
@codecov
Copy link

codecov bot commented Feb 6, 2023

Codecov Report

Merging #2563 (89b03ac) into master (7520dfd) will increase coverage by 0.09%.
The diff coverage is 84.41%.

@@            Coverage Diff             @@
##           master    #2563      +/-   ##
==========================================
+ Coverage   67.44%   67.54%   +0.09%     
==========================================
  Files         368      368              
  Lines       21319    21412      +93     
==========================================
+ Hits        14379    14462      +83     
- Misses       5247     5256       +9     
- Partials     1693     1694       +1     
Impacted Files Coverage Δ
pkg/ddc/juicefs/transform.go 70.83% <25.00%> (-2.70%) ⬇️
pkg/ddc/juicefs/transform_fuse.go 81.25% <25.00%> (-1.11%) ⬇️
pkg/ddc/juicefs/transform_volume.go 94.17% <91.30%> (-5.83%) ⬇️
pkg/ddc/eac/types.go 100.00% <0.00%> (ø)
api/v1alpha1/eacruntime_types.go 11.11% <0.00%> (ø)
pkg/ddc/eac/transform.go 61.97% <0.00%> (+2.28%) ⬆️
pkg/webhook/certificate_builder.go 84.09% <0.00%> (+4.54%) ⬆️
pkg/ddc/base/syncs.go 54.54% <0.00%> (+8.20%) ⬆️

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

@zwwhdls
Copy link
Member Author

zwwhdls commented Feb 6, 2023

/test fluid-e2e

- mountPath: /root/script
name: script
{{- range $name, $mount := .Values.cacheDirs }}
- name: cache-dir-{{ $name }}
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please update changelog and chart version. thanks.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: zwwhdls <zww@hdls.me>
@cheyang
Copy link
Collaborator

cheyang commented Feb 7, 2023

/lgtm
/approve

@fluid-e2e-bot
Copy link

fluid-e2e-bot bot commented Feb 7, 2023

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: cheyang

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@fluid-e2e-bot fluid-e2e-bot bot merged commit b8f6049 into fluid-cloudnative:master Feb 7, 2023
uniqueni pushed a commit to uniqueni/fluid that referenced this pull request Feb 8, 2023
* fix worker cache when set option

Signed-off-by: zwwhdls <zww@hdls.me>

* update changelog in chart

Signed-off-by: zwwhdls <zww@hdls.me>

* fix unittest

Signed-off-by: zwwhdls <zww@hdls.me>

---------

Signed-off-by: zwwhdls <zww@hdls.me>
cheyang pushed a commit to cheyang/fluid that referenced this pull request Feb 14, 2023
* fix worker cache when set option

Signed-off-by: zwwhdls <zww@hdls.me>

* update changelog in chart

Signed-off-by: zwwhdls <zww@hdls.me>

* fix unittest

Signed-off-by: zwwhdls <zww@hdls.me>

---------

Signed-off-by: zwwhdls <zww@hdls.me>
cheyang pushed a commit to cheyang/fluid that referenced this pull request Feb 18, 2023
* fix worker cache when set option

Signed-off-by: zwwhdls <zww@hdls.me>

* update changelog in chart

Signed-off-by: zwwhdls <zww@hdls.me>

* fix unittest

Signed-off-by: zwwhdls <zww@hdls.me>

---------

Signed-off-by: zwwhdls <zww@hdls.me>
cheyang pushed a commit to cheyang/fluid that referenced this pull request Feb 18, 2023
* fix worker cache when set option

Signed-off-by: zwwhdls <zww@hdls.me>

* update changelog in chart

Signed-off-by: zwwhdls <zww@hdls.me>

* fix unittest

Signed-off-by: zwwhdls <zww@hdls.me>

---------

Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: cheyang <cheyang@163.com>
cheyang pushed a commit to cheyang/fluid that referenced this pull request Mar 23, 2023
* fix worker cache when set option

Signed-off-by: zwwhdls <zww@hdls.me>

* update changelog in chart

Signed-off-by: zwwhdls <zww@hdls.me>

* fix unittest

Signed-off-by: zwwhdls <zww@hdls.me>

---------

Signed-off-by: zwwhdls <zww@hdls.me>
cheyang pushed a commit to cheyang/fluid that referenced this pull request Mar 23, 2023
* fix worker cache when set option

Signed-off-by: zwwhdls <zww@hdls.me>

* update changelog in chart

Signed-off-by: zwwhdls <zww@hdls.me>

* fix unittest

Signed-off-by: zwwhdls <zww@hdls.me>

---------

Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: cheyang <cheyang@163.com>
cheyang added a commit that referenced this pull request Mar 27, 2023
* [juicefs] fix worker cache when set option (#2563)

* fix worker cache when set option

Signed-off-by: zwwhdls <zww@hdls.me>

* update changelog in chart

Signed-off-by: zwwhdls <zww@hdls.me>

* fix unittest

Signed-off-by: zwwhdls <zww@hdls.me>

---------

Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: cheyang <cheyang@163.com>

* fix multi cache dir (#2639)

* fix multi cache dir

Signed-off-by: zwwhdls <zww@hdls.me>

* fix unit test

---------

Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: cheyang <cheyang@163.com>

* [Enhancement]CSI plugin checks mount point liveness before binding mount points (#2703)

* Clean up broken mount point when NodeStageVolume

Signed-off-by: dongyun.xzh <dongyun.xzh@alibaba-inc.com>

* Check mount point aliveness when NodePublishVolume

Signed-off-by: dongyun.xzh <dongyun.xzh@alibaba-inc.com>

* Clean up broken mount point when NodeStageVolume

Signed-off-by: dongyun.xzh <dongyun.xzh@alibaba-inc.com>

* Fix cleaning logic

Signed-off-by: dongyun.xzh <dongyun.xzh@alibaba-inc.com>

---------

Signed-off-by: dongyun.xzh <dongyun.xzh@alibaba-inc.com>
Signed-off-by: cheyang <cheyang@163.com>

* Prettify error messages for exec.Commands in Fluid (#2718)

* Prettify error log message when calling NodePublishVolume

Signed-off-by: dongyun.xzh <dongyun.xzh@alibaba-inc.com>

* Prettify error logs when calling helm-related funcs

Signed-off-by: dongyun.xzh <dongyun.xzh@alibaba-inc.com>

* Use instead `errors.As`

Signed-off-by: dongyun.xzh <dongyun.xzh@alibaba-inc.com>

* Use instead `errors.As`

Signed-off-by: dongyun.xzh <dongyun.xzh@alibaba-inc.com>

* Set higher log level for helm exec

Signed-off-by: dongyun.xzh <dongyun.xzh@alibaba-inc.com>

---------

Signed-off-by: dongyun.xzh <dongyun.xzh@alibaba-inc.com>
Signed-off-by: cheyang <cheyang@163.com>

* update mount to check mountinfo, To #48327952

Signed-off-by: cheyang <cheyang@163.com>

* update mount to check mountinfo, To #48327952

Signed-off-by: cheyang <cheyang@163.com>

* Build docker images for v0.8.5, To #48327952

Signed-off-by: cheyang <cheyang@163.com>

---------

Signed-off-by: zwwhdls <zww@hdls.me>
Signed-off-by: cheyang <cheyang@163.com>
Signed-off-by: dongyun.xzh <dongyun.xzh@alibaba-inc.com>
Co-authored-by: Weiwei <zww@hdls.me>
Co-authored-by: TzZtzt <trafalgarz@outlook.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Juice worker uses wrong cache when setting cache dir
2 participants