Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate the roadmap of integration with fluid project #178

Closed
2 tasks
sighingnow opened this issue Jan 29, 2021 · 1 comment
Closed
2 tasks

Investigate the roadmap of integration with fluid project #178

sighingnow opened this issue Jan 29, 2021 · 1 comment
Labels
community Community discussions. component:vineyardd Issues about vineyardd enhancement New feature or request kubernetes proposal Enhancement proposals for vineyard.

Comments

@sighingnow
Copy link
Member

Describe your problem

The fluid project manages a data cache layer (provided by alluxio or jindofs) for on-top bigdata applications. Fluid abstract the data caching services as a Dataset, and mount it to worker pods via a CSI driver. Besides, based the affinity of volumes, fluid also considering the data locality when scheduling.

Vineyard also consider the data locality when scheduling. Currently vineyard abstracts objects as CRDs to make them visible for kubernetes. And volumes also fit vineyard's design well. Integrating with fluid would benifits vineyard to make the sheduler plugin and vineyard-operator more lightweight.

To be abbreviated, vineyard could work as a fluid runtime. Things need to be done to work together with fluid are as follows (if
I understand it correctly):

  • allowing mount an vineyard object as a volume. Vineyard server may need to provided a seperated IPC service for that.
  • implements a controller for vineyard in fluid (a fluid runtime).

Additional context

N/A

@sighingnow sighingnow added enhancement New feature or request kubernetes community Community discussions. component:vineyardd Issues about vineyardd proposal Enhancement proposals for vineyard. labels Jan 29, 2021
@sighingnow sighingnow changed the title Invistigate the roadmap of integration with fluid project Investigate the roadmap of integration with fluid project Feb 3, 2021
@sighingnow
Copy link
Member Author

Closing as we have getting started on the integration with fluid, see also #1596.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
community Community discussions. component:vineyardd Issues about vineyardd enhancement New feature or request kubernetes proposal Enhancement proposals for vineyard.
Projects
Archived in project
Development

No branches or pull requests

1 participant