Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support provisioning of qtrees instead of volumes to improve Trident scalability #2

Closed
arndt-netapp opened this issue Jan 5, 2017 · 8 comments

Comments

@arndt-netapp
Copy link
Contributor

Requesting that Trident implement a capability to provision qtrees instead of flexible volumes (flexvols) for each new PVC. At the time of this RFE, ONTAP supports up to 1000 flexvols per node and 12,000 flexvols per cluster. In some environments, customers will have a desire to provision many small volumes with Trident, and will certainly run into the 1000 flexvols per node or 12,000 flexvols per cluster limit before they run into performance or capacity limits on a node or cluster. A qtree based implementation would assume that the user must configure Trident with a list of SVMs and pre-created flexvols on those SVMs that can be used for qtree based provisioning. Trident should then load balance the creation of new qtrees across those flexvols based on free capacity and the number of qtrees already created in each flexvol. Note that there are limits of 4,995 qtrees per flexvol and 100,000 qtrees per node.

@innergy
Copy link
Contributor

innergy commented Jan 5, 2017

Thanks for the feedback. Using qtrees is one possible approach for ONTAP, there are others worth considering. This will require careful design, because capabilities are lost when you move away from a full volume.

@nthawani
Copy link

We are large organization with thousands of qtrees presented to OSE w/Kubernetes. We are unable to implement Trident because of its limitation on qtree support. We would love to see qtree support in Trident.

@adkerr
Copy link
Contributor

adkerr commented Mar 1, 2017

Tracked internally as [US2505]

@adkerr adkerr added the tracked label Mar 1, 2017
@netapp-ci
Copy link
Collaborator

(Comment from NetApp CI):

(Comment from Andrew Kerr):

Tracked internally as [US2505]

@kaparora
Copy link

kaparora commented Sep 5, 2017

Do we have any status on this request? Is this being worked on ? Still under consideration?

@clintonk
Copy link
Contributor

clintonk commented Sep 5, 2017

Hi, Kapil. Yes, we're working on the scalability question. Stay tuned.

@kaparora
Copy link

Hi Clinton,
Awesome work!
When is this getting released? Any tentative dates?
Kapil

@adkerr
Copy link
Contributor

adkerr commented Sep 20, 2017

We plan to have a beta shortly and it will be included in the 17.10 release (so October release)

netapp-ci pushed a commit that referenced this issue Jan 4, 2019
* Add k8s v1.13.0 references to the docs and bump version in code

* Add k8s v1.13.0 references to the docs and bump version in code
netapp-ci pushed a commit that referenced this issue Jul 30, 2019
* [WIP] Doc updates for 19.07

This patch includes updates to the RTD for the 19.07 GA
release. Items addressed include a "What's new" section,
a Virtual pools section to Element and Santricity backends,
updating the "deploying" section.

* Update concepts_and_definitions.rst

* Update concepts_and_definitions.rst

* Update netapp_products_integrations.rst

* Update netapp_products_integrations.rst

* Update netapp_products_integrations.rst

* Update netapp_products_integrations.rst

* Update storage_configuration_trident.rst

* Update storage_configuration_trident.rst

* Update storage_configuration_trident.rst

* Update integrating_trident.rst

* Update integrating_trident.rst

* [WIP] Doc updates for 19.07

This patch includes updates to the RTD for the 19.07 GA
release. Items addressed include a "What's new" section,
a Virtual pools section to Element and Santricity backends,
updating the "deploying" section.

* Update integrating_trident.rst

* Update integrating_trident.rst

* Update integrating_trident.rst

* Update integrating_trident.rst

* Update integrating_trident.rst

* Update deploying_trident.rst

* Update deploying_trident.rst

* Update backup_disaster_recovery.rst

* Updates to reference pages

Minor updates to installation procedure
and reference pages

* Update backup_disaster_recovery.rst

* Update backup_disaster_recovery.rst

* Update to CSI Trident section

Changes made to the CSI Trident section which include
feature flags required, installation/uninstallation/usage
updates

* Minor fix

* Update backup_disaster_recovery.rst

* Update backup_disaster_recovery.rst

* Update backup_disaster_recovery.rst

* Update backup_disaster_recovery.rst

* Update backup_disaster_recovery.rst

* Update backup_disaster_recovery.rst

* Update backup_disaster_recovery.rst

* Update backup_disaster_recovery.rst

* Update backup_disaster_recovery.rst

* Update backup_disaster_recovery.rst

* Update integrating_trident.rst

* Update integrating_trident.rst

* Update integrating_trident.rst

* Update deploying_trident.rst

* Update deploying_trident.rst

* Update deploying_trident.rst

* Update deploying_trident.rst

* Update storage_configuration_trident.rst

* Update netapp_products_integrations.rst

* Update netapp_products_integrations.rst

* Update concepts_and_definitions.rst

* Update deploying_trident.rst

* Update deploying_trident.rst

* Update frequently_asked_questions.rst

* Update deploying_trident.rst

* Update frequently_asked_questions.rst

* Update frequently_asked_questions.rst

* Update frequently_asked_questions.rst

* Update backup_disaster_recovery.rst

* Update integrating_trident.rst

* Update deploying_trident.rst

* Update backup_disaster_recovery.rst

* Update concepts_and_definitions.rst

* Update backup_disaster_recovery.rst

* Update frequently_asked_questions.rst

* Fixes to upgrade/downgrade and etcd removal

Removing all mentions of etcd for Trident
Includes a how-to for upgrading to Trident 19.07
and optional downgrade

* Update deploying_trident.rst

* Update deploying_trident.rst

* Add Azure NetApp Files documentation

* Minor fixes

* Update concepts_and_definitions.rst

* Update storage_configuration_trident.rst

* Update integrating_trident.rst

* Update storage_configuration_trident.rst

* Update storage_configuration_trident.rst

* Update integrating_trident.rst

* Fixes

Addressing Jacob's feedback

* Fixing syntax errors

Build errors due to improper formatting and ref calls
are fixed

* Cleanup and reformatting

Cleanup and refactor the DAG for 19.07

* Update integrating_trident.rst

* Update integrating_trident.rst

* Deleting volumes/backends with snapshots

Volumes/Backend deletion will only be completed
if associated snapshots are cleaned up

* Minor changes

* HCI/SolidFire backend support

Include HCI with SolidFire as a supported backend for Element OS

* Minor formatting

* Update backup_disaster_recovery.rst

* Update backup_disaster_recovery.rst

* Update deploying_trident.rst

* Update deploying_trident.rst

* Update deploying_trident.rst

* Update deploying_trident.rst

* Update deploying_trident.rst

* Update frequently_asked_questions.rst

* Update backup_disaster_recovery.rst

* Update backup_disaster_recovery.rst

* Update frequently_asked_questions.rst

* Upgrading PVs

Doc changes for upgrading PVs and codeblock to show the output
for upgrading to Trident 19.07

* Fix vol import section

* Fix #1

* Update Virtual Storage Pools image

* Fix #2

A majority of fixes included in this commit:
. A separate upgrade page
. obliviate mention in crds
. img update
. other fixes

* You have been warned

* Update backup_disaster_recovery.rst

* Update backup_disaster_recovery.rst

* Update backup_disaster_recovery.rst

* Updates to install & upgrade procedures

* Updating reflinks

* Include reflinks

* Numbering fix

* Mention the backends that support on-demand snapshots

* Minor fix

* Universal Virtual storage pools section

* Update deploying_trident.rst

* Update frequently_asked_questions.rst

* Update backup_disaster_recovery.rst

* Update deploying_trident.rst

* Update integrating_trident.rst

* Update integrating_trident.rst

* Update security_recommendations.rst

* Fixes

* Final set of fixes

* Minor fix

* Minor updates

* Cleanup

* Fixes

* Update security_recommendations.rst

* Fixes
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

7 participants