Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use a Set for id lookup #1088

Merged
merged 2 commits into from
May 21, 2024
Merged

Use a Set for id lookup #1088

merged 2 commits into from
May 21, 2024

Conversation

dmfalke
Copy link
Member

@dmfalke dmfalke commented May 13, 2024

This PR is meant to address some inefficiencies when a study has >120,000 variables.

Changes include:

  • Use a Set for lookups, rather than Array.prototype.includes

For now, we will only support 30K variables.

@dmfalke
Copy link
Member Author

dmfalke commented May 13, 2024

Viz picker is now usable
Screencast from 2024-05-13 11-06-05.webm

@dmfalke dmfalke marked this pull request as ready for review May 15, 2024 17:13
@dmfalke dmfalke requested a review from asizemore May 15, 2024 17:13
@asizemore
Copy link
Member

asizemore commented May 16, 2024

Sweet! How would you like me to test? Just general testing to make sure it works on other datasets? Or would you like me to test it on the super big dataset? Happy to do whatever would be most helpful!

@dmfalke
Copy link
Member Author

dmfalke commented May 16, 2024

I think the main thing is to test that the test being performed is still correct

Copy link
Member

@asizemore asizemore left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm!

@dmfalke dmfalke merged commit 7e97ee8 into main May 21, 2024
1 check passed
@dmfalke dmfalke deleted the eda-handle-many-variables branch May 21, 2024 20:40
dmfalke added a commit that referenced this pull request Jul 9, 2024
dmfalke added a commit that referenced this pull request Jul 10, 2024
* Display invalid filters so they can be removed (#1124)

* Display invalid filters so they can be removed

* Update tooltip verbiage

(cherry picked from commit 90cfd8f)

* Add banner related to fixing variable identifiers in mbio (#1128)

(cherry picked from commit 51f3d57)

* Use a Set for id lookup (#1088)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants