Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automate WMDA MV4 "homework" #1294

Open
zabeen opened this issue Apr 24, 2024 · 0 comments
Open

Automate WMDA MV4 "homework" #1294

zabeen opened this issue Apr 24, 2024 · 0 comments
Labels
testing Tasks related to testing of Atlas, no dev required

Comments

@zabeen
Copy link
Collaborator

zabeen commented Apr 24, 2024

Homework from MV4 currently involves running specific patient-donor pairs through Atlas and returning the "working out". That means: genotype lists for patient and donor, and the matching genotypes list.

We have debug endpoints that generate this data, but need to automate entire process:

Single new locally running manual testing function that accepts:

  • a list of PIDs and DIDs
  • location to save the results
  • homework set name (will be used to name the result folder)
  • match loci

For each PDP:

  1. Check if patient is typed at all match loci.
  2. Check if donor is typed at A, B, and DRB1.
  3. Only if patient and donor are typed at required loci, then continue, else save IDs with missing info to file.
  4. Send imputation request for patient to remote Atlas instance
  5. Process patient imputation result, and store as a CSV file
  6. Repeat 1 & 2 for donor
  7. Send matching genotypes request
  8. Process matching genotypes result, store as a CSV file
  9. Optional (if possible), copy contents of CSV files to a single Excel spreadsheet (existing template is available)
  • Results files should be named after the patient/donor/PDP
@zabeen zabeen added the testing Tasks related to testing of Atlas, no dev required label Apr 24, 2024
@zabeen zabeen self-assigned this Apr 24, 2024
zabeen added a commit that referenced this issue May 1, 2024
zabeen added a commit that referenced this issue May 1, 2024
zabeen added a commit that referenced this issue May 1, 2024
zabeen added a commit that referenced this issue May 1, 2024
zabeen added a commit that referenced this issue May 1, 2024
zabeen added a commit that referenced this issue May 1, 2024
zabeen added a commit that referenced this issue May 2, 2024
zabeen added a commit that referenced this issue May 2, 2024
zabeen added a commit that referenced this issue May 2, 2024
zabeen added a commit that referenced this issue May 2, 2024
zabeen added a commit that referenced this issue May 2, 2024
zabeen added a commit that referenced this issue May 2, 2024
zabeen added a commit that referenced this issue May 3, 2024
zabeen added a commit that referenced this issue May 3, 2024
zabeen added a commit that referenced this issue May 3, 2024
zabeen added a commit that referenced this issue May 3, 2024
zabeen added a commit that referenced this issue May 6, 2024
zabeen added a commit that referenced this issue May 6, 2024
zabeen added a commit that referenced this issue May 6, 2024
---

docs: #1294: Added homework instructions and updated debug client models changelog.

chore: #1294: Updated SQL queries.

refactor: #1294: Yield Genotype matcher response as enumerable prevent memory exceptions.

refactor: #1294: Use IEnumerable when bulk inserting to reduce memory usage.

chore: #1294: Add SQL to select out

chore: #1294: Store matching genotypes

refactor: #1294: Move match prediction debug models to debug client models namespace.

chore: #1294: Add HLA version to homework set.

chore: #1294: SQL for selecting out homework subjects with missing HLA.

chore: #1294: Process all sets imported found in a directory.

chore: #1294: Import pdps directly from file.

chore: #1294: Detect subjects with missing HLA.

chore: #1294: Add functions to submit MV4 homework request.

chore: #1294: Add genotype count to debug model, genotype matcher response.
zabeen added a commit that referenced this issue May 6, 2024
---

docs: #1294: Added homework instructions and updated debug client models changelog.

chore: #1294: Updated SQL queries.

refactor: #1294: Yield Genotype matcher response as enumerable prevent memory exceptions.

refactor: #1294: Use IEnumerable when bulk inserting to reduce memory usage.

chore: #1294: Add SQL to select out

chore: #1294: Store matching genotypes

refactor: #1294: Move match prediction debug models to debug client models namespace.

chore: #1294: Add HLA version to homework set.

chore: #1294: SQL for selecting out homework subjects with missing HLA.

chore: #1294: Process all sets imported found in a directory.

chore: #1294: Import pdps directly from file.

chore: #1294: Detect subjects with missing HLA.

chore: #1294: Add functions to submit MV4 homework request.

chore: #1294: Add genotype count to debug model, genotype matcher response.
zabeen added a commit that referenced this issue May 6, 2024
---

docs: #1294: Added homework instructions and updated debug client models changelog.

chore: #1294: Updated SQL queries.

refactor: #1294: Yield Genotype matcher response as enumerable prevent memory exceptions.

refactor: #1294: Use IEnumerable when bulk inserting to reduce memory usage.

chore: #1294: Add SQL to select out

chore: #1294: Store matching genotypes

refactor: #1294: Move match prediction debug models to debug client models namespace.

chore: #1294: Add HLA version to homework set.

chore: #1294: SQL for selecting out homework subjects with missing HLA.

chore: #1294: Process all sets imported found in a directory.

chore: #1294: Import pdps directly from file.

chore: #1294: Detect subjects with missing HLA.

chore: #1294: Add functions to submit MV4 homework request.

chore: #1294: Add genotype count to debug model, genotype matcher response.
zabeen added a commit that referenced this issue May 6, 2024
---

docs: #1294: Added homework instructions and updated debug client models changelog.

chore: #1294: Updated SQL queries.

refactor: #1294: Yield Genotype matcher response as enumerable prevent memory exceptions.

refactor: #1294: Use IEnumerable when bulk inserting to reduce memory usage.

chore: #1294: Add SQL to select out

chore: #1294: Store matching genotypes

refactor: #1294: Move match prediction debug models to debug client models namespace.

chore: #1294: Add HLA version to homework set.

chore: #1294: SQL for selecting out homework subjects with missing HLA.

chore: #1294: Process all sets imported found in a directory.

chore: #1294: Import pdps directly from file.

chore: #1294: Detect subjects with missing HLA.

chore: #1294: Add functions to submit MV4 homework request.

chore: #1294: Add genotype count to debug model, genotype matcher response.
zabeen added a commit that referenced this issue May 6, 2024
---

docs: #1294: Added homework instructions and updated debug client models changelog.

chore: #1294: Updated SQL queries.

refactor: #1294: Yield Genotype matcher response as enumerable prevent memory exceptions.

refactor: #1294: Use IEnumerable when bulk inserting to reduce memory usage.

chore: #1294: Add SQL to select out

chore: #1294: Store matching genotypes

refactor: #1294: Move match prediction debug models to debug client models namespace.

chore: #1294: Add HLA version to homework set.

chore: #1294: SQL for selecting out homework subjects with missing HLA.

chore: #1294: Process all sets imported found in a directory.

chore: #1294: Import pdps directly from file.

chore: #1294: Detect subjects with missing HLA.

chore: #1294: Add functions to submit MV4 homework request.

chore: #1294: Add genotype count to debug model, genotype matcher response.
zabeen added a commit that referenced this issue May 6, 2024
---

docs: #1294: Added homework instructions and updated debug client models changelog.

chore: #1294: Updated SQL queries.

refactor: #1294: Yield Genotype matcher response as enumerable prevent memory exceptions.

refactor: #1294: Use IEnumerable when bulk inserting to reduce memory usage.

chore: #1294: Add SQL to select out

chore: #1294: Store matching genotypes

refactor: #1294: Move match prediction debug models to debug client models namespace.

chore: #1294: Add HLA version to homework set.

chore: #1294: SQL for selecting out homework subjects with missing HLA.

chore: #1294: Process all sets imported found in a directory.

chore: #1294: Import pdps directly from file.

chore: #1294: Detect subjects with missing HLA.

chore: #1294: Add functions to submit MV4 homework request.

chore: #1294: Add genotype count to debug model, genotype matcher response.
zabeen added a commit that referenced this issue May 6, 2024
---

docs: #1294: Added homework instructions and updated debug client models changelog.

chore: #1294: Updated SQL queries.

refactor: #1294: Yield Genotype matcher response as enumerable prevent memory exceptions.

refactor: #1294: Use IEnumerable when bulk inserting to reduce memory usage.

chore: #1294: Add SQL to select out

chore: #1294: Store matching genotypes

refactor: #1294: Move match prediction debug models to debug client models namespace.

chore: #1294: Add HLA version to homework set.

chore: #1294: SQL for selecting out homework subjects with missing HLA.

chore: #1294: Process all sets imported found in a directory.

chore: #1294: Import pdps directly from file.

chore: #1294: Detect subjects with missing HLA.

chore: #1294: Add functions to submit MV4 homework request.

chore: #1294: Add genotype count to debug model, genotype matcher response.
zabeen added a commit that referenced this issue May 6, 2024
---

docs: #1294: Added homework instructions and updated debug client models changelog.

chore: #1294: Updated SQL queries.

refactor: #1294: Yield Genotype matcher response as enumerable prevent memory exceptions.

refactor: #1294: Use IEnumerable when bulk inserting to reduce memory usage.

chore: #1294: Add SQL to select out

chore: #1294: Store matching genotypes

refactor: #1294: Move match prediction debug models to debug client models namespace.

chore: #1294: Add HLA version to homework set.

chore: #1294: SQL for selecting out homework subjects with missing HLA.

chore: #1294: Process all sets imported found in a directory.

chore: #1294: Import pdps directly from file.

chore: #1294: Detect subjects with missing HLA.

chore: #1294: Add functions to submit MV4 homework request.

chore: #1294: Add genotype count to debug model, genotype matcher response.
zabeen added a commit that referenced this issue May 6, 2024
---

docs: #1294: Added homework instructions and updated debug client models changelog.

chore: #1294: Updated SQL queries.

refactor: #1294: Yield Genotype matcher response as enumerable prevent memory exceptions.

refactor: #1294: Use IEnumerable when bulk inserting to reduce memory usage.

chore: #1294: Add SQL to select out

chore: #1294: Store matching genotypes

refactor: #1294: Move match prediction debug models to debug client models namespace.

chore: #1294: Add HLA version to homework set.

chore: #1294: SQL for selecting out homework subjects with missing HLA.

chore: #1294: Process all sets imported found in a directory.

chore: #1294: Import pdps directly from file.

chore: #1294: Detect subjects with missing HLA.

chore: #1294: Add functions to submit MV4 homework request.

chore: #1294: Add genotype count to debug model, genotype matcher response.
zabeen added a commit that referenced this issue May 7, 2024
zabeen added a commit that referenced this issue May 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
testing Tasks related to testing of Atlas, no dev required
Projects
Status: Done
Development

No branches or pull requests

1 participant