Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

99 data product uploads #107

Closed
wants to merge 113 commits into from
Closed

99 data product uploads #107

wants to merge 113 commits into from

Commits on Oct 30, 2023

  1. Configuration menu
    Copy the full SHA
    b067ec9 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2023

  1. Configuration menu
    Copy the full SHA
    4a14ed1 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    1d5222a View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    9c8123f View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2023

  1. WIP - UI - see todos - allow two-way sync b/w Stepper's and AutoCompl…

    …ete's selected fileType value
    ri-pandey committed Nov 1, 2023
    Configuration menu
    Copy the full SHA
    0435911 View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2023

  1. Enhancements to Upload feature

    added ability to upload file
    
    added new page for data product upload
    
    created file upload part of stepper
    
    show warning before leaving route
    
    show failed status for failed files
    
    added retry ability for failed files
    
    show icons for indicating file upload status
    
    added progress circle
    
    reformat
    
    added File Type dropdown to Data Product Upload stepper
    
    perform validation before moving to next tab in stepper
    
    moved File Type dropdown into separate component
    
    added Raw Data select to form; disabled AutoCompleteSelect's value being controlled from outside
    
    resized dropdowns, changed button layout
    
    added validation for Source Raw Data
    
    added async validation for Data Product name
    
    use ternary
    
    store files within Data Product's parent directory
    
    added worker to merge file chunks
    ri-pandey committed Nov 7, 2023
    Configuration menu
    Copy the full SHA
    175cfff View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    16109a4 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    ca43727 View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2023

  1. Configuration menu
    Copy the full SHA
    1a86c55 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d45b562 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    162f422 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    4026beb View commit details
    Browse the repository at this point in the history
  5. fixed modal alert width

    ri-pandey committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    62d6956 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    27e9a95 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    09d989c View commit details
    Browse the repository at this point in the history
  8. renamed component

    ri-pandey committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    a0ac9a4 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    2c3c379 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    f52012a View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    f6fed4f View commit details
    Browse the repository at this point in the history
  12. changed scope

    ri-pandey committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    25ee2b2 View commit details
    Browse the repository at this point in the history

Commits on Nov 10, 2023

  1. Configuration menu
    Copy the full SHA
    0fe0425 View commit details
    Browse the repository at this point in the history

Commits on Nov 11, 2023

  1. Configuration menu
    Copy the full SHA
    101014f View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2023

  1. show details after submission

    trigger worker after upload
    
    provide file details needed for merging to worker
    
    prevent form submission if no files selected
    
    WIP - File Type not being seeded; show File Type in Uploads history
    
    corrected association; updated layout
    
    validate field before next step
    
    changed alert style
    
    tested merging code
    
    WIP - resume ability for failed uploads
    
    got retry button to be disabled/enabled based on upload status
    
    fixed runtime error
    
    tested showing error on upload fail, then showing correct status on retry, etc.
    
    added colors for new status values
    
    kick off worker after all files are uploaded
    
    validate checksums during upload
    
    provide ability to re-upload files in case of runtime errors
    
    rearranging variables
    
    added role to page
    
    added role to page
    
    don't show type UPLOAD data products on Raw Data page
    
    use correct HTTP method
    
    persist file metadata
    
    moved checksum evaluation into then chain
    
    removed redundant async/await
    
    update file log's and upload log's status after merge
    
    removed test exception
    
    finished implementing retry-merge feature
    
    delete partially merged file in case of exception
    
    changed upload path, dataset type
    
    added file_type field to Data Products table
    
    don't allow spaces in Data Product name
    
    added upload path to config
    
    WIP - testing
    ri-pandey committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    4cbfdb7 View commit details
    Browse the repository at this point in the history
  2. tested error handling

    ri-pandey committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    a7e0a8b View commit details
    Browse the repository at this point in the history
  3. testing

    ri-pandey committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    42d049f View commit details
    Browse the repository at this point in the history

Commits on Nov 18, 2023

  1. finished testing

    ri-pandey committed Nov 18, 2023
    Configuration menu
    Copy the full SHA
    dd84d16 View commit details
    Browse the repository at this point in the history
  2. show file type as chips

    ri-pandey committed Nov 18, 2023
    Configuration menu
    Copy the full SHA
    0ef38ba View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2023

  1. WIP - resume upload

    ri-pandey committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    dbd9f9f View commit details
    Browse the repository at this point in the history
  2. fixed checksum generation

    ri-pandey committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    0ecfc3c View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2023

  1. Configuration menu
    Copy the full SHA
    5c1028d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    ae5c917 View commit details
    Browse the repository at this point in the history
  3. renamed file

    ri-pandey committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    9140b14 View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2023

  1. tested retry code

    ri-pandey committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    ab7da4a View commit details
    Browse the repository at this point in the history

Commits on Nov 27, 2023

  1. testing

    ri-pandey committed Nov 27, 2023
    Configuration menu
    Copy the full SHA
    e68090d View commit details
    Browse the repository at this point in the history
  2. use isValid from useForm

    ri-pandey committed Nov 27, 2023
    Configuration menu
    Copy the full SHA
    427f440 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    c61f4fa View commit details
    Browse the repository at this point in the history

Commits on Nov 28, 2023

  1. Configuration menu
    Copy the full SHA
    ebd4b36 View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2023

  1. validate file's checksums post-merge

    update file and logs status together before page exit
    
    show Files on Uploads page
    
    check if workflow isn't running before triggering
    
    enable searching logs
    
    update status of all files upon FAILED
    ri-pandey committed Nov 29, 2023
    Configuration menu
    Copy the full SHA
    c90707d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    3a23712 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    c7135b1 View commit details
    Browse the repository at this point in the history
  4. cleanup

    ri-pandey committed Nov 29, 2023
    Configuration menu
    Copy the full SHA
    e4ff1e7 View commit details
    Browse the repository at this point in the history
  5. added access-control

    ri-pandey committed Nov 29, 2023
    Configuration menu
    Copy the full SHA
    fbeea3b View commit details
    Browse the repository at this point in the history
  6. added cron schedule

    ri-pandey committed Nov 29, 2023
    Configuration menu
    Copy the full SHA
    a254c9a View commit details
    Browse the repository at this point in the history

Commits on Nov 30, 2023

  1. Configuration menu
    Copy the full SHA
    3d05396 View commit details
    Browse the repository at this point in the history
  2. reverted config change

    ri-pandey committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    92a49f9 View commit details
    Browse the repository at this point in the history
  3. typo fix

    ri-pandey committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    da265c1 View commit details
    Browse the repository at this point in the history
  4. update status as last step

    ri-pandey committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    e783703 View commit details
    Browse the repository at this point in the history
  5. corrected status

    ri-pandey committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    47666ce View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2023

  1. allow script to fail

    ri-pandey committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    c1e9889 View commit details
    Browse the repository at this point in the history

Commits on Dec 10, 2023

  1. Configuration menu
    Copy the full SHA
    0281c66 View commit details
    Browse the repository at this point in the history

Commits on Dec 11, 2023

  1. Configuration menu
    Copy the full SHA
    d44b5fa View commit details
    Browse the repository at this point in the history
  2. use non-blocking method

    ri-pandey committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    0a9176d View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    1cd587b View commit details
    Browse the repository at this point in the history
  4. changed status code

    ri-pandey committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    24707f2 View commit details
    Browse the repository at this point in the history
  5. use more generic naming

    ri-pandey committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    946cb7b View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2023

  1. renamed

    ri-pandey committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    0c652c8 View commit details
    Browse the repository at this point in the history
  2. refactoring

    ri-pandey committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    5aa7cbb View commit details
    Browse the repository at this point in the history
  3. changed var name

    ri-pandey committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    2ba94bd View commit details
    Browse the repository at this point in the history
  4. several minor changes

    ri-pandey committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    c114ad0 View commit details
    Browse the repository at this point in the history
  5. added docs for upload

    ri-pandey committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    4257eb2 View commit details
    Browse the repository at this point in the history
  6. added comments

    ri-pandey committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    85ef223 View commit details
    Browse the repository at this point in the history
  7. moved

    ri-pandey committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    a998616 View commit details
    Browse the repository at this point in the history
  8. added docs

    ri-pandey committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    3a46a6a View commit details
    Browse the repository at this point in the history

Commits on Dec 19, 2023

  1. call upload API from UI

    ri-pandey committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    6ed585e View commit details
    Browse the repository at this point in the history
  2. updated arch diagram

    ri-pandey committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    9983b93 View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2024

  1. 114 and 104 fixes (#148)

    * Revert "Revert "104 Projects dataset pagination (#113)" (#145)"
    
    This reverts commit f4c58d7.
    
    * Revert "Revert "114 dynamic search (#122)" (#144)"
    
    This reverts commit 7af8f0b.
    
    * got search widget working with pagination
    
    * reset page index after dataset assignment
    
    * some cleaup
    
    * fixed responsiveness for widget in stepper
    
    * don't show assigned datasets, or ones meant for search, if user doesn't have appropriate access
    
    * removed temporary seeding code
    
    * some cleanup
    
    * allow operators/admins to edit datasets regardless of project-user association
    
    * removed comments
    
    * check for project-user association if role is user
    
    * edited comment
    
    * return datasets instead of project-dataset associations included
    ri-pandey committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    f67b0f0 View commit details
    Browse the repository at this point in the history

Commits on Feb 9, 2024

  1. Configuration menu
    Copy the full SHA
    b2a10c3 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    7c2fb87 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    8b65624 View commit details
    Browse the repository at this point in the history
  4. Return workflows info with paginated datasets (#153)

    * return wf info for paginated datasets
    
    * fixed property name
    
    * fixed return object
    ri-pandey committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    952a191 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    7a72252 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    26c2f79 View commit details
    Browse the repository at this point in the history

Commits on Feb 13, 2024

  1. Configuration menu
    Copy the full SHA
    08706b2 View commit details
    Browse the repository at this point in the history
  2. misc changes

    ri-pandey committed Feb 13, 2024
    Configuration menu
    Copy the full SHA
    a99f695 View commit details
    Browse the repository at this point in the history
  3. check for scope

    scadev committed Feb 13, 2024
    Configuration menu
    Copy the full SHA
    c33642d View commit details
    Browse the repository at this point in the history
  4. WIP - testing connection to secure_download

    scadev committed Feb 13, 2024
    Configuration menu
    Copy the full SHA
    372ada7 View commit details
    Browse the repository at this point in the history

Commits on Feb 16, 2024

  1. Configuration menu
    Copy the full SHA
    425dabe View commit details
    Browse the repository at this point in the history

Commits on Feb 17, 2024

  1. Configuration menu
    Copy the full SHA
    959b8fd View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    73e60b1 View commit details
    Browse the repository at this point in the history

Commits on Feb 19, 2024

  1. 146 inputs (#165)

    * ignore .vite
    
    * increased version
    ri-pandey committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    ac3da0c View commit details
    Browse the repository at this point in the history

Commits on Feb 20, 2024

  1. Configuration menu
    Copy the full SHA
    42f2d5e View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2024

  1. Configuration menu
    Copy the full SHA
    1aa4d5c View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b34955b View commit details
    Browse the repository at this point in the history
  3. use object instead of array

    ri-pandey committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    a95d881 View commit details
    Browse the repository at this point in the history
  4. Merge remote-tracking branch 'refs/remotes/origin/99-data-product-upl…

    …oads' into 99-data-product-uploads
    ri-pandey committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    6c9450a View commit details
    Browse the repository at this point in the history
  5. fixed .env.example

    ri-pandey committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    aa0529b View commit details
    Browse the repository at this point in the history
  6. use scope from env; log token

    scadev committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    280503f View commit details
    Browse the repository at this point in the history
  7. use provide/inject (#168)

    ri-pandey committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    7d8898b View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2024

  1. 77 about page (#156)

    * retrieve about text from api
    
    * WIP
    
    * escape input
    
    * switched to markdown-it
    
    * fixed some styles
    
    * use toast to show errors
    
    * size; reset after Cancel
    
    * made height fixed; use break-words
    
    * changed modal size
    
    * changed Edit button
    
    * allow users/operators to read
    
    * some UI changes
    
    * escape input; allow for creation or updating
    
    * use popover to indicate syntax
    
    * UI changes
    
    * added unauthenticated route
    
    * cleanup
    
    * changed routes; UI changes
    
    * WIP
    
    * force equal heights; made break-words work
    
    * use labels optionally
    
    * WIP
    
    * changed .gitignore; seed data
    
    * WIP - HTML line breaks missing
    
    * fixed several styles
    
    * fixed spacing; fonts
    
    * use constant height across different screen sizes
    
    * labels as props
    
    * edited seeding code
    ri-pandey committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    e45648d View commit details
    Browse the repository at this point in the history
  2. cleanup (#171)

    ri-pandey committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    c399dd9 View commit details
    Browse the repository at this point in the history

Commits on Feb 26, 2024

  1. Configuration menu
    Copy the full SHA
    d11bb0e View commit details
    Browse the repository at this point in the history
  2. WIP - token persistence

    ri-pandey committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    36e0cb7 View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2024

  1. refresh token

    ri-pandey committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    88d098b View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2024

  1. nodemon

    ri-pandey committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    cd64465 View commit details
    Browse the repository at this point in the history
  2. nodemon

    ri-pandey committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    831d7b5 View commit details
    Browse the repository at this point in the history
  3. nodemon

    ri-pandey committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    a093a51 View commit details
    Browse the repository at this point in the history
  4. nodemon

    ri-pandey committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    aea4a9b View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2024

  1. Configuration menu
    Copy the full SHA
    17411ae View commit details
    Browse the repository at this point in the history
  2. some minor refactoring

    ri-pandey committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    6fc1917 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    5cc3784 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    6bd4aba View commit details
    Browse the repository at this point in the history

Commits on Mar 30, 2024

  1. WIP - validation in store

    ri-pandey committed Mar 30, 2024
    Configuration menu
    Copy the full SHA
    2a41c79 View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2024

  1. bypass validation

    ri-pandey committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    99af60f View commit details
    Browse the repository at this point in the history
  2. migration

    ri-pandey committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    875fe6c View commit details
    Browse the repository at this point in the history
  3. route

    ri-pandey committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    b920164 View commit details
    Browse the repository at this point in the history
  4. fixed call

    ri-pandey committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    85d1205 View commit details
    Browse the repository at this point in the history
  5. logging

    ri-pandey committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    b71b798 View commit details
    Browse the repository at this point in the history
  6. logging

    ri-pandey committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    f2f38ee View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    24bebd7 View commit details
    Browse the repository at this point in the history
  8. logging

    ri-pandey committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    f1f150c View commit details
    Browse the repository at this point in the history
  9. 0

    ri-pandey committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    954d319 View commit details
    Browse the repository at this point in the history
  10. test removals

    ri-pandey committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    2799af0 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    7959375 View commit details
    Browse the repository at this point in the history