Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Reorganized and updated documentation for NameRes loading #28

Merged
merged 45 commits into from
Jan 18, 2023
Merged

Reorganized and updated documentation for NameRes loading #28

merged 45 commits into from
Jan 18, 2023

Commits on Sep 9, 2022

  1. Added data-loading dir for NameRes data loading instructions. 

    Also established `data-loading/data` for storing data and moved
csv2json.py into /data-loading.
    @gaurav
    gaurav committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    9ac0cfd View commit details
    Browse the repository at this point in the history

  2. First stab at a Makefile for converting synonym files to JSON.

    @gaurav
    gaurav committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    b1078a5 View commit details
    Browse the repository at this point in the history

  3. Added a requirements.txt file just for data loading.

    @gaurav
    gaurav committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    cd466a0 View commit details
    Browse the repository at this point in the history

  4. Fixed Makefile.

    @gaurav
    gaurav committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    9b7d738 View commit details
    Browse the repository at this point in the history

  5. Moved setup.sh to data loading.

    @gaurav
    gaurav committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    c851747 View commit details
    Browse the repository at this point in the history

  6. Improved .gitignore documentation.

    @gaurav
    gaurav committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    590ad16 View commit details
    Browse the repository at this point in the history

  7. Started writing a data loading README.

    @gaurav
    gaurav committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    efdb4b7 View commit details
    Browse the repository at this point in the history

  8. Tried to fix Makefile.

    @gaurav
    gaurav committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    3df4add View commit details
    Browse the repository at this point in the history

  9. Updated instructions.

    @gaurav
    gaurav committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    396c615 View commit details
    Browse the repository at this point in the history

  10. Updated setup.sh to use Unix line endings.

    @gaurav
    gaurav committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    63d776d View commit details
    Browse the repository at this point in the history

  11. A thing that runs.

    @gaurav
    gaurav committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    6d84df2 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2022

  1. Updated instructions, fixed Makefile and setup.sh.

    @gaurav
    gaurav committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    8ae7821 View commit details
    Browse the repository at this point in the history

  2. Added instructions on taking a backup.

    @gaurav
    gaurav committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    63c0b4d View commit details
    Browse the repository at this point in the history

  3. Updated data-loading instructions.

    @gaurav
    gaurav committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    edee24c View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2022

  1. Added a Dockerfile so the data-loading process can be containerized.

    @gaurav
    gaurav committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    b9ef726 View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2022

  1. Temporarily adding new Makefile.

    @gaurav
    gaurav committed Dec 6, 2022
    Configuration menu
    Copy the full SHA
    b45911c View commit details
    Browse the repository at this point in the history

  2. Fixed line-endings on data-loading/csv2json.py.

    @gaurav
    gaurav committed Dec 6, 2022
    Configuration menu
    Copy the full SHA
    53ffe11 View commit details
    Browse the repository at this point in the history

  3. Added some instructions.

    @gaurav
    gaurav committed Dec 6, 2022
    Configuration menu
    Copy the full SHA
    a06749d View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2022

  1. Don't include dev in Dockerfile; we use it to speed up development.

    @gaurav
    gaurav committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    7b41dc6 View commit details
    Browse the repository at this point in the history

Commits on Dec 8, 2022

  1. Added code to start Solr and record the PID.

    @gaurav
    gaurav committed Dec 8, 2022
    Configuration menu
    Copy the full SHA
    7cbc300 View commit details
    Browse the repository at this point in the history

  2. Added lsof to Docker image.

    @gaurav
    gaurav committed Dec 8, 2022
    Configuration menu
    Copy the full SHA
    cf9f6a9 View commit details
    Browse the repository at this point in the history

  3. Added info-level debugging messages.

    @gaurav
    gaurav committed Dec 8, 2022
    Configuration menu
    Copy the full SHA
    e81e856 View commit details
    Browse the repository at this point in the history

  4. First stab at adding the CSV2JSON code.

    @gaurav
    gaurav committed Dec 8, 2022
    Configuration menu
    Copy the full SHA
    f28b812 View commit details
    Browse the repository at this point in the history

Commits on Dec 9, 2022

  1. Added instructions for loading data into Solr.

    @gaurav
    gaurav committed Dec 9, 2022
    Configuration menu
    Copy the full SHA
    0e931d3 View commit details
    Browse the repository at this point in the history

  2. Updated older Makefile.

    @gaurav
    gaurav committed Dec 9, 2022
    Configuration menu
    Copy the full SHA
    904bad6 View commit details
    Browse the repository at this point in the history

  3. Updated paths.

    @gaurav
    gaurav committed Dec 9, 2022
    Configuration menu
    Copy the full SHA
    361606a View commit details
    Browse the repository at this point in the history

  4. Added README and Makefile to Dockerfile.

    @gaurav
    gaurav committed Dec 9, 2022
    Configuration menu
    Copy the full SHA
    68f65c3 View commit details
    Browse the repository at this point in the history

  5. Oops, COPY command incorrect.

    @gaurav
    gaurav committed Dec 9, 2022
    Configuration menu
    Copy the full SHA
    c19d6fa View commit details
    Browse the repository at this point in the history

  6. Added basic Kubernetes files for data-loading.

    @gaurav
    gaurav committed Dec 9, 2022
    Configuration menu
    Copy the full SHA
    9ca672b View commit details
    Browse the repository at this point in the history

  7. Added /tmp to nameres-loading.

    @gaurav
    gaurav committed Dec 9, 2022
    Configuration menu
    Copy the full SHA
    917c1e0 View commit details
    Browse the repository at this point in the history

  8. Added some ephemeral storage.

    @gaurav
    gaurav committed Dec 9, 2022
    Configuration menu
    Copy the full SHA
    ff467a4 View commit details
    Browse the repository at this point in the history

Commits on Dec 10, 2022

  1. Removed mapping for /tmp.

    @gaurav
    gaurav committed Dec 10, 2022
    Configuration menu
    Copy the full SHA
    3e8de14 View commit details
    Browse the repository at this point in the history

  2. Added Solr port so we can use this as a Solr server for testing.

    @gaurav
    gaurav committed Dec 10, 2022
    Configuration menu
    Copy the full SHA
    9ff77c1 View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2022

  1. Upgraded Solr to 9.1.0.

    @gaurav
    gaurav committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    f9a1aed View commit details
    Browse the repository at this point in the history

  2. Improved documentation on Nameres PVCs.

    @gaurav
    gaurav committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    53703b2 View commit details
    Browse the repository at this point in the history

  3. Separated limit and request quotas.

    @gaurav
    gaurav committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    f9d6873 View commit details
    Browse the repository at this point in the history

  4. Changed memory limit to 64G.

    @gaurav
    gaurav committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    97836ce View commit details
    Browse the repository at this point in the history

  5. Removed storage limit (which seems to be ignored).

    @gaurav
    gaurav committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    5036668 View commit details
    Browse the repository at this point in the history

  6. Improved Makefile.

    @gaurav
    gaurav committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    5035370 View commit details
    Browse the repository at this point in the history

  7. Added imagePullPolicy so we always get the latest dev release.

    @gaurav
    gaurav committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    969d5eb View commit details
    Browse the repository at this point in the history

  8. Fixed location of imagePullPolicy.

    @gaurav
    gaurav committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    a8eabd3 View commit details
    Browse the repository at this point in the history

  9. Added logs to setup.sh output.

    @gaurav
    gaurav committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    5a705d5 View commit details
    Browse the repository at this point in the history

Commits on Jan 17, 2023

  1. Updated to latest Babel release.

    @gaurav
    gaurav committed Jan 17, 2023
    Configuration menu
    Copy the full SHA
    4d42812 View commit details
    Browse the repository at this point in the history

Commits on Jan 18, 2023

  1. Fixed a path in README.

    @gaurav
    gaurav committed Jan 18, 2023
    Configuration menu
    Copy the full SHA
    2df169b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into fix-instructions

    @gaurav
    gaurav committed Jan 18, 2023
    Configuration menu
    Copy the full SHA
    ec91f76 View commit details
    Browse the repository at this point in the history