Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature/issue 25 llm for noc code lookup #1111

Closed
wants to merge 76 commits into from
Closed

Feature/issue 25 llm for noc code lookup #1111

wants to merge 76 commits into from

Commits on Feb 29, 2024

  1. Implement example from https://www.youtube.com/watch?v=jENqvjpkwmw

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    d15227d View commit details
    Browse the repository at this point in the history

Commits on Mar 12, 2024

  1. progress

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    2a3652b View commit details
    Browse the repository at this point in the history

  2. progress

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    d137b82 View commit details
    Browse the repository at this point in the history

  3. Can do the query about ollama

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    88a5ae6 View commit details
    Browse the repository at this point in the history

  4. Issue XXXX Can ask about the code for a given role

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    925b905 View commit details
    Browse the repository at this point in the history

  5. progress

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    bcfd6bd View commit details
    Browse the repository at this point in the history

  6. progress

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    14e1039 View commit details
    Browse the repository at this point in the history

  7. Issue #XXX Identify code for executive assistant in film

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    901dfa8 View commit details
    Browse the repository at this point in the history

  8. Issue #XXX JD for hospital chef

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    e8b7884 View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2024

  1. Issue #XXX Make progress on cohere and ollama rag demos

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    4d39570 View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2024

  1. progress

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    100fe54 View commit details
    Browse the repository at this point in the history

  2. progress

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    a178e97 View commit details
    Browse the repository at this point in the history

  3. Issue XXXX Use json for the docs

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    a168198 View commit details
    Browse the repository at this point in the history

  4. progress

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    030101b View commit details
    Browse the repository at this point in the history

  5. Issue #### Remove chuncking, use one NOC code as a chunck

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    88aa631 View commit details
    Browse the repository at this point in the history

  6. Issue #### Filter out duplicate noc codes

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    1338a0c View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2024

  1. Try persisting embeddings

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    8286ce0 View commit details
    Browse the repository at this point in the history

  2. Issue XXXX Persisting embeddings seem to work...

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    60caf3b View commit details
    Browse the repository at this point in the history

  3. Progress

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    3017706 View commit details
    Browse the repository at this point in the history

  4. CleanUp

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    a5637c9 View commit details
    Browse the repository at this point in the history

  5. CleanUp

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    d7e6a41 View commit details
    Browse the repository at this point in the history

  6. Issue #XXXX Add basic timing info

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    1946b62 View commit details
    Browse the repository at this point in the history

  7. CleanUp

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    902697d View commit details
    Browse the repository at this point in the history

  8. Issue #XXXX Create model file with system prompt. Command to build th… 

    …e model: `ollama create noc_master -f ./MODEL`
    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    c087f17 View commit details
    Browse the repository at this point in the history

  9. Issue #XXXX Clean up of the model file

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    1e4f1ba View commit details
    Browse the repository at this point in the history

  10. Issue #XXXX Generated some job descriptions using chat gpt

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    2970eee View commit details
    Browse the repository at this point in the history

  11. progress

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    b5bb437 View commit details
    Browse the repository at this point in the history

  12. Issue #XXX Prompt is too slow

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    f85ad18 View commit details
    Browse the repository at this point in the history

  13. Issue #XXX Simpler prompt that may work better

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    ad326ba View commit details
    Browse the repository at this point in the history

Commits on Mar 19, 2024

  1. progresss

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    4975e40 View commit details
    Browse the repository at this point in the history

  2. Issue #XXXX prompt gives pretty consistent JSON back

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    b492a20 View commit details
    Browse the repository at this point in the history

  3. Tweaks

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    a0f282e View commit details
    Browse the repository at this point in the history

  4. Issue #XXXX Polish

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    73c9e3c View commit details
    Browse the repository at this point in the history

Commits on Mar 21, 2024

  1. Issue #XX First commit of cloud based (AWS) AI script

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    6a12d8c View commit details
    Browse the repository at this point in the history

  2. progress

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    d47980f View commit details
    Browse the repository at this point in the history

  3. step

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    a101caa View commit details
    Browse the repository at this point in the history

  4. Issue #XXXXX Add requirements files for bedrock and ollama

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    8ba5e56 View commit details
    Browse the repository at this point in the history

  5. Issue #XXXX Fix library statements

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    b7358ff View commit details
    Browse the repository at this point in the history

Commits on Mar 26, 2024

  1. steps

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    eda843e View commit details
    Browse the repository at this point in the history

  2. step

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    145ab22 View commit details
    Browse the repository at this point in the history

  3. steps

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    3fc6866 View commit details
    Browse the repository at this point in the history

  4. Issue #XXXX Three stages are in place, with user input to select winn… 

    …er each time
    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    7058442 View commit details
    Browse the repository at this point in the history

  5. step

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    4914191 View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2024

  1. step

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    7fb4795 View commit details
    Browse the repository at this point in the history

  2. Making progress, did not run out of memory!

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    6dbab15 View commit details
    Browse the repository at this point in the history

  3. Chroma database no longer running out of memory

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    6a2cd2c View commit details
    Browse the repository at this point in the history

  4. Can handle the persisted database existing or not

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    a04d753 View commit details
    Browse the repository at this point in the history

  5. renamed files

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    4b87d1d View commit details
    Browse the repository at this point in the history

  6. Clean up

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    bd812f7 View commit details
    Browse the repository at this point in the history

  7. Issue XXXX Read job descriptions to find matchess

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    82a40bf View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2024

  1. it's working!!

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    5e9ffe7 View commit details
    Browse the repository at this point in the history

  2. Can connect to zilliz

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    c3c2535 View commit details
    Browse the repository at this point in the history

Commits on Mar 30, 2024

  1. Zilliz: document insert works

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Mar 30, 2024
    Configuration menu
    Copy the full SHA
    9659870 View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2024

  1. Issue #### Can prepare json for import into a Zilliz collection

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    df74b03 View commit details
    Browse the repository at this point in the history

  2. Issue #### Compute embeddings using all-MinimLM-L6-v2

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    de07ec4 View commit details
    Browse the repository at this point in the history

  3. Vector searches in Zilliz now works

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    fd8d6ae View commit details
    Browse the repository at this point in the history

  4. tool for computing embeddings for job descriptions

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    1f50dc8 View commit details
    Browse the repository at this point in the history

  5. CleanUp

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    a5cc722 View commit details
    Browse the repository at this point in the history

  6. Can query server with BEARER authentication

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    1441267 View commit details
    Browse the repository at this point in the history

  7. progress

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    aecfbc8 View commit details
    Browse the repository at this point in the history

  8. CleanUp

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    4bed16b View commit details
    Browse the repository at this point in the history

  9. CleanUp

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    f7d7f8f View commit details
    Browse the repository at this point in the history

  10. improved command line argument handling

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    6e83d33 View commit details
    Browse the repository at this point in the history

  11. Improvements

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    e83a55d View commit details
    Browse the repository at this point in the history

  12. Step

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    9197db7 View commit details
    Browse the repository at this point in the history

Commits on Apr 2, 2024

  1. Delete a file

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    cf0684f View commit details
    Browse the repository at this point in the history

  2. Rename a file

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    6177226 View commit details
    Browse the repository at this point in the history

  3. Translate file from py to js

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    4709a71 View commit details
    Browse the repository at this point in the history

  4. progress

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    4e94092 View commit details
    Browse the repository at this point in the history

  5. step

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    40369dd View commit details
    Browse the repository at this point in the history

  6. step

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    183b24e View commit details
    Browse the repository at this point in the history

  7. step

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    03f94e7 View commit details
    Browse the repository at this point in the history

  8. step

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    24df338 View commit details
    Browse the repository at this point in the history

  9. step

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    66be9bd View commit details
    Browse the repository at this point in the history

  10. renames

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    be34b75 View commit details
    Browse the repository at this point in the history

  11. step

    @rasmus-storjohann-PG
    rasmus-storjohann-PG committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    e527fad View commit details
    Browse the repository at this point in the history