Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(LAB-2944): add file data conversion prior to import for new llm format #1714

Conversation

BlueGrizzliBear
Copy link
Contributor

@BlueGrizzliBear BlueGrizzliBear commented Jun 17, 2024

  • Adds file data conversion from chat (Mistral) format (if present) to our asset content format
  • Adds jsonMetadata for the following keys :
    • chat_id
    • chat_item_ids
    • models
    • text (for asset interface display) : with chat_id and chat_item_ids
  • Adds 3 tests :
    • one for uploading a file in chat format without jsonMetadata
    • one for uploading a file in chat format with jsonMetadata
    • one for unit testing the processJson method which converts the chat format file data into llm kili format asset data

@BlueGrizzliBear BlueGrizzliBear force-pushed the feature/lab-2944-aa-mistral-user-i-import-my-data-using-my-preferred-format branch from 95f1991 to 6d56a20 Compare June 17, 2024 15:36
@BlueGrizzliBear BlueGrizzliBear force-pushed the feature/lab-2944-aa-mistral-user-i-import-my-data-using-my-preferred-format branch from 6d56a20 to e9d9701 Compare June 17, 2024 16:09
@BlueGrizzliBear BlueGrizzliBear force-pushed the feature/lab-2944-aa-mistral-user-i-import-my-data-using-my-preferred-format branch from a8d333f to 3518d1d Compare June 21, 2024 08:02
@BlueGrizzliBear BlueGrizzliBear self-assigned this Jun 24, 2024
@BlueGrizzliBear BlueGrizzliBear force-pushed the feature/lab-2944-aa-mistral-user-i-import-my-data-using-my-preferred-format branch from 643b806 to 69acfe4 Compare June 24, 2024 12:36
@BlueGrizzliBear
Copy link
Contributor Author

I just added another error in case of a payload with no user prompt (no item with "model": None)

@baptiste-olivier baptiste-olivier merged commit 88338cd into main Jun 24, 2024
13 checks passed
@baptiste-olivier baptiste-olivier deleted the feature/lab-2944-aa-mistral-user-i-import-my-data-using-my-preferred-format branch June 24, 2024 14:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants