Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Example for LLM model #89

Merged
merged 11 commits into from
Feb 26, 2023
Merged

Example for LLM model #89

merged 11 commits into from
Feb 26, 2023

Conversation

a-r-r-o-w
Copy link
Contributor

@a-r-r-o-w a-r-r-o-w commented Feb 20, 2023

As mentioned in #34, this example contains:

  • An example to highlight how UpTrain can be used to smartly fine-tune a LLM
  • A model signal using sentiment analysis
  • A model signal using keyword search

This PR is opened as a draft because of the following TODOs (please add on others that are required):

  • Improve code documentation
  • Add uptrain logging to create plots showing loss and perplexity on Streamlit dashboard
  • Add visualizations for things like weight of prediction of different words to provide a graphical representation of what the model thinks is the best masked word

Edit: I've added loss, perplexity and mask prediction score visualizations using the streamlit dashboard functionality.

@a-r-r-o-w a-r-r-o-w marked this pull request as ready for review February 25, 2023 21:17
@vipgupta vipgupta merged commit f292d17 into uptrain-ai:main Feb 26, 2023
@a-r-r-o-w a-r-r-o-w deleted the llm_bert_example branch March 12, 2023 19:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants