Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge LiT5 into RankLLM #116

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

17Melissa
Copy link

Reference URA-Project

Issue 35 RankLLM: Merge LiT5 Models into RankLLM castorini/ura-projects#35

The goal is to port LiT5-Distill and LiT5-Score over to RankLLM.

Completed

  • Synced the LiT5 integration structure with the latest master, from command-line execution to the rankllm class
  • Built RankFiDDistill(RankLLM) and RankFiDScore(RankLLM) in rank_fid.py
  • Built LiT5DistillReranker and LiT5ScoreReranker in lit5_reranker.py

Next Steps

  • Inherited functions in RankFiDDistill, like create_prompt and run_llm, still need adjustments and testing to ensure LiT5 performs correctly
  • Implemented inherited functions in RankFiDScore
  • Validate the process of using LiT5 models within RankLLM, ideally we have a central command so run LiT5 as python src/rank_llm/scripts/run_rank_llm.py with --args

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant