Skip to content

remove bulky dependencies - #13

Merged
generall merged 2 commits into
mainfrom
0.5-suggestions
Oct 4, 2023
Merged

remove bulky dependencies#13
generall merged 2 commits into
mainfrom
0.5-suggestions

Conversation

@generall

@generall generall commented Oct 3, 2023

Copy link
Copy Markdown
Member
  • remove optimum
  • more test + ci on other OS
  • fix batching embed

Performance of the current branch:

Huggingface Transformers (Average, Max, Min): (0.1034623384475708, 0.10434174537658691, 0.10258293151855469)
FastEmbed (Average, Max, Min): (0.06690812110900879, 0.06795573234558105, 0.06586050987243652)

and my venv directory is now only 200Mb instead of 5Gb for optimum.

@generall
generall requested a review from NirantK October 3, 2023 19:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants