-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
What's new in 0.25.0 #536
Labels
Comments
nicolay-r
added a commit
that referenced
this issue
Nov 20, 2023
nicolay-r
added a commit
that referenced
this issue
Nov 20, 2023
nicolay-r
added a commit
that referenced
this issue
Dec 18, 2023
…e. List of column names and column types are now even in terms of their length.
nicolay-r
added a commit
that referenced
this issue
Dec 30, 2023
This was referenced Feb 26, 2024
Published 🥳 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
Support
Batching
for effecting imputing LLM into text processing pipelinesPreviosly, the whole text processing pipeline was relying on the
sentence
/ text part.Now we overcome that liimitation and therefore we can consider multiple sentences, formed in list i.e. batch.
This step is so important for LLM, LM, neural networks, for which batching accelerates the performance.
As the result, overall pipeline launching is expected to perform faster.
Pipelines
-- refactoring core concept,source
customization selection for ppl items #539 🔥run
operation #540SentenceObjectsParserPipelineItem
-- rename to theObjectsParserPipelineItem
concept #541Sources collections are no longer going to be a part of AREkit ✨
Tha allow us to lightweight 🪶 the overall framework and so that purely focus on data processing techniques
requests
library dependency 🪶AREkit-ss
project. 🪶Flexibility and Performance Enhancements
Pipelines
-- refactoring core concept,source
customization selection for ppl items #539 🔥arekit-ss
project)Dynamic creation of labels provider #511SQlite
-based readers and storage providers #538Partitioning
-- fancy last operations of theSentenceObjectsParserPipelineItem
which has no longer application [ARElight backlog] #542 🔧Fixed bugs
RowCacheStorageProvider
fixed bug with mismatching size of type list and columns list in case of otherforce
collected columns (ad4312c)Minor Updates
OpinionsIO
(76b4c1f)-0
in filenames for samples. (76b4c1f)TermsSplitterParser
-- is no longer required [ARElight backlog] #543_get_text
is no longer needed #544SamplesIO.create_target
-- provide this parameter as function [ARElight backlog] #547The text was updated successfully, but these errors were encountered: