-
Notifications
You must be signed in to change notification settings - Fork 242
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Feature improve excerpt iterator #2304
Merged
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
austin007008
force-pushed
the
feature-improve-excerpt-iterator
branch
from
March 13, 2024 12:43
f56d550
to
7327e3d
Compare
ivakegg
reviewed
Mar 13, 2024
warehouse/query-core/src/main/java/datawave/query/iterator/logic/WordsAndScores.java
Show resolved
Hide resolved
ivakegg
requested changes
Mar 13, 2024
warehouse/query-core/src/main/java/datawave/query/transformer/ExcerptTransform.java
Outdated
Show resolved
Hide resolved
austin007008
force-pushed
the
feature-improve-excerpt-iterator
branch
from
March 18, 2024 15:50
1c16d03
to
b9c0bd9
Compare
jack-gitdev
reviewed
Mar 18, 2024
warehouse/query-core/src/main/java/datawave/query/iterator/logic/WordsAndScores.java
Show resolved
Hide resolved
austin007008
force-pushed
the
feature-improve-excerpt-iterator
branch
4 times, most recently
from
March 26, 2024 12:37
2748049
to
b00394a
Compare
austin007008
force-pushed
the
feature-improve-excerpt-iterator
branch
8 times, most recently
from
April 9, 2024 18:08
216f3c5
to
f832805
Compare
austin007008
force-pushed
the
feature-improve-excerpt-iterator
branch
5 times, most recently
from
April 16, 2024 19:08
219b1e1
to
2f1f8b2
Compare
austin007008
force-pushed
the
feature-improve-excerpt-iterator
branch
4 times, most recently
from
May 8, 2024 16:46
d9b6f68
to
f25999b
Compare
austin007008
force-pushed
the
feature-improve-excerpt-iterator
branch
3 times, most recently
from
May 15, 2024 13:09
141dd68
to
1a90a71
Compare
drewfarris
reviewed
Aug 6, 2024
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Another set of comments/questions/feedback
...use/query-core/src/main/java/datawave/query/iterator/logic/TermFrequencyExcerptIterator.java
Outdated
Show resolved
Hide resolved
warehouse/query-core/src/main/java/datawave/query/iterator/logic/WordsAndScores.java
Outdated
Show resolved
Hide resolved
...use/query-core/src/main/java/datawave/query/iterator/logic/TermFrequencyExcerptIterator.java
Outdated
Show resolved
Hide resolved
warehouse/query-core/src/main/java/datawave/query/transformer/ExcerptTransform.java
Outdated
Show resolved
Hide resolved
warehouse/query-core/src/main/java/datawave/query/transformer/ExcerptTransform.java
Outdated
Show resolved
Hide resolved
warehouse/query-core/src/main/java/datawave/query/transformer/ExcerptTransform.java
Outdated
Show resolved
Hide resolved
warehouse/query-core/src/main/java/datawave/query/transformer/ExcerptTransform.java
Outdated
Show resolved
Hide resolved
warehouse/query-core/src/main/java/datawave/query/transformer/ExcerptTransform.java
Outdated
Show resolved
Hide resolved
warehouse/query-core/src/main/java/datawave/query/transformer/ExcerptTransform.java
Outdated
Show resolved
Hide resolved
warehouse/query-core/src/main/java/datawave/query/transformer/ExcerptTransform.java
Show resolved
Hide resolved
still need to add comments on some new pieces |
austin007008
force-pushed
the
feature-improve-excerpt-iterator
branch
2 times, most recently
from
August 8, 2024 19:20
f4704c7
to
92f2923
Compare
drewfarris
reviewed
Aug 13, 2024
...use/query-core/src/main/java/datawave/query/iterator/logic/TermFrequencyExcerptIterator.java
Outdated
Show resolved
Hide resolved
drewfarris
reviewed
Aug 13, 2024
warehouse/query-core/src/main/java/datawave/query/iterator/logic/WordsAndScores.java
Outdated
Show resolved
Hide resolved
drewfarris
reviewed
Aug 13, 2024
warehouse/query-core/src/main/java/datawave/query/iterator/logic/WordsAndScores.java
Outdated
Show resolved
Hide resolved
austin007008
force-pushed
the
feature-improve-excerpt-iterator
branch
3 times, most recently
from
August 19, 2024 12:43
30eae83
to
6354fb9
Compare
austin007008
force-pushed
the
feature-improve-excerpt-iterator
branch
from
August 22, 2024 13:47
e304ed7
to
1cf42ec
Compare
austin007008
force-pushed
the
feature-improve-excerpt-iterator
branch
2 times, most recently
from
September 4, 2024 18:25
46e9ca1
to
08fa19d
Compare
drewfarris
previously approved these changes
Sep 4, 2024
warehouse/query-core/src/main/java/datawave/query/iterator/logic/WordsAndScores.java
Outdated
Show resolved
Hide resolved
austin007008
force-pushed
the
feature-improve-excerpt-iterator
branch
3 times, most recently
from
September 5, 2024 18:59
ddde2c8
to
f10def6
Compare
ivakegg
reviewed
Sep 6, 2024
warehouse/query-core/src/main/java/datawave/query/iterator/logic/WordsAndScores.java
Show resolved
Hide resolved
documentation pt1 format documentation pt2 format set retry to 0 and add log for testing wordsandscores test testing format fix documentation and add new method more tests, fix edge case, documentation test, log, tostring more methods, more tests add getArrSize pass skips on end of cq squash me squash me working except for excerptTest fix test squash me fix before/after method not cq upgrade retry change start offset logic quicker fail and retry make scores output more user readable change output score to 0-1 brackets around whole phrase and add override scores, no scores, onebest excerpt clean and test ln for score and fix skippedword return one best eps fix remove google.sets from excerpt test fix brackets around all phrases in excerpts clean change start to int clean return null when score is above 90000000 return longest word in brackets on hit in node recommendations pt1 recommendations pt2 recommendations pt3 dont generate scored excerpt if we dont have to only check scores of offsets in range more recommendations rename and comment and remove i==1 excerpt transform reccomendations comment and clean transform comment and clean excerpt iterator the big clean pt1 add PhraseOffset instead of tuples and clean/update related tests quicksave some comments excerpt iterator static and clean excerpt iterator comments/naming/formatting wordsandscores except todo todo better test add recommendations
austin007008
force-pushed
the
feature-improve-excerpt-iterator
branch
from
September 9, 2024 13:17
f10def6
to
d09a42d
Compare
ivakegg
approved these changes
Sep 9, 2024
drewfarris
approved these changes
Sep 9, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.