Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Compare "relevant" keywords between the advisory text and the commits messages #331

Closed
sacca97 opened this issue Oct 10, 2022 · 2 comments
Closed

Compare "relevant" keywords between the advisory text and the commits messages #331

sacca97 opened this issue Oct 10, 2022 · 2 comments
Assignees
@sacca97
Labels
assuremoss component/prospector new feature New feature or request planned

Comments

@sacca97
Copy link
Collaborator

sacca97 commented Oct 10, 2022

Using spacy to extract nouns, propn or verbs from the advisory and the commits messages and then looking for matches seems a good start to treat difficult candidates that do not match any other rule.

This issue supersedes #327, #271 and #259.
@sacca97 sacca97 self-assigned this Oct 10, 2022
This was referenced Oct 10, 2022
Closed
Closed
Closed
sacca97 added a commit that referenced this issue Oct 10, 2022
@sacca97
keywords extraction test using spacy related to #331, fixes #329
dc06c76
copernico pushed a commit that referenced this issue Oct 10, 2022
@sacca97 @copernico
keywords extraction test using spacy related to #331, fixes #329
15e42f8
@copernico
Copy link
Contributor

copernico commented Oct 10, 2022 •
edited
Loading

I would try extracting verbs too and applying stemming (or lemmatisation).

@sacca97 sacca97 mentioned this issue Nov 3, 2022
Merged
copernico pushed a commit that referenced this issue Nov 3, 2022
@sacca97
Search twin commits and misc other improvements (#342)
7284e34 
- Implemented twin commits, closes #147 
- Using basemodel again (pydantic)
- Fixed the logger, improved log aesthetics and readability
- github and jira issues are collected using their respective APIs (GITHUB token required via .env file)
- Better word extraction and filtering based on tests conducted on the small dataset.
- Report handlers now create nested folders
- updated to python 3.10
- skip GitHub when fetching references
- refactored git and raw_commit modules: all commit IDs, timestamp, parent, message and changed files are
collected with a single call to git executable
- refactored logging

- Fixes:
#339  
#341  
#334  
#331  
#326 
#336
@sacca97
Copy link
Collaborator Author

sacca97 commented Nov 4, 2022

Closed by #342

@sacca97 sacca97 closed this as completed Nov 4, 2022
sacca97 added a commit that referenced this issue Nov 7, 2022
@sacca97
keywords extraction test using spacy related to #331, fixes #329
c913a1c
sacca97 added a commit that referenced this issue Dec 8, 2022
@sacca97
keywords extraction test using spacy related to #331, fixes #329
c9deda6
copernico pushed a commit that referenced this issue Dec 12, 2022
@sacca97 @copernico
keywords extraction test using spacy related to #331, fixes #329
3e8efca
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@sacca97 sacca97

Labels
assuremoss component/prospector new feature New feature or request planned
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@copernico @sacca97