Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Topic code consolidation #94

Merged
merged 20 commits into from
Oct 21, 2019
Merged

Topic code consolidation #94

merged 20 commits into from
Oct 21, 2019

Conversation

yvespeirsman
Copy link
Collaborator

WHAT

Consolidated experimental code from Jupyter notebooks and scripts to the quillnlp package.

WHY

Code in the package is easier to reuse and makes it easier to build new NLP pipelines.

HOW

The quillnlp package now has several subpackages. The code is organized as follows:

  • quillnlp/allennlp: the code for our AllenNLP experiments
  • quillnlp/data: functions for processing our data sets (e.g. data diversity)
  • quillnlp/models: the core classes and functions for NLP models such as BERT
  • quillnlp/preprocessing: functions for preprocessing our data sets (e.g. coreference and SRL steps)

yvespeirsman and others added 18 commits August 1, 2019 10:28
@yvespeirsman
BERT experiments with synthetic data and passage
d3265a4
@yvespeirsman
Removed hardcoded key file location from script
59af118
@yvespeirsman
Data files, notebooks and scripts for experiments on the larger eatin…
4bf8e34 
…g meat datasets
@yvespeirsman
Fixed small error in synthetic data loading
380b8f9
@yvespeirsman
XL dataset for eating meat
b7f6ca4
Added notebook for BERT multilabel experiments
4785ae4
@yvespeirsman
New notebooks for data exploration and diversity
bdae59a
@yvespeirsman
Script version of notebook BERT-4
e561f21
@yvespeirsman
Added label mapping in file
3d8b77e
@yvespeirsman
Added notebook for diversity experiments with BERT
189747c
@yvespeirsman
Small changes in notebooks for data diversity
1a161cf
@yvespeirsman
Merged master into branch
22f242c
@yvespeirsman
Merged master into branch (2)
ba738ba
@yvespeirsman
BERT code in QuillNLP package
b6bee60
Integrated clustering and data diversity code into quillnlp package
60db6e1
Added code for multilabel classification to QuillNLP package
19bc37c
@yvespeirsman
Added notebooks with code based on the new QuillNLP package
5798a87
Updated SRL scripts
cf0baac
dandrabik
dandrabik approved these changes Oct 21, 2019
View reviewed changes
Copy link
Member

@dandrabik dandrabik left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 Looks good to me, sorry for this very slow review. I'm going to squash and merge this branch.

@dandrabik dandrabik merged commit 405041d into master Oct 21, 2019
@happythenewsad happythenewsad deleted the topic-code-consolidation branch October 17, 2023 13:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@dandrabik dandrabik dandrabik approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
2 participants
@yvespeirsman @dandrabik