Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

llm/chatgpt test dataset generation #120

Closed
simongray opened this issue Sep 20, 2023 · 1 comment
Closed

llm/chatgpt test dataset generation #120

simongray opened this issue Sep 20, 2023 · 1 comment

Comments

@simongray
Copy link
Member

simongray commented Sep 20, 2023 •
edited
Loading

Generating a dataset to test ChatGPTmby querying DanNet.

Based on loose ideas coming from Nathalie, Bolette, and Sussi.
simongray added a commit that referenced this issue Sep 21, 2023
@simongray
#120 zoology query for llm dataset + associated data export fns
da98633
simongray added a commit that referenced this issue Sep 21, 2023
@simongray
#120 added comestible liquid pattern for rows 1+2 in the excel data
0dfe1e6
simongray added a commit that referenced this issue Sep 21, 2023
@simongray
#120 write the entire (so far) dataset to disk
67a413f
simongray added a commit that referenced this issue Sep 21, 2023
@simongray
#120 added non-liquid pattern
b3b7349
simongray added a commit that referenced this issue Sep 21, 2023
@simongray
#120 added time patterns
cdf1d6d
simongray added a commit that referenced this issue Sep 21, 2023
@simongray
#120 added time patterns
41fcce0
simongray added a commit that referenced this issue Sep 21, 2023
@simongray
#120 added time patterns (not quite perfect)
f359411
simongray added a commit that referenced this issue Sep 22, 2023
@simongray
#120 added thoughts and feelings comparison
4dfd4b7
simongray added a commit that referenced this issue Sep 22, 2023
@simongray
#120 xlsx support
11e6d8d
simongray added a commit that referenced this issue Sep 22, 2023
@simongray
#120 xlsx support
cf4c850
simongray added a commit that referenced this issue Sep 22, 2023
@simongray
#120 xlsx support
d8b76c3
simongray added a commit that referenced this issue Sep 22, 2023
@simongray
#120 xlsx support
05e7af3
simongray added a commit that referenced this issue Sep 25, 2023
@simongray
#120 add comments to output
aa9da67
simongray added a commit that referenced this issue Sep 26, 2023
@simongray
#120 plant tests
efd8469
simongray added a commit that referenced this issue Sep 26, 2023
@simongray
#120 added sports queries
83f5318
simongray added a commit that referenced this issue Sep 26, 2023
@simongray
#120 disciplines
acb538f
simongray added a commit that referenced this issue Sep 26, 2023
@simongray
#120 add prompt sentences as tests too + limit every test type to 50 …
ab4fd72 
…samples
simongray added a commit that referenced this issue Sep 26, 2023
@simongray
#120 add prompt sentences as tests too + limit every test type to 50 …
51464b2 
…samples
simongray added a commit that referenced this issue Sep 27, 2023
@simongray
#120 - don't use feeling hyponyms + reduce size the generated dataset
7429511
simongray added a commit that referenced this issue Sep 27, 2023
@simongray
#120 - en/et fixes
f85bfdc
simongray added a commit that referenced this issue Sep 27, 2023
@simongray
#120 apply appropriate gender most of the time
d7b49e7
simongray added a commit that referenced this issue Sep 27, 2023
@simongray
#120 llm/chatgpt test dataset generation
e32549f 
- applying SPARQL queries to generate rows of data
- data export fns (CSV and XLSX)
- use COR data to generate en/et (gender)
@simongray
Copy link
Member Author

Mostly done as of e32549f

@simongray simongray changed the title Special query assignment llm/chatgpt test dataset generation Sep 27, 2023
simongray added a commit that referenced this issue Oct 6, 2023
@simongray
#120 - new pattern architecture + more patterns
cf635f8 
- more filters, e.g. frequency and slang
- part-whole query and pattern
- rewrite gen-rows code to support part-whole query
- the few remaining inference queries
simongray added a commit that referenced this issue Oct 6, 2023
@simongray
#120 - new pattern architecture + more patterns
e128232 
- more filters, e.g. frequency and slang
- part-whole query and pattern
- rewrite gen-rows code to support part-whole query
- the few remaining inference queries
- a few discussion points written down (for the paper)
simongray added a commit that referenced this issue Oct 6, 2023
@simongray
#120 - improved reproducibility
e152423
simongray added a commit that referenced this issue Oct 9, 2023
@simongray
#120 - presorting database output for improved reproducibility
eaa1a6a
simongray added a commit that referenced this issue Oct 9, 2023
@simongray
#120 - sports query fixed + smaller data output
38a47b1
simongray added a commit that referenced this issue Oct 9, 2023
@simongray
#120 - .csv -> tsv
1398dd6
simongray added a commit that referenced this issue Oct 10, 2023
@simongray
#120 - fix clashes bug caused by limiting lemmas to canonical ones
d5521d4
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@simongray