Skip to content

[EMNLP 2023] ALCUNA: Large Language Models Meet New Knowledge

License

Notifications You must be signed in to change notification settings

Arvid-pku/ALCUNA

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 

Repository files navigation

🐐 ALCUNA: Large Language Models Meet New Knowledge

Paper link: https://arxiv.org/abs/2310.14820v1

KnowGen: Entity Knowledge Generation Method

Demonstration of ALCUNA

Demonstration of ALCUNA

Algorithm

algorithm

Data Structure

Everyone can get our dataset from here.

Meta Data

Each line in dataset/meta_data.jsonl corresponds to the metadata information of one artificial entity:

  • artificial_entity: the information of artificial entity
    • name: the name of artificial entity
    • id: the negative of parent entity's id
    • rank: rank in the biological taxonomy
    • property: a list of property structure (mentioned later).
  • parent_entity: the information of parent entity.
  • difference: the differences made for generating the properties of the artificial entity.
    • extension: a list of property structure of artificial entity from other entities.
    • variation: a list of tuples (old_property, new_property), old_property refers to the source of the created property (new_property) of artificial entity.
    • heredity: a list of property structure of artificial entity inherited from parent entity.
    • dropout: a list of property structure of parent entity not inherited to artificial entity.

The property structure is structured as follow:

  • name: the name of current property.
  • type: the type of current property. One of ['attribute', 'relation'].
  • values: a list of valid values of current property.

Question Dataset

dataset/id2question.json contains a dict mapping from artificial entity id to its corresponding questions. Each question is structured as following,

  • question
  • answers: a list of all valid answers.
  • form: the form of the question. One of ['boolean' 'fill-in-blank', 'multi-choice'].
  • type: the subset to which the question belongs. One of [ 'Knowledge Understanding', 'Knowledge Differentiation', 'Knowledge Association']
  • meta_data:
    • related_property: the property of the artificial entity related to the current question. If difference is 'variation', it is a tuple of (old_property, new_property). For other cases, it is a property structure.
    • difference: the difference type of related_property. One of ['extension', 'variation', 'heredity', 'dropout']
    • hop_triplets (optional): the chain of relation triplets corresponding to the multi-hop question.Only available for Knowledge Association dataset.

Citations

Please cite the paper and star this repo if you use ALCUNA (or KnowGen) and find it interesting/useful, thanks!

@misc{yin2023alcuna,
      title={ALCUNA: Large Language Models Meet New Knowledge}, 
      author={Xunjian Yin and Baizhou Huang and Xiaojun Wan},
      year={2023},
      eprint={2310.14820},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}

About

[EMNLP 2023] ALCUNA: Large Language Models Meet New Knowledge

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published