Skip to content
/ FERMAT Public

An Alternative to Accuracy for Numerical Reasoning

License

Notifications You must be signed in to change notification settings

jasivan/FERMAT

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

FERMAT: An Alternative to Accuracy for Numerical Reasoning

This is the repository for FERMAT: An Alternative to Accuracy for Numerical Reasoning by Jasivan Alex Sivakumar and Nafise Sadat Moosavi accepted at ACL 2023.

You can find the codes, templates and test sets in their respective folders. Note that the codes folder is still being updated.

Usage

Requirements

Install the packages from the requirements.txt file (transformers, torch, datasets, accelerate, SentencePiece, json, pandas, numpy).

Reference

If you use this code in your work, please cite the paper:

@InProceedings{sivakumar-moosavi_2023_FERMAT,
    author = { Jasivan Alex Sivakumar, Nafise Sadat Moosavi},
    title = {FERMAT: An Alternative to Accuracy for Numerical Reasoning},
    year = {2023},
    booktitle = {Proceedings of the 61st Annual Meeting of
		the Association for Computational Linguistics (Volume 1: Long Papers)},
    publisher = {Association for Computational Linguistics},
    address = {Toronto, Canada},
}

Authors

This code was written by @jasivan.

If you have any queries or comments, please email jasivakumar1@sheffield.ac.uk .

About

An Alternative to Accuracy for Numerical Reasoning

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published