Skip to content

Mining Scientific Terms and their Definitions: A Study of the ACL Anthology (EMNLP 2013). [code+data]

Notifications You must be signed in to change notification settings

YipingNUS/DefMiner

Repository files navigation

DefMiner v1.1.0 - 2013-12-20 Automatic Definition Extraction System

Copyright (c) 2013-2014 Web Information Retrieval/Natural Language Processing Group at National University of Singapore

Author: Yiping Jin

The system is based on Yiping's thesis and EMNLP paper. Please refer to:

http://wing.comp.nus.edu.sg/downloads/term_definition_mining/ (currently down due to server problem)

If you're using the code or the corpus for your research work, please cite the following paper:

Jin, Yiping, et al. "Mining scientific terms and their definitions: A study of the ACL anthology." Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. 2013.

DOCUMENTATION

LICENSE

This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with this program; if not, write to the Free Software Foundation, Inc., 59 Temple Place - Suite 330, Boston, MA 02111-1307, USA.

For more information, bug reports, fixes, contact: Yiping Jin, Dept of Computer Science, National Univeristy of Singapore Singapore


Software Dependencies

The software requires Python 2.7.X be installed. It might not work for version 3+ due to minor difference in the syntax. It also requires JRE and C++ compiler to be installed.

The software can build without problem on a freshly installed Ubuntu 12.0.4 system.


Compilation

Step 1: Compile CRF++ Below are the steps from their website: (Note it may not work if you are not root user)

- Go to CRF++-0.58/ sub-dirctory

% ./configure 

% make

% su

# make install

Note that if you don't have root access "make install" will not work. But this step is optional. As long as you pass the make step the program will work.

This project is developed mainly in Python and Java. The code is portable and does not require further compilation.

However, currently some of the parameters are hard coded in the shell scripts, you have to modify the script CGI/webapp/cgi-bin/defminer.cgi

and change the line to indicate the path where defminer is installed in your machine:

my $baseDir = "/home/yiping/defminer-distribution/";

In this software we requires library from Stanford Corenlp. To reduce the size of the repository, we did not include it inside the git repository. Please download the library separately and put it under the directory:

defminer/preprocess/integratedParser/lib/

The external library (version 3.2.0) can be downloaded at:

http://nlp.stanford.edu/software/corenlp.shtml#Download

Our program needs the following two files:

stanford-corenlp-3.2.0.jar
stanford-corenlp-3.2.0-models.jar

Run the Program

To run the program from command line:

.DefMiner_clean [input file]

To run from web CGI:

go to directory

defminer/CGI/webapp/

run command:

python simple_httpd.py

then use the browser to open url:

localhost:8080

Corpus

W00_dataset.zip contains the W00 corpus described in the paper.


CHANGES

2013-12-17 1.0 Initial release 2013-12-20 1.1 Speed up by using a different NER

About

Mining Scientific Terms and their Definitions: A Study of the ACL Anthology (EMNLP 2013). [code+data]

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published