Skip to content

ruc-wjyu/IOT-Match

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

24 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

IOT-Match

This is the official implementation for the SIGIR 2022 paper "Explainable Legal Case Matching via Inverse Optimal Transport-based Rationale Extraction".

Overview

As an essential operation of legal retrieval, legal case matching plays a central role in intelligent legal systems. This task has a high demand on the explainability of matching results because of its critical impacts on downstream applications --- the matched legal cases may provide supportive evidence for the judgments of target cases and thus influence the fairness and justice of legal decisions. Focusing on this challenging task, we propose a novel and explainable method, namely IOT-Match, with the help of computational optimal transport, which formulates the legal case matching problem as an inverse optimal transport (IOT) problem. Different from most existing methods, which merely focus on the sentence-level semantic similarity between legal cases, our IOT-Match learns to extract rationales from paired legal cases based on both semantics and legal characteristics of their sentences. The extracted rationales are further applied to generate faithful explanations and conduct matching. Moreover, the proposed IOT-Match is robust to the alignment label insufficiency issue commonly in practical legal case matching tasks, which is suitable for both supervised and semi-supervised learning paradigms. To demonstrate the superiority of our IOT-Match method and construct a benchmark of explainable legal case matching task, we not only extend the well-known Challenge of AI in Law (CAIL) dataset but also build a new Explainable Legal cAse Matching (ELAM) dataset, which contains lots of legal cases with detailed and explainable annotations. Experiments on these two datasets show that our IOT-Match outperforms state-of-the-art methods consistently on matching prediction, rationale extraction, and explanation generation.

Data

We will provide ELAM to support CAIL 2022 explainable legal case matching track. For a fair competition, we will not release ELAM here. Please stay tuned for CAIL!

For eCAIL, you would like to download it here. For ELAM, you would like to download it here. For ELAM for CAIL you would like to download it here.

Requirements

python>=3.7
torch>=1.9.1+cu111
transformers>=4.20.1
numpy>=1.20.1
jieba>=0.42.1
six>=1.15.0
rouge>=1.0.1
tqdm>=4.62.3
scikit-learn>=1.0.1
pandas>=1.2.4
nni>=2.6.1
matplotlib>=3.3.4
termcolor>=1.1.0
networkx>=2.5
requests>=2.25.1
filelock>=3.0.12
textrank4zh>=0.3
gensim>=3.8.3
openprompt>=1.0
scipy>=1.8.0
seaborn>=0.11.1

t5-pegasus

Trainining and Evaluation

python selector_one.py
python selector_two_multi_class_ot_v3.py
python seq2seq_convert_cail.py
python seq2seq_model_t5.py
python predictor_convert_t5.py
cat_predictor.py
python predictor_v5.py

The parameters used in above code are shown in their own files as default parameters.

Acknowledgement

Please cite the following papers as the references if you use our codes or the processed datasets.

@inproceedings{10.1145/3477495.3531974,
author = {Yu, Weijie and Sun, Zhongxiang and Xu, Jun and Dong, Zhenhua and Chen, Xu and Xu, Hongteng and Wen, Ji-Rong},
title = {Explainable Legal Case Matching via Inverse Optimal Transport-Based Rationale Extraction},
year = {2022},
isbn = {9781450387323},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
url = {https://doi.org/10.1145/3477495.3531974},
doi = {10.1145/3477495.3531974},
booktitle = {Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval},
pages = {657–668},
numpages = {12},
keywords = {legal retrieval, explainable matching},
location = {Madrid, Spain},
series = {SIGIR '22}
}

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages