Hi!
So I've already used the docker command (under Usage 1) to train and evaluate my model with REINA, and I have all the outputs from that. For further use, is it possible to do
export HF_DATASETS_CACHE=/home/reina/data; export TRANSFORMERS_CACHE=/home/reina/cache
python run_summarization.py ...
on my local run_summarization.py (ie, without using the docker command)?
Also, is Lucene needed for inference? My guess is that it isn't, because it seems like when you have the REINA dataset in cache, all reina() does is load that dataset, and then HuggingFace's Trainer takes care of the rest, but want to confirm.
Hi!
So I've already used the docker command (under
Usage 1) to train and evaluate my model with REINA, and I have all the outputs from that. For further use, is it possible to doexport HF_DATASETS_CACHE=/home/reina/data; export TRANSFORMERS_CACHE=/home/reina/cachepython run_summarization.py ...on my local
run_summarization.py(ie, without using the docker command)?Also, is Lucene needed for inference? My guess is that it isn't, because it seems like when you have the REINA dataset in cache, all
reina()does is load that dataset, and then HuggingFace'sTrainertakes care of the rest, but want to confirm.