Step 1: Domain LoRAs Training: Follow LLaMA-Factory to train domain adapters.
Step 2: Mixture of LoRAs (Sci-LoRA): ./code/lora_mixture.py
Step 3: Evaluation - ./code/evaluation.py
Sci-LoRA: Mixture of Scientific LoRAs for Cross-Domain Lay Paraphrasing
Paper is accepted at ACL 2025 Findings