Search results

Confusing logic for <code>reset_parameters()</code> in <code>Embedding</code> and <code>Linear</code> layer

Status: Open.

#194 In microsoft/LoRA;

· aeryskyB opened on Mar 30, 2025

Why not merge BA during training?

Status: Open.

#193 In microsoft/LoRA;

· rp7sv opened on Mar 17, 2025

ValueError: Target module CLIPEncoderLayer，only the following modules are supported: <code>torch.nn.Linear</code>, <code>torch.nn.Embedding</code>, <code>torch.nn.Conv2d</code>, <code>transformers.pytorch_utils.Conv1D</code>.

Status: Open.

#192 In microsoft/LoRA;

· Crystal-twy998 opened on Mar 17, 2025

Feedback on Training Parameters for Fine-Tuning a 7B RAG LLM, slow training:/

Status: Open.

#191 In microsoft/LoRA;

· linahadhri opened on Feb 14, 2025

<code>lora.Linear.weight</code> Parameters Change After Loading Checkpoint in Train Mode Leading to Inconsistent Evaluation Results

Status: Open.

#190 In microsoft/LoRA;

· sunpihai-up opened on Jan 17, 2025

Entire model weights saved after fine-tuning instead of only the LoRA weights?

Status: Open.

#189 In microsoft/LoRA;

· HuanBor opened on Jan 13, 2025

Need Help with Fine-Tuning LoRa Using Diffusion Pipe for Hyperrealistic Object Videos

Status: Open.

#188 In microsoft/LoRA;

· AlexNistiriuc opened on Jan 12, 2025

Sudden nan values from the loss during LoRA training

Status: Open.

#186 In microsoft/LoRA;

· MH-Python opened on Dec 4, 2024

Understanding Figure 3

Status: Open.

#184 In microsoft/LoRA;

· Davidyao99 opened on Oct 20, 2024

How are the pretrained weigts set to be fixed during training?

Status: Open.

#181 In microsoft/LoRA;

· HaiminZhang opened on Jul 26, 2024

Questions about replicating NLU experiments

Status: Open.

#177 In microsoft/LoRA;

· lky-violet opened on Jun 22, 2024

Questions about running the cola dataset script

Status: Open.

#176 In microsoft/LoRA;

· dengxingzhi opened on May 21, 2024