Experiments Post Hoc Attribution Black Box ICL

• Exp 1:

• Exp 2:

• Exp 3:

Experiments Post Hoc Attribution

• Exp4:

  Finetuning LLAMA 7B and MPT 7B on NQ_Open dataset for context generations. Inferencing on NQ_Open validation set

  2 settings

  • Q -> LLM -> Answer
  • Q -> LLM -> Answer + Context

  We perform Diverse Generations as well using DiverseBeamSearch.

  • Models used:

    • LLAMA3
    • MPT

  • Results: Pending

• Exp 5:

  Finetuning LLAMA 7B and MPT 7B on HotpotQA dataset for context generations. Inferencing on HotpotQA validation set

  2 settings

  • Q -> LLM -> Answer
  • Q -> LLM -> Answer + Context

  We perform Diverse Generations as well using DiverseBeamSearch.

  • Models used:

    • LLAMA3
    • MPT

  • Results: Pending

• Exp 6:

  Finetuning LLAMA 7B and MPT 7B on TriviaQA dataset for context generations. Inferencing on HotpotQA validation set

  2 settings

  • Q -> LLM -> Answer
  • Q -> LLM -> Answer + Context ntext

  We perform Diverse Generations as well using DiverseBeamSearch.

  • Models used:

    • LLAMA3
    • MPT

  • Results: Pending

• Exp 7:

  Experiments targetted subset selection for diversity.

  Model : LLAMA3 Dataset: NQ_OPEN