LLM_Challenge

Project Repository

These repository consists 3 submissions for neurips23 llm efficiency challenge in Nvidia 4090 track

This repository contains the project files organized as follows:

4090_track

• submission_1

  • training
  • evaluation

• submission_2

  • training
  • evaluation

• submission_3

  • training
  • evaluation

LLM_Challenge

Project Repository

These repository consists 3 submissions for neurips23 llm efficiency challenge in Nvidia 4090 track

This repository contains the project files organized as follows:

4090_track

• submission_1

  • training
  • evaluation

• submission_2

  • training
  • evaluation

• submission_3 - training - evaluation

Training using docker container

Build docker container

docker build -f Dockerfile -t llm_challenge:train .

Run main.py in docker container

docker run --gpus all -ti llm_challenge:train python3 main.py