Skip to content

Commit

Permalink
add related work
Browse files Browse the repository at this point in the history
  • Loading branch information
kddubey committed Dec 5, 2024
1 parent 5478c28 commit 35f3661
Showing 1 changed file with 13 additions and 0 deletions.
13 changes: 13 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,7 @@ here](https://www.youtube.com/watch?v=CCvVEszRiDI&t=225s).

[Poster](https://docs.google.com/presentation/d/1RKS0scvabb92GZngEpJ3KQoNbhch6kj_uv2p87kxyZU/edit?usp=sharing).


## Question

<details>
Expand Down Expand Up @@ -54,6 +55,7 @@ score is valid. Who is right, Alice or Bob?
</details>


## Setup

1. Clone repo
Expand Down Expand Up @@ -282,3 +284,14 @@ for cloud runs. Note that it assumes that the bucket name is
```

</details>


## Related work

A complement to this paper are the results around **text contamination** in [*Does Data
Contamination Make a Difference? Insights from Intentionally Contaminating Pre-training
Data For Language
Models*](https://openreview.net/forum?id=wSpwj7xab9&referrer=%5Bthe%20profile%20of%20Sanmi%20Koyejo%5D(%2Fprofile%3Fid%3D~Sanmi_Koyejo1)).
This paper directly addresses the limitation in my paper that I don't study the initial
pretraining stage of an LM. (Unfortunately I didn't see this paper until a few weeks
after I presented the poster. So it's not cited in my paper or the poster.)

0 comments on commit 35f3661

Please sign in to comment.