Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add reproduction logs #1732

Merged
merged 4 commits into from
Dec 1, 2023
Merged

Conversation

golnooshasefi
Copy link
Contributor

Everything worked accordingly.

  • Operating System:

    • WSL 2 on Windows 11
  • Development Environment:

    • Python 3.10.12
    • Java 11.0.20.1 2023-08-24
  • Hardware:

    • Processor: Intel Core i7-13650HX, 2.60 GHz
    • RAM: 32 GB
    • Storage: SSD Drive - NVMe Micron 2400
    • GPU: NVIDIA GeForce RTX 4060

One more thing, there was this discrepancy with the output of this command in experiments-msmarco-passage.md, where the number of the lines and the characters were the same, but the number of the words were one less than the output mentioned in the file:

wc tools/topics-and-qrels/topics.msmarco-passage.dev-subset.txt
  6980  48334 290193 tools/topics-and-qrels/topics.msmarco-passage.dev-subset.txt

@lintool
Copy link
Member

lintool commented Nov 30, 2023

@golnooshasefi please update to resolve conflicts?

One more thing, there was this discrepancy with the output of this command in experiments-msmarco-passage.md, where the number of the lines and the characters were the same, but the number of the words were one less than the output mentioned in the file:

wc tools/topics-and-qrels/topics.msmarco-passage.dev-subset.txt
  6980  48334 290193 tools/topics-and-qrels/topics.msmarco-passage.dev-subset.txt

Thanks for noting. This might be a Windows issue...?

@golnooshasefi
Copy link
Contributor Author

Resolved the conflicts.

Thanks for noting. This might be a Windows issue...?

It may be. I'm guessing it's because of the difference in the line break types.

@@ -337,4 +337,5 @@ Before you move on, however, add an entry in the "Reproduction Log" at the botto
+ Results reproduced by [@Seun-Ajayi](https://github.com/Seun-Ajayi) on 2023-11-13 (commit [`086e16b`](https://github.com/castorini/pyserini/commit/086e16be28b7dc6022f8582dbd803824dc2c1ad2))
+ Results reproduced by [@AndreSlavescu](https://github.com/AndreSlavescu) on 2023-11-28 (commit [`1219cdb`](https://github.com/castorini/pyserini/commit/1219cdbca780e869ba77658c29e1aaa972585d09))
+ Results reproduced by [@tudou0002](https://github.com/tudou0002) on 2023-11-28 (commit [`723e06c`](https://github.com/castorini/pyserini/commit/723e06c3b04e6c6fcd56fcf5bce4386c72503e5a))
+ Results reproduced by [@golnooshasefi](https://github.com/golnooshasefi) on 2023-11-28 (commit [`1219cdb`](https://github.com/castorini/pyserini/commit/1219cdbca780e869ba77658c29e1aaa972585d09))
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

move down to final entry to be consistent.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The results were reproduced on the 28th of November, which is why it's placed before the final entry.

@lintool lintool merged commit a2049c4 into castorini:master Dec 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants