Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Random seed parameter for iterations #90

Open
MaviccPRP opened this issue Jun 29, 2022 · 0 comments
Open

Random seed parameter for iterations #90

MaviccPRP opened this issue Jun 29, 2022 · 0 comments

Comments

@MaviccPRP
Copy link

Hi @timoschick ,

thank you very much for pushing your amazing PET tool to this repo.
I am currently trying to investigate, how the random seed works, during different iteration per pattern.

If I understand correctly, PET trains and evaluates for each pattern n=repetitions independent models (stored in the folders final/p0-iY). This is done, to calculate later std deviation for the results.

You are describing that in your paper, too:
"each model is trained three times using different seeds and average results are reported"
https://arxiv.org/pdf/2001.07676v3.pdf

This would happend in pet/modeling.py in line: 326 and 327

    set_seed(seed)

    for pattern_id in pattern_ids:
        for iteration in range(repetitions):

Do I interpret this correctly?
I am currently struggeling to understand how the different seeds for the model initialization per iteration is handled. We are setting a single seed in line 324.
Are the models initialized with diferent weights per iteration? Are there other seeds set?

Thank youfso much in advance for your help!

@MaviccPRP MaviccPRP changed the title Seed parameter for iterations Random seed parameter for iterations Jun 29, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant