Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

only one tmp used at least when using madmax #807

Open
altendky opened this issue Jun 24, 2021 · 5 comments
Open

only one tmp used at least when using madmax #807

altendky opened this issue Jun 24, 2021 · 5 comments

Comments

@altendky
Copy link
Collaborator

altendky commented Jun 24, 2021

Originally posted by @wasdokij in #797 (comment)

I have a problem

5950x + 3* 2T nvme

Looking at my setup, the results are not what I expected

version: [2]

directories:
        tmp:
                - /ssd1/Plotter
                - /ssd2/Plotter
                - /ssd3/Plotter

        tmp_overrides:
                "/ssd1/Plotter":
                        tmpdir_max_jobs: 2

                "/ssd2/Plotter":
                        tmpdir_max_jobs: 2

                "/ssd3/Plotter":
                        tmpdir_max_jobs: 2

        dst:
                - /d/Plots
                - /e/Plots
                - /f/Plots
                - /g/Plots
                - /h/Plots

scheduling:

        tmpdir_stagger_phase_major: 2
        tmpdir_stagger_phase_minor: 1
        tmpdir_stagger_phase_limit: 1
        tmpdir_max_jobs: 2
        global_max_jobs: 6
        global_stagger_m: 5
        polling_time_s: 20

        type: madmax
  
        madmax:
                n_threads: 8         
                n_buckets: 256       

1624514385031

@altendky
Copy link
Collaborator Author

Sorry, I haven't had time to dig into this too far. Could you share a screenshot of plotman interactive --no-autostart-plotting --no-autostart-archiving? This will show a bit more information about what tmps plotman is acknowledging exist. Also, I don't know if you were adding more tmp drives or such but please make sure to save your config and restart the plotting processes. Check ps aux | grep plotman to make sure you don't have more than one generally. But sure, I don't see any evidence this is caused by multiple instances. Just... looking to make sure we rule out 'the simple stuff'.

@altendky
Copy link
Collaborator Author

@wasdokij, this is still not working for you? I'm inching back towards this being what i need to look into 'soon'.

@altendky
Copy link
Collaborator Author

altendky commented Jul 1, 2021

madmax requires a trailing / on the tmp directory and we had a silly pure equality check that failed due to not having the trailing / on the reference path. Anyways, I merged the fix to development. Let me know if it helps your setup.

@wasdokij
Copy link

wasdokij commented Jul 1, 2021

/

Thank you!
The solution: madmax requires a trailing / on the tmp directory

@altendky
Copy link
Collaborator Author

altendky commented Jul 1, 2021

Well, the fact that madmax required that exposed plotman doing too simplistic of a comparison of directories which has been fixed. plotman already made sure the trailing slash was provided to madmax.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants