Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Transfer workflow files #2

Merged
merged 796 commits into from
Oct 6, 2023
Merged

Conversation

liamhuber
Copy link
Member

Including git history. I found this helpful in the process.

Namely, on_run should be a property returning a callable
They are not implemented and working yet, so at least fail cleanly!
And downstream stuff like `update` and thus `__call__`. This was requested by Joerg and now makes things really start to feel like regular python
We may wish to later make Macro's slow, but for Workflows, since the IO is just routing through to the owned nodes, input updates are _anyhow_ most of the time re-running things, so it's a sensible default IMO
Just a first pass
Excessive granularity can't hurt us, so always pass something >0 and don't bother with overriding the method
liamhuber and others added 3 commits October 5, 2023 13:45
There are unreasonable dependency bugs when I include pympipool, so since the executor stuff needs to be redone anyhow, just kill it all.
@liamhuber
Copy link
Member Author

Well, purging pympipool did the trick and all the tests I expected to pass are (coverage is not working because I need to get set up with codacy, and black is failing).

I tried tracking down why pympipool would force a too-old version of maggma to get installed, but didn't get anywhere. Over on ironflow I ran into the same problem; I just cleared the caches there and am simply re-running -- if that works maybe I somehow wound up with a cache problem here in this new repo too??? If so, I'll revert the executor purge here and try again.

@liamhuber
Copy link
Member Author

Nope, it wasn't the cache. I just pinned maggma over in ironflow, so let's see if that smokes out the offender.

@liamhuber
Copy link
Member Author

Tests hang now for an hour. This is also a problem I encounter with pympipool when I run tests in pycharm on my macbook. Since my primary objective right now is just to get functioning workflow module moved over to this repository, I'm going to revert to using pyiron_contrib.executors.CloudpickleProcessPoolExecutor.

liamhuber and others added 2 commits October 6, 2023 10:41
pympipool seems to work ok in the notebook, but hangs on my macbook and it looks like on the CI too
@liamhuber
Copy link
Member Author

...
└─ python >=3.7,<3.8.0a0 , which can be installed.
Error: Process completed with exit code 1.

Of course, I'm an idiot, I moved this here because the dependencies were not playing well with other parts of pyiron_contrib to start with. That will be resolved separately soon, but for now just move on.

I'll repo-transfer the executor code and history over.

@liamhuber liamhuber merged commit df9bd13 into update_module_name Oct 6, 2023
11 of 13 checks passed
@liamhuber liamhuber deleted the transfer_workflow_files branch October 6, 2023 20:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants