Pipeline

[jan-janssen]

@SanderBorgmans Can you try this branch? It should enable submitting pipeline jobs to the queue. Please initially try it with the example notebook. For me it worked with both interactive jobs as well as modal jobs.

[jan-janssen]

This also includes the changes from #842

[coveralls]

Pull Request Test Coverage Report for Build 5661

• 2 of 12 (16.67%) changed or added relevant lines in 2 files are covered.
• 42 unchanged lines in 2 files lost coverage.
• Overall coverage decreased (-0.2%) to 58.076%

---

Changes Missing Coverage	Covered Lines	Changed/Added Lines	%
pyiron/base/master/parallel.py	2	3	66.67%
pyiron/atomistics/master/parallel.py	0	9	0.0%

Files with Coverage Reduction	New Missed Lines	%
pyiron/base/master/parallel.py	1	59.69%
pyiron/atomistics/master/murnaghan.py	41	39.86%

Totals
Change from base Build 5648:	-0.2%
Covered Lines:	12427
Relevant Lines:	21398

---

💛 - Coveralls

[SanderBorgmans]

@jan-janssen it seems the issue was that the 'queue' mode was not taken into account.
When adding:

if job.server.run_mode.queue:
    break

to the run_static() function in

pyiron/pyiron/base/master/flexible.py

Lines 157 to 182 in 0fb4c52

	def run_static(self):
	"""
	The FlexibleMaster uses functions to connect multiple Jobs.
	"""
	self.status.running = True
	max_steps = len(self.child_ids + self._job_name_lst)
	ind = max_steps - 1
	for ind in range(len(self.child_ids), max_steps):
	job = self.pop(0)
	job._master_id = self.job_id
	if ind != 0:
	prev_job = self[ind - 1]
	if ind < max_steps:
	mod_funct = self._step_function_lst[ind - 1]
	mod_funct(prev_job, job)
	job._parent_id = prev_job.job_id
	job.run()
	if job.server.run_mode.interactive and not isinstance(job, GenericMaster):
	job.interactive_close()
	if self.server.run_mode.non_modal and job.server.run_mode.non_modal:
	break
	if ind == max_steps - 1 and self.is_finished():
	self.status.finished = True
	self.project.db.item_update(self._runtime(), self.job_id)
	else:
	self.status.suspended = True

similar to the non_modal mode, everything seems to be working as expected.

[jan-janssen]

@SanderBorgmans Sounds reasonable - Can you open a pull request for this? It seems like the runmode queue wasn't considered properly.

[jan-janssen]

I created a new pull request for this #863