Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

job-exec: implement ability to execute job shells #2198

Merged
merged 14 commits into from Jun 23, 2019
Merged

job-exec: implement ability to execute job shells #2198

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
b357126
t2400-job-exec-test: force test execution mode
grondo Jun 19, 2019
b9339d8
job-exec: refactor jobinfo_emit_event_pack_nowait
grondo Jun 14, 2019
7d3c365
job-exec: add jansson pack args to jobinfo_started()
grondo Jun 14, 2019
6214389
job-exec: clear running flag in jobinfo_complete()
grondo Jun 15, 2019
32c77d1
job-exec: major refactor of test execution module
grondo Jun 17, 2019
5942862
job-exec: add bulk execution api
grondo Jun 19, 2019
cd81d12
job-exec: add real exec implementation to job-exec module
grondo Jun 19, 2019
f3747e0
test/sched-bench.sh: fix fake rank numbering origin
grondo Jun 19, 2019
ea691b7
flux-jobspec: add current working directory to jobspec
grondo Jun 19, 2019
0895ae6
t0021-flux-jobspec: add check for attributes.system.cwd
grondo Jun 19, 2019
212a47b
t2400-job-exec-test: skip entire test if no jq
grondo Jun 19, 2019
73bc647
t2500-job-attach: set all jobs to use testexec exec implementation
grondo Jun 19, 2019
91a7a73
t2402-job-exec-dummy: add dummy job shell script and tests
grondo Jun 20, 2019
075e59e
test/bulk-exec.c: add signal handler
grondo Jun 21, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
3 changes: 2 additions & 1 deletion src/cmd/flux-jobspec.py
View file
Open in desktop
Expand Up @@ -3,6 +3,7 @@
from __future__ import print_function

import re
import os
import sys
import math
import logging
Expand Down Expand Up @@ -70,7 +71,7 @@ def create_slurm_style_jobspec(
"attributes": {},
}
],
"attributes": {"system": {}},
"attributes": {"system": {"cwd": os.getcwd()}},
}
if walltime:
jobspec["attributes"]["system"]["duration"] = walltime
Expand Down
28 changes: 27 additions & 1 deletion src/modules/job-exec/Makefile.am
View file
Open in desktop
Expand Up @@ -14,10 +14,23 @@ AM_CPPFLAGS = \
fluxmod_LTLIBRARIES = \
job-exec.la

noinst_LTLIBRARIES = \
libbulk-exec.la

noinst_PROGRAMS = \
bulk-exec

libbulk_exec_la_SOURCES = \
bulk-exec.h \
bulk-exec.c

job_exec_la_SOURCES = \
job-exec.h \
job-exec.c \
rset.c \
rset.h
rset.h \
testexec.c \
exec.c

job_exec_la_LDFLAGS = \
$(fluxmod_ldflags) \
Expand All @@ -27,6 +40,19 @@ job_exec_la_LIBADD = \
$(fluxmod_ldadd) \
$(top_builddir)/src/common/libflux-internal.la \
$(top_builddir)/src/common/libflux-core.la \
libbulk-exec.la \
$(ZMQ_LIBS)

bulk_exec_SOURCES = \
test/bulk-exec.c

bulk_exec_LDADD = \
$(fluxmod_ldadd) \
$(top_builddir)/src/common/libflux-internal.la \
$(top_builddir)/src/common/libflux-core.la \
$(top_builddir)/src/common/libflux-idset.la \
$(top_builddir)/src/common/libflux-optparse.la \
libbulk-exec.la \
$(ZMQ_LIBS)

test_ldadd = \
Expand Down