Skip to content

Move pysqa_job_output_validation() function - #1043

Merged
jan-janssen merged 8 commits into
fix/1037-slurm-cluster-executor-job-timeout-hangfrom
validation
Aug 7, 2026
Merged

Move pysqa_job_output_validation() function#1043
jan-janssen merged 8 commits into
fix/1037-slurm-cluster-executor-job-timeout-hangfrom
validation

Conversation

@jan-janssen

Copy link
Copy Markdown
Member

No description provided.

@coderabbitai

coderabbitai Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: 67052c46-f318-4069-844a-babb6ce82f35

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@codecov

codecov Bot commented Aug 7, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 93.75000% with 1 line in your changes missing coverage. Please review.
✅ Project coverage is 94.19%. Comparing base (e23aee1) to head (97cf100).

Files with missing lines Patch % Lines
.../executorlib/task_scheduler/file/task_scheduler.py 50.00% 1 Missing ⚠️
Additional details and impacted files
@@                                 Coverage Diff                                  @@
##           fix/1037-slurm-cluster-executor-job-timeout-hang    #1043      +/-   ##
====================================================================================
+ Coverage                                             94.15%   94.19%   +0.03%     
====================================================================================
  Files                                                    39       39              
  Lines                                                  2140     2137       -3     
====================================================================================
- Hits                                                   2015     2013       -2     
+ Misses                                                  125      124       -1     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@jan-janssen
jan-janssen merged commit ecc1841 into fix/1037-slurm-cluster-executor-job-timeout-hang Aug 7, 2026
94 of 99 checks passed
@jan-janssen
jan-janssen deleted the validation branch August 7, 2026 06:00
jan-janssen added a commit that referenced this pull request Aug 7, 2026
* Fix future hang when a queuing-system job dies without output (#1037)

FileTaskScheduler only resolved a task's future once its _o.h5 output file
appeared, so a job killed by the scheduler (walltime TIMEOUT, OOM, NODE_FAIL,
scancel) never wrote that file and future.result() blocked forever.

_check_task_output now falls back to querying the job status via pysqa when
the output file is missing and fails the future if the job is no longer
known to the queuing system. The status query is throttled per task
(_JOB_STATUS_CHECK_INTERVAL) and imported lazily so subprocess-only task
submissions never pay the pysqa import cost.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>

* Skip pysqa status tests on Windows

* Skip pysqa tests when pysqa is not installed

* More fixes and more tests

* Move `pysqa_job_output_validation()` function (#1043)

* Move job validation to pysqa module

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fixes

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* mypy fix

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix tests

* fix

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

---------

Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant