Skip to content

Fix directory file dependency resolution#29

Merged
gliargovas merged 24 commits intomainfrom
fix-directory-file-dependency-resolution
Apr 12, 2023
Merged

Fix directory file dependency resolution#29
gliargovas merged 24 commits intomainfrom
fix-directory-file-dependency-resolution

Conversation

@gliargovas
Copy link
Copy Markdown
Collaborator

No description provided.

@gliargovas gliargovas added work in progress priority Try to resolve this issue before others labels Apr 3, 2023
@gliargovas gliargovas self-assigned this Apr 3, 2023
@gliargovas
Copy link
Copy Markdown
Collaborator Author

Right now I am getting a strange fail in test 6 because of a file in the output dir that normally shouldn't exist. It is never referenced in any log trace, and when run independently the test passes, so I guess it has to do with the test script itself.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Apr 3, 2023

OS:ubuntu-22.04
Mon Apr 3 22:00:32 UTC 2023
Summary: 6/6 tests passed.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Apr 3, 2023

OS:ubuntu-22.04
Mon Apr 3 22:00:41 UTC 2023
Summary: 5/6 tests passed.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Apr 4, 2023

OS:ubuntu-22.04
Tue Apr 4 17:44:11 UTC 2023
Summary: 7/7 tests passed.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Apr 5, 2023

OS:ubuntu-22.04
Wed Apr 5 23:19:45 UTC 2023
Summary: 8/8 tests passed.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Apr 7, 2023

OS:ubuntu-22.04
Fri Apr 7 20:56:02 UTC 2023
Summary: 8/8 tests passed.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Apr 8, 2023

OS:ubuntu-22.04
Sat Apr 8 18:31:19 UTC 2023
Summary: 9/9 tests passed.

Copy link
Copy Markdown
Member

@angelhof angelhof left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! You can merge it if you add a brief comment regarding the dir/file resolution

next_non_speculated.append(node_id)
return list(next_non_speculated)

def has_dir_file_dependency(self, first_cmd_set, second_cmd_set):
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you add a comment explaining how is the check exactly supposed to work? If I understand correctly, if the first command creates has a directory in its write set (meaning that it creates it?) and the second reads from a file in this directory (but not its children directories), then there is a conflict? Shouldn't the second cmd write set also be checked? In any case, I think a comment above the function explaining what is it supposed to check and implement would be great :)

Copy link
Copy Markdown
Collaborator Author

@gliargovas gliargovas Apr 12, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You are right, this implementation was incorrect. Changed it to examine all relevant suffixes. Also, discovered some limitations with the parsing and directories. Maybe it's inevitable to switch to a more tight integration with the Riker trace, but at a later PR (I think this one has already too many changes).

Comment thread parallel-orch/partial_program_order.py Outdated
@github-actions
Copy link
Copy Markdown

github-actions Bot commented Apr 8, 2023

OS:ubuntu-22.04
Sat Apr 8 21:26:32 UTC 2023
Summary: 9/9 tests passed.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Apr 9, 2023

OS:ubuntu-22.04
Sun Apr 9 21:26:14 UTC 2023
Summary: 9/9 tests passed.

@github-actions
Copy link
Copy Markdown

OS:ubuntu-22.04
Tue Apr 11 04:02:08 UTC 2023
Summary: 6/9 tests passed.

@github-actions
Copy link
Copy Markdown

OS:ubuntu-22.04
Tue Apr 11 16:18:28 UTC 2023
Summary: 7/9 tests passed.

@github-actions
Copy link
Copy Markdown

OS:ubuntu-22.04
Wed Apr 12 03:27:35 UTC 2023
Summary: 21/21 tests passed.

@github-actions
Copy link
Copy Markdown

OS:ubuntu-22.04
Wed Apr 12 03:47:43 UTC 2023
Summary: 21/21 tests passed.

@github-actions
Copy link
Copy Markdown

OS:ubuntu-22.04
Wed Apr 12 04:08:34 UTC 2023
Summary: 19/21 tests passed.

@github-actions
Copy link
Copy Markdown

OS:ubuntu-22.04
Wed Apr 12 04:25:02 UTC 2023
Summary: 20/21 tests passed.

@github-actions
Copy link
Copy Markdown

OS:ubuntu-22.04
Wed Apr 12 14:58:05 UTC 2023
Summary: 21/21 tests passed.

@gliargovas gliargovas merged commit 35f1eec into main Apr 12, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

priority Try to resolve this issue before others work in progress

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Background procs don't terminate when scheduler exits prematurely File-directory dependency resolution

2 participants