fix: Improve robustness of get_task HF pipeline invocations

[MichelBartels]

Related Issues

• fixes Improve robustness of get_task HF pipeline invocations #4848

Proposed Changes:

Before this fix, the HF invocation layer was tested early which caused the process not to reach the correct invocation layer check if the HF servers were unresponsive. This PR changes the invocation order so HF is checked later and adds a timeout of 1s so it can't get stuck waiting for a response from the HF servers.

How did you test it?

I added a unit test that checks that the timeout is handled correctly. There is also a new test checking that the huggingface checks are in the last five invocation layer checks.

Notes for the reviewer

The timeout is set to 1s and can't be changed by the user. This could potentially lead to issues. I am also not sure about whether the test for the invocation layer order should be different because it does not make sure the methods are actually called in that order.

I have discussed these changes with @vblagoje who also created the original issue. I am not sure if it might make sense for him to review the PR.

Checklist

• I have read the contributors guidelines and the code of conduct
• I have updated the related issue with new insights and changes
• I added unit tests and updated the docstrings
• I've used one of the conventional commit types for my PR title: fix:, feat:, build:, chore:, ci:, docs:, style:, refactor:, perf:, test:.
• I documented my code
• I ran pre-commit hooks and fixed any issue

[coveralls]

Pull Request Test Coverage Report for Build 5476358114

• 0 of 0 changed or added relevant lines in 0 files are covered.
• 10 unchanged lines in 1 file lost coverage.
• Overall coverage increased (+0.01%) to 44.668%

---

Files with Coverage Reduction	New Missed Lines	%
nodes/prompt/invocation_layer/hugging_face.py	10	88.06%

Totals
Change from base Build 5474864964:	0.01%
Covered Lines:	10283
Relevant Lines:	23021

---

💛 - Coveralls

[vblagoje]

All makes sense to me, except 1s timeout seems too aggressive. I'd set it to 2-3 sec. @anakin87

[vblagoje]

@MichelBartels you'll likely need to rebase to main (or merge main) as #5285 fixed the test issue.

[anakin87]

@MichelBartels, it seems like a nice hotfix to me!

I left two minor comments to improve things...

[vblagoje]

Nice work 🚀