How to ignore Timeout errors

[harshil21]

So the test suite I deal with has a lot of network related operations, i.e API calls, etc. Most of which we usually mock using monkeypatch. But there are a few which we don't monkeypatch, and for some reason there are always timeout errors happening in that function. Tried increasing the timeout using pytest.mark.timeout but it didn't help. Is there a way to just ignore Timeout errors globally?

It shows up in the end of the test like this (in GH actions):

+++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++
TestXYZ::test_method_XYZ
Error: Process completed with exit code 1.

[The-Compiler]

That output isn't coming from pytest itself, and I don't think it's coming from pytest-timeout either (but it's been a while since I last used that plugin). Could you show the full output?

[harshil21]

Actually I believe these headers come from pytest-timeout:

Oh well...

Have you tried increasing the timeout?

Yea we did, it helped a bit, but it's not really a long term solution.

Otherwise it might really be that the code is hanging in there

Brings me back to the original question, no way to just xpass a test which has exceeded the timeout?

[The-Compiler]

Brings me back to the original question, no way to just xpass a test which has exceeded the timeout?

You could probably use @pytest.mark.timeout(None) on that test?

[nicoddemus]

You could probably use @pytest.mark.timeout(None) on that test?

That will mean the test will now hang forever, I believe @harshil21 means to xfail the test if the timeout occurs. However this is not currently possible: the way that pytest-timeout works is to send a signal to the main thread when the timeout occurs. The only thing it can do at that point is to kill the main thread, dumping the stacks.

A possible solution would be to implement a timeout-like mechanism yourself, something like (untested):

def test_send_message():
	reply_to_message = None

	def run_in_thread():
		nonlocal reply_to_message
		reply_to_message = default_bot.send_message(chat_id, 'test')

	thread = threading.Thread(default_bot.send_message, chat_id, 'test')
	thread.start()
	started = time.perf_counter()
	while reply_to_message is None:
		time.sleep(0.1)
		elapsed = time.perf_counter() - started
		if elapsed > 10.0:
			break

	if reply_to_message is None:
		pytest.xfail(reason="timeout")    
	...

[harshil21]

I see, I'll try this solution out. Thank you for answering!

[nicoddemus]

Sure. Please don't forget to get back here if it works out for you. 😁