integration/conftest: try to set event_loop on failure

[jevonyeoh]

Description

There's a bunch of errors of the form RuntimeError: There is no current event loop in thread 'Dummy-1'. that pop up once in a while on failing integration tests.

Example: https://github.com/featurebyte/featurebyte/actions/runs/4320831275/jobs/7541472752

Some googling suggests we can try to avoid this by having some extra handling around the event loop fixture.

Related links

• https://stackoverflow.com/questions/46727787/runtimeerror-there-is-no-current-event-loop-in-thread-in-async-apscheduler
• "RuntimeError: There is no current event loop in thread 'Dummy-1'" - asyncio issue with potential fix ultrafunkamsterdam/undetected-chromedriver#373
• Event loop shutdown failures on 0.17 pytest-dev/pytest-asyncio#257

I don't think this necessarily solves the underlying issue, but figured it might be worth a try to try to make a short-term patch to alleviate some flaky integration tests.

Related Issue

Type of Change

Label this pull request to place it under the correct category in Release Notes:

Pull Request Label	Category in Release Notes
enhancement, feature	🚀 Features
bug, refactoring, bugfix, fix	🔧 Fixes & Refactoring
build, ci, testing	📦 Build System & CI/CD
breaking	💥 Breaking Changes
documentation	📝 Documentation
dependencies	⬆️ Dependencies updates

Checklist

• I have read the CODE_OF_CONDUCT.md and CONTRIBUTING.md guides.
• I have written tests for the changes made.
• I have written docstrings in NumpyDoc format
• I have labeled my Pull Request correctly

[github-actions]

Coverage Report

File	Stmts	Miss	Cover	Missing
featurebyte
__init__.py	31	0	100%
__main__.py	120	120	0%	4–298
app.py	54	1	97%	138
config.py	143	4	97%	288, 308–309, 381
enum.py	138	0	100%
exception.py	64	0	100%
logger.py	11	0	100%
middleware.py	61	2	96%	78, 118
featurebyte/api
__init__.py	0	0	100%
api_object.py	255	8	96%	73, 125, 415, 595, 620, 674–>676, 677, 680, 703
base_data.py	141	2	98%	60–>exit, 279–280
change_view.py	85	6	93%	97, 180–188, 255, 339
data.py	25	0	100%
database_table.py	102	1	98%	48–>51, 107
dimension_data.py	34	0	100%
dimension_view.py	53	0	100%
entity.py	49	1	96%	110
event_data.py	78	3	95%	104–105, 308
event_view.py	120	0	99%	66–>exit
feature.py	250	5	96%	92, 103, 331, 335, 783
feature_job.py	125	3	97%	122–123, 322
feature_job_setting_analysis.py	62	0	100%
feature_list.py	390	10	96%	100, 275, 304, 340, 343, 437, 448, 645, 909, 1066, 1168–>1163, 1188–>1190
feature_store.py	54	3	90%	135, 162, 196
feature_validation_util.py	6	0	100%
groupby.py	226	6	97%	93, 205, 335–>exit, 418, 528, 642–>646, 672, 675
item_data.py	61	0	98%	86–>97
item_view.py	108	3	95%	148, 243, 400–>exit, 409
lag.py	22	0	100%
relationship.py	42	6	86%	73–74, 86–89
scd_data.py	65	0	100%
scd_view.py	82	1	97%	104, 244–>246
view.py	241	7	97%	78, 263–264, 307–309, 785
window_validator.py	12	0	100%
workspace.py	46	0	100%
featurebyte/api/templates
__init__.py	0	0	100%
featurebyte/api/templates/online_serving
__init__.py	0	0	100%
featurebyte/common
__init__.py	0	0	100%
date_util.py	29	1	95%	37
descriptor.py	16	0	100%
dict_util.py	6	0	100%
doc_util.py	8	0	100%
env_util.py	16	1	95%	21
join_utils.py	37	0	100%
model_util.py	34	0	100%
path_util.py	12	0	100%
singleton.py	9	4	45%	17–20
tile_util.py	12	0	100%
typing.py	18	0	100%
utils.py	76	3	96%	215–216, 252
validator.py	48	0	100%
featurebyte/core
__init__.py	0	0	100%
frame.py	72	1	98%	202
generic.py	106	3	95%	239–>238, 280, 287, 300
mixin.py	92	4	93%	189, 229, 294, 348
series.py	253	3	98%	169, 800, 844
timedelta.py	13	0	100%
util.py	27	1	97%	80
featurebyte/core/accessor
__init__.py	0	0	100%
count_dict.py	66	0	100%
datetime.py	31	1	95%	102
string.py	54	0	100%
featurebyte/datasets
__init__.py	0	0	100%
__main__.py	19	19	0%	4–26
app.py	62	62	0%	4–103
featurebyte/feature_manager
__init__.py	0	0	100%
manager.py	78	0	100%
model.py	33	0	100%
sql_template.py	8	0	100%
featurebyte/migration
__init__.py	0	0	100%
migration_data_service.py	6	0	100%
model.py	21	0	100%
run.py	84	1	99%	235
featurebyte/migration/service
__init__.py	18	0	100%
context.py	4	0	100%
data_warehouse.py	95	9	90%	56–59, 104, 131, 156, 165, 209–211
dimension_data.py	4	0	100%
entity.py	43	0	100%
event_data.py	20	9	50%	25–45
feature.py	17	0	100%
feature_job_setting_analysis.py	4	0	100%
feature_list.py	4	0	100%
feature_list_namespace.py	17	0	100%
feature_namespace.py	17	0	100%
item_data.py	4	0	100%
mixin.py	73	0	100%
scd_data.py	4	0	100%
featurebyte/models
__init__.py	8	0	100%
base.py	113	4	96%	53, 61, 138, 263
context.py	10	0	100%
credential.py	46	1	96%	77
dimension_data.py	26	2	93%	55–58
entity.py	28	0	100%
entity_validation.py	34	0	100%
event_data.py	29	1	94%	83
feature.py	102	0	100%
feature_job_setting_analysis.py	89	3	94%	79, 81, 84
feature_list.py	199	2	98%	195, 567
feature_store.py	48	0	100%
item_data.py	21	0	100%
online_store.py	48	0	97%	101–>97, 103–>97
parent_serving.py	14	0	100%
persistent.py	33	0	100%
relationship.py	35	0	100%
scd_data.py	28	4	81%	71–83
semantic.py	7	0	100%
tabular_data.py	13	0	100%
task.py	22	0	100%
tile.py	32	1	95%	73
workspace.py	12	0	100%
featurebyte/persistent
__init__.py	2	0	100%
audit.py	62	1	97%	162, 291–>300
base.py	99	2	98%	668–669
mongo.py	70	1	97%	316, 334–>exit
featurebyte/query_graph
__init__.py	0	0	100%
algorithm.py	25	0	100%
enum.py	75	0	100%
graph.py	86	2	98%	312–313
pruning_util.py	11	0	100%
util.py	46	0	100%
featurebyte/query_graph/graph_node
__init__.py	0	0	100%
base.py	29	0	100%
featurebyte/query_graph/model
__init__.py	0	0	100%
column_info.py	9	0	100%
common_table.py	93	1	97%	60–>62, 74
critical_data_info.py	18	0	100%
feature_job_setting.py	30	1	94%	122
graph.py	193	6	95%	118, 128, 138, 301, 360–363
table.py	173	8	95%	44, 67–69, 127, 334, 405, 683
featurebyte/query_graph/node
__init__.py	10	0	100%
agg_func.py	58	1	97%	45
base.py	179	11	94%	124, 144, 397–400, 428, 589–590, 649, 652
binary.py	76	2	97%	163, 166
cleaning_operation.py	89	1	99%	226
count_dict.py	98	11	90%	33, 36, 121, 124, 137, 187–190, 210–211
date.py	77	6	92%	73, 76, 107, 110, 147, 150
generic.py	501	14	96%	399, 406–413, 654, 1038, 1040, 1047–>exit, 1202, 1205, 1272, 1275, 1298
input.py	130	2	99%	301, 304
mixin.py	67	0	98%	108–>exit, 111–>113
nested.py	153	6	96%	58, 61, 163, 534, 543, 550
schema.py	43	0	100%
string.py	95	0	98%	53–>55, 157–>159
unary.py	78	2	96%	136, 151
validator.py	17	0	100%
featurebyte/query_graph/node/metadata
__init__.py	0	0	100%
column.py	10	0	100%
operation.py	217	2	98%	138–>exit, 357–>364, 436–>exit, 456, 464
sdk_code.py	161	1	99%	119
featurebyte/query_graph/sql
__init__.py	0	0	100%
adapter.py	165	2	98%	491, 554
builder.py	74	0	99%	180–>187
common.py	43	0	100%
dataframe.py	21	0	100%
expression.py	29	0	100%
feature_compute.py	169	1	99%	141
feature_historical.py	53	0	100%
feature_preview.py	39	0	100%
groupby_helper.py	48	1	97%	68
interpreter.py	235	4	97%	250, 262–265, 267–>269, 734–>765, 824–>835
online_serving.py	116	0	100%
online_serving_util.py	10	0	100%
parent_serving.py	38	0	100%
scd_helper.py	81	0	100%
specs.py	183	0	99%	411–>415
template.py	27	0	100%
tile_compute.py	100	0	100%
tile_util.py	25	0	100%
tiling.py	105	0	100%
featurebyte/query_graph/sql/aggregator
__init__.py	0	0	100%
asat.py	42	0	100%
base.py	115	0	100%
item.py	34	0	100%
latest.py	35	0	100%
lookup.py	90	2	97%	86–87
request_table.py	41	0	100%
window.py	139	0	100%
featurebyte/query_graph/sql/ast
__init__.py	0	0	100%
aggregate.py	60	0	100%
base.py	124	3	98%	110–111, 203
binary.py	33	0	100%
count_dict.py	79	0	100%
datetime.py	119	0	100%
generic.py	113	0	100%
groupby.py	33	1	95%	49
input.py	36	1	95%	45
is_in.py	22	0	100%
join.py	93	0	100%
literal.py	12	0	100%
string.py	127	0	100%
tile.py	119	0	99%	229–>231, 240–>exit
unary.py	76	0	100%
util.py	23	0	100%
featurebyte/query_graph/transform
__init__.py	0	0	100%
base.py	25	0	100%
flattening.py	42	0	100%
operation_structure.py	45	0	100%
pruning.py	138	0	99%	336–>352
reconstruction.py	64	0	100%
sdk_code.py	51	0	97%	124–>126, 126–>128
featurebyte/routes
__init__.py	0	0	100%
app_container.py	41	0	100%
app_container_config.py	35	0	100%
registry.py	101	0	100%
featurebyte/routes/common
__init__.py	0	0	100%
base.py	49	0	100%
base_data.py	49	0	100%
schema.py	12	0	100%
util.py	6	0	100%
featurebyte/routes/context
__init__.py	0	0	100%
api.py	35	0	100%
controller.py	14	0	100%
featurebyte/routes/dimension_data
__init__.py	0	0	100%
api.py	41	0	100%
controller.py	18	0	100%
featurebyte/routes/entity
__init__.py	0	0	100%
api.py	56	0	100%
controller.py	23	0	100%
featurebyte/routes/event_data
__init__.py	0	0	100%
api.py	46	0	100%
controller.py	20	0	100%
featurebyte/routes/feature
__init__.py	0	0	100%
api.py	54	0	100%
controller.py	64	0	99%	109–>115
featurebyte/routes/feature_job_setting_analysis
__init__.py	0	0	100%
api.py	50	0	100%
controller.py	41	0	100%
featurebyte/routes/feature_list
__init__.py	0	0	100%
api.py	72	0	100%
controller.py	96	6	94%	141–>148, 232–233, 271–277, 355–356
featurebyte/routes/feature_list_namespace
__init__.py	0	0	100%
api.py	35	3	91%	106–115
controller.py	34	0	100%
featurebyte/routes/feature_namespace
__init__.py	0	0	100%
api.py	35	3	91%	99–108
controller.py	31	0	100%
featurebyte/routes/feature_store
__init__.py	0	0	100%
api.py	69	0	100%
controller.py	65	7	85%	118–142, 167
featurebyte/routes/item_data
__init__.py	0	0	100%
api.py	41	0	100%
controller.py	18	0	100%
featurebyte/routes/relationship_info
__init__.py	0	0	100%
api.py	40	0	100%
controller.py	33	0	100%
featurebyte/routes/scd_data
__init__.py	0	0	100%
api.py	41	0	100%
controller.py	22	0	96%	36–>42
featurebyte/routes/semantic
__init__.py	0	0	100%
api.py	41	0	100%
controller.py	14	0	100%
featurebyte/routes/tabular_data
__init__.py	0	0	100%
api.py	18	0	100%
controller.py	7	0	100%
featurebyte/routes/task
__init__.py	0	0	100%
api.py	16	0	100%
controller.py	17	0	100%
featurebyte/routes/temp_data
__init__.py	0	0	100%
api.py	11	0	100%
controller.py	17	2	88%	49–50
featurebyte/routes/workspace
__init__.py	0	0	100%
api.py	46	0	100%
controller.py	21	0	100%
featurebyte/schema
__init__.py	3	0	100%
context.py	27	0	100%
dimension_data.py	14	0	100%
entity.py	23	0	100%
event_data.py	20	0	100%
feature.py	63	1	98%	117
feature_job_setting_analysis.py	36	0	100%
feature_list.py	44	0	100%
feature_list_namespace.py	16	0	100%
feature_namespace.py	28	0	100%
feature_store.py	49	0	100%
info.py	135	4	97%	135–136, 365–366
item_data.py	16	0	100%
relationship_info.py	28	0	100%
scd_data.py	22	0	100%
semantic.py	15	0	100%
tabular_data.py	38	4	86%	70–73
task.py	25	0	100%
workspace.py	18	0	100%
featurebyte/schema/common
__init__.py	0	0	100%
base.py	17	0	100%
operation.py	43	1	97%	78
featurebyte/schema/worker
__init__.py	0	0	100%
progress.py	6	0	100%
featurebyte/schema/worker/task
__init__.py	0	0	100%
base.py	30	1	91%	47, 51–>53
feature_job_setting_analysis.py	14	0	100%
test.py	8	0	100%
featurebyte/service
__init__.py	0	0	100%
base_data_document.py	53	1	92%	100–>115, 101–>111, 112, 126–>130
base_document.py	174	4	97%	181–183, 395, 467, 479–>464
base_service.py	10	0	100%
context.py	57	0	99%	133–>138
data_update.py	135	1	99%	321
default_version_mode.py	32	0	100%
deploy.py	76	0	100%
dimension_data.py	6	0	100%
entity.py	21	0	100%
entity_validation.py	59	0	100%
event_data.py	6	0	100%
feature.py	56	0	100%
feature_job_setting_analysis.py	24	0	100%
feature_list.py	67	0	100%
feature_list_namespace.py	6	0	100%
feature_namespace.py	6	0	100%
feature_readiness.py	83	0	100%
feature_store.py	8	0	100%
feature_store_warehouse.py	78	0	99%	246–>263
info.py	205	1	99%	532
item_data.py	6	0	100%
mixin.py	30	0	100%
online_enable.py	67	1	97%	162
online_serving.py	47	1	96%	78
parent_serving.py	70	0	99%	107–>exit
preview.py	144	1	99%	387
relationship.py	79	0	100%
relationship_info.py	5	0	100%
scd_data.py	9	0	100%
semantic.py	8	0	100%
session_manager.py	29	1	94%	66
session_validator.py	56	3	94%	119, 176–179
tabular_data.py	12	0	100%
task_manager.py	41	0	100%
user_service.py	6	0	100%
version.py	154	3	97%	124, 128, 197, 238–>189
working_schema.py	35	2	90%	36, 71
workspace.py	25	0	100%
featurebyte/session
__init__.py	0	0	100%
base.py	243	6	96%	15–16, 87, 240–>243, 266–267, 414, 661–>664
databricks.py	105	9	89%	18–19, 58, 62, 66, 72–>74, 80–>82, 92–>94, 109–>116, 173, 176–177, 183, 189–>191
enum.py	12	0	100%
hive.py	48	18	53%	56–79
manager.py	41	0	100%
simple_storage.py	61	22	60%	126–147, 150, 154, 157–158
snowflake.py	202	15	90%	98–>100, 117–>119, 129–>131, 131–>133, 160, 247–>252, 277, 335–340, 343–348, 370
spark.py	211	21	86%	72, 76, 108–109, 162–>164, 169–>172, 179–>181, 193–>202, 211, 229, 268, 274–275, 322–>330, 365, 441, 507–508, 511–522, 525
sqlite.py	60	1	95%	57–>59, 80, 90–>95
featurebyte/sql
__init__.py	0	0	100%
featurebyte/sql/spark
__init__.py	0	0	100%
common.py	4	0	100%
tile_common.py	27	0	100%
tile_generate.py	66	4	92%	93–95, 123
tile_generate_entity_tracking.py	40	0	100%
tile_generate_schedule.py	67	9	86%	55–56, 173–182
tile_monitor.py	45	7	85%	39, 123–156
tile_registry.py	52	1	96%	109–>113, 122
tile_schedule_online_store.py	50	0	100%
featurebyte/storage
__init__.py	4	0	100%
base.py	33	0	100%
local.py	40	1	98%	44
local_temp.py	7	0	100%
featurebyte/tile
__init__.py	0	0	100%
base.py	45	8	76%	165–178, 254–261
databricks_tile.py	45	45	0%	4–169
scheduler.py	44	2	96%	101–102
snowflake_tile.py	92	3	95%	238, 285, 414
spark_tile.py	29	0	100%
sql_template.py	9	0	100%
tile_cache.py	190	0	100%
featurebyte/utils
__init__.py	0	0	100%
credential.py	14	0	100%
messaging.py	21	9	52%	34–36, 47–48, 58–61
persistent.py	11	0	100%
storage.py	12	0	100%
featurebyte/utils/snowflake
__init__.py	0	0	100%
sql.py	4	0	100%
featurebyte/worker
__init__.py	37	7	76%	29, 45–48, 51–52
enum.py	2	2	0%	4–7
process_store.py	54	54	0%	4–121
progress.py	14	14	0%	4–50
start.py	2	2	0%	4–6
task_executor.py	22	3	86%	56–58
featurebyte/worker/task
__init__.py	3	0	100%
base.py	29	0	100%
feature_job_setting_analysis.py	62	0	100%
test_task.py	12	4	57%	24–27
TOTAL	19083	746	95%

Tests	Skipped	Failures	Errors	Time
1867	13 💤	0 ❌	0 🔥	9m 20s ⏱️

[YS-L]

Would it be useful to log that this happened before the extra handling just in case for troubleshooting?

[jevonyeoh]

sounds good, i'll add a log line!

[YS-L]

Good findings! I saw this error before too. Would be great if this can prevent that from happening again.