{"message": "Setup starting RabbitMQRPCConsumer", "timestamp": "2023-03-01T10:57:45.988781Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 44} DEBUG 2023-03-01 10:57:45,988 RabbitMQRPCConsumer __init__ 44 : Setup starting RabbitMQRPCConsumer DEBUG 2023-03-01 10:57:45,989 pika.adapters.select_connection _get_poller 415 : Using EPollPoller DEBUG 2023-03-01 10:57:45,989 kafka.protocol.parser _process_response 139 : Received correlation id: 3 DEBUG 2023-03-01 10:57:45,990 pika.connection _set_connection_state 2273: New Connection state: CLOSED (prev=CLOSED) DEBUG 2023-03-01 10:57:45,990 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 10:57:45,990 pika.callback add 165 : Added: {'callback': >>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} DEBUG 2023-03-01 10:57:45,992 pika.callback add 165 : Added: {'callback': >>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} DEBUG 2023-03-01 10:57:45,992 pika.callback add 165 : Added: {'callback': functools.partial(>>, >), 'one_shot': False, 'only': None, 'arguments': None} DEBUG 2023-03-01 10:57:45,992 pika.callback add 165 : Added: {'callback': functools.partial(>>, >), 'one_shot': False, 'only': None, 'arguments': None} DEBUG 2023-03-01 10:57:45,992 pika.callback add 165 : Added: {'callback': >>, 'one_shot': False, 'only': None, 'arguments': None} DEBUG 2023-03-01 10:57:45,992 pika.callback add 165 : Added: {'callback': >, 'one_shot': False, 'only': None, 'arguments': None} DEBUG 2023-03-01 10:57:45,992 pika.connection _set_connection_state 2273: New Connection state: INIT (prev=CLOSED) DEBUG 2023-03-01 10:57:45,992 pika.adapters.utils.connection_workflow start 656 : Starting AMQP Connection workflow asynchronously. DEBUG 2023-03-01 10:57:45,992 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10729636.582079262 and callback=functools.partial(>, first=True); now=10729636.582079262; delay=0 {"message": "Setup ended RabbitMQRPCConsumer", "timestamp": "2023-03-01T10:57:45.993310Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 50} DEBUG 2023-03-01 10:57:45,993 RabbitMQRPCConsumer __init__ 50 : Setup ended RabbitMQRPCConsumer {"message": "Setup starting RabbitMQRPCConsumer", "timestamp": "2023-03-01T10:57:45.993470Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 35} DEBUG 2023-03-01 10:57:45,993 RabbitMQRPCConsumer __init__ 35 : Setup starting RabbitMQRPCConsumer {"message": "Setup ended RabbitMQRPCConsumer", "timestamp": "2023-03-01T10:57:45.993603Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 36} DEBUG 2023-03-01 10:57:45,993 RabbitMQRPCConsumer __init__ 36 : Setup ended RabbitMQRPCConsumer {"message": "Method called start", "timestamp": "2023-03-01T10:57:45.993740Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 98} INFO 2023-03-01 10:57:45,993 RabbitMQRPCConsumer start 98 : Method called start DEBUG 2023-03-01 10:57:45,993 pika.adapters.select_connection start 799 : Entering IOLoop DEBUG 2023-03-01 10:57:45,994 pika.adapters.utils.connection_workflow _start_new_cycle_async 751 : Beginning a new AMQP connection workflow cycle; attempts remaining after this: 0 DEBUG 2023-03-01 10:57:45,994 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10729636.583260356 and callback=>; now=10729636.583260356; delay=0 DEBUG 2023-03-01 10:57:45,994 pika.adapters.utils.connection_workflow _try_next_config_async 779 : _try_next_config_async: 'rabbitmq.rabbitmq-system.svc.cluster.local':5672 DEBUG 2023-03-01 10:57:45,992 kafka.conn recv 1074: [IPv4 ('10.244.2.16', 9092)]> Response 3 (4.604339599609375 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 10:57:45,995 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 10:57:46,001 pika.adapters.select_connection add_callback_threadsafe 481 : add_callback_threadsafe: added callback=> DEBUG 2023-03-01 10:57:46,002 pika.adapters.select_connection process_timeouts 494 : process_timeouts: invoking callback=> DEBUG 2023-03-01 10:57:46,002 pika.adapters.utils.selector_ioloop_adapter _dispatch_result 591 : Invoking asynchronous getaddrinfo() completion callback; host='rabbitmq.rabbitmq-system.svc.cluster.local' DEBUG 2023-03-01 10:57:46,002 pika.adapters.utils.connection_workflow _on_getaddrinfo_async_done 804 : getaddrinfo returned 1 records DEBUG 2023-03-01 10:57:46,002 pika.adapters.utils.connection_workflow _try_next_resolved_address 822 : Attempting to connect using address record (, , 6, '', ('10.0.203.182', 5672)) INFO 2023-03-01 10:57:46,002 pika.adapters.utils.connection_workflow start 179 : Pika version 1.2.0 connecting to ('10.0.203.182', 5672) DEBUG 2023-03-01 10:57:46,003 pika.adapters.select_connection add_callback_threadsafe 481 : add_callback_threadsafe: added callback=> DEBUG 2023-03-01 10:57:46,003 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10729646.592370974 and callback=>; now=10729636.592370974; delay=10.0 DEBUG 2023-03-01 10:57:46,003 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10729651.592501285 and callback=>; now=10729636.592501285; delay=15.0 DEBUG 2023-03-01 10:57:46,003 pika.adapters.select_connection process_timeouts 494 : process_timeouts: invoking callback=> DEBUG 2023-03-01 10:57:46,003 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 10:57:46,003 pika.adapters.utils.selector_ioloop_adapter set_writer 324 : set_writer(11, _) added handler Wr DEBUG 2023-03-01 10:57:46,003 pika.adapters.utils.io_services_utils _start_async 324 : Connection-establishment is in progress for . INFO 2023-03-01 10:57:46,004 pika.adapters.utils.io_services_utils _on_writable 345 : Socket connected: DEBUG 2023-03-01 10:57:46,004 pika.adapters.utils.io_services_utils _report_completion 273 : _AsyncSocketConnector._report_completion(None); DEBUG 2023-03-01 10:57:46,005 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 10:57:46,005 pika.adapters.utils.selector_ioloop_adapter remove_writer 364 : remove_writer(11) removed handler DEBUG 2023-03-01 10:57:46,005 pika.adapters.select_connection remove_timeout 284 : remove_timeout: removing timeout with deadline=10729646.592370974 and callback=> DEBUG 2023-03-01 10:57:46,005 pika.adapters.utils.connection_workflow _on_tcp_connection_done 382 : TCP connection to broker established: . DEBUG 2023-03-01 10:57:46,005 pika.adapters.utils.io_services_utils start 456 : _AsyncStreamConnector.start(); DEBUG 2023-03-01 10:57:46,005 pika.adapters.select_connection add_callback_threadsafe 481 : add_callback_threadsafe: added callback=> DEBUG 2023-03-01 10:57:46,005 pika.adapters.select_connection process_timeouts 494 : process_timeouts: invoking callback=> DEBUG 2023-03-01 10:57:46,005 pika.adapters.utils.io_services_utils _start_async 528 : _AsyncStreamConnector._start_async(); DEBUG 2023-03-01 10:57:46,005 pika.adapters.utils.io_services_utils _linkup 566 : _AsyncStreamConnector._linkup() DEBUG 2023-03-01 10:57:46,006 pika.adapters.utils.io_services_utils __init__ 715 : _AsyncTransportBase.__init__: DEBUG 2023-03-01 10:57:46,006 pika.adapters.utils.selector_ioloop_adapter set_reader 251 : SelectorIOServicesAdapter.set_reader(11, >) DEBUG 2023-03-01 10:57:46,006 pika.adapters.utils.selector_ioloop_adapter set_reader 263 : set_reader(11, _) added handler Rd DEBUG 2023-03-01 10:57:46,006 pika.adapters.utils.io_services_utils _linkup 598 : _linkup(): created transport DEBUG 2023-03-01 10:57:46,006 pika.connection _set_connection_state 2273: New Connection state: PROTOCOL (prev=INIT) DEBUG 2023-03-01 10:57:46,006 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 10:57:46,006 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 10:57:46,006 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 10:57:46,006 pika.adapters.utils.io_services_utils _linkup 609 : _linkup(): introduced transport to protocol ; _StreamingProtocolShim: params=> DEBUG 2023-03-01 10:57:46,006 pika.adapters.utils.io_services_utils _report_completion 499 : _AsyncStreamConnector._report_completion((, _StreamingProtocolShim: params=>)); INFO 2023-03-01 10:57:46,007 pika.adapters.utils.connection_workflow _on_transport_establishment_done 428 : Streaming transport linked up: (, _StreamingProtocolShim: params=>). DEBUG 2023-03-01 10:57:46,007 pika.callback remove 265 : Removing callback #0: {'callback': params=>>, 'one_shot': False, 'only': None, 'arguments': None} DEBUG 2023-03-01 10:57:46,007 pika.callback add 165 : Added: {'callback': >, 'one_shot': False, 'only': None, 'arguments': None} DEBUG 2023-03-01 10:57:46,007 pika.callback add 165 : Added: {'callback': >, 'one_shot': False, 'only': None, 'arguments': None} DEBUG 2023-03-01 10:57:46,007 pika.adapters.utils.io_services_utils _cleanup 422 : _AsyncStreamConnector._cleanup(False) DEBUG 2023-03-01 10:57:46,007 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 10:57:46,007 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 10:57:46,008 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 10:57:46,009 pika.callback process 217 : Processing 0:Connection.Start DEBUG 2023-03-01 10:57:46,009 pika.callback _use_one_shot_callback 401 : Processing use of oneshot callback DEBUG 2023-03-01 10:57:46,009 pika.callback _use_one_shot_callback 403 : 0 registered uses left DEBUG 2023-03-01 10:57:46,009 pika.callback remove 265 : Removing callback #0: {'callback': params=>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} DEBUG 2023-03-01 10:57:46,009 pika.callback process 231 : Calling params=>> for "0:Connection.Start" DEBUG 2023-03-01 10:57:46,009 pika.connection _set_connection_state 2273: New Connection state: START (prev=PROTOCOL) DEBUG 2023-03-01 10:57:46,010 pika.callback add 165 : Added: {'callback': params=>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} DEBUG 2023-03-01 10:57:46,010 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 10:57:46,010 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 10:57:46,010 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 10:57:46,010 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 10:57:46,010 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 10:57:46,010 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 10:57:46,010 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 10:57:46,011 pika.callback process 217 : Processing 0:Connection.Tune DEBUG 2023-03-01 10:57:46,011 pika.callback _use_one_shot_callback 401 : Processing use of oneshot callback DEBUG 2023-03-01 10:57:46,011 pika.callback _use_one_shot_callback 403 : 0 registered uses left DEBUG 2023-03-01 10:57:46,011 pika.callback remove 265 : Removing callback #0: {'callback': params=>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} DEBUG 2023-03-01 10:57:46,011 pika.callback process 231 : Calling params=>> for "0:Connection.Tune" DEBUG 2023-03-01 10:57:46,011 pika.connection _set_connection_state 2273: New Connection state: TUNE (prev=START) DEBUG 2023-03-01 10:57:46,011 pika.connection _create_heartbeat_checker 1569: Creating a HeartbeatChecker: 60 DEBUG 2023-03-01 10:57:46,011 pika.heartbeat __init__ 67 : timeout: 60.000000 send_interval: 30.000000 check_interval: 65.000000 DEBUG 2023-03-01 10:57:46,012 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10729666.601169968 and callback=>; now=10729636.601169968; delay=30.0 DEBUG 2023-03-01 10:57:46,012 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10729701.601272276 and callback=>; now=10729636.601272276; delay=65 DEBUG 2023-03-01 10:57:46,012 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 10:57:46,012 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 10:57:46,012 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 10:57:46,012 pika.callback add 165 : Added: {'callback': params=>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} DEBUG 2023-03-01 10:57:46,012 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 10:57:46,012 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 10:57:46,013 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 10:57:46,013 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 10:57:46,013 pika.callback process 217 : Processing 0:Connection.OpenOk DEBUG 2023-03-01 10:57:46,013 pika.callback _use_one_shot_callback 401 : Processing use of oneshot callback DEBUG 2023-03-01 10:57:46,013 pika.callback _use_one_shot_callback 403 : 0 registered uses left DEBUG 2023-03-01 10:57:46,013 pika.callback remove 265 : Removing callback #0: {'callback': params=>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} DEBUG 2023-03-01 10:57:46,014 pika.callback process 231 : Calling params=>> for "0:Connection.OpenOk" DEBUG 2023-03-01 10:57:46,014 pika.connection _set_connection_state 2273: New Connection state: OPEN (prev=TUNE) DEBUG 2023-03-01 10:57:46,014 pika.callback process 217 : Processing 0:_on_connection_open_ok DEBUG 2023-03-01 10:57:46,014 pika.callback process 231 : Calling > for "0:_on_connection_open_ok" DEBUG 2023-03-01 10:57:46,014 pika.connection _create_channel 1558: Creating channel 1 DEBUG 2023-03-01 10:57:46,014 pika.callback add 165 : Added: {'callback': params=>>, 'one_shot': True, 'only': params=>>, 'arguments': None, 'calls': 1} DEBUG 2023-03-01 10:57:46,014 pika.callback add 165 : Added: {'callback': params=>>>, 'one_shot': False, 'only': None, 'arguments': None} DEBUG 2023-03-01 10:57:46,014 pika.callback add 165 : Added: {'callback': params=>>>, 'one_shot': False, 'only': None, 'arguments': None} DEBUG 2023-03-01 10:57:46,014 pika.callback add 165 : Added: {'callback': params=>>>, 'one_shot': False, 'only': None, 'arguments': None} DEBUG 2023-03-01 10:57:46,014 pika.callback add 165 : Added: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} DEBUG 2023-03-01 10:57:46,015 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 10:57:46,015 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 10:57:46,015 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 10:57:46,015 pika.channel _rpc 1354: Entering blocking state on frame ; acceptable_replies=[] DEBUG 2023-03-01 10:57:46,015 pika.channel _rpc 1363: Adding on_synchronous_complete callback DEBUG 2023-03-01 10:57:46,015 pika.callback add 165 : Added: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} DEBUG 2023-03-01 10:57:46,015 pika.channel _rpc 1369: Adding passed-in RPC response callback DEBUG 2023-03-01 10:57:46,015 pika.callback add 165 : Added: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} DEBUG 2023-03-01 10:57:46,015 pika.callback process 231 : Calling > for "0:_on_connection_open_ok" DEBUG 2023-03-01 10:57:46,015 pika.adapters.utils.connection_workflow _on_amqp_handshake_done 451 : AMQPConnector: AMQP handshake attempt completed; state=3; error=None; 'rabbitmq.rabbitmq-system.svc.cluster.local'/(, , 6, '', ('10.0.203.182', 5672)) DEBUG 2023-03-01 10:57:46,015 pika.adapters.utils.connection_workflow _on_amqp_handshake_done 470 : AMQPConnector: AMQP connection established for 'rabbitmq.rabbitmq-system.svc.cluster.local'/(, , 6, '', ('10.0.203.182', 5672)): params=> INFO 2023-03-01 10:57:46,015 pika.adapters.utils.connection_workflow _report_completion_and_cleanup 293 : AMQPConnector - reporting success: params=> DEBUG 2023-03-01 10:57:46,016 pika.adapters.select_connection remove_timeout 284 : remove_timeout: removing timeout with deadline=10729651.592501285 and callback=> DEBUG 2023-03-01 10:57:46,016 pika.adapters.utils.connection_workflow _on_connector_done 839 : Connection attempt completed with params=> INFO 2023-03-01 10:57:46,016 pika.adapters.utils.connection_workflow _report_completion_and_cleanup 725 : AMQPConnectionWorkflow - reporting success: params=> DEBUG 2023-03-01 10:57:46,016 pika.adapters.base_connection _on_connection_workflow_done 311 : Full-stack connection workflow completed: params=> DEBUG 2023-03-01 10:57:46,016 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 10:57:46,016 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 10:57:46,016 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 10:57:46,016 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 10:57:46,017 pika.callback process 217 : Processing 1:Channel.OpenOk DEBUG 2023-03-01 10:57:46,017 pika.callback _use_one_shot_callback 401 : Processing use of oneshot callback DEBUG 2023-03-01 10:57:46,017 pika.callback _use_one_shot_callback 403 : 0 registered uses left DEBUG 2023-03-01 10:57:46,018 pika.callback remove 265 : Removing callback #0: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} DEBUG 2023-03-01 10:57:46,018 pika.callback _use_one_shot_callback 401 : Processing use of oneshot callback DEBUG 2023-03-01 10:57:46,018 pika.callback _use_one_shot_callback 403 : 0 registered uses left DEBUG 2023-03-01 10:57:46,018 pika.callback remove 265 : Removing callback #0: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} DEBUG 2023-03-01 10:57:46,018 pika.callback process 231 : Calling params=>>> for "1:Channel.OpenOk" DEBUG 2023-03-01 10:57:46,018 pika.channel _on_synchronous_complete 1260: 0 blocked frames DEBUG 2023-03-01 10:57:46,018 pika.callback process 231 : Calling params=>>> for "1:Channel.OpenOk" DEBUG 2023-03-01 10:57:46,018 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 10:57:46,018 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 10:57:46,018 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 10:57:46,019 pika.channel _rpc 1354: Entering blocking state on frame ; acceptable_replies=[] DEBUG 2023-03-01 10:57:46,019 pika.channel _rpc 1363: Adding on_synchronous_complete callback DEBUG 2023-03-01 10:57:46,019 pika.callback add 165 : Added: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} DEBUG 2023-03-01 10:57:46,019 pika.channel _rpc 1338: Already in blocking state, so enqueueing method ; acceptable_replies=[] DEBUG 2023-03-01 10:57:46,019 pika.channel _rpc 1338: Already in blocking state, so enqueueing method ; acceptable_replies=[(, {'consumer_tag': 'ctag1.14dd088fdacd4cb6b44241cc36112bfa'})] DEBUG 2023-03-01 10:57:46,019 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 10:57:46,019 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 10:57:46,019 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 10:57:46,019 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 10:57:46,020 pika.callback process 217 : Processing 1:Basic.QosOk DEBUG 2023-03-01 10:57:46,020 pika.callback _use_one_shot_callback 401 : Processing use of oneshot callback DEBUG 2023-03-01 10:57:46,020 pika.callback _use_one_shot_callback 403 : 0 registered uses left DEBUG 2023-03-01 10:57:46,020 pika.callback remove 265 : Removing callback #0: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} DEBUG 2023-03-01 10:57:46,020 pika.callback process 231 : Calling params=>>> for "1:Basic.QosOk" DEBUG 2023-03-01 10:57:46,020 pika.channel _on_synchronous_complete 1260: 2 blocked frames DEBUG 2023-03-01 10:57:46,020 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 10:57:46,021 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 10:57:46,021 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 10:57:46,021 pika.channel _rpc 1354: Entering blocking state on frame ; acceptable_replies=[(, {'consumer_tag': 'ctag1.14dd088fdacd4cb6b44241cc36112bfa'})] DEBUG 2023-03-01 10:57:46,021 pika.channel _rpc 1363: Adding on_synchronous_complete callback DEBUG 2023-03-01 10:57:46,021 pika.callback add 165 : Added: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': {'consumer_tag': 'ctag1.14dd088fdacd4cb6b44241cc36112bfa'}, 'calls': 1} DEBUG 2023-03-01 10:57:46,021 pika.channel _rpc 1369: Adding passed-in RPC response callback DEBUG 2023-03-01 10:57:46,021 pika.callback add 165 : Added: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': {'consumer_tag': 'ctag1.14dd088fdacd4cb6b44241cc36112bfa'}, 'calls': 1} DEBUG 2023-03-01 10:57:46,022 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 10:57:46,022 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 10:57:46,022 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 10:57:46,022 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 10:57:46,024 pika.callback process 217 : Processing 1:Basic.ConsumeOk DEBUG 2023-03-01 10:57:46,024 pika.callback _use_one_shot_callback 401 : Processing use of oneshot callback DEBUG 2023-03-01 10:57:46,024 pika.callback _use_one_shot_callback 403 : 0 registered uses left DEBUG 2023-03-01 10:57:46,024 pika.callback _dict_arguments_match 347 : Comparing {'consumer_tag': 'ctag1.14dd088fdacd4cb6b44241cc36112bfa'} to {'consumer_tag': 'ctag1.14dd088fdacd4cb6b44241cc36112bfa'} DEBUG 2023-03-01 10:57:46,024 pika.callback remove 265 : Removing callback #0: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': {'consumer_tag': 'ctag1.14dd088fdacd4cb6b44241cc36112bfa'}, 'calls': 0} DEBUG 2023-03-01 10:57:46,024 pika.callback _use_one_shot_callback 401 : Processing use of oneshot callback DEBUG 2023-03-01 10:57:46,024 pika.callback _use_one_shot_callback 403 : 0 registered uses left DEBUG 2023-03-01 10:57:46,024 pika.callback _dict_arguments_match 347 : Comparing {'consumer_tag': 'ctag1.14dd088fdacd4cb6b44241cc36112bfa'} to {'consumer_tag': 'ctag1.14dd088fdacd4cb6b44241cc36112bfa'} DEBUG 2023-03-01 10:57:46,025 pika.callback remove 265 : Removing callback #0: {'callback': params=>>>, 'one_shot': True, 'only': None, 'arguments': {'consumer_tag': 'ctag1.14dd088fdacd4cb6b44241cc36112bfa'}, 'calls': 0} DEBUG 2023-03-01 10:57:46,025 pika.callback process 231 : Calling params=>>> for "1:Basic.ConsumeOk" DEBUG 2023-03-01 10:57:46,025 pika.channel _on_synchronous_complete 1260: 0 blocked frames DEBUG 2023-03-01 10:57:46,025 pika.callback process 231 : Calling params=>>> for "1:Basic.ConsumeOk" DEBUG 2023-03-01 10:57:46,025 pika.channel _on_eventok 1159: Discarding frame "])> DEBUG 2023-03-01 10:57:46,025 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 10:58:16,013 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 10:58:16,013 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 10:58:16,013 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 10:58:16,014 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 10:58:16,014 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 10:58:16,014 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 10:58:16,014 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 10:58:16,014 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10729696.603595827 and callback=>; now=10729666.603595827; delay=30.0 DEBUG 2023-03-01 10:58:16,014 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 10:58:16,014 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 10:58:16,014 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 10:58:28.439", "timestamp": "2023-03-01T10:58:28.580918Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 10:58:28,580 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 089c2063-51d0-4924-bc92-67d2f465f589 arrived", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 10:58:28.439", "timestamp": "2023-03-01T10:58:28.581146Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 10:58:28,581 RabbitMQRPCConsumer handle 60 : Message with id 089c2063-51d0-4924-bc92-67d2f465f589 arrived {"message": "Method called action with parameters {'message': '{\"order_by\":[\"creationDate\"],\"page\":[\"1\"],\"dataset\":[\"997\"],\"order_type\":[\"DESC\"],\"page_size\":[\"50\"]}'}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 10:58:28.439", "timestamp": "2023-03-01T10:58:28.581283Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 10:58:28,581 AnnotationCallback action 29 : Method called action with parameters {'message': '{"order_by":["creationDate"],"page":["1"],"dataset":["997"],"order_type":["DESC"],"page_size":["50"]}'} {"message": "Method called find with parameters {'args': {'order_by': ['creationDate'], 'page': ['1'], 'dataset': ['997'], 'order_type': ['DESC'], 'page_size': ['50']}}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 10:58:28.439", "timestamp": "2023-03-01T10:58:28.581716Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 309} INFO 2023-03-01 10:58:28,581 AnnotationService find 309 : Method called find with parameters {'args': {'order_by': ['creationDate'], 'page': ['1'], 'dataset': ['997'], 'order_type': ['DESC'], 'page_size': ['50']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 10:58:28.439", "timestamp": "2023-03-01T10:58:28.635669Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 10:58:28,635 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 10:58:28.439", "timestamp": "2023-03-01T10:58:28.636031Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 10:58:28,635 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended find", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 10:58:28.439", "timestamp": "2023-03-01T10:58:28.788727Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 323} INFO 2023-03-01 10:58:28,788 AnnotationService find 323 : Method ended find {"message": "Method called build with parameters {'annotations_size': 1}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 10:58:28.439", "timestamp": "2023-03-01T10:58:28.789300Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 17} INFO 2023-03-01 10:58:28,789 ResponseBuilder build 17 : Method called build with parameters {'annotations_size': 1} {"message": "Method called _build_json with parameters {'annotations_size': 25}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 10:58:28.439", "timestamp": "2023-03-01T10:58:28.789481Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 10:58:28,789 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 25} {"message": "Method ended _build_json", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 10:58:28.439", "timestamp": "2023-03-01T10:58:28.789719Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 10:58:28,789 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method ended build", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 10:58:28.439", "timestamp": "2023-03-01T10:58:28.789937Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 25} INFO 2023-03-01 10:58:28,789 ResponseBuilder build 25 : Method ended build {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 10:58:28.439", "timestamp": "2023-03-01T10:58:28.790233Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 10:58:28,790 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 10:58:28.439", "timestamp": "2023-03-01T10:58:28.790517Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 10:58:28,790 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 10:58:28.439", "timestamp": "2023-03-01T10:58:28.790684Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 48} INFO 2023-03-01 10:58:28,790 AnnotationCallback action 48 : Method ended action {"message": "Sending response on queue annotation-request-queue_SEARCH_ANNOTATION_0b76e9a8-e74b-4ed0-ba88-ff8a2d8b06ab_1677668308549", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 10:58:28.439", "timestamp": "2023-03-01T10:58:28.790856Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 10:58:28,790 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_SEARCH_ANNOTATION_0b76e9a8-e74b-4ed0-ba88-ff8a2d8b06ab_1677668308549 DEBUG 2023-03-01 10:58:28,791 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 10:58:28,791 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 10:58:28,791 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 10:58:28.439", "timestamp": "2023-03-01T10:58:28.791476Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 10:58:28,791 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 10:58:28.439", "timestamp": "2023-03-01T10:58:28.791680Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 10:58:28,791 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 10:58:28,791 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 10:58:28,792 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 10:58:28,792 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 10:58:28,792 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 10:58:46,017 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 10:58:46,017 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 10:58:46,017 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 10:58:46,018 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 10:58:46,018 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 10:58:46,018 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10729726.607506905 and callback=>; now=10729696.607506905; delay=30.0 DEBUG 2023-03-01 10:58:46,018 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 10:58:46,018 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 10:58:46,018 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 10:58:51,018 pika.heartbeat _check_heartbeat 124 : Received 1 heartbeat frames, sent 2, idle intervals 0 DEBUG 2023-03-01 10:58:51,018 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10729766.607359407 and callback=>; now=10729701.607359407; delay=65 DEBUG 2023-03-01 10:59:16,014 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 10:59:16,014 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 10:59:16,019 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 10:59:16,019 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 10:59:16,019 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 10:59:16,019 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 10:59:16,019 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 10:59:16,020 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10729756.609178212 and callback=>; now=10729726.609178212; delay=30.0 DEBUG 2023-03-01 10:59:16,020 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 10:59:16,020 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 10:59:16,020 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:24.629", "timestamp": "2023-03-01T10:59:24.692114Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 10:59:24,692 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 89166d3d-e59a-4270-b66d-be2ff22154c1 arrived", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:24.629", "timestamp": "2023-03-01T10:59:24.692381Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 10:59:24,692 RabbitMQRPCConsumer handle 60 : Message with id 89166d3d-e59a-4270-b66d-be2ff22154c1 arrived {"message": "Method called action with parameters {'message': '{\"skillExecution\":[\"403\"],\"document\":[\"41422\"]}'}", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:24.629", "timestamp": "2023-03-01T10:59:24.692601Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 10:59:24,692 AnnotationCallback action 29 : Method called action with parameters {'message': '{"skillExecution":["403"],"document":["41422"]}'} {"message": "Method called count with parameters {'args': {'skillExecution': ['403'], 'document': ['41422']}}", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:24.629", "timestamp": "2023-03-01T10:59:24.693082Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 510} INFO 2023-03-01 10:59:24,693 AnnotationService count 510 : Method called count with parameters {'args': {'skillExecution': ['403'], 'document': ['41422']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:24.629", "timestamp": "2023-03-01T10:59:24.693524Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 10:59:24,693 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:24.629", "timestamp": "2023-03-01T10:59:24.693811Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 10:59:24,693 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended count", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:24.629", "timestamp": "2023-03-01T10:59:24.727850Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 518} INFO 2023-03-01 10:59:24,727 AnnotationService count 518 : Method ended count {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:24.629", "timestamp": "2023-03-01T10:59:24.728309Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 10:59:24,728 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:24.629", "timestamp": "2023-03-01T10:59:24.728515Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 10:59:24,728 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:24.629", "timestamp": "2023-03-01T10:59:24.728669Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 52} INFO 2023-03-01 10:59:24,728 AnnotationCallback action 52 : Method ended action {"message": "Sending response on queue annotation-request-queue_COUNT_ANNOTATION_0d4f371f-9035-4fe6-ad37-234614b79350_1677668364644", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:24.629", "timestamp": "2023-03-01T10:59:24.728858Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 10:59:24,728 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_COUNT_ANNOTATION_0d4f371f-9035-4fe6-ad37-234614b79350_1677668364644 DEBUG 2023-03-01 10:59:24,729 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 10:59:24,729 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 10:59:24,729 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:24.629", "timestamp": "2023-03-01T10:59:24.729655Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 10:59:24,729 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:24.629", "timestamp": "2023-03-01T10:59:24.729864Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 10:59:24,729 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 10:59:24,730 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 10:59:24,730 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 10:59:24,730 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 10:59:24,730 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:25.058", "timestamp": "2023-03-01T10:59:25.092817Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 10:59:25,092 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 87c79797-b907-4e81-8a51-17ef42c2c1d1 arrived", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:25.058", "timestamp": "2023-03-01T10:59:25.093022Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 10:59:25,092 RabbitMQRPCConsumer handle 60 : Message with id 87c79797-b907-4e81-8a51-17ef42c2c1d1 arrived {"message": "Method called action with parameters {'message': '{\"parent\":[\"1\"],\"skillExecution\":[\"403\"],\"document\":[\"41422\"],\"order_by\":[\"creationDate\"],\"order_type\":[\"DESC\"]}'}", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:25.058", "timestamp": "2023-03-01T10:59:25.093302Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 10:59:25,093 AnnotationCallback action 29 : Method called action with parameters {'message': '{"parent":["1"],"skillExecution":["403"],"document":["41422"],"order_by":["creationDate"],"order_type":["DESC"]}'} {"message": "Method called count with parameters {'args': {'parent': ['1'], 'skillExecution': ['403'], 'document': ['41422'], 'order_by': ['creationDate'], 'order_type': ['DESC']}}", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:25.058", "timestamp": "2023-03-01T10:59:25.093731Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 510} INFO 2023-03-01 10:59:25,093 AnnotationService count 510 : Method called count with parameters {'args': {'parent': ['1'], 'skillExecution': ['403'], 'document': ['41422'], 'order_by': ['creationDate'], 'order_type': ['DESC']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:25.058", "timestamp": "2023-03-01T10:59:25.094230Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 10:59:25,094 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:25.058", "timestamp": "2023-03-01T10:59:25.094566Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 10:59:25,094 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended count", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:25.058", "timestamp": "2023-03-01T10:59:25.122746Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 518} INFO 2023-03-01 10:59:25,122 AnnotationService count 518 : Method ended count {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:25.058", "timestamp": "2023-03-01T10:59:25.123135Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 10:59:25,123 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:25.058", "timestamp": "2023-03-01T10:59:25.123294Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 10:59:25,123 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:25.058", "timestamp": "2023-03-01T10:59:25.123405Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 52} INFO 2023-03-01 10:59:25,123 AnnotationCallback action 52 : Method ended action {"message": "Sending response on queue annotation-request-queue_COUNT_ANNOTATION_d043cf52-ca3b-4e00-99fd-6f4db3660f43_1677668365069", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:25.058", "timestamp": "2023-03-01T10:59:25.123536Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 10:59:25,123 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_COUNT_ANNOTATION_d043cf52-ca3b-4e00-99fd-6f4db3660f43_1677668365069 DEBUG 2023-03-01 10:59:25,123 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 10:59:25,123 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 10:59:25,124 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:25.058", "timestamp": "2023-03-01T10:59:25.124215Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 10:59:25,124 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "giuseppe.barbato", "correlationId": "IAAPI-annotationCount-2023-03-01 10:59:25.058", "timestamp": "2023-03-01T10:59:25.124501Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 10:59:25,124 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 10:59:25,124 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 10:59:25,125 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 10:59:25,125 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 10:59:25,125 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 10:59:46,022 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 10:59:46,022 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 10:59:46,022 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 10:59:46,022 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 10:59:46,022 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 10:59:46,022 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10729786.6117696 and callback=>; now=10729756.6117696; delay=30.0 DEBUG 2023-03-01 10:59:46,022 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 10:59:46,023 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 10:59:46,023 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 10:59:56,023 pika.heartbeat _check_heartbeat 124 : Received 2 heartbeat frames, sent 4, idle intervals 0 DEBUG 2023-03-01 10:59:56,024 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10729831.613280188 and callback=>; now=10729766.613280188; delay=65 DEBUG 2023-03-01 11:00:16,015 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:00:16,016 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:00:16,023 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:00:16,023 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:00:16,023 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:00:16,024 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:00:16,024 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:00:16,024 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10729816.613527348 and callback=>; now=10729786.613527348; delay=30.0 DEBUG 2023-03-01 11:00:16,024 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:00:16,024 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:00:16,024 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "timestamp": "2023-03-01T11:00:20.876991Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:00:20,876 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id e1b95add-562b-4c21-a776-29908e9f0f4d arrived", "tenant": "altilia", "timestamp": "2023-03-01T11:00:20.877345Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:00:20,877 RabbitMQRPCConsumer handle 60 : Message with id e1b95add-562b-4c21-a776-29908e9f0f4d arrived {"message": "Method called action with parameters {'message': '{\"annotations\": []}'}", "tenant": "altilia", "timestamp": "2023-03-01T11:00:20.877574Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:00:20,877 AnnotationCallback action 29 : Method called action with parameters {'message': '{"annotations": []}'} {"message": "Method called bulk_insert_annotations with parameters {'data': {'annotations': []}}", "tenant": "altilia", "timestamp": "2023-03-01T11:00:20.878111Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 575} INFO 2023-03-01 11:00:20,878 AnnotationService bulk_insert_annotations 575 : Method called bulk_insert_annotations with parameters {'data': {'annotations': []}} {"message": "Method problem action. documents must be a non-empty list", "tenant": "altilia", "timestamp": "2023-03-01T11:00:20.878677Z", "level": "WARNING", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 134} WARNING 2023-03-01 11:00:20,878 AnnotationCallback action 134 : Method problem action. documents must be a non-empty list {"message": "Sending response on queue amq.gen-mIoq8Jk4VyY0N0VsK0ikLQ", "tenant": "altilia", "timestamp": "2023-03-01T11:00:20.878887Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:00:20,878 RabbitMQRPCConsumer handle 63 : Sending response on queue amq.gen-mIoq8Jk4VyY0N0VsK0ikLQ DEBUG 2023-03-01 11:00:20,879 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:00:20,879 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:00:20,879 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "timestamp": "2023-03-01T11:00:20.879523Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:00:20,879 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "timestamp": "2023-03-01T11:00:20.879739Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:00:20,879 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:00:20,879 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:00:20,880 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:00:20,880 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:00:20,880 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:00:46,025 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:00:46,025 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:00:46,026 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:00:46,026 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:00:46,026 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:00:46,026 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10729846.615635347 and callback=>; now=10729816.615635347; delay=30.0 DEBUG 2023-03-01 11:00:46,026 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:00:46,026 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:00:46,027 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "timestamp": "2023-03-01T11:00:51.508211Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:00:51,508 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id d057a258-765f-4883-baf8-1606feda85e8 arrived", "tenant": "altilia", "timestamp": "2023-03-01T11:00:51.508571Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:00:51,508 RabbitMQRPCConsumer handle 60 : Message with id d057a258-765f-4883-baf8-1606feda85e8 arrived {"message": "Method called action with parameters {'message': '{\"annotations\": []}'}", "tenant": "altilia", "timestamp": "2023-03-01T11:00:51.508832Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:00:51,508 AnnotationCallback action 29 : Method called action with parameters {'message': '{"annotations": []}'} {"message": "Method called bulk_insert_annotations with parameters {'data': {'annotations': []}}", "tenant": "altilia", "timestamp": "2023-03-01T11:00:51.509479Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 575} INFO 2023-03-01 11:00:51,509 AnnotationService bulk_insert_annotations 575 : Method called bulk_insert_annotations with parameters {'data': {'annotations': []}} {"message": "Method problem action. documents must be a non-empty list", "tenant": "altilia", "timestamp": "2023-03-01T11:00:51.510100Z", "level": "WARNING", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 134} WARNING 2023-03-01 11:00:51,510 AnnotationCallback action 134 : Method problem action. documents must be a non-empty list {"message": "Sending response on queue amq.gen-7BBim-k4Cc4VEJdet3amnQ", "tenant": "altilia", "timestamp": "2023-03-01T11:00:51.510288Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:00:51,510 RabbitMQRPCConsumer handle 63 : Sending response on queue amq.gen-7BBim-k4Cc4VEJdet3amnQ DEBUG 2023-03-01 11:00:51,510 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:00:51,510 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:00:51,510 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "timestamp": "2023-03-01T11:00:51.510776Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:00:51,510 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "timestamp": "2023-03-01T11:00:51.510998Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:00:51,510 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:00:51,511 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:00:51,511 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:00:51,511 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:00:51,511 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:01:01,028 pika.heartbeat _check_heartbeat 124 : Received 3 heartbeat frames, sent 6, idle intervals 0 DEBUG 2023-03-01 11:01:01,028 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10729896.617870396 and callback=>; now=10729831.617870396; delay=65 DEBUG 2023-03-01 11:01:16,030 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:01:16,030 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:01:16,030 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:01:16,030 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:01:16,030 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:01:16,031 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10729876.620204022 and callback=>; now=10729846.620204022; delay=30.0 DEBUG 2023-03-01 11:01:16,031 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:01:16,031 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:01:16,031 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:01:46,020 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:01:46,020 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:01:46,031 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:01:46,032 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:01:46,032 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:01:46,032 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:01:46,032 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:01:46,032 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10729906.62174952 and callback=>; now=10729876.62174952; delay=30.0 DEBUG 2023-03-01 11:01:46,032 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:01:46,033 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:01:46,033 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:02:06,034 pika.heartbeat _check_heartbeat 124 : Received 4 heartbeat frames, sent 8, idle intervals 0 DEBUG 2023-03-01 11:02:06,034 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10729961.623548724 and callback=>; now=10729896.623548724; delay=65 DEBUG 2023-03-01 11:02:16,021 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:02:16,022 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:02:16,034 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:02:16,034 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:02:16,034 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:02:16,034 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:02:16,034 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:02:16,034 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10729936.623956537 and callback=>; now=10729906.623956537; delay=30.0 DEBUG 2023-03-01 11:02:16,035 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:02:16,035 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:02:16,035 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:02:45,999 kafka.client _maybe_refresh_metadata 856 : Initializing connection to node 1 for metadata request DEBUG 2023-03-01 11:02:46,019 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:02:46,019 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:02:46,036 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:02:46,036 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:02:46,037 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:02:46,037 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:02:46,037 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:02:46,037 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10729966.626698408 and callback=>; now=10729936.626698408; delay=30.0 DEBUG 2023-03-01 11:02:46,037 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:02:46,038 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:02:46,038 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:02:46,050 kafka.client _maybe_connect 374 : Initiating connection to node 1 at kafka-1.kafka-headless.kafka.svc.cluster.local:9092 DEBUG 2023-03-01 11:02:46,050 kafka.metrics.metrics sensor 156 : Added sensor with name node-1.bytes-sent DEBUG 2023-03-01 11:02:46,050 kafka.metrics.metrics sensor 156 : Added sensor with name node-1.bytes-received DEBUG 2023-03-01 11:02:46,050 kafka.metrics.metrics sensor 156 : Added sensor with name node-1.latency DEBUG 2023-03-01 11:02:46,052 kafka.conn connect 368 : [unspecified None]>: creating new socket DEBUG 2023-03-01 11:02:46,052 kafka.conn connect 374 : [IPv4 ('10.244.8.209', 9092)]>: setting socket option (6, 1, 1) INFO 2023-03-01 11:02:46,052 kafka.conn connect 380 : [IPv4 ('10.244.8.209', 9092)]>: connecting to kafka-1.kafka-headless.kafka.svc.cluster.local:9092 [('10.244.8.209', 9092) IPv4] DEBUG 2023-03-01 11:02:46,053 kafka.conn connect 394 : [IPv4 ('10.244.8.209', 9092)]>: established TCP connection DEBUG 2023-03-01 11:02:46,054 kafka.conn connect 397 : [IPv4 ('10.244.8.209', 9092)]>: initiating SSL handshake DEBUG 2023-03-01 11:02:46,054 kafka.conn _wrap_ssl 464 : [IPv4 ('10.244.8.209', 9092)]>: configuring default SSL Context INFO 2023-03-01 11:02:46,054 kafka.conn _wrap_ssl 472 : [IPv4 ('10.244.8.209', 9092)]>: Loading SSL CA from /etc/kafka-volume/ca.crt DEBUG 2023-03-01 11:02:46,055 kafka.conn _wrap_ssl 495 : [IPv4 ('10.244.8.209', 9092)]>: wrapping socket in ssl context DEBUG 2023-03-01 11:02:46,061 kafka.conn connect 430 : [IPv4 ('10.244.8.209', 9092)]>: completed SSL handshake. INFO 2023-03-01 11:02:46,061 kafka.conn connect 435 : [IPv4 ('10.244.8.209', 9092)]>: Connection complete. DEBUG 2023-03-01 11:02:46,061 kafka.client _conn_state_change 283 : Node 1 connected INFO 2023-03-01 11:02:46,061 kafka.conn close 919 : [IPv4 ('10.244.2.16', 9092)]>: Closing connection. DEBUG 2023-03-01 11:02:46,062 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 11:02:46,062 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:02:46,062 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 1: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:02:46,064 kafka.protocol.parser _process_response 139 : Received correlation id: 1 DEBUG 2023-03-01 11:02:46,064 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 11:02:46,066 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 1 (3.3903121948242188 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 11:02:46,067 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 11:03:11,039 pika.heartbeat _check_heartbeat 124 : Received 6 heartbeat frames, sent 10, idle intervals 0 DEBUG 2023-03-01 11:03:11,039 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730026.62852983 and callback=>; now=10729961.62852983; delay=65 {"message": "Method called handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:14.945", "timestamp": "2023-03-01T11:03:15.082241Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:03:15,082 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 65de862d-f8ed-46c0-93f0-3e0604b6293f arrived", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:14.945", "timestamp": "2023-03-01T11:03:15.082666Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:03:15,082 RabbitMQRPCConsumer handle 60 : Message with id 65de862d-f8ed-46c0-93f0-3e0604b6293f arrived {"message": "Method called action with parameters {'message': '{\"task\":[\"document_classification\"],\"document\":[\"373\",\"371\",\"370\",\"369\",\"374\",\"193\",\"194\",\"195\",\"196\",\"375\"],\"order_by\":[\"creationDate\"],\"dataset\":[\"160\"],\"order_type\":[\"ASC\"]}'}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:14.945", "timestamp": "2023-03-01T11:03:15.082869Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:03:15,082 AnnotationCallback action 29 : Method called action with parameters {'message': '{"task":["document_classification"],"document":["373","371","370","369","374","193","194","195","196","375"],"order_by":["creationDate"],"dataset":["160"],"order_type":["ASC"]}'} {"message": "Method called find with parameters {'args': {'task': ['document_classification'], 'document': ['373', '371', '370', '369', '374', '193', '194', '195', '196', '375'], 'order_by': ['creationDate'], 'dataset': ['160'], 'order_type': ['ASC']}}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:14.945", "timestamp": "2023-03-01T11:03:15.083407Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 309} INFO 2023-03-01 11:03:15,083 AnnotationService find 309 : Method called find with parameters {'args': {'task': ['document_classification'], 'document': ['373', '371', '370', '369', '374', '193', '194', '195', '196', '375'], 'order_by': ['creationDate'], 'dataset': ['160'], 'order_type': ['ASC']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:14.945", "timestamp": "2023-03-01T11:03:15.083940Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 11:03:15,083 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:14.945", "timestamp": "2023-03-01T11:03:15.084346Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 11:03:15,084 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended find", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:14.945", "timestamp": "2023-03-01T11:03:15.172643Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 323} INFO 2023-03-01 11:03:15,172 AnnotationService find 323 : Method ended find {"message": "Method called build with parameters {'annotations_size': 0}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:14.945", "timestamp": "2023-03-01T11:03:15.173330Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 17} INFO 2023-03-01 11:03:15,173 ResponseBuilder build 17 : Method called build with parameters {'annotations_size': 0} {"message": "Method ended build", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:14.945", "timestamp": "2023-03-01T11:03:15.173561Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 25} INFO 2023-03-01 11:03:15,173 ResponseBuilder build 25 : Method ended build {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:14.945", "timestamp": "2023-03-01T11:03:15.173986Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 11:03:15,173 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:14.945", "timestamp": "2023-03-01T11:03:15.174219Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 11:03:15,174 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:14.945", "timestamp": "2023-03-01T11:03:15.174410Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 48} INFO 2023-03-01 11:03:15,174 AnnotationCallback action 48 : Method ended action {"message": "Sending response on queue annotation-request-queue_SEARCH_ANNOTATION_44d79f02-7b85-465d-9fee-b61dbef6936e_1677668595060", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:14.945", "timestamp": "2023-03-01T11:03:15.174640Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:03:15,174 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_SEARCH_ANNOTATION_44d79f02-7b85-465d-9fee-b61dbef6936e_1677668595060 DEBUG 2023-03-01 11:03:15,174 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:03:15,175 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:03:15,175 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:14.945", "timestamp": "2023-03-01T11:03:15.175379Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:03:15,175 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:14.945", "timestamp": "2023-03-01T11:03:15.175604Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:03:15,175 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:03:15,175 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:03:15,176 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:03:15,176 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:03:15,176 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:03:16,038 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:03:16,038 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:03:16,039 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:03:16,039 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:03:16,039 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:03:16,039 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10729996.628660213 and callback=>; now=10729966.628660213; delay=30.0 DEBUG 2023-03-01 11:03:16,039 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:03:16,039 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:03:16,040 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:03:21.122", "timestamp": "2023-03-01T11:03:21.149539Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:03:21,149 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 703e8eff-e700-4945-9312-be1cd4f10e1b arrived", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:03:21.122", "timestamp": "2023-03-01T11:03:21.150761Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:03:21,150 RabbitMQRPCConsumer handle 60 : Message with id 703e8eff-e700-4945-9312-be1cd4f10e1b arrived {"message": "Method called action with parameters {'message': '{\"document\":[\"373\"]}'}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:03:21.122", "timestamp": "2023-03-01T11:03:21.150966Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:03:21,150 AnnotationCallback action 29 : Method called action with parameters {'message': '{"document":["373"]}'} {"message": "Method called count with parameters {'args': {'document': ['373']}}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:03:21.122", "timestamp": "2023-03-01T11:03:21.152017Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 510} INFO 2023-03-01 11:03:21,151 AnnotationService count 510 : Method called count with parameters {'args': {'document': ['373']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:03:21.122", "timestamp": "2023-03-01T11:03:21.152453Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 11:03:21,152 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:03:21.122", "timestamp": "2023-03-01T11:03:21.152795Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 11:03:21,152 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended count", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:03:21.122", "timestamp": "2023-03-01T11:03:21.183924Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 518} INFO 2023-03-01 11:03:21,183 AnnotationService count 518 : Method ended count {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:03:21.122", "timestamp": "2023-03-01T11:03:21.184546Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 11:03:21,184 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:03:21.122", "timestamp": "2023-03-01T11:03:21.184764Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 11:03:21,184 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:03:21.122", "timestamp": "2023-03-01T11:03:21.184976Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 52} INFO 2023-03-01 11:03:21,184 AnnotationCallback action 52 : Method ended action {"message": "Sending response on queue annotation-request-queue_COUNT_ANNOTATION_cd4a9eab-3465-41f6-a44a-2fe2281d22f4_1677668601128", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:03:21.122", "timestamp": "2023-03-01T11:03:21.185217Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:03:21,185 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_COUNT_ANNOTATION_cd4a9eab-3465-41f6-a44a-2fe2281d22f4_1677668601128 DEBUG 2023-03-01 11:03:21,185 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:03:21,185 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:03:21,185 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:03:21.122", "timestamp": "2023-03-01T11:03:21.186386Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:03:21,186 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:03:21.122", "timestamp": "2023-03-01T11:03:21.186730Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:03:21,186 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:03:21,187 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:03:21,187 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:03:21,187 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:03:21,187 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.737726Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:03:21,737 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 470d5908-5d3d-4391-9781-9398bd140318 arrived", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.738181Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:03:21,738 RabbitMQRPCConsumer handle 60 : Message with id 470d5908-5d3d-4391-9781-9398bd140318 arrived {"message": "Method called action with parameters {'message': '{\"document\":[\"373\"],\"order_by\":[\"creationDate\"],\"page\":[\"1\"],\"dataset\":[\"160\"],\"order_type\":[\"DESC\"],\"page_size\":[\"50\"]}'}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.738372Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:03:21,738 AnnotationCallback action 29 : Method called action with parameters {'message': '{"document":["373"],"order_by":["creationDate"],"page":["1"],"dataset":["160"],"order_type":["DESC"],"page_size":["50"]}'} {"message": "Method called find with parameters {'args': {'document': ['373'], 'order_by': ['creationDate'], 'page': ['1'], 'dataset': ['160'], 'order_type': ['DESC'], 'page_size': ['50']}}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.738750Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 309} INFO 2023-03-01 11:03:21,738 AnnotationService find 309 : Method called find with parameters {'args': {'document': ['373'], 'order_by': ['creationDate'], 'page': ['1'], 'dataset': ['160'], 'order_type': ['DESC'], 'page_size': ['50']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.739158Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 11:03:21,739 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.739550Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 11:03:21,739 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended find", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.753616Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 323} INFO 2023-03-01 11:03:21,753 AnnotationService find 323 : Method ended find {"message": "Method called build with parameters {'annotations_size': 30}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.754113Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 17} INFO 2023-03-01 11:03:21,754 ResponseBuilder build 17 : Method called build with parameters {'annotations_size': 30} {"message": "Method called _build_json with parameters {'annotations_size': 25}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.754354Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,754 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 25} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.754622Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,754 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 23}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.754859Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,754 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 23} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.755369Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,755 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 25}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.755571Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,755 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 25} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.755836Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,755 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 25}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.756086Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,756 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 25} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.756445Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,756 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 25}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.756905Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,756 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 25} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.757184Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,757 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 25}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.757574Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,757 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 25} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.757842Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,757 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 25}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.758133Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,758 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 25} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.758397Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,758 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 25}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.758732Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,758 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 25} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.759026Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,758 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 25}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.759271Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,759 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 25} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.759506Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,759 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 25}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.759710Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,759 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 25} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.759931Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,759 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 25}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.760116Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,760 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 25} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.760325Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,760 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 25}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.760510Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,760 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 25} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.760721Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,760 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 25}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.760912Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,760 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 25} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.761119Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,761 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 25}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.761316Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,761 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 25} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.761571Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,761 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 25}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.761890Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,761 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 25} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.762203Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,762 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 25}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.762435Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,762 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 25} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.762691Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,762 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 25}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.762924Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,762 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 25} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.763131Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,763 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 25}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.763370Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,763 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 25} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.763627Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,763 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 25}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.763852Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,763 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 25} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.764150Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,764 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 25}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.764347Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,764 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 25} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.764536Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,764 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 24}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.764706Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,764 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 24} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.764900Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,764 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 24}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.765060Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,765 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 24} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.765361Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,765 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 21}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.765629Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,765 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 21} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.765819Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,765 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 21}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.766025Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,765 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 21} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.766239Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,766 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 21}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.766371Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,766 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 21} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.766612Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,766 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 21}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.766798Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,766 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 21} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.766982Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,766 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 21}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.767108Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,767 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 21} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.767218Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,767 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 21}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.767397Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,767 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 21} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.767583Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,767 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 21}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.767737Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,767 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 21} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.767883Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,767 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method called _build_json with parameters {'annotations_size': 21}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.768014Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:03:21,767 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 21} {"message": "Method ended _build_json", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.768156Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:03:21,768 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method ended build", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.768299Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 25} INFO 2023-03-01 11:03:21,768 ResponseBuilder build 25 : Method ended build {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.768570Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 11:03:21,768 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.769633Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 11:03:21,769 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.769842Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 48} INFO 2023-03-01 11:03:21,769 AnnotationCallback action 48 : Method ended action {"message": "Sending response on queue annotation-request-queue_SEARCH_ANNOTATION_5a948f15-e740-4c15-a38c-b6ec46c592e9_1677668601705", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.770522Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:03:21,770 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_SEARCH_ANNOTATION_5a948f15-e740-4c15-a38c-b6ec46c592e9_1677668601705 DEBUG 2023-03-01 11:03:21,770 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:03:21,771 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:03:21,771 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.771459Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:03:21,771 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:03:21.555", "timestamp": "2023-03-01T11:03:21.771701Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:03:21,771 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:03:21,771 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:03:21,772 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:03:21,772 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:03:21,772 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:03:46,042 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:03:46,042 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:03:46,042 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:03:46,042 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:03:46,042 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:03:46,043 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730026.632075353 and callback=>; now=10729996.632075353; delay=30.0 DEBUG 2023-03-01 11:03:46,043 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:03:46,043 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:03:46,043 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:04:16,022 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:04:16,022 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:04:16,040 pika.heartbeat _check_heartbeat 124 : Received 7 heartbeat frames, sent 12, idle intervals 0 DEBUG 2023-03-01 11:04:16,040 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730091.62955818 and callback=>; now=10730026.62955818; delay=65 DEBUG 2023-03-01 11:04:16,043 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:04:16,043 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:04:16,044 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:04:16,044 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:04:16,044 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:04:16,044 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730056.633976229 and callback=>; now=10730026.633976229; delay=30.0 DEBUG 2023-03-01 11:04:16,045 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:04:16,045 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:04:16,045 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "timestamp": "2023-03-01T11:04:43.741165Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:04:43,741 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id de08d378-fd45-43a0-8090-6de74131d530 arrived", "tenant": "altilia", "timestamp": "2023-03-01T11:04:43.741444Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:04:43,741 RabbitMQRPCConsumer handle 60 : Message with id de08d378-fd45-43a0-8090-6de74131d530 arrived {"message": "Method called action with parameters {'message': '{\"annotations\": []}'}", "tenant": "altilia", "timestamp": "2023-03-01T11:04:43.741625Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:04:43,741 AnnotationCallback action 29 : Method called action with parameters {'message': '{"annotations": []}'} {"message": "Method called bulk_insert_annotations with parameters {'data': {'annotations': []}}", "tenant": "altilia", "timestamp": "2023-03-01T11:04:43.742136Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 575} INFO 2023-03-01 11:04:43,742 AnnotationService bulk_insert_annotations 575 : Method called bulk_insert_annotations with parameters {'data': {'annotations': []}} {"message": "Method problem action. documents must be a non-empty list", "tenant": "altilia", "timestamp": "2023-03-01T11:04:43.742663Z", "level": "WARNING", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 134} WARNING 2023-03-01 11:04:43,742 AnnotationCallback action 134 : Method problem action. documents must be a non-empty list {"message": "Sending response on queue amq.gen-J6dWulHDxJLK7vnIziQvWQ", "tenant": "altilia", "timestamp": "2023-03-01T11:04:43.742911Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:04:43,742 RabbitMQRPCConsumer handle 63 : Sending response on queue amq.gen-J6dWulHDxJLK7vnIziQvWQ DEBUG 2023-03-01 11:04:43,743 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:04:43,743 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:04:43,743 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "timestamp": "2023-03-01T11:04:43.743547Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:04:43,743 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "timestamp": "2023-03-01T11:04:43.743721Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:04:43,743 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:04:43,743 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:04:43,744 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:04:43,744 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:04:43,744 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:04:46,046 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:04:46,047 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:04:46,047 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:04:46,047 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:04:46,047 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:04:46,048 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730086.63721094 and callback=>; now=10730056.63721094; delay=30.0 DEBUG 2023-03-01 11:04:46,048 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:04:46,048 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:04:46,048 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:05:16,024 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:05:16,024 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:05:16,048 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:05:16,048 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:05:16,048 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:05:16,048 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:05:16,048 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:05:16,049 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730116.638143118 and callback=>; now=10730086.638143118; delay=30.0 DEBUG 2023-03-01 11:05:16,049 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:05:16,049 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:05:16,049 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:05:21,043 pika.heartbeat _check_heartbeat 124 : Received 8 heartbeat frames, sent 15, idle intervals 0 DEBUG 2023-03-01 11:05:21,044 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730156.633339088 and callback=>; now=10730091.633339088; delay=65 DEBUG 2023-03-01 11:05:46,026 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:05:46,026 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:05:46,049 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:05:46,049 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:05:46,050 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:05:46,050 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:05:46,050 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:05:46,050 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730146.639594248 and callback=>; now=10730116.639594248; delay=30.0 DEBUG 2023-03-01 11:05:46,050 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:05:46,050 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:05:46,050 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:06:16,026 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:06:16,027 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:06:16,051 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:06:16,051 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:06:16,051 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:06:16,052 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:06:16,052 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:06:16,052 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730176.641387235 and callback=>; now=10730146.641387235; delay=30.0 DEBUG 2023-03-01 11:06:16,052 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:06:16,052 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:06:16,052 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "timestamp": "2023-03-01T11:06:20.016524Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:06:20,016 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 6660fa4b-d732-441d-b420-5b1c81863a54 arrived", "tenant": "altilia", "timestamp": "2023-03-01T11:06:20.017255Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:06:20,017 RabbitMQRPCConsumer handle 60 : Message with id 6660fa4b-d732-441d-b420-5b1c81863a54 arrived {"message": "Method called action with parameters {'message': '{\"annotations\": []}'}", "tenant": "altilia", "timestamp": "2023-03-01T11:06:20.017475Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:06:20,017 AnnotationCallback action 29 : Method called action with parameters {'message': '{"annotations": []}'} {"message": "Method called bulk_insert_annotations with parameters {'data': {'annotations': []}}", "tenant": "altilia", "timestamp": "2023-03-01T11:06:20.017995Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 575} INFO 2023-03-01 11:06:20,017 AnnotationService bulk_insert_annotations 575 : Method called bulk_insert_annotations with parameters {'data': {'annotations': []}} {"message": "Method problem action. documents must be a non-empty list", "tenant": "altilia", "timestamp": "2023-03-01T11:06:20.018597Z", "level": "WARNING", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 134} WARNING 2023-03-01 11:06:20,018 AnnotationCallback action 134 : Method problem action. documents must be a non-empty list {"message": "Sending response on queue amq.gen-8MDOGtS0KgAZFU69UTaL7w", "tenant": "altilia", "timestamp": "2023-03-01T11:06:20.019823Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:06:20,019 RabbitMQRPCConsumer handle 63 : Sending response on queue amq.gen-8MDOGtS0KgAZFU69UTaL7w DEBUG 2023-03-01 11:06:20,021 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:06:20,021 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:06:20,021 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "timestamp": "2023-03-01T11:06:20.021917Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:06:20,021 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "timestamp": "2023-03-01T11:06:20.022396Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:06:20,022 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:06:20,022 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:06:20,022 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:06:20,024 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:06:20,024 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:06:26,045 pika.heartbeat _check_heartbeat 124 : Received 10 heartbeat frames, sent 17, idle intervals 0 DEBUG 2023-03-01 11:06:26,046 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730221.635226415 and callback=>; now=10730156.635226415; delay=65 DEBUG 2023-03-01 11:06:46,058 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:06:46,058 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:06:46,058 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:06:46,058 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:06:46,058 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:06:46,058 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730206.647897093 and callback=>; now=10730176.647897093; delay=30.0 DEBUG 2023-03-01 11:06:46,059 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:06:46,059 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:06:46,059 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:07:16,029 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:07:16,030 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:07:16,059 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:07:16,059 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:07:16,059 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:07:16,060 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:07:16,060 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:07:16,060 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730236.64935728 and callback=>; now=10730206.64935728; delay=30.0 DEBUG 2023-03-01 11:07:16,060 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:07:16,060 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:07:16,060 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:07:31,051 pika.heartbeat _check_heartbeat 124 : Received 11 heartbeat frames, sent 19, idle intervals 0 DEBUG 2023-03-01 11:07:31,051 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730286.640978863 and callback=>; now=10730221.640978863; delay=65 {"message": "Method called handle", "tenant": "altilia", "timestamp": "2023-03-01T11:07:45.776357Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:07:45,776 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 062910f7-9b78-4b6c-a7f1-4b11c95e0d42 arrived", "tenant": "altilia", "timestamp": "2023-03-01T11:07:45.776701Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:07:45,776 RabbitMQRPCConsumer handle 60 : Message with id 062910f7-9b78-4b6c-a7f1-4b11c95e0d42 arrived {"message": "Method called action with parameters {'message': '{\"annotations\": []}'}", "tenant": "altilia", "timestamp": "2023-03-01T11:07:45.776925Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:07:45,776 AnnotationCallback action 29 : Method called action with parameters {'message': '{"annotations": []}'} {"message": "Method called bulk_insert_annotations with parameters {'data': {'annotations': []}}", "tenant": "altilia", "timestamp": "2023-03-01T11:07:45.777796Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 575} INFO 2023-03-01 11:07:45,777 AnnotationService bulk_insert_annotations 575 : Method called bulk_insert_annotations with parameters {'data': {'annotations': []}} {"message": "Method problem action. documents must be a non-empty list", "tenant": "altilia", "timestamp": "2023-03-01T11:07:45.778642Z", "level": "WARNING", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 134} WARNING 2023-03-01 11:07:45,778 AnnotationCallback action 134 : Method problem action. documents must be a non-empty list {"message": "Sending response on queue amq.gen-0HOAjlilnhwYUKKYZTwebg", "tenant": "altilia", "timestamp": "2023-03-01T11:07:45.778913Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:07:45,778 RabbitMQRPCConsumer handle 63 : Sending response on queue amq.gen-0HOAjlilnhwYUKKYZTwebg DEBUG 2023-03-01 11:07:45,779 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:07:45,779 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:07:45,779 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "timestamp": "2023-03-01T11:07:45.779998Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:07:45,779 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "timestamp": "2023-03-01T11:07:45.780457Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:07:45,780 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:07:45,780 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:07:45,781 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:07:45,781 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:07:45,781 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:07:46,060 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:07:46,060 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:07:46,060 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:07:46,061 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:07:46,061 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:07:46,061 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730266.650607945 and callback=>; now=10730236.650607945; delay=30.0 DEBUG 2023-03-01 11:07:46,061 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:07:46,061 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:07:46,062 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:07:46,068 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 11:07:46,069 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:07:46,069 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 2: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:07:46,070 kafka.protocol.parser _process_response 139 : Received correlation id: 2 DEBUG 2023-03-01 11:07:46,070 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 11:07:46,074 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 2 (5.224704742431641 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 11:07:46,076 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 11:08:16,032 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:08:16,032 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:08:16,061 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:08:16,062 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:08:16,062 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:08:16,062 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:08:16,062 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:08:16,062 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730296.651921622 and callback=>; now=10730266.651921622; delay=30.0 DEBUG 2023-03-01 11:08:16,063 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:08:16,063 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:08:16,063 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:08:36,056 pika.heartbeat _check_heartbeat 124 : Received 12 heartbeat frames, sent 21, idle intervals 0 DEBUG 2023-03-01 11:08:36,057 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730351.646252668 and callback=>; now=10730286.646252668; delay=65 DEBUG 2023-03-01 11:08:46,033 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:08:46,033 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:08:46,063 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:08:46,063 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:08:46,063 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:08:46,063 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:08:46,063 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:08:46,064 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730326.653153935 and callback=>; now=10730296.653153935; delay=30.0 DEBUG 2023-03-01 11:08:46,064 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:08:46,064 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:08:46,064 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:09:00.769", "timestamp": "2023-03-01T11:09:00.822804Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:09:00,822 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id c86d4f7d-3639-4f5b-ac35-4bb9551a948d arrived", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:09:00.769", "timestamp": "2023-03-01T11:09:00.825087Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:09:00,824 RabbitMQRPCConsumer handle 60 : Message with id c86d4f7d-3639-4f5b-ac35-4bb9551a948d arrived {"message": "Method called action with parameters {'message': '{\"documentsIds\":[17928],\"datasetVersionId\":997}'}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:09:00.769", "timestamp": "2023-03-01T11:09:00.825314Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:09:00,825 AnnotationCallback action 29 : Method called action with parameters {'message': '{"documentsIds":[17928],"datasetVersionId":997}'} {"message": "Method called get_annotation_counts_by_validation_and_documents_in_dataset with parameters {'data': {'documentsIds': [17928], 'datasetVersionId': 997}}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:09:00.769", "timestamp": "2023-03-01T11:09:00.825860Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 69} INFO 2023-03-01 11:09:00,825 AnnotationService get_annotation_counts_by_validation_and_documents_in_dataset 69 : Method called get_annotation_counts_by_validation_and_documents_in_dataset with parameters {'data': {'documentsIds': [17928], 'datasetVersionId': 997}} {"message": "Method ended get_annotation_counts_by_validation_and_documents_in_dataset", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:09:00.769", "timestamp": "2023-03-01T11:09:00.951831Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 105} INFO 2023-03-01 11:09:00,951 AnnotationService get_annotation_counts_by_validation_and_documents_in_dataset 105 : Method ended get_annotation_counts_by_validation_and_documents_in_dataset {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:09:00.769", "timestamp": "2023-03-01T11:09:00.952479Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 11:09:00,952 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:09:00.769", "timestamp": "2023-03-01T11:09:00.952754Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 11:09:00,952 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:09:00.769", "timestamp": "2023-03-01T11:09:00.952994Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 56} INFO 2023-03-01 11:09:00,952 AnnotationCallback action 56 : Method ended action {"message": "Sending response on queue annotation-request-queue_COUNT_VALIDATION_BY_DOCUMENTS_2927b2b1-85cc-41ba-8baa-8492a8a3134b_1677668940786", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:09:00.769", "timestamp": "2023-03-01T11:09:00.953253Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:09:00,953 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_COUNT_VALIDATION_BY_DOCUMENTS_2927b2b1-85cc-41ba-8baa-8492a8a3134b_1677668940786 DEBUG 2023-03-01 11:09:00,953 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:09:00,953 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:09:00,953 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:09:00.769", "timestamp": "2023-03-01T11:09:00.953913Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:09:00,953 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:09:00.769", "timestamp": "2023-03-01T11:09:00.954164Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:09:00,954 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:09:00,954 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:09:00,954 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:09:00,954 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:09:00,954 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:09:16,064 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:09:16,064 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:09:16,065 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:09:16,065 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:09:16,065 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:09:16,065 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730356.65465768 and callback=>; now=10730326.65465768; delay=30.0 DEBUG 2023-03-01 11:09:16,065 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:09:16,066 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:09:16,066 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:09:41,062 pika.heartbeat _check_heartbeat 124 : Received 13 heartbeat frames, sent 23, idle intervals 0 DEBUG 2023-03-01 11:09:41,062 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730416.65151391 and callback=>; now=10730351.65151391; delay=65 DEBUG 2023-03-01 11:09:46,035 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:09:46,035 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:09:46,066 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:09:46,066 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:09:46,066 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:09:46,066 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:09:46,066 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:09:46,066 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730386.65593109 and callback=>; now=10730356.65593109; delay=30.0 DEBUG 2023-03-01 11:09:46,067 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:09:46,067 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:09:46,067 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:10:16,036 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:10:16,037 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:10:16,069 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:10:16,069 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:10:16,069 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:10:16,070 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:10:16,070 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:10:16,070 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730416.659873797 and callback=>; now=10730386.659873797; delay=30.0 DEBUG 2023-03-01 11:10:16,071 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:10:16,071 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:10:16,072 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:10:16.389", "timestamp": "2023-03-01T11:10:16.419563Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:10:16,419 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 0e1011f5-020b-4dbf-859d-5aae3679cdeb arrived", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:10:16.389", "timestamp": "2023-03-01T11:10:16.419868Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:10:16,419 RabbitMQRPCConsumer handle 60 : Message with id 0e1011f5-020b-4dbf-859d-5aae3679cdeb arrived {"message": "Method called action with parameters {'message': '{\"documentsIds\":[17928],\"datasetVersionId\":997}'}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:10:16.389", "timestamp": "2023-03-01T11:10:16.420055Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:10:16,420 AnnotationCallback action 29 : Method called action with parameters {'message': '{"documentsIds":[17928],"datasetVersionId":997}'} {"message": "Method called get_annotation_counts_by_validation_and_documents_in_dataset with parameters {'data': {'documentsIds': [17928], 'datasetVersionId': 997}}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:10:16.389", "timestamp": "2023-03-01T11:10:16.420788Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 69} INFO 2023-03-01 11:10:16,420 AnnotationService get_annotation_counts_by_validation_and_documents_in_dataset 69 : Method called get_annotation_counts_by_validation_and_documents_in_dataset with parameters {'data': {'documentsIds': [17928], 'datasetVersionId': 997}} {"message": "Method ended get_annotation_counts_by_validation_and_documents_in_dataset", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:10:16.389", "timestamp": "2023-03-01T11:10:16.428047Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 105} INFO 2023-03-01 11:10:16,427 AnnotationService get_annotation_counts_by_validation_and_documents_in_dataset 105 : Method ended get_annotation_counts_by_validation_and_documents_in_dataset {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:10:16.389", "timestamp": "2023-03-01T11:10:16.428538Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 11:10:16,428 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:10:16.389", "timestamp": "2023-03-01T11:10:16.429003Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 11:10:16,428 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:10:16.389", "timestamp": "2023-03-01T11:10:16.429379Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 56} INFO 2023-03-01 11:10:16,429 AnnotationCallback action 56 : Method ended action {"message": "Sending response on queue annotation-request-queue_COUNT_VALIDATION_BY_DOCUMENTS_95e0f722-faed-4c75-9976-1f9877d76c2b_1677669016398", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:10:16.389", "timestamp": "2023-03-01T11:10:16.429701Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:10:16,429 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_COUNT_VALIDATION_BY_DOCUMENTS_95e0f722-faed-4c75-9976-1f9877d76c2b_1677669016398 DEBUG 2023-03-01 11:10:16,430 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:10:16,430 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:10:16,430 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:10:16.389", "timestamp": "2023-03-01T11:10:16.430935Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:10:16,430 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:10:16.389", "timestamp": "2023-03-01T11:10:16.431153Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:10:16,431 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:10:16,431 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:10:16,431 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:10:16,431 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:10:16,431 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "timestamp": "2023-03-01T11:10:41.420058Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:10:41,419 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 0b9b7ed3-e26e-45bd-8947-33bb235781f8 arrived", "tenant": "altilia", "timestamp": "2023-03-01T11:10:41.420389Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:10:41,420 RabbitMQRPCConsumer handle 60 : Message with id 0b9b7ed3-e26e-45bd-8947-33bb235781f8 arrived {"message": "Method called action with parameters {'message': '{\"annotations\": []}'}", "tenant": "altilia", "timestamp": "2023-03-01T11:10:41.420597Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:10:41,420 AnnotationCallback action 29 : Method called action with parameters {'message': '{"annotations": []}'} {"message": "Method called bulk_insert_annotations with parameters {'data': {'annotations': []}}", "tenant": "altilia", "timestamp": "2023-03-01T11:10:41.420969Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 575} INFO 2023-03-01 11:10:41,420 AnnotationService bulk_insert_annotations 575 : Method called bulk_insert_annotations with parameters {'data': {'annotations': []}} {"message": "Method problem action. documents must be a non-empty list", "tenant": "altilia", "timestamp": "2023-03-01T11:10:41.421466Z", "level": "WARNING", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 134} WARNING 2023-03-01 11:10:41,421 AnnotationCallback action 134 : Method problem action. documents must be a non-empty list {"message": "Sending response on queue amq.gen-AORgYHFkY5IhMJBc4jn7lg", "tenant": "altilia", "timestamp": "2023-03-01T11:10:41.421646Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:10:41,421 RabbitMQRPCConsumer handle 63 : Sending response on queue amq.gen-AORgYHFkY5IhMJBc4jn7lg DEBUG 2023-03-01 11:10:41,421 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:10:41,422 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:10:41,422 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "timestamp": "2023-03-01T11:10:41.422451Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:10:41,422 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "timestamp": "2023-03-01T11:10:41.422630Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:10:41,422 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:10:41,422 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:10:41,423 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:10:41,423 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:10:41,423 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:10:46,066 pika.heartbeat _check_heartbeat 124 : Received 15 heartbeat frames, sent 25, idle intervals 0 DEBUG 2023-03-01 11:10:46,066 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730481.655355848 and callback=>; now=10730416.655355848; delay=65 DEBUG 2023-03-01 11:10:46,071 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:10:46,071 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:10:46,071 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:10:46,071 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:10:46,071 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:10:46,072 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730446.66127871 and callback=>; now=10730416.66127871; delay=30.0 DEBUG 2023-03-01 11:10:46,072 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:10:46,072 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:10:46,072 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:11:16,039 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:11:16,039 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:11:16,072 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:11:16,072 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:11:16,073 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:11:16,073 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:11:16,073 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:11:16,073 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730476.662416568 and callback=>; now=10730446.662416568; delay=30.0 DEBUG 2023-03-01 11:11:16,073 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:11:16,073 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:11:16,073 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:11:46,042 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:11:46,042 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:11:46,074 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:11:46,074 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:11:46,074 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:11:46,074 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:11:46,074 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:11:46,075 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730506.66470831 and callback=>; now=10730476.66470831; delay=30.0 DEBUG 2023-03-01 11:11:46,075 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:11:46,075 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:11:46,075 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:11:51,067 pika.heartbeat _check_heartbeat 124 : Received 17 heartbeat frames, sent 28, idle intervals 0 DEBUG 2023-03-01 11:11:51,067 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730546.657056216 and callback=>; now=10730481.657056216; delay=65 DEBUG 2023-03-01 11:12:16,043 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:12:16,043 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:12:16,076 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:12:16,076 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:12:16,076 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:12:16,076 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:12:16,076 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:12:16,076 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730536.665824644 and callback=>; now=10730506.665824644; delay=30.0 DEBUG 2023-03-01 11:12:16,077 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:12:16,077 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:12:16,077 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:12:46,044 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:12:46,044 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:12:46,076 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 11:12:46,077 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:12:46,077 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 3: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:12:46,077 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:12:46,078 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:12:46,078 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:12:46,078 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:12:46,078 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:12:46,078 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730566.667702 and callback=>; now=10730536.667702; delay=30.0 DEBUG 2023-03-01 11:12:46,078 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:12:46,079 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:12:46,079 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:12:46,080 kafka.protocol.parser _process_response 139 : Received correlation id: 3 DEBUG 2023-03-01 11:12:46,081 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 11:12:46,082 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 3 (4.87065315246582 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 11:12:46,084 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 11:12:56,071 pika.heartbeat _check_heartbeat 124 : Received 19 heartbeat frames, sent 30, idle intervals 0 DEBUG 2023-03-01 11:12:56,071 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730611.660652788 and callback=>; now=10730546.660652788; delay=65 DEBUG 2023-03-01 11:13:16,045 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:13:16,046 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:13:16,079 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:13:16,079 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:13:16,079 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:13:16,080 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:13:16,080 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:13:16,080 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730596.66950898 and callback=>; now=10730566.66950898; delay=30.0 DEBUG 2023-03-01 11:13:16,080 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:13:16,080 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:13:16,080 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:13:46,047 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:13:46,047 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:13:46,080 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:13:46,081 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:13:46,081 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:13:46,081 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:13:46,081 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:13:46,081 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730626.670883972 and callback=>; now=10730596.670883972; delay=30.0 DEBUG 2023-03-01 11:13:46,082 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:13:46,082 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:13:46,082 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:14:01,075 pika.heartbeat _check_heartbeat 124 : Received 21 heartbeat frames, sent 32, idle intervals 0 DEBUG 2023-03-01 11:14:01,075 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730676.664945625 and callback=>; now=10730611.664945625; delay=65 DEBUG 2023-03-01 11:14:16,052 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:14:16,052 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:14:16,083 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:14:16,083 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:14:16,083 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:14:16,083 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:14:16,083 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:14:16,084 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730656.673104208 and callback=>; now=10730626.673104208; delay=30.0 DEBUG 2023-03-01 11:14:16,084 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:14:16,084 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:14:16,084 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:14:46,055 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:14:46,055 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:14:46,084 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:14:46,084 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:14:46,084 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:14:46,084 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:14:46,084 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:14:46,084 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730686.674065392 and callback=>; now=10730656.674065392; delay=30.0 DEBUG 2023-03-01 11:14:46,085 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:14:46,085 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:14:46,085 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:15:06,079 pika.heartbeat _check_heartbeat 124 : Received 23 heartbeat frames, sent 34, idle intervals 0 DEBUG 2023-03-01 11:15:06,079 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730741.6689909 and callback=>; now=10730676.6689909; delay=65 DEBUG 2023-03-01 11:15:16,056 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:15:16,056 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:15:16,086 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:15:16,086 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:15:16,086 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:15:16,086 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:15:16,086 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:15:16,086 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730716.675986256 and callback=>; now=10730686.675986256; delay=30.0 DEBUG 2023-03-01 11:15:16,087 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:15:16,087 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:15:16,087 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:15:46,057 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:15:46,057 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:15:46,088 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:15:46,088 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:15:46,088 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:15:46,088 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:15:46,088 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:15:46,089 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730746.678207835 and callback=>; now=10730716.678207835; delay=30.0 DEBUG 2023-03-01 11:15:46,089 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:15:46,089 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:15:46,089 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:15:52.925", "timestamp": "2023-03-01T11:15:52.964806Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:15:52,964 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 3a24ac49-67d0-4a18-b332-2ceac5669bbd arrived", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:15:52.925", "timestamp": "2023-03-01T11:15:52.965124Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:15:52,965 RabbitMQRPCConsumer handle 60 : Message with id 3a24ac49-67d0-4a18-b332-2ceac5669bbd arrived {"message": "Method called action with parameters {'message': '{\"documentsIds\":[17928],\"datasetVersionId\":997}'}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:15:52.925", "timestamp": "2023-03-01T11:15:52.965665Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:15:52,965 AnnotationCallback action 29 : Method called action with parameters {'message': '{"documentsIds":[17928],"datasetVersionId":997}'} {"message": "Method called get_annotation_counts_by_validation_and_documents_in_dataset with parameters {'data': {'documentsIds': [17928], 'datasetVersionId': 997}}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:15:52.925", "timestamp": "2023-03-01T11:15:52.966325Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 69} INFO 2023-03-01 11:15:52,966 AnnotationService get_annotation_counts_by_validation_and_documents_in_dataset 69 : Method called get_annotation_counts_by_validation_and_documents_in_dataset with parameters {'data': {'documentsIds': [17928], 'datasetVersionId': 997}} {"message": "Method ended get_annotation_counts_by_validation_and_documents_in_dataset", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:15:52.925", "timestamp": "2023-03-01T11:15:53.037750Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 105} INFO 2023-03-01 11:15:53,037 AnnotationService get_annotation_counts_by_validation_and_documents_in_dataset 105 : Method ended get_annotation_counts_by_validation_and_documents_in_dataset {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:15:52.925", "timestamp": "2023-03-01T11:15:53.038675Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 11:15:53,038 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:15:52.925", "timestamp": "2023-03-01T11:15:53.038891Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 11:15:53,038 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:15:52.925", "timestamp": "2023-03-01T11:15:53.039052Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 56} INFO 2023-03-01 11:15:53,039 AnnotationCallback action 56 : Method ended action {"message": "Sending response on queue annotation-request-queue_COUNT_VALIDATION_BY_DOCUMENTS_836460e0-43b1-4a4d-882d-6230c27aae16_1677669352937", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:15:52.925", "timestamp": "2023-03-01T11:15:53.039252Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:15:53,039 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_COUNT_VALIDATION_BY_DOCUMENTS_836460e0-43b1-4a4d-882d-6230c27aae16_1677669352937 DEBUG 2023-03-01 11:15:53,039 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:15:53,039 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:15:53,039 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:15:52.925", "timestamp": "2023-03-01T11:15:53.040164Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:15:53,040 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:15:52.925", "timestamp": "2023-03-01T11:15:53.040461Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:15:53,040 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:15:53,040 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:15:53,040 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:15:53,041 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:15:53,041 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:16:11,080 pika.heartbeat _check_heartbeat 124 : Received 25 heartbeat frames, sent 36, idle intervals 0 DEBUG 2023-03-01 11:16:11,080 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730806.66972555 and callback=>; now=10730741.66972555; delay=65 DEBUG 2023-03-01 11:16:16,090 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:16:16,090 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:16:16,090 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:16:16,090 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:16:16,090 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:16:16,091 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730776.680093767 and callback=>; now=10730746.680093767; delay=30.0 DEBUG 2023-03-01 11:16:16,091 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:16:16,091 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:16:16,091 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:16:46,058 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:16:46,058 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:16:46,091 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:16:46,092 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:16:46,092 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:16:46,092 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:16:46,092 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:16:46,092 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730806.681885645 and callback=>; now=10730776.681885645; delay=30.0 DEBUG 2023-03-01 11:16:46,093 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:16:46,093 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:16:46,093 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:17:16,059 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:17:16,060 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:17:16,081 pika.heartbeat _check_heartbeat 124 : Received 27 heartbeat frames, sent 38, idle intervals 0 DEBUG 2023-03-01 11:17:16,081 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730871.67107124 and callback=>; now=10730806.67107124; delay=65 DEBUG 2023-03-01 11:17:16,093 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:17:16,093 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:17:16,094 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:17:16,094 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:17:16,094 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:17:16,094 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730836.683772158 and callback=>; now=10730806.683772158; delay=30.0 DEBUG 2023-03-01 11:17:16,094 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:17:16,095 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:17:16,095 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:17:46,059 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:17:46,059 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:17:46,084 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 11:17:46,085 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:17:46,085 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 4: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:17:46,086 kafka.protocol.parser _process_response 139 : Received correlation id: 4 DEBUG 2023-03-01 11:17:46,086 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 11:17:46,088 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 4 (2.5904178619384766 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 11:17:46,089 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 11:17:46,095 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:17:46,095 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:17:46,095 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:17:46,095 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:17:46,095 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:17:46,095 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730866.684771985 and callback=>; now=10730836.684771985; delay=30.0 DEBUG 2023-03-01 11:17:46,095 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:17:46,096 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:17:46,096 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:18:13.126", "timestamp": "2023-03-01T11:18:13.229369Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:18:13,229 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id f2adfda7-1553-4979-8912-d3948d574d8c arrived", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:18:13.126", "timestamp": "2023-03-01T11:18:13.229674Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:18:13,229 RabbitMQRPCConsumer handle 60 : Message with id f2adfda7-1553-4979-8912-d3948d574d8c arrived {"message": "Method called action with parameters {'message': '{\"task\":[\"document_classification\"],\"document\":[\"17928\"],\"order_by\":[\"creationDate\"],\"dataset\":[\"997\"],\"order_type\":[\"ASC\"]}'}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:18:13.126", "timestamp": "2023-03-01T11:18:13.229942Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:18:13,229 AnnotationCallback action 29 : Method called action with parameters {'message': '{"task":["document_classification"],"document":["17928"],"order_by":["creationDate"],"dataset":["997"],"order_type":["ASC"]}'} {"message": "Method called find with parameters {'args': {'task': ['document_classification'], 'document': ['17928'], 'order_by': ['creationDate'], 'dataset': ['997'], 'order_type': ['ASC']}}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:18:13.126", "timestamp": "2023-03-01T11:18:13.230534Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 309} INFO 2023-03-01 11:18:13,230 AnnotationService find 309 : Method called find with parameters {'args': {'task': ['document_classification'], 'document': ['17928'], 'order_by': ['creationDate'], 'dataset': ['997'], 'order_type': ['ASC']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:18:13.126", "timestamp": "2023-03-01T11:18:13.230964Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 11:18:13,230 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:18:13.126", "timestamp": "2023-03-01T11:18:13.231228Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 11:18:13,231 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended find", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:18:13.126", "timestamp": "2023-03-01T11:18:13.321386Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 323} INFO 2023-03-01 11:18:13,321 AnnotationService find 323 : Method ended find {"message": "Method called build with parameters {'annotations_size': 0}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:18:13.126", "timestamp": "2023-03-01T11:18:13.321990Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 17} INFO 2023-03-01 11:18:13,321 ResponseBuilder build 17 : Method called build with parameters {'annotations_size': 0} {"message": "Method ended build", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:18:13.126", "timestamp": "2023-03-01T11:18:13.322205Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 25} INFO 2023-03-01 11:18:13,322 ResponseBuilder build 25 : Method ended build {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:18:13.126", "timestamp": "2023-03-01T11:18:13.322513Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 11:18:13,322 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:18:13.126", "timestamp": "2023-03-01T11:18:13.322645Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 11:18:13,322 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:18:13.126", "timestamp": "2023-03-01T11:18:13.322746Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 48} INFO 2023-03-01 11:18:13,322 AnnotationCallback action 48 : Method ended action {"message": "Sending response on queue annotation-request-queue_SEARCH_ANNOTATION_34908d19-e97d-45b7-b19f-c0a9eff83387_1677669493204", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:18:13.126", "timestamp": "2023-03-01T11:18:13.322888Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:18:13,322 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_SEARCH_ANNOTATION_34908d19-e97d-45b7-b19f-c0a9eff83387_1677669493204 DEBUG 2023-03-01 11:18:13,323 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:18:13,323 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:18:13,323 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:18:13.126", "timestamp": "2023-03-01T11:18:13.323426Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:18:13,323 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:18:13.126", "timestamp": "2023-03-01T11:18:13.323607Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:18:13,323 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:18:13,323 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:18:13,323 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:18:13,324 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:18:13,324 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:18:16,098 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:18:16,098 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:18:16,098 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:18:16,098 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:18:16,098 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:18:16,099 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730896.688230984 and callback=>; now=10730866.688230984; delay=30.0 DEBUG 2023-03-01 11:18:16,099 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:18:16,099 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:18:16,099 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:18:21,086 pika.heartbeat _check_heartbeat 124 : Received 28 heartbeat frames, sent 41, idle intervals 0 DEBUG 2023-03-01 11:18:21,086 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730936.675549733 and callback=>; now=10730871.675549733; delay=65 DEBUG 2023-03-01 11:18:46,061 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:18:46,061 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:18:46,099 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:18:46,099 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:18:46,099 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:18:46,100 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:18:46,100 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:18:46,100 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730926.689641586 and callback=>; now=10730896.689641586; delay=30.0 DEBUG 2023-03-01 11:18:46,100 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:18:46,100 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:18:46,100 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:19:16,061 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:19:16,062 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:19:16,101 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:19:16,101 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:19:16,102 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:19:16,102 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:19:16,102 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:19:16,102 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730956.69175387 and callback=>; now=10730926.69175387; delay=30.0 DEBUG 2023-03-01 11:19:16,102 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:19:16,103 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:19:16,103 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:19:26,090 pika.heartbeat _check_heartbeat 124 : Received 30 heartbeat frames, sent 43, idle intervals 0 DEBUG 2023-03-01 11:19:26,090 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731001.679475004 and callback=>; now=10730936.679475004; delay=65 DEBUG 2023-03-01 11:19:46,063 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:19:46,063 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:19:46,103 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:19:46,104 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:19:46,104 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:19:46,104 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:19:46,104 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:19:46,104 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10730986.693619495 and callback=>; now=10730956.693619495; delay=30.0 DEBUG 2023-03-01 11:19:46,104 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:19:46,104 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:19:46,104 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:20:12.868", "timestamp": "2023-03-01T11:20:13.022494Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:20:13,022 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 71c79add-7a01-4d19-b761-5d958a46588d arrived", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:20:12.868", "timestamp": "2023-03-01T11:20:13.022804Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:20:13,022 RabbitMQRPCConsumer handle 60 : Message with id 71c79add-7a01-4d19-b761-5d958a46588d arrived {"message": "Method called action with parameters {'message': '{\"order_by\":[\"creationDate\"],\"page\":[\"1\"],\"dataset\":[\"997\"],\"order_type\":[\"DESC\"],\"page_size\":[\"50\"]}'}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:20:12.868", "timestamp": "2023-03-01T11:20:13.022999Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:20:13,022 AnnotationCallback action 29 : Method called action with parameters {'message': '{"order_by":["creationDate"],"page":["1"],"dataset":["997"],"order_type":["DESC"],"page_size":["50"]}'} {"message": "Method called find with parameters {'args': {'order_by': ['creationDate'], 'page': ['1'], 'dataset': ['997'], 'order_type': ['DESC'], 'page_size': ['50']}}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:20:12.868", "timestamp": "2023-03-01T11:20:13.023631Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 309} INFO 2023-03-01 11:20:13,023 AnnotationService find 309 : Method called find with parameters {'args': {'order_by': ['creationDate'], 'page': ['1'], 'dataset': ['997'], 'order_type': ['DESC'], 'page_size': ['50']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:20:12.868", "timestamp": "2023-03-01T11:20:13.024127Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 11:20:13,024 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:20:12.868", "timestamp": "2023-03-01T11:20:13.024412Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 11:20:13,024 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended find", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:20:12.868", "timestamp": "2023-03-01T11:20:13.030469Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 323} INFO 2023-03-01 11:20:13,030 AnnotationService find 323 : Method ended find {"message": "Method called build with parameters {'annotations_size': 1}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:20:12.868", "timestamp": "2023-03-01T11:20:13.030912Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 17} INFO 2023-03-01 11:20:13,030 ResponseBuilder build 17 : Method called build with parameters {'annotations_size': 1} {"message": "Method called _build_json with parameters {'annotations_size': 25}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:20:12.868", "timestamp": "2023-03-01T11:20:13.031423Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:20:13,031 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 25} {"message": "Method ended _build_json", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:20:12.868", "timestamp": "2023-03-01T11:20:13.031725Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:20:13,031 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method ended build", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:20:12.868", "timestamp": "2023-03-01T11:20:13.031926Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 25} INFO 2023-03-01 11:20:13,031 ResponseBuilder build 25 : Method ended build {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:20:12.868", "timestamp": "2023-03-01T11:20:13.032346Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 11:20:13,032 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:20:12.868", "timestamp": "2023-03-01T11:20:13.032749Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 11:20:13,032 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:20:12.868", "timestamp": "2023-03-01T11:20:13.032947Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 48} INFO 2023-03-01 11:20:13,032 AnnotationCallback action 48 : Method ended action {"message": "Sending response on queue annotation-request-queue_SEARCH_ANNOTATION_be0a44f0-4343-4e3b-9fc8-0f3cc7efd4de_1677669612997", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:20:12.868", "timestamp": "2023-03-01T11:20:13.033171Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:20:13,033 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_SEARCH_ANNOTATION_be0a44f0-4343-4e3b-9fc8-0f3cc7efd4de_1677669612997 DEBUG 2023-03-01 11:20:13,033 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:20:13,033 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:20:13,033 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:20:12.868", "timestamp": "2023-03-01T11:20:13.034157Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:20:13,034 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:20:12.868", "timestamp": "2023-03-01T11:20:13.034457Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:20:13,034 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:20:13,034 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:20:13,035 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:20:13,035 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:20:13,035 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:20:16,106 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:20:16,106 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:20:16,106 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:20:16,106 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:20:16,106 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:20:16,106 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731016.695900789 and callback=>; now=10730986.695900789; delay=30.0 DEBUG 2023-03-01 11:20:16,107 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:20:16,107 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:20:16,107 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:20:31,095 pika.heartbeat _check_heartbeat 124 : Received 31 heartbeat frames, sent 45, idle intervals 0 DEBUG 2023-03-01 11:20:31,096 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731066.685312124 and callback=>; now=10731001.685312124; delay=65 DEBUG 2023-03-01 11:20:46,065 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:20:46,065 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:20:46,107 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:20:46,107 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:20:46,108 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:20:46,108 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:20:46,108 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:20:46,108 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731046.697434843 and callback=>; now=10731016.697434843; delay=30.0 DEBUG 2023-03-01 11:20:46,108 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:20:46,108 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:20:46,108 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:21:16,065 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:21:16,066 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:21:16,109 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:21:16,109 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:21:16,109 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:21:16,110 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:21:16,110 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:21:16,110 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731076.699340599 and callback=>; now=10731046.699340599; delay=30.0 DEBUG 2023-03-01 11:21:16,110 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:21:16,110 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:21:16,110 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:21:36,102 pika.heartbeat _check_heartbeat 124 : Received 33 heartbeat frames, sent 47, idle intervals 0 DEBUG 2023-03-01 11:21:36,102 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731131.691471923 and callback=>; now=10731066.691471923; delay=65 DEBUG 2023-03-01 11:21:46,066 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:21:46,066 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:21:46,111 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:21:46,111 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:21:46,111 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:21:46,111 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:21:46,111 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:21:46,112 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731106.70116348 and callback=>; now=10731076.70116348; delay=30.0 DEBUG 2023-03-01 11:21:46,112 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:21:46,112 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:21:46,112 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:22:16,067 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:22:16,067 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:22:16,112 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:22:16,112 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:22:16,112 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:22:16,112 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:22:16,112 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:22:16,113 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731136.702100694 and callback=>; now=10731106.702100694; delay=30.0 DEBUG 2023-03-01 11:22:16,113 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:22:16,113 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:22:16,113 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:22:41,106 pika.heartbeat _check_heartbeat 124 : Received 35 heartbeat frames, sent 49, idle intervals 0 DEBUG 2023-03-01 11:22:41,106 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731196.695440045 and callback=>; now=10731131.695440045; delay=65 DEBUG 2023-03-01 11:22:46,068 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:22:46,069 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:22:46,090 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 11:22:46,090 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:22:46,090 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 5: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:22:46,092 kafka.protocol.parser _process_response 139 : Received correlation id: 5 DEBUG 2023-03-01 11:22:46,092 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 11:22:46,093 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 5 (2.302408218383789 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 11:22:46,094 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 11:22:46,113 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:22:46,114 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:22:46,114 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:22:46,114 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:22:46,114 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:22:46,114 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731166.70366066 and callback=>; now=10731136.70366066; delay=30.0 DEBUG 2023-03-01 11:22:46,114 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:22:46,114 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:22:46,115 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:23:16,069 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:23:16,070 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:23:16,116 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:23:16,116 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:23:16,116 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:23:16,116 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:23:16,116 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:23:16,116 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731196.705919476 and callback=>; now=10731166.705919476; delay=30.0 DEBUG 2023-03-01 11:23:16,117 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:23:16,117 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:23:16,117 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:23:46,071 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:23:46,071 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:23:46,106 pika.heartbeat _check_heartbeat 124 : Received 38 heartbeat frames, sent 51, idle intervals 0 DEBUG 2023-03-01 11:23:46,107 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731261.696078567 and callback=>; now=10731196.696078567; delay=65 DEBUG 2023-03-01 11:23:46,117 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:23:46,117 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:23:46,117 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:23:46,118 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:23:46,118 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:23:46,118 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731226.707808984 and callback=>; now=10731196.707808984; delay=30.0 DEBUG 2023-03-01 11:23:46,119 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:23:46,119 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:23:46,119 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:24:16,071 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:24:16,072 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:24:16,119 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:24:16,119 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:24:16,120 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:24:16,120 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:24:16,120 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:24:16,120 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731256.70945806 and callback=>; now=10731226.70945806; delay=30.0 DEBUG 2023-03-01 11:24:16,120 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:24:16,120 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:24:16,120 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:24:46,073 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:24:46,073 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:24:46,120 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:24:46,121 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:24:46,121 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:24:46,121 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:24:46,121 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:24:46,121 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731286.710762048 and callback=>; now=10731256.710762048; delay=30.0 DEBUG 2023-03-01 11:24:46,121 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:24:46,122 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:24:46,122 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:24:51,110 pika.heartbeat _check_heartbeat 124 : Received 40 heartbeat frames, sent 54, idle intervals 0 DEBUG 2023-03-01 11:24:51,110 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731326.699366484 and callback=>; now=10731261.699366484; delay=65 DEBUG 2023-03-01 11:25:16,074 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:25:16,074 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:25:16,122 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:25:16,122 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:25:16,122 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:25:16,122 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:25:16,122 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:25:16,122 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731316.712073483 and callback=>; now=10731286.712073483; delay=30.0 DEBUG 2023-03-01 11:25:16,123 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:25:16,123 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:25:16,123 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:25:46,075 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:25:46,075 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:25:46,123 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:25:46,123 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:25:46,123 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:25:46,123 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:25:46,123 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:25:46,124 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731346.713198764 and callback=>; now=10731316.713198764; delay=30.0 DEBUG 2023-03-01 11:25:46,124 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:25:46,124 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:25:46,124 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:25:56,114 pika.heartbeat _check_heartbeat 124 : Received 42 heartbeat frames, sent 56, idle intervals 0 DEBUG 2023-03-01 11:25:56,114 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731391.703355983 and callback=>; now=10731326.703355983; delay=65 DEBUG 2023-03-01 11:26:16,078 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:26:16,078 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:26:16,124 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:26:16,125 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:26:16,125 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:26:16,125 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:26:16,125 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:26:16,125 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731376.714658603 and callback=>; now=10731346.714658603; delay=30.0 DEBUG 2023-03-01 11:26:16,125 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:26:16,126 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:26:16,126 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:26:46,077 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:26:46,078 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:26:46,126 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:26:46,126 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:26:46,126 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:26:46,127 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:26:46,127 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:26:46,127 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731406.716327012 and callback=>; now=10731376.716327012; delay=30.0 DEBUG 2023-03-01 11:26:46,127 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:26:46,127 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:26:46,127 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:27:01,119 pika.heartbeat _check_heartbeat 124 : Received 44 heartbeat frames, sent 58, idle intervals 0 DEBUG 2023-03-01 11:27:01,119 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731456.708681976 and callback=>; now=10731391.708681976; delay=65 DEBUG 2023-03-01 11:27:16,078 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:27:16,079 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:27:16,127 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:27:16,127 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:27:16,127 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:27:16,127 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:27:16,127 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:27:16,128 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731436.717207104 and callback=>; now=10731406.717207104; delay=30.0 DEBUG 2023-03-01 11:27:16,128 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:27:16,128 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:27:16,128 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:27:46,079 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:27:46,080 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:27:46,097 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 11:27:46,097 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:27:46,097 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 6: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:27:46,100 kafka.protocol.parser _process_response 139 : Received correlation id: 6 DEBUG 2023-03-01 11:27:46,100 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 11:27:46,101 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 6 (3.7593841552734375 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 11:27:46,102 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 11:27:46,128 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:27:46,128 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:27:46,128 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:27:46,128 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:27:46,128 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:27:46,129 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731466.71810986 and callback=>; now=10731436.71810986; delay=30.0 DEBUG 2023-03-01 11:27:46,129 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:27:46,129 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:27:46,129 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:28:06,122 pika.heartbeat _check_heartbeat 124 : Received 46 heartbeat frames, sent 60, idle intervals 0 DEBUG 2023-03-01 11:28:06,122 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731521.711398298 and callback=>; now=10731456.711398298; delay=65 DEBUG 2023-03-01 11:28:16,081 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:28:16,081 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:28:16,129 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:28:16,129 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:28:16,129 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:28:16,130 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:28:16,130 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:28:16,130 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731496.719368344 and callback=>; now=10731466.719368344; delay=30.0 DEBUG 2023-03-01 11:28:16,130 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:28:16,130 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:28:16,130 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:28:46,082 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:28:46,082 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:28:46,130 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:28:46,131 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:28:46,131 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:28:46,131 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:28:46,131 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:28:46,131 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731526.720766423 and callback=>; now=10731496.720766423; delay=30.0 DEBUG 2023-03-01 11:28:46,131 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:28:46,132 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:28:46,132 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:29:11,126 pika.heartbeat _check_heartbeat 124 : Received 48 heartbeat frames, sent 62, idle intervals 0 DEBUG 2023-03-01 11:29:11,126 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731586.71539125 and callback=>; now=10731521.71539125; delay=65 DEBUG 2023-03-01 11:29:16,083 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:29:16,083 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:29:16,132 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:29:16,132 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:29:16,132 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:29:16,132 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:29:16,132 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:29:16,132 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731556.722019585 and callback=>; now=10731526.722019585; delay=30.0 DEBUG 2023-03-01 11:29:16,133 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:29:16,133 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:29:16,133 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:29:46,084 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:29:46,084 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:29:46,133 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:29:46,133 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:29:46,133 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:29:46,134 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:29:46,134 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:29:46,134 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731586.723528864 and callback=>; now=10731556.723528864; delay=30.0 DEBUG 2023-03-01 11:29:46,134 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:29:46,135 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:29:46,135 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:30:16,085 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:30:16,086 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:30:16,127 pika.heartbeat _check_heartbeat 124 : Received 51 heartbeat frames, sent 64, idle intervals 0 DEBUG 2023-03-01 11:30:16,127 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731651.716600036 and callback=>; now=10731586.716600036; delay=65 DEBUG 2023-03-01 11:30:16,134 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:30:16,135 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:30:16,135 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:30:16,135 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:30:16,135 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:30:16,135 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731616.724775076 and callback=>; now=10731586.724775076; delay=30.0 DEBUG 2023-03-01 11:30:16,135 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:30:16,135 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:30:16,136 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:30:46,087 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:30:46,087 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:30:46,136 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:30:46,136 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:30:46,137 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:30:46,137 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:30:46,137 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:30:46,137 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731646.726474438 and callback=>; now=10731616.726474438; delay=30.0 DEBUG 2023-03-01 11:30:46,137 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:30:46,137 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:30:46,137 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:31:16,088 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:31:16,088 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:31:16,138 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:31:16,138 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:31:16,138 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:31:16,138 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:31:16,138 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:31:16,138 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731676.727915557 and callback=>; now=10731646.727915557; delay=30.0 DEBUG 2023-03-01 11:31:16,139 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:31:16,139 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:31:16,139 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:31:21,130 pika.heartbeat _check_heartbeat 124 : Received 53 heartbeat frames, sent 67, idle intervals 0 DEBUG 2023-03-01 11:31:21,130 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731716.71946744 and callback=>; now=10731651.71946744; delay=65 DEBUG 2023-03-01 11:31:46,090 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:31:46,090 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:31:46,139 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:31:46,140 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:31:46,140 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:31:46,140 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:31:46,140 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:31:46,140 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731706.729945162 and callback=>; now=10731676.729945162; delay=30.0 DEBUG 2023-03-01 11:31:46,141 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:31:46,141 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:31:46,141 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:32:03.408", "timestamp": "2023-03-01T11:32:03.541400Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:32:03,541 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id d474c4c6-be35-4622-b220-61acff2cb583 arrived", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:32:03.408", "timestamp": "2023-03-01T11:32:03.541912Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:32:03,541 RabbitMQRPCConsumer handle 60 : Message with id d474c4c6-be35-4622-b220-61acff2cb583 arrived {"message": "Method called action with parameters {'message': '{\"order_by\":[\"creationDate\"],\"page\":[\"1\"],\"dataset\":[\"997\"],\"order_type\":[\"DESC\"],\"page_size\":[\"50\"]}'}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:32:03.408", "timestamp": "2023-03-01T11:32:03.542137Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:32:03,542 AnnotationCallback action 29 : Method called action with parameters {'message': '{"order_by":["creationDate"],"page":["1"],"dataset":["997"],"order_type":["DESC"],"page_size":["50"]}'} {"message": "Method called find with parameters {'args': {'order_by': ['creationDate'], 'page': ['1'], 'dataset': ['997'], 'order_type': ['DESC'], 'page_size': ['50']}}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:32:03.408", "timestamp": "2023-03-01T11:32:03.542721Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 309} INFO 2023-03-01 11:32:03,542 AnnotationService find 309 : Method called find with parameters {'args': {'order_by': ['creationDate'], 'page': ['1'], 'dataset': ['997'], 'order_type': ['DESC'], 'page_size': ['50']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:32:03.408", "timestamp": "2023-03-01T11:32:03.543212Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 11:32:03,543 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:32:03.408", "timestamp": "2023-03-01T11:32:03.543568Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 11:32:03,543 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended find", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:32:03.408", "timestamp": "2023-03-01T11:32:03.620013Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 323} INFO 2023-03-01 11:32:03,619 AnnotationService find 323 : Method ended find {"message": "Method called build with parameters {'annotations_size': 1}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:32:03.408", "timestamp": "2023-03-01T11:32:03.620558Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 17} INFO 2023-03-01 11:32:03,620 ResponseBuilder build 17 : Method called build with parameters {'annotations_size': 1} {"message": "Method called _build_json with parameters {'annotations_size': 25}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:32:03.408", "timestamp": "2023-03-01T11:32:03.621073Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 29} DEBUG 2023-03-01 11:32:03,620 ResponseBuilder _build_json 29 : Method called _build_json with parameters {'annotations_size': 25} {"message": "Method ended _build_json", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:32:03.408", "timestamp": "2023-03-01T11:32:03.621345Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 46} DEBUG 2023-03-01 11:32:03,621 ResponseBuilder _build_json 46 : Method ended _build_json {"message": "Method ended build", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:32:03.408", "timestamp": "2023-03-01T11:32:03.621509Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 25} INFO 2023-03-01 11:32:03,621 ResponseBuilder build 25 : Method ended build {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:32:03.408", "timestamp": "2023-03-01T11:32:03.621858Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 11:32:03,621 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:32:03.408", "timestamp": "2023-03-01T11:32:03.622182Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 11:32:03,622 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:32:03.408", "timestamp": "2023-03-01T11:32:03.622368Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 48} INFO 2023-03-01 11:32:03,622 AnnotationCallback action 48 : Method ended action {"message": "Sending response on queue annotation-request-queue_SEARCH_ANNOTATION_ff2c2610-26c6-4e63-9fae-c54e70971df1_1677670323510", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:32:03.408", "timestamp": "2023-03-01T11:32:03.622564Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:32:03,622 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_SEARCH_ANNOTATION_ff2c2610-26c6-4e63-9fae-c54e70971df1_1677670323510 DEBUG 2023-03-01 11:32:03,622 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:32:03,622 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:32:03,623 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:32:03.408", "timestamp": "2023-03-01T11:32:03.623235Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:32:03,623 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationGet-2023-03-01 11:32:03.408", "timestamp": "2023-03-01T11:32:03.623419Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:32:03,623 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:32:03,623 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:32:03,623 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:32:03,624 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:32:03,624 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:32:16,142 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:32:16,142 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:32:16,142 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:32:16,142 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:32:16,142 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:32:16,142 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731736.732014032 and callback=>; now=10731706.732014032; delay=30.0 DEBUG 2023-03-01 11:32:16,143 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:32:16,143 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:32:16,143 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:32:26,134 pika.heartbeat _check_heartbeat 124 : Received 54 heartbeat frames, sent 69, idle intervals 0 DEBUG 2023-03-01 11:32:26,134 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731781.7234976 and callback=>; now=10731716.7234976; delay=65 DEBUG 2023-03-01 11:32:46,091 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:32:46,091 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:32:46,104 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 11:32:46,104 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:32:46,104 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 7: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:32:46,106 kafka.protocol.parser _process_response 139 : Received correlation id: 7 DEBUG 2023-03-01 11:32:46,106 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 11:32:46,107 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 7 (3.2515525817871094 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 11:32:46,109 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 11:32:46,143 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:32:46,144 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:32:46,144 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:32:46,144 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:32:46,144 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:32:46,144 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731766.733708063 and callback=>; now=10731736.733708063; delay=30.0 DEBUG 2023-03-01 11:32:46,144 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:32:46,144 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:32:46,145 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:33:16,091 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:33:16,091 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:33:16,145 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:33:16,145 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:33:16,145 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:33:16,145 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:33:16,145 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:33:16,146 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731796.735082965 and callback=>; now=10731766.735082965; delay=30.0 DEBUG 2023-03-01 11:33:16,146 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:33:16,146 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:33:16,146 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:33:31,138 pika.heartbeat _check_heartbeat 124 : Received 56 heartbeat frames, sent 71, idle intervals 0 DEBUG 2023-03-01 11:33:31,138 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731846.72736502 and callback=>; now=10731781.72736502; delay=65 DEBUG 2023-03-01 11:33:46,092 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:33:46,092 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:33:46,147 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:33:46,147 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:33:46,147 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:33:46,147 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:33:46,147 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:33:46,148 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731826.737156527 and callback=>; now=10731796.737156527; delay=30.0 DEBUG 2023-03-01 11:33:46,148 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:33:46,148 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:33:46,148 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:34:16,093 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:34:16,094 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:34:16,148 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:34:16,148 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:34:16,148 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:34:16,149 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:34:16,149 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:34:16,149 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731856.738462936 and callback=>; now=10731826.738462936; delay=30.0 DEBUG 2023-03-01 11:34:16,149 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:34:16,149 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:34:16,149 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:34:36,143 pika.heartbeat _check_heartbeat 124 : Received 58 heartbeat frames, sent 73, idle intervals 0 DEBUG 2023-03-01 11:34:36,143 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731911.732820448 and callback=>; now=10731846.732820448; delay=65 {"message": "Method called handle", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:34:38.931", "timestamp": "2023-03-01T11:34:38.959978Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:34:38,959 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 5619cda3-cf14-40b0-86e5-0d6a349e198b arrived", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:34:38.931", "timestamp": "2023-03-01T11:34:38.960270Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:34:38,960 RabbitMQRPCConsumer handle 60 : Message with id 5619cda3-cf14-40b0-86e5-0d6a349e198b arrived {"message": "Method called action with parameters {'message': '{\"documentsIds\":[17928],\"datasetVersionId\":997}'}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:34:38.931", "timestamp": "2023-03-01T11:34:38.960441Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:34:38,960 AnnotationCallback action 29 : Method called action with parameters {'message': '{"documentsIds":[17928],"datasetVersionId":997}'} {"message": "Method called get_annotation_counts_by_validation_and_documents_in_dataset with parameters {'data': {'documentsIds': [17928], 'datasetVersionId': 997}}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:34:38.931", "timestamp": "2023-03-01T11:34:38.960953Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 69} INFO 2023-03-01 11:34:38,960 AnnotationService get_annotation_counts_by_validation_and_documents_in_dataset 69 : Method called get_annotation_counts_by_validation_and_documents_in_dataset with parameters {'data': {'documentsIds': [17928], 'datasetVersionId': 997}} {"message": "Method ended get_annotation_counts_by_validation_and_documents_in_dataset", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:34:38.931", "timestamp": "2023-03-01T11:34:39.033379Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 105} INFO 2023-03-01 11:34:39,033 AnnotationService get_annotation_counts_by_validation_and_documents_in_dataset 105 : Method ended get_annotation_counts_by_validation_and_documents_in_dataset {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:34:38.931", "timestamp": "2023-03-01T11:34:39.033821Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 11:34:39,033 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:34:38.931", "timestamp": "2023-03-01T11:34:39.034093Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 11:34:39,034 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:34:38.931", "timestamp": "2023-03-01T11:34:39.034280Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 56} INFO 2023-03-01 11:34:39,034 AnnotationCallback action 56 : Method ended action {"message": "Sending response on queue annotation-request-queue_COUNT_VALIDATION_BY_DOCUMENTS_c1d8def0-ef46-482a-a4dc-f240c2847d63_1677670478945", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:34:38.931", "timestamp": "2023-03-01T11:34:39.034498Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:34:39,034 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_COUNT_VALIDATION_BY_DOCUMENTS_c1d8def0-ef46-482a-a4dc-f240c2847d63_1677670478945 DEBUG 2023-03-01 11:34:39,034 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:34:39,034 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:34:39,034 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:34:38.931", "timestamp": "2023-03-01T11:34:39.035162Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:34:39,035 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:34:38.931", "timestamp": "2023-03-01T11:34:39.035331Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:34:39,035 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:34:39,035 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:34:39,035 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:34:39,035 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:34:39,035 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:34:46,151 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:34:46,151 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:34:46,152 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:34:46,152 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:34:46,152 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:34:46,152 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731886.741608828 and callback=>; now=10731856.741608828; delay=30.0 DEBUG 2023-03-01 11:34:46,152 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:34:46,152 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:34:46,152 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:35:16,097 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:35:16,097 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:35:16,152 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:35:16,153 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:35:16,153 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:35:16,153 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:35:16,153 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:35:16,153 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731916.742700877 and callback=>; now=10731886.742700877; delay=30.0 DEBUG 2023-03-01 11:35:16,153 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:35:16,154 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:35:16,154 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:35:41,150 pika.heartbeat _check_heartbeat 124 : Received 59 heartbeat frames, sent 75, idle intervals 0 DEBUG 2023-03-01 11:35:41,154 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731976.743128952 and callback=>; now=10731911.743128952; delay=65 DEBUG 2023-03-01 11:35:46,098 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:35:46,098 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:35:46,154 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:35:46,154 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:35:46,155 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:35:46,155 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:35:46,155 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:35:46,155 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731946.74460327 and callback=>; now=10731916.74460327; delay=30.0 DEBUG 2023-03-01 11:35:46,155 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:35:46,155 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:35:46,155 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:36:16,098 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:36:16,099 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:36:16,156 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:36:16,156 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:36:16,156 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:36:16,157 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:36:16,157 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:36:16,157 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10731976.746439924 and callback=>; now=10731946.746439924; delay=30.0 DEBUG 2023-03-01 11:36:16,157 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:36:16,157 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:36:16,157 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:36:46,099 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:36:46,100 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:36:46,154 pika.heartbeat _check_heartbeat 124 : Received 62 heartbeat frames, sent 77, idle intervals 0 DEBUG 2023-03-01 11:36:46,155 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732041.744221086 and callback=>; now=10731976.744221086; delay=65 DEBUG 2023-03-01 11:36:46,158 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:36:46,158 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:36:46,158 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:36:46,158 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:36:46,158 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:36:46,159 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732006.748147996 and callback=>; now=10731976.748147996; delay=30.0 DEBUG 2023-03-01 11:36:46,159 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:36:46,159 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:36:46,159 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:37:16,100 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:37:16,101 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:37:16,159 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:37:16,159 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:37:16,159 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:37:16,159 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:37:16,159 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:37:16,160 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732036.749201331 and callback=>; now=10732006.749201331; delay=30.0 DEBUG 2023-03-01 11:37:16,160 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:37:16,160 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:37:16,160 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:37:46,101 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:37:46,102 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:37:46,111 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 11:37:46,111 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:37:46,111 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 8: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:37:46,112 kafka.protocol.parser _process_response 139 : Received correlation id: 8 DEBUG 2023-03-01 11:37:46,112 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 11:37:46,113 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 8 (2.063751220703125 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 11:37:46,115 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 11:37:46,160 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:37:46,160 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:37:46,161 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:37:46,161 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:37:46,161 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:37:46,161 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732066.750536187 and callback=>; now=10732036.750536187; delay=30.0 DEBUG 2023-03-01 11:37:46,161 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:37:46,161 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:37:46,161 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:37:51,158 pika.heartbeat _check_heartbeat 124 : Received 64 heartbeat frames, sent 80, idle intervals 0 DEBUG 2023-03-01 11:37:51,158 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732106.747433322 and callback=>; now=10732041.747433322; delay=65 DEBUG 2023-03-01 11:38:16,102 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:38:16,102 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:38:16,162 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:38:16,162 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:38:16,162 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:38:16,162 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:38:16,162 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:38:16,162 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732096.751934065 and callback=>; now=10732066.751934065; delay=30.0 DEBUG 2023-03-01 11:38:16,163 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:38:16,163 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:38:16,163 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:38:46,103 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:38:46,103 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:38:46,163 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:38:46,163 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:38:46,163 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:38:46,163 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:38:46,163 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:38:46,163 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732126.753036033 and callback=>; now=10732096.753036033; delay=30.0 DEBUG 2023-03-01 11:38:46,164 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:38:46,164 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:38:46,164 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:38:56,162 pika.heartbeat _check_heartbeat 124 : Received 66 heartbeat frames, sent 82, idle intervals 0 DEBUG 2023-03-01 11:38:56,162 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732171.751369426 and callback=>; now=10732106.751369426; delay=65 DEBUG 2023-03-01 11:39:16,104 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:39:16,105 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:39:16,164 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:39:16,165 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:39:16,165 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:39:16,165 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:39:16,165 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:39:16,165 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732156.754784886 and callback=>; now=10732126.754784886; delay=30.0 DEBUG 2023-03-01 11:39:16,165 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:39:16,166 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:39:16,166 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:39:27.991", "timestamp": "2023-03-01T11:39:28.094484Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:39:28,094 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 17c69242-1037-480e-845c-22100d22e834 arrived", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:39:27.991", "timestamp": "2023-03-01T11:39:28.094782Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:39:28,094 RabbitMQRPCConsumer handle 60 : Message with id 17c69242-1037-480e-845c-22100d22e834 arrived {"message": "Method called action with parameters {'message': '{\"task\":[\"document_classification\"],\"document\":[\"373\",\"371\",\"370\",\"369\",\"374\",\"193\",\"194\",\"195\",\"196\",\"375\"],\"order_by\":[\"creationDate\"],\"dataset\":[\"160\"],\"order_type\":[\"ASC\"]}'}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:39:27.991", "timestamp": "2023-03-01T11:39:28.094956Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:39:28,094 AnnotationCallback action 29 : Method called action with parameters {'message': '{"task":["document_classification"],"document":["373","371","370","369","374","193","194","195","196","375"],"order_by":["creationDate"],"dataset":["160"],"order_type":["ASC"]}'} {"message": "Method called find with parameters {'args': {'task': ['document_classification'], 'document': ['373', '371', '370', '369', '374', '193', '194', '195', '196', '375'], 'order_by': ['creationDate'], 'dataset': ['160'], 'order_type': ['ASC']}}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:39:27.991", "timestamp": "2023-03-01T11:39:28.095463Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 309} INFO 2023-03-01 11:39:28,095 AnnotationService find 309 : Method called find with parameters {'args': {'task': ['document_classification'], 'document': ['373', '371', '370', '369', '374', '193', '194', '195', '196', '375'], 'order_by': ['creationDate'], 'dataset': ['160'], 'order_type': ['ASC']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:39:27.991", "timestamp": "2023-03-01T11:39:28.095900Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 11:39:28,095 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:39:27.991", "timestamp": "2023-03-01T11:39:28.096529Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 11:39:28,096 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended find", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:39:27.991", "timestamp": "2023-03-01T11:39:28.549081Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 323} INFO 2023-03-01 11:39:28,548 AnnotationService find 323 : Method ended find {"message": "Method called build with parameters {'annotations_size': 0}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:39:27.991", "timestamp": "2023-03-01T11:39:28.549663Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 17} INFO 2023-03-01 11:39:28,549 ResponseBuilder build 17 : Method called build with parameters {'annotations_size': 0} {"message": "Method ended build", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:39:27.991", "timestamp": "2023-03-01T11:39:28.549927Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 25} INFO 2023-03-01 11:39:28,549 ResponseBuilder build 25 : Method ended build {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:39:27.991", "timestamp": "2023-03-01T11:39:28.550380Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 11:39:28,550 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:39:27.991", "timestamp": "2023-03-01T11:39:28.550592Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 11:39:28,550 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:39:27.991", "timestamp": "2023-03-01T11:39:28.550748Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 48} INFO 2023-03-01 11:39:28,550 AnnotationCallback action 48 : Method ended action {"message": "Sending response on queue annotation-request-queue_SEARCH_ANNOTATION_654308b0-abbe-49ef-acec-eff49a1f948d_1677670768075", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:39:27.991", "timestamp": "2023-03-01T11:39:28.550933Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:39:28,550 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_SEARCH_ANNOTATION_654308b0-abbe-49ef-acec-eff49a1f948d_1677670768075 DEBUG 2023-03-01 11:39:28,551 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:39:28,551 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:39:28,551 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:39:27.991", "timestamp": "2023-03-01T11:39:28.551594Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:39:28,551 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:39:27.991", "timestamp": "2023-03-01T11:39:28.551792Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:39:28,551 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:39:28,551 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:39:28,552 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:39:28,552 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:39:28,552 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:39:46,166 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:39:46,167 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:39:46,167 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:39:46,167 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:39:46,167 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:39:46,167 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732186.756803324 and callback=>; now=10732156.756803324; delay=30.0 DEBUG 2023-03-01 11:39:46,168 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:39:46,168 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:39:46,168 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.682892Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:40:00,682 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id da9d9d2e-0332-4cc8-8d5c-1fd0ec2556c8 arrived", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.683409Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:40:00,683 RabbitMQRPCConsumer handle 60 : Message with id da9d9d2e-0332-4cc8-8d5c-1fd0ec2556c8 arrived {"message": "Method called action with parameters {'message': '{\"label\":[\"2764\"],\"dataset\":[\"997\"]}'}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.683656Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:40:00,683 AnnotationCallback action 29 : Method called action with parameters {'message': '{"label":["2764"],"dataset":["997"]}'} {"message": "Method called delete_annotation_by_params with parameters {'data': {'label': ['2764'], 'dataset': ['997']}}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.684276Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 487} INFO 2023-03-01 11:40:00,684 AnnotationService delete_annotation_by_params 487 : Method called delete_annotation_by_params with parameters {'data': {'label': ['2764'], 'dataset': ['997']}} {"message": "Setup starting MongoQueryBuilder", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.684788Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "MongoQueryBuilder", "lineNumber": 14} DEBUG 2023-03-01 11:40:00,684 MongoQueryBuilder __init__ 14 : Setup starting MongoQueryBuilder {"message": "Method called _build_paginate", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.685031Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "MongoQueryBuilder", "lineNumber": 78} DEBUG 2023-03-01 11:40:00,684 MongoQueryBuilder _build_paginate 78 : Method called _build_paginate {"message": "Method ended _build_paginate", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.685237Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "MongoQueryBuilder", "lineNumber": 93} DEBUG 2023-03-01 11:40:00,685 MongoQueryBuilder _build_paginate 93 : Method ended _build_paginate {"message": "Method called _build_order", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.685439Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "MongoQueryBuilder", "lineNumber": 97} DEBUG 2023-03-01 11:40:00,685 MongoQueryBuilder _build_order 97 : Method called _build_order {"message": "Method ended _build_order", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.685631Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "MongoQueryBuilder", "lineNumber": 101} DEBUG 2023-03-01 11:40:00,685 MongoQueryBuilder _build_order 101 : Method ended _build_order {"message": "Setup ended MongoQueryBuilder", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.686053Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "MongoQueryBuilder", "lineNumber": 26} DEBUG 2023-03-01 11:40:00,685 MongoQueryBuilder __init__ 26 : Setup ended MongoQueryBuilder {"message": "Method called build", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.686286Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "MongoQueryBuilder", "lineNumber": 29} INFO 2023-03-01 11:40:00,686 MongoQueryBuilder build 29 : Method called build {"message": "Method called _build_or with parameters {'k': 'label', 'values': ['2764']}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.686494Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "MongoQueryBuilder", "lineNumber": 43} DEBUG 2023-03-01 11:40:00,686 MongoQueryBuilder _build_or 43 : Method called _build_or with parameters {'k': 'label', 'values': ['2764']} {"message": "Method ended _build_or", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.687030Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "MongoQueryBuilder", "lineNumber": 51} DEBUG 2023-03-01 11:40:00,686 MongoQueryBuilder _build_or 51 : Method ended _build_or {"message": "Method called _build_or with parameters {'k': 'dataset', 'values': ['997']}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.687254Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "MongoQueryBuilder", "lineNumber": 43} DEBUG 2023-03-01 11:40:00,687 MongoQueryBuilder _build_or 43 : Method called _build_or with parameters {'k': 'dataset', 'values': ['997']} {"message": "Method ended _build_or", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.687467Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "MongoQueryBuilder", "lineNumber": 51} DEBUG 2023-03-01 11:40:00,687 MongoQueryBuilder _build_or 51 : Method ended _build_or {"message": "Method ended build", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.687683Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "MongoQueryBuilder", "lineNumber": 39} INFO 2023-03-01 11:40:00,687 MongoQueryBuilder build 39 : Method ended build {"message": "Method ended delete_annotation_by_params", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.708103Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 506} INFO 2023-03-01 11:40:00,708 AnnotationService delete_annotation_by_params 506 : Method ended delete_annotation_by_params {"message": "Method called build with parameters {'annotations_size': 0}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.708695Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 17} INFO 2023-03-01 11:40:00,708 ResponseBuilder build 17 : Method called build with parameters {'annotations_size': 0} {"message": "Method ended build", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.708923Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 25} INFO 2023-03-01 11:40:00,708 ResponseBuilder build 25 : Method ended build {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.709283Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 11:40:00,709 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.709518Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 11:40:00,709 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.709725Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 82} INFO 2023-03-01 11:40:00,709 AnnotationCallback action 82 : Method ended action {"message": "Sending response on queue annotation-request-queue_DELETE_ANNOTATION_BY_PARAMS_daaaaf32-c83d-42a1-827f-af3d8d4c45d0_1677670800609", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.710050Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:40:00,709 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_DELETE_ANNOTATION_BY_PARAMS_daaaaf32-c83d-42a1-827f-af3d8d4c45d0_1677670800609 DEBUG 2023-03-01 11:40:00,710 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:40:00,710 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:40:00,710 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.711085Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:40:00,711 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "francesco.pandolfi", "correlationId": "IAAPI-labelDelete-2023-03-01 11:40:00.319", "timestamp": "2023-03-01T11:40:00.711355Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:40:00,711 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:40:00,711 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:40:00,711 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:40:00,712 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:40:00,712 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:40:01,163 pika.heartbeat _check_heartbeat 124 : Received 67 heartbeat frames, sent 84, idle intervals 0 DEBUG 2023-03-01 11:40:01,163 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732236.752434595 and callback=>; now=10732171.752434595; delay=65 DEBUG 2023-03-01 11:40:16,170 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:40:16,170 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:40:16,170 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:40:16,170 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:40:16,170 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:40:16,170 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732216.760070316 and callback=>; now=10732186.760070316; delay=30.0 DEBUG 2023-03-01 11:40:16,171 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:40:16,171 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:40:16,171 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:40:46,110 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:40:46,111 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:40:46,171 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:40:46,171 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:40:46,171 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:40:46,171 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:40:46,172 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:40:46,172 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732246.76127818 and callback=>; now=10732216.76127818; delay=30.0 DEBUG 2023-03-01 11:40:46,172 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:40:46,172 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:40:46,172 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:41:06,166 pika.heartbeat _check_heartbeat 124 : Received 68 heartbeat frames, sent 86, idle intervals 0 DEBUG 2023-03-01 11:41:06,167 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732301.75631804 and callback=>; now=10732236.75631804; delay=65 DEBUG 2023-03-01 11:41:16,111 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:41:16,112 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:41:16,172 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:41:16,172 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:41:16,173 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:41:16,173 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:41:16,173 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:41:16,173 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732276.762597987 and callback=>; now=10732246.762597987; delay=30.0 DEBUG 2023-03-01 11:41:16,173 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:41:16,173 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:41:16,173 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:41:46,113 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:41:46,113 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:41:46,173 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:41:46,174 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:41:46,174 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:41:46,174 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:41:46,174 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:41:46,174 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732306.763722116 and callback=>; now=10732276.763722116; delay=30.0 DEBUG 2023-03-01 11:41:46,174 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:41:46,174 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:41:46,175 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:42:11,171 pika.heartbeat _check_heartbeat 124 : Received 70 heartbeat frames, sent 88, idle intervals 0 DEBUG 2023-03-01 11:42:11,172 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732366.761288192 and callback=>; now=10732301.761288192; delay=65 DEBUG 2023-03-01 11:42:16,114 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:42:16,114 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:42:16,180 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:42:16,181 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:42:16,181 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:42:16,181 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:42:16,181 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:42:16,181 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732336.770622019 and callback=>; now=10732306.770622019; delay=30.0 DEBUG 2023-03-01 11:42:16,181 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:42:16,182 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:42:16,182 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:42:46,115 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:42:46,116 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:42:46,116 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 11:42:46,116 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:42:46,116 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 9: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:42:46,118 kafka.protocol.parser _process_response 139 : Received correlation id: 9 DEBUG 2023-03-01 11:42:46,118 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 11:42:46,119 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 9 (2.7313232421875 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 11:42:46,121 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 11:42:46,181 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:42:46,182 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:42:46,182 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:42:46,182 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:42:46,182 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:42:46,182 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732366.771985644 and callback=>; now=10732336.771985644; delay=30.0 DEBUG 2023-03-01 11:42:46,183 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:42:46,183 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:42:46,183 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:54.725", "timestamp": "2023-03-01T11:42:54.838853Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:42:54,838 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 8db018c6-5cba-460d-8b85-7b380c0bab0e arrived", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:54.725", "timestamp": "2023-03-01T11:42:54.839065Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:42:54,839 RabbitMQRPCConsumer handle 60 : Message with id 8db018c6-5cba-460d-8b85-7b380c0bab0e arrived {"message": "Method called action with parameters {'message': '{\"task\":[\"document_classification\"],\"document\":[\"373\",\"371\",\"370\",\"369\",\"374\",\"193\",\"194\",\"195\",\"196\",\"375\"],\"order_by\":[\"creationDate\"],\"dataset\":[\"160\"],\"order_type\":[\"ASC\"]}'}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:54.725", "timestamp": "2023-03-01T11:42:54.839190Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:42:54,839 AnnotationCallback action 29 : Method called action with parameters {'message': '{"task":["document_classification"],"document":["373","371","370","369","374","193","194","195","196","375"],"order_by":["creationDate"],"dataset":["160"],"order_type":["ASC"]}'} {"message": "Method called find with parameters {'args': {'task': ['document_classification'], 'document': ['373', '371', '370', '369', '374', '193', '194', '195', '196', '375'], 'order_by': ['creationDate'], 'dataset': ['160'], 'order_type': ['ASC']}}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:54.725", "timestamp": "2023-03-01T11:42:54.839575Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 309} INFO 2023-03-01 11:42:54,839 AnnotationService find 309 : Method called find with parameters {'args': {'task': ['document_classification'], 'document': ['373', '371', '370', '369', '374', '193', '194', '195', '196', '375'], 'order_by': ['creationDate'], 'dataset': ['160'], 'order_type': ['ASC']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:54.725", "timestamp": "2023-03-01T11:42:54.839946Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 11:42:54,839 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:54.725", "timestamp": "2023-03-01T11:42:54.840237Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 11:42:54,840 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended find", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:54.725", "timestamp": "2023-03-01T11:42:54.944952Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 323} INFO 2023-03-01 11:42:54,944 AnnotationService find 323 : Method ended find {"message": "Method called build with parameters {'annotations_size': 0}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:54.725", "timestamp": "2023-03-01T11:42:54.945465Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 17} INFO 2023-03-01 11:42:54,945 ResponseBuilder build 17 : Method called build with parameters {'annotations_size': 0} {"message": "Method ended build", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:54.725", "timestamp": "2023-03-01T11:42:54.945629Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 25} INFO 2023-03-01 11:42:54,945 ResponseBuilder build 25 : Method ended build {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:54.725", "timestamp": "2023-03-01T11:42:54.945949Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 11:42:54,945 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:54.725", "timestamp": "2023-03-01T11:42:54.946112Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 11:42:54,946 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:54.725", "timestamp": "2023-03-01T11:42:54.946269Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 48} INFO 2023-03-01 11:42:54,946 AnnotationCallback action 48 : Method ended action {"message": "Sending response on queue annotation-request-queue_SEARCH_ANNOTATION_5d3c0bb3-2373-4b39-85b2-02a173548d4f_1677670974818", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:54.725", "timestamp": "2023-03-01T11:42:54.946506Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:42:54,946 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_SEARCH_ANNOTATION_5d3c0bb3-2373-4b39-85b2-02a173548d4f_1677670974818 DEBUG 2023-03-01 11:42:54,946 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:42:54,946 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:42:54,946 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:54.725", "timestamp": "2023-03-01T11:42:54.947151Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:42:54,947 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:54.725", "timestamp": "2023-03-01T11:42:54.947321Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:42:54,947 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:42:54,947 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:42:54,947 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:42:54,947 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:42:54,948 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:42:57.857", "timestamp": "2023-03-01T11:42:58.008919Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:42:58,008 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 387a4aa2-bee0-4956-971c-5b59bfe1b693 arrived", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:42:57.857", "timestamp": "2023-03-01T11:42:58.009151Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:42:58,009 RabbitMQRPCConsumer handle 60 : Message with id 387a4aa2-bee0-4956-971c-5b59bfe1b693 arrived {"message": "Method called action with parameters {'message': '{\"document\":[\"373\"],\"order_by\":[\"creationDate\"],\"page\":[\"1\"],\"dataset\":[\"160\"],\"order_type\":[\"DESC\"],\"page_size\":[\"50\"]}'}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:42:57.857", "timestamp": "2023-03-01T11:42:58.009561Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:42:58,009 AnnotationCallback action 29 : Method called action with parameters {'message': '{"document":["373"],"order_by":["creationDate"],"page":["1"],"dataset":["160"],"order_type":["DESC"],"page_size":["50"]}'} {"message": "Method called count with parameters {'args': {'document': ['373'], 'order_by': ['creationDate'], 'page': ['1'], 'dataset': ['160'], 'order_type': ['DESC'], 'page_size': ['50']}}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:42:57.857", "timestamp": "2023-03-01T11:42:58.010146Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 510} INFO 2023-03-01 11:42:58,010 AnnotationService count 510 : Method called count with parameters {'args': {'document': ['373'], 'order_by': ['creationDate'], 'page': ['1'], 'dataset': ['160'], 'order_type': ['DESC'], 'page_size': ['50']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:42:57.857", "timestamp": "2023-03-01T11:42:58.010630Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 11:42:58,010 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:42:57.857", "timestamp": "2023-03-01T11:42:58.010893Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 11:42:58,010 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended count", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:42:57.857", "timestamp": "2023-03-01T11:42:58.034472Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 518} INFO 2023-03-01 11:42:58,034 AnnotationService count 518 : Method ended count {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:42:57.857", "timestamp": "2023-03-01T11:42:58.035144Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 11:42:58,035 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:42:57.857", "timestamp": "2023-03-01T11:42:58.035447Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 11:42:58,035 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:42:57.857", "timestamp": "2023-03-01T11:42:58.035628Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 52} INFO 2023-03-01 11:42:58,035 AnnotationCallback action 52 : Method ended action {"message": "Sending response on queue annotation-request-queue_COUNT_ANNOTATION_15dce8b0-209a-4b6c-9f38-b284ce202cde_1677670977977", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:42:57.857", "timestamp": "2023-03-01T11:42:58.035883Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:42:58,035 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_COUNT_ANNOTATION_15dce8b0-209a-4b6c-9f38-b284ce202cde_1677670977977 DEBUG 2023-03-01 11:42:58,036 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:42:58,036 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:42:58,036 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:42:57.857", "timestamp": "2023-03-01T11:42:58.037024Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:42:58,036 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:42:57.857", "timestamp": "2023-03-01T11:42:58.037292Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:42:58,037 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:42:58,037 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:42:58,037 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:42:58,038 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:42:58,038 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:58.797", "timestamp": "2023-03-01T11:42:58.939343Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:42:58,939 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id b2ebb674-1f30-4468-93c5-27e263601f59 arrived", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:58.797", "timestamp": "2023-03-01T11:42:58.939771Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:42:58,939 RabbitMQRPCConsumer handle 60 : Message with id b2ebb674-1f30-4468-93c5-27e263601f59 arrived {"message": "Method called action with parameters {'message': '{\"parent\":[\"1\",\"2\",\"3\",\"4\",\"5\",\"6\",\"7\",\"8\",\"9\",\"10\",\"11\"],\"task\":[\"page_classification\"],\"document\":[\"373\"],\"order_by\":[\"creationDate\"],\"dataset\":[\"160\"],\"order_type\":[\"ASC\"]}'}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:58.797", "timestamp": "2023-03-01T11:42:58.939933Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:42:58,939 AnnotationCallback action 29 : Method called action with parameters {'message': '{"parent":["1","2","3","4","5","6","7","8","9","10","11"],"task":["page_classification"],"document":["373"],"order_by":["creationDate"],"dataset":["160"],"order_type":["ASC"]}'} {"message": "Method called find with parameters {'args': {'parent': ['1', '2', '3', '4', '5', '6', '7', '8', '9', '10', '11'], 'task': ['page_classification'], 'document': ['373'], 'order_by': ['creationDate'], 'dataset': ['160'], 'order_type': ['ASC']}}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:58.797", "timestamp": "2023-03-01T11:42:58.940647Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 309} INFO 2023-03-01 11:42:58,940 AnnotationService find 309 : Method called find with parameters {'args': {'parent': ['1', '2', '3', '4', '5', '6', '7', '8', '9', '10', '11'], 'task': ['page_classification'], 'document': ['373'], 'order_by': ['creationDate'], 'dataset': ['160'], 'order_type': ['ASC']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:58.797", "timestamp": "2023-03-01T11:42:58.941315Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 11:42:58,941 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:58.797", "timestamp": "2023-03-01T11:42:58.941962Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 11:42:58,941 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended find", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:58.797", "timestamp": "2023-03-01T11:42:58.980243Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 323} INFO 2023-03-01 11:42:58,980 AnnotationService find 323 : Method ended find {"message": "Method called build with parameters {'annotations_size': 0}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:58.797", "timestamp": "2023-03-01T11:42:58.980656Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 17} INFO 2023-03-01 11:42:58,980 ResponseBuilder build 17 : Method called build with parameters {'annotations_size': 0} {"message": "Method ended build", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:58.797", "timestamp": "2023-03-01T11:42:58.981814Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 25} INFO 2023-03-01 11:42:58,981 ResponseBuilder build 25 : Method ended build {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:58.797", "timestamp": "2023-03-01T11:42:58.982241Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 11:42:58,982 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:58.797", "timestamp": "2023-03-01T11:42:58.982399Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 11:42:58,982 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:58.797", "timestamp": "2023-03-01T11:42:58.982560Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 48} INFO 2023-03-01 11:42:58,982 AnnotationCallback action 48 : Method ended action {"message": "Sending response on queue annotation-request-queue_SEARCH_ANNOTATION_0e15709f-4c25-4473-8972-06aedeef883a_1677670978920", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:58.797", "timestamp": "2023-03-01T11:42:58.982942Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:42:58,982 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_SEARCH_ANNOTATION_0e15709f-4c25-4473-8972-06aedeef883a_1677670978920 DEBUG 2023-03-01 11:42:58,983 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:42:58,983 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:42:58,983 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:58.797", "timestamp": "2023-03-01T11:42:58.983700Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:42:58,983 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:42:58.797", "timestamp": "2023-03-01T11:42:58.983908Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:42:58,983 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:42:58,984 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:42:58,984 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:42:58,984 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:42:58,984 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:43:16,174 pika.heartbeat _check_heartbeat 124 : Received 72 heartbeat frames, sent 90, idle intervals 0 DEBUG 2023-03-01 11:43:16,174 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732431.763385093 and callback=>; now=10732366.763385093; delay=65 DEBUG 2023-03-01 11:43:16,183 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:43:16,183 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:43:16,184 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:43:16,184 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:43:16,184 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:43:16,184 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732396.773625296 and callback=>; now=10732366.773625296; delay=30.0 DEBUG 2023-03-01 11:43:16,184 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:43:16,184 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:43:16,185 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:43:46,117 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:43:46,117 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:43:46,185 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:43:46,185 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:43:46,185 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:43:46,185 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:43:46,186 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:43:46,186 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732426.775333252 and callback=>; now=10732396.775333252; delay=30.0 DEBUG 2023-03-01 11:43:46,186 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:43:46,186 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:43:46,186 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:43:57.414", "timestamp": "2023-03-01T11:43:57.458793Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:43:57,458 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id ded2a363-9c4d-48c2-908d-fed55edfba25 arrived", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:43:57.414", "timestamp": "2023-03-01T11:43:57.459060Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:43:57,459 RabbitMQRPCConsumer handle 60 : Message with id ded2a363-9c4d-48c2-908d-fed55edfba25 arrived {"message": "Method called action with parameters {'message': '{\"documentsIds\":[373,371,370,369,374,193,194,195,196,375],\"datasetVersionId\":160}'}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:43:57.414", "timestamp": "2023-03-01T11:43:57.459237Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:43:57,459 AnnotationCallback action 29 : Method called action with parameters {'message': '{"documentsIds":[373,371,370,369,374,193,194,195,196,375],"datasetVersionId":160}'} {"message": "Method called get_annotation_counts_by_validation_and_documents_in_dataset with parameters {'data': {'documentsIds': [373, 371, 370, 369, 374, 193, 194, 195, 196, 375], 'datasetVersionId': 160}}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:43:57.414", "timestamp": "2023-03-01T11:43:57.459700Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 69} INFO 2023-03-01 11:43:57,459 AnnotationService get_annotation_counts_by_validation_and_documents_in_dataset 69 : Method called get_annotation_counts_by_validation_and_documents_in_dataset with parameters {'data': {'documentsIds': [373, 371, 370, 369, 374, 193, 194, 195, 196, 375], 'datasetVersionId': 160}} {"message": "Method ended get_annotation_counts_by_validation_and_documents_in_dataset", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:43:57.414", "timestamp": "2023-03-01T11:43:57.470112Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 105} INFO 2023-03-01 11:43:57,470 AnnotationService get_annotation_counts_by_validation_and_documents_in_dataset 105 : Method ended get_annotation_counts_by_validation_and_documents_in_dataset {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:43:57.414", "timestamp": "2023-03-01T11:43:57.470589Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 11:43:57,470 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:43:57.414", "timestamp": "2023-03-01T11:43:57.470818Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 11:43:57,470 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:43:57.414", "timestamp": "2023-03-01T11:43:57.470974Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 56} INFO 2023-03-01 11:43:57,470 AnnotationCallback action 56 : Method ended action {"message": "Sending response on queue annotation-request-queue_COUNT_VALIDATION_BY_DOCUMENTS_af6c9add-24eb-4dfa-9110-33b6faea0acb_1677671037433", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:43:57.414", "timestamp": "2023-03-01T11:43:57.471288Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:43:57,471 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_COUNT_VALIDATION_BY_DOCUMENTS_af6c9add-24eb-4dfa-9110-33b6faea0acb_1677671037433 DEBUG 2023-03-01 11:43:57,471 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:43:57,471 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:43:57,471 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:43:57.414", "timestamp": "2023-03-01T11:43:57.471929Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:43:57,471 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 11:43:57.414", "timestamp": "2023-03-01T11:43:57.472110Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:43:57,472 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:43:57,472 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:43:57,472 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:43:57,472 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:43:57,472 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:44:16,190 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:44:16,190 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:44:16,191 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:44:16,191 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:44:16,191 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:44:16,191 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732456.780983392 and callback=>; now=10732426.780983392; delay=30.0 DEBUG 2023-03-01 11:44:16,192 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:44:16,192 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:44:16,192 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:44:21,176 pika.heartbeat _check_heartbeat 124 : Received 73 heartbeat frames, sent 93, idle intervals 0 DEBUG 2023-03-01 11:44:21,176 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732496.7659743 and callback=>; now=10732431.7659743; delay=65 DEBUG 2023-03-01 11:44:46,119 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:44:46,120 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:44:46,192 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:44:46,192 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:44:46,192 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:44:46,192 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:44:46,192 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:44:46,192 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732486.781984136 and callback=>; now=10732456.781984136; delay=30.0 DEBUG 2023-03-01 11:44:46,193 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:44:46,193 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:44:46,193 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:45:16,139 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:45:16,139 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:45:16,193 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:45:16,193 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:45:16,193 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:45:16,193 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:45:16,194 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:45:16,194 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732516.783319578 and callback=>; now=10732486.783319578; delay=30.0 DEBUG 2023-03-01 11:45:16,194 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:45:16,194 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:45:16,194 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:45:26,182 pika.heartbeat _check_heartbeat 124 : Received 75 heartbeat frames, sent 95, idle intervals 0 DEBUG 2023-03-01 11:45:26,182 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732561.771495638 and callback=>; now=10732496.771495638; delay=65 {"message": "Method called handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.169", "timestamp": "2023-03-01T11:45:45.376883Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:45:45,376 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 365ebf02-e87c-4a1b-b9b6-9ecfc7500b3f arrived", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.169", "timestamp": "2023-03-01T11:45:45.377180Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:45:45,377 RabbitMQRPCConsumer handle 60 : Message with id 365ebf02-e87c-4a1b-b9b6-9ecfc7500b3f arrived {"message": "Method called action with parameters {'message': '{\"document\":[\"373\"],\"order_by\":[\"creationDate\"],\"page\":[\"1\"],\"dataset\":[\"160\"],\"order_type\":[\"DESC\"],\"page_size\":[\"50\"]}'}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.169", "timestamp": "2023-03-01T11:45:45.377372Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:45:45,377 AnnotationCallback action 29 : Method called action with parameters {'message': '{"document":["373"],"order_by":["creationDate"],"page":["1"],"dataset":["160"],"order_type":["DESC"],"page_size":["50"]}'} {"message": "Method called count with parameters {'args': {'document': ['373'], 'order_by': ['creationDate'], 'page': ['1'], 'dataset': ['160'], 'order_type': ['DESC'], 'page_size': ['50']}}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.169", "timestamp": "2023-03-01T11:45:45.377939Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 510} INFO 2023-03-01 11:45:45,377 AnnotationService count 510 : Method called count with parameters {'args': {'document': ['373'], 'order_by': ['creationDate'], 'page': ['1'], 'dataset': ['160'], 'order_type': ['DESC'], 'page_size': ['50']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.169", "timestamp": "2023-03-01T11:45:45.378326Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 11:45:45,378 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.169", "timestamp": "2023-03-01T11:45:45.378520Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 11:45:45,378 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended count", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.169", "timestamp": "2023-03-01T11:45:45.384565Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 518} INFO 2023-03-01 11:45:45,384 AnnotationService count 518 : Method ended count {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.169", "timestamp": "2023-03-01T11:45:45.384906Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 11:45:45,384 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.169", "timestamp": "2023-03-01T11:45:45.385091Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 11:45:45,385 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.169", "timestamp": "2023-03-01T11:45:45.385262Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 52} INFO 2023-03-01 11:45:45,385 AnnotationCallback action 52 : Method ended action {"message": "Sending response on queue annotation-request-queue_COUNT_ANNOTATION_c534c66c-dfa0-4537-b52e-6d87653bbaf3_1677671145348", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.169", "timestamp": "2023-03-01T11:45:45.385417Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:45:45,385 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_COUNT_ANNOTATION_c534c66c-dfa0-4537-b52e-6d87653bbaf3_1677671145348 DEBUG 2023-03-01 11:45:45,385 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:45:45,385 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:45:45,385 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.169", "timestamp": "2023-03-01T11:45:45.386166Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:45:45,386 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.169", "timestamp": "2023-03-01T11:45:45.386394Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:45:45,386 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:45:45,386 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:45:45,386 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:45:45,386 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:45:45,386 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.873", "timestamp": "2023-03-01T11:45:46.019952Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:45:46,019 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id f15a0ba1-1f8b-4e76-8589-0fa12a9c7fe8 arrived", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.873", "timestamp": "2023-03-01T11:45:46.020229Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:45:46,020 RabbitMQRPCConsumer handle 60 : Message with id f15a0ba1-1f8b-4e76-8589-0fa12a9c7fe8 arrived {"message": "Method called action with parameters {'message': '{\"parent\":[\"1\"],\"document\":[\"373\"],\"order_by\":[\"creationDate\"],\"dataset\":[\"160\"],\"order_type\":[\"DESC\"]}'}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.873", "timestamp": "2023-03-01T11:45:46.020403Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:45:46,020 AnnotationCallback action 29 : Method called action with parameters {'message': '{"parent":["1"],"document":["373"],"order_by":["creationDate"],"dataset":["160"],"order_type":["DESC"]}'} {"message": "Method called count with parameters {'args': {'parent': ['1'], 'document': ['373'], 'order_by': ['creationDate'], 'dataset': ['160'], 'order_type': ['DESC']}}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.873", "timestamp": "2023-03-01T11:45:46.020845Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 510} INFO 2023-03-01 11:45:46,020 AnnotationService count 510 : Method called count with parameters {'args': {'parent': ['1'], 'document': ['373'], 'order_by': ['creationDate'], 'dataset': ['160'], 'order_type': ['DESC']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.873", "timestamp": "2023-03-01T11:45:46.021231Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 11:45:46,021 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.873", "timestamp": "2023-03-01T11:45:46.021496Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 11:45:46,021 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended count", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.873", "timestamp": "2023-03-01T11:45:46.032622Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 518} INFO 2023-03-01 11:45:46,032 AnnotationService count 518 : Method ended count {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.873", "timestamp": "2023-03-01T11:45:46.032989Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 11:45:46,032 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.873", "timestamp": "2023-03-01T11:45:46.033143Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 11:45:46,033 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.873", "timestamp": "2023-03-01T11:45:46.033304Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 52} INFO 2023-03-01 11:45:46,033 AnnotationCallback action 52 : Method ended action {"message": "Sending response on queue annotation-request-queue_COUNT_ANNOTATION_f39bec7c-7cb6-49fe-a374-51dce60eedbc_1677671146003", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.873", "timestamp": "2023-03-01T11:45:46.033445Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:45:46,033 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_COUNT_ANNOTATION_f39bec7c-7cb6-49fe-a374-51dce60eedbc_1677671146003 DEBUG 2023-03-01 11:45:46,033 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:45:46,033 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:45:46,033 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.873", "timestamp": "2023-03-01T11:45:46.034145Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:45:46,034 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:45:45.873", "timestamp": "2023-03-01T11:45:46.034289Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:45:46,034 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:45:46,034 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:45:46,034 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:45:46,034 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:45:46,034 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:45:46,195 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:45:46,196 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:45:46,197 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:45:46,199 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:45:46,200 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:45:46,200 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732546.789599422 and callback=>; now=10732516.789599422; delay=30.0 DEBUG 2023-03-01 11:45:46,201 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:45:46,201 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:45:46,201 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:46:16,144 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:46:16,144 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:46:16,201 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:46:16,201 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:46:16,202 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:46:16,202 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:46:16,202 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:46:16,202 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732576.791929528 and callback=>; now=10732546.791929528; delay=30.0 DEBUG 2023-03-01 11:46:16,203 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:46:16,203 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:46:16,203 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:46:31,186 pika.heartbeat _check_heartbeat 124 : Received 76 heartbeat frames, sent 97, idle intervals 0 DEBUG 2023-03-01 11:46:31,186 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732626.775395183 and callback=>; now=10732561.775395183; delay=65 DEBUG 2023-03-01 11:46:46,145 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:46:46,146 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:46:46,203 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:46:46,203 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:46:46,203 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:46:46,203 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:46:46,203 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:46:46,203 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732606.79283426 and callback=>; now=10732576.79283426; delay=30.0 DEBUG 2023-03-01 11:46:46,203 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:46:46,204 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:46:46,204 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:47:16,146 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:47:16,147 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:47:16,204 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:47:16,204 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:47:16,204 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:47:16,205 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:47:16,205 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:47:16,205 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732636.794500723 and callback=>; now=10732606.794500723; delay=30.0 DEBUG 2023-03-01 11:47:16,205 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:47:16,205 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:47:16,205 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:47:36,191 pika.heartbeat _check_heartbeat 124 : Received 78 heartbeat frames, sent 99, idle intervals 0 DEBUG 2023-03-01 11:47:36,191 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732691.78043428 and callback=>; now=10732626.78043428; delay=65 DEBUG 2023-03-01 11:47:46,121 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 11:47:46,122 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:47:46,122 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 10: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:47:46,123 kafka.protocol.parser _process_response 139 : Received correlation id: 10 DEBUG 2023-03-01 11:47:46,123 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 11:47:46,125 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 10 (2.7093887329101562 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 11:47:46,126 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 11:47:46,147 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:47:46,148 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:47:46,206 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:47:46,206 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:47:46,206 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:47:46,207 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:47:46,207 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:47:46,207 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732666.796515366 and callback=>; now=10732636.796515366; delay=30.0 DEBUG 2023-03-01 11:47:46,207 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:47:46,207 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:47:46,207 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:48:07.214", "timestamp": "2023-03-01T11:48:07.353581Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:48:07,353 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id e7a37000-ed64-4a17-83ff-70ab91847ce3 arrived", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:48:07.214", "timestamp": "2023-03-01T11:48:07.353858Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:48:07,353 RabbitMQRPCConsumer handle 60 : Message with id e7a37000-ed64-4a17-83ff-70ab91847ce3 arrived {"message": "Method called action with parameters {'message': '{\"task\":[\"document_classification\"],\"document\":[\"373\",\"371\",\"370\",\"369\",\"374\",\"193\",\"194\",\"195\",\"196\",\"375\"],\"order_by\":[\"creationDate\"],\"dataset\":[\"160\"],\"order_type\":[\"ASC\"]}'}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:48:07.214", "timestamp": "2023-03-01T11:48:07.354105Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:48:07,354 AnnotationCallback action 29 : Method called action with parameters {'message': '{"task":["document_classification"],"document":["373","371","370","369","374","193","194","195","196","375"],"order_by":["creationDate"],"dataset":["160"],"order_type":["ASC"]}'} {"message": "Method called find with parameters {'args': {'task': ['document_classification'], 'document': ['373', '371', '370', '369', '374', '193', '194', '195', '196', '375'], 'order_by': ['creationDate'], 'dataset': ['160'], 'order_type': ['ASC']}}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:48:07.214", "timestamp": "2023-03-01T11:48:07.354496Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 309} INFO 2023-03-01 11:48:07,354 AnnotationService find 309 : Method called find with parameters {'args': {'task': ['document_classification'], 'document': ['373', '371', '370', '369', '374', '193', '194', '195', '196', '375'], 'order_by': ['creationDate'], 'dataset': ['160'], 'order_type': ['ASC']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:48:07.214", "timestamp": "2023-03-01T11:48:07.354881Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 11:48:07,354 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:48:07.214", "timestamp": "2023-03-01T11:48:07.355177Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 11:48:07,355 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended find", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:48:07.214", "timestamp": "2023-03-01T11:48:07.443543Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 323} INFO 2023-03-01 11:48:07,443 AnnotationService find 323 : Method ended find {"message": "Method called build with parameters {'annotations_size': 0}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:48:07.214", "timestamp": "2023-03-01T11:48:07.444057Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 17} INFO 2023-03-01 11:48:07,443 ResponseBuilder build 17 : Method called build with parameters {'annotations_size': 0} {"message": "Method ended build", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:48:07.214", "timestamp": "2023-03-01T11:48:07.444361Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 25} INFO 2023-03-01 11:48:07,444 ResponseBuilder build 25 : Method ended build {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:48:07.214", "timestamp": "2023-03-01T11:48:07.444677Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 11:48:07,444 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:48:07.214", "timestamp": "2023-03-01T11:48:07.444887Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 11:48:07,444 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:48:07.214", "timestamp": "2023-03-01T11:48:07.445057Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 48} INFO 2023-03-01 11:48:07,445 AnnotationCallback action 48 : Method ended action {"message": "Sending response on queue annotation-request-queue_SEARCH_ANNOTATION_1bd495dc-b4e3-496f-bf8b-59e052efac0e_1677671287322", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:48:07.214", "timestamp": "2023-03-01T11:48:07.445271Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:48:07,445 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_SEARCH_ANNOTATION_1bd495dc-b4e3-496f-bf8b-59e052efac0e_1677671287322 DEBUG 2023-03-01 11:48:07,445 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:48:07,445 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:48:07,446 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:48:07.214", "timestamp": "2023-03-01T11:48:07.446309Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:48:07,446 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationGet-2023-03-01 11:48:07.214", "timestamp": "2023-03-01T11:48:07.446662Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:48:07,446 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:48:07,446 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:48:07,447 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:48:07,447 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:48:07,447 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:08.191", "timestamp": "2023-03-01T11:48:08.351899Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:48:08,351 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 8cd8bd9d-8062-4c71-a16e-0e375396c699 arrived", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:08.191", "timestamp": "2023-03-01T11:48:08.352197Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:48:08,352 RabbitMQRPCConsumer handle 60 : Message with id 8cd8bd9d-8062-4c71-a16e-0e375396c699 arrived {"message": "Method called action with parameters {'message': '{\"document\":[\"373\"],\"order_by\":[\"creationDate\"],\"page\":[\"1\"],\"dataset\":[\"160\"],\"order_type\":[\"DESC\"],\"page_size\":[\"50\"]}'}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:08.191", "timestamp": "2023-03-01T11:48:08.352419Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:48:08,352 AnnotationCallback action 29 : Method called action with parameters {'message': '{"document":["373"],"order_by":["creationDate"],"page":["1"],"dataset":["160"],"order_type":["DESC"],"page_size":["50"]}'} {"message": "Method called count with parameters {'args': {'document': ['373'], 'order_by': ['creationDate'], 'page': ['1'], 'dataset': ['160'], 'order_type': ['DESC'], 'page_size': ['50']}}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:08.191", "timestamp": "2023-03-01T11:48:08.352872Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 510} INFO 2023-03-01 11:48:08,352 AnnotationService count 510 : Method called count with parameters {'args': {'document': ['373'], 'order_by': ['creationDate'], 'page': ['1'], 'dataset': ['160'], 'order_type': ['DESC'], 'page_size': ['50']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:08.191", "timestamp": "2023-03-01T11:48:08.353347Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 11:48:08,353 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:08.191", "timestamp": "2023-03-01T11:48:08.353600Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 11:48:08,353 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended count", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:08.191", "timestamp": "2023-03-01T11:48:08.378956Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 518} INFO 2023-03-01 11:48:08,378 AnnotationService count 518 : Method ended count {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:08.191", "timestamp": "2023-03-01T11:48:08.379445Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 11:48:08,379 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:08.191", "timestamp": "2023-03-01T11:48:08.379645Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 11:48:08,379 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:08.191", "timestamp": "2023-03-01T11:48:08.379813Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 52} INFO 2023-03-01 11:48:08,379 AnnotationCallback action 52 : Method ended action {"message": "Sending response on queue annotation-request-queue_COUNT_ANNOTATION_68f4fd42-321b-4bc4-b63f-9cd6e057e85f_1677671288316", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:08.191", "timestamp": "2023-03-01T11:48:08.380042Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:48:08,379 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_COUNT_ANNOTATION_68f4fd42-321b-4bc4-b63f-9cd6e057e85f_1677671288316 DEBUG 2023-03-01 11:48:08,380 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:48:08,380 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:48:08,380 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:08.191", "timestamp": "2023-03-01T11:48:08.380714Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:48:08,380 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:08.191", "timestamp": "2023-03-01T11:48:08.380877Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:48:08,380 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:48:08,381 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:48:08,381 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:48:08,381 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:48:08,381 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:09.098", "timestamp": "2023-03-01T11:48:09.372158Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:48:09,372 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 0c3731a9-bc39-4329-b929-500f81c538bf arrived", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:09.098", "timestamp": "2023-03-01T11:48:09.372486Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:48:09,372 RabbitMQRPCConsumer handle 60 : Message with id 0c3731a9-bc39-4329-b929-500f81c538bf arrived {"message": "Method called action with parameters {'message': '{\"parent\":[\"1\"],\"document\":[\"373\"],\"order_by\":[\"creationDate\"],\"dataset\":[\"160\"],\"order_type\":[\"DESC\"]}'}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:09.098", "timestamp": "2023-03-01T11:48:09.372661Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:48:09,372 AnnotationCallback action 29 : Method called action with parameters {'message': '{"parent":["1"],"document":["373"],"order_by":["creationDate"],"dataset":["160"],"order_type":["DESC"]}'} {"message": "Method called count with parameters {'args': {'parent': ['1'], 'document': ['373'], 'order_by': ['creationDate'], 'dataset': ['160'], 'order_type': ['DESC']}}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:09.098", "timestamp": "2023-03-01T11:48:09.373157Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 510} INFO 2023-03-01 11:48:09,373 AnnotationService count 510 : Method called count with parameters {'args': {'parent': ['1'], 'document': ['373'], 'order_by': ['creationDate'], 'dataset': ['160'], 'order_type': ['DESC']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:09.098", "timestamp": "2023-03-01T11:48:09.373489Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 11:48:09,373 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:09.098", "timestamp": "2023-03-01T11:48:09.373719Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 11:48:09,373 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended count", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:09.098", "timestamp": "2023-03-01T11:48:09.383147Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 518} INFO 2023-03-01 11:48:09,383 AnnotationService count 518 : Method ended count {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:09.098", "timestamp": "2023-03-01T11:48:09.383539Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 11:48:09,383 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:09.098", "timestamp": "2023-03-01T11:48:09.383735Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 11:48:09,383 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:09.098", "timestamp": "2023-03-01T11:48:09.383913Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 52} INFO 2023-03-01 11:48:09,383 AnnotationCallback action 52 : Method ended action {"message": "Sending response on queue annotation-request-queue_COUNT_ANNOTATION_7d42d25e-cd03-441e-9bc8-bd6434357b55_1677671289328", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:09.098", "timestamp": "2023-03-01T11:48:09.384277Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:48:09,384 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_COUNT_ANNOTATION_7d42d25e-cd03-441e-9bc8-bd6434357b55_1677671289328 DEBUG 2023-03-01 11:48:09,384 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:48:09,384 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:48:09,384 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:09.098", "timestamp": "2023-03-01T11:48:09.384985Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:48:09,384 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "tonino.bagnato", "correlationId": "IAAPI-annotationCount-2023-03-01 11:48:09.098", "timestamp": "2023-03-01T11:48:09.385125Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:48:09,385 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:48:09,385 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:48:09,385 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:48:09,385 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:48:09,385 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "timestamp": "2023-03-01T11:48:14.538882Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:48:14,538 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 4f85d35b-7284-4c75-9bfe-72322dd92288 arrived", "tenant": "altilia", "timestamp": "2023-03-01T11:48:14.539187Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:48:14,539 RabbitMQRPCConsumer handle 60 : Message with id 4f85d35b-7284-4c75-9bfe-72322dd92288 arrived {"message": "Method called action with parameters {'message': '{\"annotations\": []}'}", "tenant": "altilia", "timestamp": "2023-03-01T11:48:14.539408Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:48:14,539 AnnotationCallback action 29 : Method called action with parameters {'message': '{"annotations": []}'} {"message": "Method called bulk_insert_annotations with parameters {'data': {'annotations': []}}", "tenant": "altilia", "timestamp": "2023-03-01T11:48:14.539920Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 575} INFO 2023-03-01 11:48:14,539 AnnotationService bulk_insert_annotations 575 : Method called bulk_insert_annotations with parameters {'data': {'annotations': []}} {"message": "Method problem action. documents must be a non-empty list", "tenant": "altilia", "timestamp": "2023-03-01T11:48:14.540490Z", "level": "WARNING", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 134} WARNING 2023-03-01 11:48:14,540 AnnotationCallback action 134 : Method problem action. documents must be a non-empty list {"message": "Sending response on queue amq.gen-736t2LMCTjJszdcACOAL6g", "tenant": "altilia", "timestamp": "2023-03-01T11:48:14.540765Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:48:14,540 RabbitMQRPCConsumer handle 63 : Sending response on queue amq.gen-736t2LMCTjJszdcACOAL6g DEBUG 2023-03-01 11:48:14,541 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:48:14,541 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:48:14,541 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "timestamp": "2023-03-01T11:48:14.541494Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:48:14,541 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "timestamp": "2023-03-01T11:48:14.541722Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:48:14,541 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:48:14,542 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:48:14,542 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:48:14,542 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:48:14,543 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:48:16,210 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:48:16,210 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:48:16,210 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:48:16,210 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:48:16,210 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:48:16,210 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732696.799964707 and callback=>; now=10732666.799964707; delay=30.0 DEBUG 2023-03-01 11:48:16,211 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:48:16,211 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:48:16,211 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:48:41,194 pika.heartbeat _check_heartbeat 124 : Received 79 heartbeat frames, sent 101, idle intervals 0 DEBUG 2023-03-01 11:48:41,194 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732756.783395186 and callback=>; now=10732691.783395186; delay=65 DEBUG 2023-03-01 11:48:46,152 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:48:46,152 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:48:46,211 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:48:46,212 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:48:46,212 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:48:46,212 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:48:46,212 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:48:46,212 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732726.801901365 and callback=>; now=10732696.801901365; delay=30.0 DEBUG 2023-03-01 11:48:46,213 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:48:46,213 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:48:46,213 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "timestamp": "2023-03-01T11:48:48.225615Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 11:48:48,225 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 161a3d2a-6663-4bf6-8724-a9080f13a564 arrived", "tenant": "altilia", "timestamp": "2023-03-01T11:48:48.225974Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 11:48:48,225 RabbitMQRPCConsumer handle 60 : Message with id 161a3d2a-6663-4bf6-8724-a9080f13a564 arrived {"message": "Method called action with parameters {'message': '{\"annotations\": []}'}", "tenant": "altilia", "timestamp": "2023-03-01T11:48:48.226163Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 11:48:48,226 AnnotationCallback action 29 : Method called action with parameters {'message': '{"annotations": []}'} {"message": "Method called bulk_insert_annotations with parameters {'data': {'annotations': []}}", "tenant": "altilia", "timestamp": "2023-03-01T11:48:48.226655Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 575} INFO 2023-03-01 11:48:48,226 AnnotationService bulk_insert_annotations 575 : Method called bulk_insert_annotations with parameters {'data': {'annotations': []}} {"message": "Method problem action. documents must be a non-empty list", "tenant": "altilia", "timestamp": "2023-03-01T11:48:48.227223Z", "level": "WARNING", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 134} WARNING 2023-03-01 11:48:48,227 AnnotationCallback action 134 : Method problem action. documents must be a non-empty list {"message": "Sending response on queue amq.gen-4sWKWkK-e0m_3S-imEGalw", "tenant": "altilia", "timestamp": "2023-03-01T11:48:48.227482Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 11:48:48,227 RabbitMQRPCConsumer handle 63 : Sending response on queue amq.gen-4sWKWkK-e0m_3S-imEGalw DEBUG 2023-03-01 11:48:48,227 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:48:48,227 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:48:48,228 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "timestamp": "2023-03-01T11:48:48.228247Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 11:48:48,228 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "timestamp": "2023-03-01T11:48:48.228449Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 11:48:48,228 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 11:48:48,228 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:48:48,228 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:48:48,229 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:48:48,229 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:49:16,214 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:49:16,214 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:49:16,214 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:49:16,214 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:49:16,214 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:49:16,215 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732756.80412778 and callback=>; now=10732726.80412778; delay=30.0 DEBUG 2023-03-01 11:49:16,215 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:49:16,215 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:49:16,215 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:49:46,153 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:49:46,153 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:49:46,195 pika.heartbeat _check_heartbeat 124 : Received 81 heartbeat frames, sent 103, idle intervals 0 DEBUG 2023-03-01 11:49:46,195 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732821.784302108 and callback=>; now=10732756.784302108; delay=65 DEBUG 2023-03-01 11:49:46,216 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:49:46,216 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:49:46,216 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:49:46,217 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:49:46,217 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:49:46,217 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732786.806347053 and callback=>; now=10732756.806347053; delay=30.0 DEBUG 2023-03-01 11:49:46,217 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:49:46,217 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:49:46,217 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:50:16,153 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:50:16,153 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:50:16,218 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:50:16,218 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:50:16,218 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:50:16,218 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:50:16,219 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:50:16,219 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732816.808297347 and callback=>; now=10732786.808297347; delay=30.0 DEBUG 2023-03-01 11:50:16,219 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:50:16,219 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:50:16,219 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:50:46,155 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:50:46,155 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:50:46,219 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:50:46,220 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:50:46,220 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:50:46,220 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:50:46,220 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:50:46,220 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732846.809827616 and callback=>; now=10732816.809827616; delay=30.0 DEBUG 2023-03-01 11:50:46,220 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:50:46,221 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:50:46,221 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:50:51,198 pika.heartbeat _check_heartbeat 124 : Received 83 heartbeat frames, sent 106, idle intervals 0 DEBUG 2023-03-01 11:50:51,198 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732886.78733439 and callback=>; now=10732821.78733439; delay=65 DEBUG 2023-03-01 11:51:16,154 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:51:16,154 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:51:16,221 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:51:16,221 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:51:16,221 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:51:16,221 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:51:16,222 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:51:16,222 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732876.81138096 and callback=>; now=10732846.81138096; delay=30.0 DEBUG 2023-03-01 11:51:16,222 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:51:16,222 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:51:16,222 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:51:46,155 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:51:46,155 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:51:46,223 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:51:46,223 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:51:46,223 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:51:46,223 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:51:46,223 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:51:46,223 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732906.812895792 and callback=>; now=10732876.812895792; delay=30.0 DEBUG 2023-03-01 11:51:46,223 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:51:46,224 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:51:46,224 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:51:56,202 pika.heartbeat _check_heartbeat 124 : Received 85 heartbeat frames, sent 108, idle intervals 0 DEBUG 2023-03-01 11:51:56,202 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732951.791354015 and callback=>; now=10732886.791354015; delay=65 DEBUG 2023-03-01 11:52:16,156 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:52:16,156 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:52:16,224 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:52:16,225 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:52:16,225 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:52:16,225 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:52:16,225 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:52:16,226 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732936.81530728 and callback=>; now=10732906.81530728; delay=30.0 DEBUG 2023-03-01 11:52:16,226 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:52:16,226 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:52:16,226 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:52:46,127 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 11:52:46,127 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:52:46,128 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 11: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:52:46,129 kafka.protocol.parser _process_response 139 : Received correlation id: 11 DEBUG 2023-03-01 11:52:46,129 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 11:52:46,130 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 11 (2.359628677368164 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 11:52:46,131 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 11:52:46,156 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:52:46,157 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:52:46,226 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:52:46,226 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:52:46,227 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:52:46,227 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:52:46,227 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:52:46,227 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732966.816569816 and callback=>; now=10732936.816569816; delay=30.0 DEBUG 2023-03-01 11:52:46,227 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:52:46,227 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:52:46,227 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:53:01,206 pika.heartbeat _check_heartbeat 124 : Received 87 heartbeat frames, sent 110, idle intervals 0 DEBUG 2023-03-01 11:53:01,206 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733016.79550846 and callback=>; now=10732951.79550846; delay=65 DEBUG 2023-03-01 11:53:16,157 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:53:16,158 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:53:16,228 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:53:16,228 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:53:16,228 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:53:16,229 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:53:16,229 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:53:16,229 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10732996.818359775 and callback=>; now=10732966.818359775; delay=30.0 DEBUG 2023-03-01 11:53:16,229 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:53:16,229 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:53:16,229 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:53:46,158 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:53:46,158 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:53:46,230 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:53:46,230 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:53:46,230 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:53:46,230 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:53:46,230 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:53:46,231 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733026.82011355 and callback=>; now=10732996.82011355; delay=30.0 DEBUG 2023-03-01 11:53:46,231 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:53:46,231 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:53:46,231 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:54:06,222 pika.heartbeat _check_heartbeat 124 : Received 89 heartbeat frames, sent 112, idle intervals 0 DEBUG 2023-03-01 11:54:06,222 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733081.811415901 and callback=>; now=10733016.811415901; delay=65 DEBUG 2023-03-01 11:54:16,159 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:54:16,159 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:54:16,231 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:54:16,231 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:54:16,231 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:54:16,231 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:54:16,231 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:54:16,232 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733056.8212228 and callback=>; now=10733026.8212228; delay=30.0 DEBUG 2023-03-01 11:54:16,232 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:54:16,232 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:54:16,232 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:54:46,161 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:54:46,162 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:54:46,232 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:54:46,232 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:54:46,233 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:54:46,233 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:54:46,233 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:54:46,233 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733086.822714305 and callback=>; now=10733056.822714305; delay=30.0 DEBUG 2023-03-01 11:54:46,233 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:54:46,234 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:54:46,234 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:55:11,229 pika.heartbeat _check_heartbeat 124 : Received 91 heartbeat frames, sent 114, idle intervals 0 DEBUG 2023-03-01 11:55:11,229 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733146.818407336 and callback=>; now=10733081.818407336; delay=65 DEBUG 2023-03-01 11:55:16,161 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:55:16,162 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:55:16,234 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:55:16,234 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:55:16,234 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:55:16,235 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:55:16,235 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:55:16,235 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733116.824416485 and callback=>; now=10733086.824416485; delay=30.0 DEBUG 2023-03-01 11:55:16,235 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:55:16,235 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:55:16,235 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:55:46,162 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:55:46,162 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:55:46,236 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:55:46,236 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:55:46,236 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:55:46,236 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:55:46,236 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:55:46,236 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733146.82587313 and callback=>; now=10733116.82587313; delay=30.0 DEBUG 2023-03-01 11:55:46,237 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:55:46,237 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:55:46,237 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:56:16,163 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:56:16,163 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:56:16,230 pika.heartbeat _check_heartbeat 124 : Received 94 heartbeat frames, sent 116, idle intervals 0 DEBUG 2023-03-01 11:56:16,231 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733211.820068331 and callback=>; now=10733146.820068331; delay=65 DEBUG 2023-03-01 11:56:16,237 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:56:16,237 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:56:16,237 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:56:16,237 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:56:16,237 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:56:16,238 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733176.827180194 and callback=>; now=10733146.827180194; delay=30.0 DEBUG 2023-03-01 11:56:16,238 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:56:16,238 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:56:16,238 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:56:46,166 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:56:46,166 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:56:46,238 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:56:46,239 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:56:46,239 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:56:46,239 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:56:46,239 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:56:46,239 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733206.828581307 and callback=>; now=10733176.828581307; delay=30.0 DEBUG 2023-03-01 11:56:46,239 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:56:46,239 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:56:46,239 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:57:16,165 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:57:16,166 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:57:16,242 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:57:16,243 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:57:16,243 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:57:16,244 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:57:16,244 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:57:16,244 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733236.833783716 and callback=>; now=10733206.833783716; delay=30.0 DEBUG 2023-03-01 11:57:16,245 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:57:16,245 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:57:16,245 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:57:21,236 pika.heartbeat _check_heartbeat 124 : Received 96 heartbeat frames, sent 119, idle intervals 0 DEBUG 2023-03-01 11:57:21,236 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733276.82561386 and callback=>; now=10733211.82561386; delay=65 DEBUG 2023-03-01 11:57:46,133 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 11:57:46,133 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:57:46,133 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 12: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 11:57:46,134 kafka.protocol.parser _process_response 139 : Received correlation id: 12 DEBUG 2023-03-01 11:57:46,135 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 11:57:46,136 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 12 (2.5680065155029297 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 11:57:46,137 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 11:57:46,169 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:57:46,170 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:57:46,245 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:57:46,245 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:57:46,245 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:57:46,246 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:57:46,246 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:57:46,246 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733266.835454656 and callback=>; now=10733236.835454656; delay=30.0 DEBUG 2023-03-01 11:57:46,246 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:57:46,246 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:57:46,246 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:58:16,169 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:58:16,170 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:58:16,246 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:58:16,246 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:58:16,247 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:58:16,247 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:58:16,247 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:58:16,247 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733296.836569676 and callback=>; now=10733266.836569676; delay=30.0 DEBUG 2023-03-01 11:58:16,247 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:58:16,247 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:58:16,247 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:58:26,242 pika.heartbeat _check_heartbeat 124 : Received 98 heartbeat frames, sent 121, idle intervals 0 DEBUG 2023-03-01 11:58:26,242 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733341.831340762 and callback=>; now=10733276.831340762; delay=65 DEBUG 2023-03-01 11:58:46,171 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:58:46,171 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:58:46,247 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:58:46,248 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:58:46,248 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:58:46,248 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:58:46,248 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:58:46,248 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733326.837703623 and callback=>; now=10733296.837703623; delay=30.0 DEBUG 2023-03-01 11:58:46,248 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:58:46,248 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:58:46,249 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:59:16,172 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:59:16,172 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:59:16,248 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:59:16,249 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:59:16,249 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:59:16,249 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:59:16,249 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:59:16,250 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733356.83911477 and callback=>; now=10733326.83911477; delay=30.0 DEBUG 2023-03-01 11:59:16,250 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:59:16,250 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:59:16,250 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 11:59:31,246 pika.heartbeat _check_heartbeat 124 : Received 100 heartbeat frames, sent 123, idle intervals 0 DEBUG 2023-03-01 11:59:31,246 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733406.835601352 and callback=>; now=10733341.835601352; delay=65 DEBUG 2023-03-01 11:59:46,173 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 11:59:46,173 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 11:59:46,251 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 11:59:46,251 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 11:59:46,251 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 11:59:46,251 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 11:59:46,252 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 11:59:46,252 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733386.841661047 and callback=>; now=10733356.841661047; delay=30.0 DEBUG 2023-03-01 11:59:46,252 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 11:59:46,252 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 11:59:46,252 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:00:16,174 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:00:16,174 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:00:16,253 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:00:16,253 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:00:16,253 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:00:16,253 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:00:16,254 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:00:16,254 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733416.843347616 and callback=>; now=10733386.843347616; delay=30.0 DEBUG 2023-03-01 12:00:16,254 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:00:16,254 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:00:16,254 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:00:36,250 pika.heartbeat _check_heartbeat 124 : Received 102 heartbeat frames, sent 125, idle intervals 0 DEBUG 2023-03-01 12:00:36,250 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733471.839327928 and callback=>; now=10733406.839327928; delay=65 DEBUG 2023-03-01 12:00:46,175 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:00:46,175 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:00:46,255 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:00:46,255 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:00:46,256 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:00:46,256 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:00:46,256 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:00:46,256 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733446.845761081 and callback=>; now=10733416.845761081; delay=30.0 DEBUG 2023-03-01 12:00:46,257 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:00:46,257 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:00:46,257 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:01:16,176 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:01:16,176 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:01:16,257 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:01:16,257 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:01:16,257 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:01:16,257 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:01:16,258 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:01:16,258 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733476.847237574 and callback=>; now=10733446.847237574; delay=30.0 DEBUG 2023-03-01 12:01:16,258 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:01:16,258 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:01:16,258 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:01:41,254 pika.heartbeat _check_heartbeat 124 : Received 104 heartbeat frames, sent 127, idle intervals 0 DEBUG 2023-03-01 12:01:41,254 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733536.843439482 and callback=>; now=10733471.843439482; delay=65 DEBUG 2023-03-01 12:01:46,178 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:01:46,178 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:01:46,258 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:01:46,259 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:01:46,259 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:01:46,259 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:01:46,259 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:01:46,259 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733506.848797873 and callback=>; now=10733476.848797873; delay=30.0 DEBUG 2023-03-01 12:01:46,259 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:01:46,260 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:01:46,260 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:02:16,179 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:02:16,179 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:02:16,260 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:02:16,261 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:02:16,261 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:02:16,261 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:02:16,261 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:02:16,261 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733536.85084082 and callback=>; now=10733506.85084082; delay=30.0 DEBUG 2023-03-01 12:02:16,262 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:02:16,262 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:02:16,262 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:02:46,138 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 12:02:46,139 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:02:46,139 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 13: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:02:46,140 kafka.protocol.parser _process_response 139 : Received correlation id: 13 DEBUG 2023-03-01 12:02:46,140 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 12:02:46,141 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 13 (2.0797252655029297 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 12:02:46,142 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 12:02:46,180 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:02:46,180 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:02:46,255 pika.heartbeat _check_heartbeat 124 : Received 107 heartbeat frames, sent 129, idle intervals 0 DEBUG 2023-03-01 12:02:46,255 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733601.844686538 and callback=>; now=10733536.844686538; delay=65 DEBUG 2023-03-01 12:02:46,263 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:02:46,274 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:02:46,274 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:02:46,274 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:02:46,274 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:02:46,275 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733566.864199566 and callback=>; now=10733536.864199566; delay=30.0 DEBUG 2023-03-01 12:02:46,275 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:02:46,275 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:02:46,275 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:03:16,181 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:03:16,181 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:03:16,276 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:03:16,276 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:03:16,276 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:03:16,276 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:03:16,276 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:03:16,276 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733596.866016036 and callback=>; now=10733566.866016036; delay=30.0 DEBUG 2023-03-01 12:03:16,277 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:03:16,277 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:03:16,277 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 12:03:21.012", "timestamp": "2023-03-01T12:03:21.067674Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 12:03:21,067 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 04fa7c5b-e0ec-4b43-8f3e-43613bdd48df arrived", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 12:03:21.012", "timestamp": "2023-03-01T12:03:21.067957Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 12:03:21,067 RabbitMQRPCConsumer handle 60 : Message with id 04fa7c5b-e0ec-4b43-8f3e-43613bdd48df arrived {"message": "Method called action with parameters {'message': '{\"documentsIds\":[40544,40549,40574,41406,41421,41447,41452,41463],\"skillExecutionId\":412}'}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 12:03:21.012", "timestamp": "2023-03-01T12:03:21.068134Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 12:03:21,068 AnnotationCallback action 29 : Method called action with parameters {'message': '{"documentsIds":[40544,40549,40574,41406,41421,41447,41452,41463],"skillExecutionId":412}'} {"message": "Method called get_annotation_counts_by_validation_and_documents_in_skill_execution with parameters {'data': {'documentsIds': [40544, 40549, 40574, 41406, 41421, 41447, 41452, 41463], 'skillExecutionId': 412}}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 12:03:21.012", "timestamp": "2023-03-01T12:03:21.068566Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 110} INFO 2023-03-01 12:03:21,068 AnnotationService get_annotation_counts_by_validation_and_documents_in_skill_execution 110 : Method called get_annotation_counts_by_validation_and_documents_in_skill_execution with parameters {'data': {'documentsIds': [40544, 40549, 40574, 41406, 41421, 41447, 41452, 41463], 'skillExecutionId': 412}} {"message": "Method ended get_annotation_counts_by_validation_and_documents_in_skill_execution", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 12:03:21.012", "timestamp": "2023-03-01T12:03:21.137991Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 146} INFO 2023-03-01 12:03:21,137 AnnotationService get_annotation_counts_by_validation_and_documents_in_skill_execution 146 : Method ended get_annotation_counts_by_validation_and_documents_in_skill_execution {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 12:03:21.012", "timestamp": "2023-03-01T12:03:21.138565Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 12:03:21,138 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 12:03:21.012", "timestamp": "2023-03-01T12:03:21.138795Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 12:03:21,138 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 12:03:21.012", "timestamp": "2023-03-01T12:03:21.138978Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 56} INFO 2023-03-01 12:03:21,138 AnnotationCallback action 56 : Method ended action {"message": "Sending response on queue annotation-request-queue_COUNT_VALIDATION_BY_DOCUMENTS_26fced93-6b10-4e19-ae17-1c5572a2b4c0_1677672201028", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 12:03:21.012", "timestamp": "2023-03-01T12:03:21.139166Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 12:03:21,139 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_COUNT_VALIDATION_BY_DOCUMENTS_26fced93-6b10-4e19-ae17-1c5572a2b4c0_1677672201028 DEBUG 2023-03-01 12:03:21,139 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:03:21,139 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:03:21,139 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 12:03:21.012", "timestamp": "2023-03-01T12:03:21.139729Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 12:03:21,139 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationValidationCountByDocuments-2023-03-01 12:03:21.012", "timestamp": "2023-03-01T12:03:21.139901Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 12:03:21,139 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 12:03:21,140 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:03:21,140 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:03:21,140 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:03:21,140 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationValidationCountByPages-2023-03-01 12:03:26.044", "timestamp": "2023-03-01T12:03:26.130010Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 12:03:26,129 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 6a65d804-62b3-487a-9764-b5aeb292b456 arrived", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationValidationCountByPages-2023-03-01 12:03:26.044", "timestamp": "2023-03-01T12:03:26.130225Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 12:03:26,130 RabbitMQRPCConsumer handle 60 : Message with id 6a65d804-62b3-487a-9764-b5aeb292b456 arrived {"message": "Method called action with parameters {'message': '{\"pages\":[1,2,3,4,5,6,7,8,9,10],\"documentId\":40574,\"skillExecutionId\":412}'}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationValidationCountByPages-2023-03-01 12:03:26.044", "timestamp": "2023-03-01T12:03:26.130400Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 12:03:26,130 AnnotationCallback action 29 : Method called action with parameters {'message': '{"pages":[1,2,3,4,5,6,7,8,9,10],"documentId":40574,"skillExecutionId":412}'} {"message": "Method called get_annotation_counts_by_validation_and_pages_in_skill_execution with parameters {'data': {'pages': [1, 2, 3, 4, 5, 6, 7, 8, 9, 10], 'documentId': 40574, 'skillExecutionId': 412}}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationValidationCountByPages-2023-03-01 12:03:26.044", "timestamp": "2023-03-01T12:03:26.130887Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 203} INFO 2023-03-01 12:03:26,130 AnnotationService get_annotation_counts_by_validation_and_pages_in_skill_execution 203 : Method called get_annotation_counts_by_validation_and_pages_in_skill_execution with parameters {'data': {'pages': [1, 2, 3, 4, 5, 6, 7, 8, 9, 10], 'documentId': 40574, 'skillExecutionId': 412}} {"message": "Method ended get_annotation_counts_by_validation_and_pages_in_skill_execution", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationValidationCountByPages-2023-03-01 12:03:26.044", "timestamp": "2023-03-01T12:03:26.154406Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 241} INFO 2023-03-01 12:03:26,154 AnnotationService get_annotation_counts_by_validation_and_pages_in_skill_execution 241 : Method ended get_annotation_counts_by_validation_and_pages_in_skill_execution {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationValidationCountByPages-2023-03-01 12:03:26.044", "timestamp": "2023-03-01T12:03:26.154891Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 12:03:26,154 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationValidationCountByPages-2023-03-01 12:03:26.044", "timestamp": "2023-03-01T12:03:26.155170Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 12:03:26,155 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationValidationCountByPages-2023-03-01 12:03:26.044", "timestamp": "2023-03-01T12:03:26.155394Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 60} INFO 2023-03-01 12:03:26,155 AnnotationCallback action 60 : Method ended action {"message": "Sending response on queue annotation-request-queue_COUNT_VALIDATION_BY_PAGES_7ce520bb-ca2e-46ea-b031-991e41c37f79_1677672206061", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationValidationCountByPages-2023-03-01 12:03:26.044", "timestamp": "2023-03-01T12:03:26.155553Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 12:03:26,155 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_COUNT_VALIDATION_BY_PAGES_7ce520bb-ca2e-46ea-b031-991e41c37f79_1677672206061 DEBUG 2023-03-01 12:03:26,155 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:03:26,155 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:03:26,155 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationValidationCountByPages-2023-03-01 12:03:26.044", "timestamp": "2023-03-01T12:03:26.156138Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 12:03:26,156 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationValidationCountByPages-2023-03-01 12:03:26.044", "timestamp": "2023-03-01T12:03:26.156474Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 12:03:26,156 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 12:03:26,156 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:03:26,157 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:03:26,157 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:03:26,157 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:42.321", "timestamp": "2023-03-01T12:03:42.473595Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 12:03:42,473 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id c78c8e27-1189-4d22-adf3-dc3c1ccbd166 arrived", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:42.321", "timestamp": "2023-03-01T12:03:42.473822Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 12:03:42,473 RabbitMQRPCConsumer handle 60 : Message with id c78c8e27-1189-4d22-adf3-dc3c1ccbd166 arrived {"message": "Method called action with parameters {'message': '{\"skillExecution\":[\"412\"],\"document\":[\"40544\"]}'}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:42.321", "timestamp": "2023-03-01T12:03:42.474188Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 12:03:42,474 AnnotationCallback action 29 : Method called action with parameters {'message': '{"skillExecution":["412"],"document":["40544"]}'} {"message": "Method called count with parameters {'args': {'skillExecution': ['412'], 'document': ['40544']}}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:42.321", "timestamp": "2023-03-01T12:03:42.474610Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 510} INFO 2023-03-01 12:03:42,474 AnnotationService count 510 : Method called count with parameters {'args': {'skillExecution': ['412'], 'document': ['40544']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:42.321", "timestamp": "2023-03-01T12:03:42.475083Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 12:03:42,475 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:42.321", "timestamp": "2023-03-01T12:03:42.475304Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 12:03:42,475 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended count", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:42.321", "timestamp": "2023-03-01T12:03:42.497708Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 518} INFO 2023-03-01 12:03:42,497 AnnotationService count 518 : Method ended count {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:42.321", "timestamp": "2023-03-01T12:03:42.498205Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 12:03:42,498 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:42.321", "timestamp": "2023-03-01T12:03:42.498356Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 12:03:42,498 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:42.321", "timestamp": "2023-03-01T12:03:42.498468Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 52} INFO 2023-03-01 12:03:42,498 AnnotationCallback action 52 : Method ended action {"message": "Sending response on queue annotation-request-queue_COUNT_ANNOTATION_8736d761-2595-416c-8952-9bc2639ce472_1677672222377", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:42.321", "timestamp": "2023-03-01T12:03:42.498657Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 12:03:42,498 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_COUNT_ANNOTATION_8736d761-2595-416c-8952-9bc2639ce472_1677672222377 DEBUG 2023-03-01 12:03:42,498 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:03:42,499 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:03:42,499 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:42.321", "timestamp": "2023-03-01T12:03:42.499420Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 12:03:42,499 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:42.321", "timestamp": "2023-03-01T12:03:42.499630Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 12:03:42,499 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 12:03:42,499 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:03:42,500 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:03:42,500 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:03:42,500 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:44.162", "timestamp": "2023-03-01T12:03:44.234367Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 12:03:44,234 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 8faa4d3b-be5f-4951-935a-75d1d497d15a arrived", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:44.162", "timestamp": "2023-03-01T12:03:44.234567Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 12:03:44,234 RabbitMQRPCConsumer handle 60 : Message with id 8faa4d3b-be5f-4951-935a-75d1d497d15a arrived {"message": "Method called action with parameters {'message': '{\"parent\":[\"1\"],\"skillExecution\":[\"412\"],\"document\":[\"40544\"],\"order_by\":[\"creationDate\"],\"order_type\":[\"DESC\"]}'}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:44.162", "timestamp": "2023-03-01T12:03:44.234694Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 12:03:44,234 AnnotationCallback action 29 : Method called action with parameters {'message': '{"parent":["1"],"skillExecution":["412"],"document":["40544"],"order_by":["creationDate"],"order_type":["DESC"]}'} {"message": "Method called count with parameters {'args': {'parent': ['1'], 'skillExecution': ['412'], 'document': ['40544'], 'order_by': ['creationDate'], 'order_type': ['DESC']}}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:44.162", "timestamp": "2023-03-01T12:03:44.235032Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 510} INFO 2023-03-01 12:03:44,234 AnnotationService count 510 : Method called count with parameters {'args': {'parent': ['1'], 'skillExecution': ['412'], 'document': ['40544'], 'order_by': ['creationDate'], 'order_type': ['DESC']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:44.162", "timestamp": "2023-03-01T12:03:44.235344Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 12:03:44,235 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:44.162", "timestamp": "2023-03-01T12:03:44.235818Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 12:03:44,235 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended count", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:44.162", "timestamp": "2023-03-01T12:03:44.243438Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 518} INFO 2023-03-01 12:03:44,243 AnnotationService count 518 : Method ended count {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:44.162", "timestamp": "2023-03-01T12:03:44.243816Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 12:03:44,243 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:44.162", "timestamp": "2023-03-01T12:03:44.243961Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 12:03:44,243 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:44.162", "timestamp": "2023-03-01T12:03:44.244071Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 52} INFO 2023-03-01 12:03:44,244 AnnotationCallback action 52 : Method ended action {"message": "Sending response on queue annotation-request-queue_COUNT_ANNOTATION_ebaa9a01-f8c4-46e2-9750-b4275a8c0cff_1677672224178", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:44.162", "timestamp": "2023-03-01T12:03:44.244199Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 12:03:44,244 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_COUNT_ANNOTATION_ebaa9a01-f8c4-46e2-9750-b4275a8c0cff_1677672224178 DEBUG 2023-03-01 12:03:44,244 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:03:44,244 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:03:44,244 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:44.162", "timestamp": "2023-03-01T12:03:44.244663Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 12:03:44,244 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:03:44.162", "timestamp": "2023-03-01T12:03:44.244797Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 12:03:44,244 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 12:03:44,244 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:03:44,245 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:03:44,245 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:03:44,245 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:03:46,278 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:03:46,278 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:03:46,278 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:03:46,278 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:03:46,278 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:03:46,278 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733626.867904602 and callback=>; now=10733596.867904602; delay=30.0 DEBUG 2023-03-01 12:03:46,279 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:03:46,279 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:03:46,279 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:03:51,258 pika.heartbeat _check_heartbeat 124 : Received 108 heartbeat frames, sent 132, idle intervals 0 DEBUG 2023-03-01 12:03:51,258 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733666.847935157 and callback=>; now=10733601.847935157; delay=65 {"message": "Method called handle", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:06.671", "timestamp": "2023-03-01T12:04:06.731212Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 12:04:06,731 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 0332b190-0c09-40ba-875c-4ada52ff9e94 arrived", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:06.671", "timestamp": "2023-03-01T12:04:06.731724Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 12:04:06,731 RabbitMQRPCConsumer handle 60 : Message with id 0332b190-0c09-40ba-875c-4ada52ff9e94 arrived {"message": "Method called action with parameters {'message': '{\"skillExecution\":[\"404\"]}'}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:06.671", "timestamp": "2023-03-01T12:04:06.731908Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 12:04:06,731 AnnotationCallback action 29 : Method called action with parameters {'message': '{"skillExecution":["404"]}'} {"message": "Method called count with parameters {'args': {'skillExecution': ['404']}}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:06.671", "timestamp": "2023-03-01T12:04:06.732591Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 510} INFO 2023-03-01 12:04:06,732 AnnotationService count 510 : Method called count with parameters {'args': {'skillExecution': ['404']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:06.671", "timestamp": "2023-03-01T12:04:06.733277Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 12:04:06,733 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:06.671", "timestamp": "2023-03-01T12:04:06.733778Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 12:04:06,733 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended count", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:06.671", "timestamp": "2023-03-01T12:04:06.739285Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 518} INFO 2023-03-01 12:04:06,739 AnnotationService count 518 : Method ended count {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:06.671", "timestamp": "2023-03-01T12:04:06.739721Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 12:04:06,739 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:06.671", "timestamp": "2023-03-01T12:04:06.739930Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 12:04:06,739 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:06.671", "timestamp": "2023-03-01T12:04:06.740233Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 52} INFO 2023-03-01 12:04:06,740 AnnotationCallback action 52 : Method ended action {"message": "Sending response on queue annotation-request-queue_COUNT_ANNOTATION_9798d7e3-e231-4883-88af-242a88ac4f17_1677672246691", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:06.671", "timestamp": "2023-03-01T12:04:06.740605Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 12:04:06,740 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_COUNT_ANNOTATION_9798d7e3-e231-4883-88af-242a88ac4f17_1677672246691 DEBUG 2023-03-01 12:04:06,740 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:04:06,741 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:04:06,741 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:06.671", "timestamp": "2023-03-01T12:04:06.741450Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 12:04:06,741 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:06.671", "timestamp": "2023-03-01T12:04:06.741699Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 12:04:06,741 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 12:04:06,742 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:04:06,742 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:04:06,742 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:04:06,742 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:09.236", "timestamp": "2023-03-01T12:04:09.281242Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 12:04:09,281 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 67565f51-9314-4ea6-8a95-ee8bcb7d371e arrived", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:09.236", "timestamp": "2023-03-01T12:04:09.281540Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 12:04:09,281 RabbitMQRPCConsumer handle 60 : Message with id 67565f51-9314-4ea6-8a95-ee8bcb7d371e arrived {"message": "Method called action with parameters {'message': '{\"document\":[\"41413\"]}'}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:09.236", "timestamp": "2023-03-01T12:04:09.281767Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 12:04:09,281 AnnotationCallback action 29 : Method called action with parameters {'message': '{"document":["41413"]}'} {"message": "Method called count with parameters {'args': {'document': ['41413']}}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:09.236", "timestamp": "2023-03-01T12:04:09.282331Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 510} INFO 2023-03-01 12:04:09,282 AnnotationService count 510 : Method called count with parameters {'args': {'document': ['41413']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:09.236", "timestamp": "2023-03-01T12:04:09.282811Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 12:04:09,282 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:09.236", "timestamp": "2023-03-01T12:04:09.283076Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 12:04:09,283 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended count", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:09.236", "timestamp": "2023-03-01T12:04:09.288032Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 518} INFO 2023-03-01 12:04:09,287 AnnotationService count 518 : Method ended count {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:09.236", "timestamp": "2023-03-01T12:04:09.288655Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 12:04:09,288 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:09.236", "timestamp": "2023-03-01T12:04:09.288858Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 12:04:09,288 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:09.236", "timestamp": "2023-03-01T12:04:09.289045Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 52} INFO 2023-03-01 12:04:09,288 AnnotationCallback action 52 : Method ended action {"message": "Sending response on queue annotation-request-queue_COUNT_ANNOTATION_f4e3520d-503a-4de6-9926-209e8d2c2b42_1677672249262", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:09.236", "timestamp": "2023-03-01T12:04:09.289266Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 12:04:09,289 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_COUNT_ANNOTATION_f4e3520d-503a-4de6-9926-209e8d2c2b42_1677672249262 DEBUG 2023-03-01 12:04:09,289 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:04:09,289 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:04:09,289 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:09.236", "timestamp": "2023-03-01T12:04:09.290037Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 12:04:09,289 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:04:09.236", "timestamp": "2023-03-01T12:04:09.290222Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 12:04:09,290 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 12:04:09,290 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:04:09,290 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:04:09,290 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:04:09,290 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:04:16,280 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:04:16,281 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:04:16,281 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:04:16,281 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:04:16,281 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:04:16,282 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733656.871047813 and callback=>; now=10733626.871047813; delay=30.0 DEBUG 2023-03-01 12:04:16,282 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:04:16,282 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:04:16,282 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:04:46,185 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:04:46,185 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:04:46,282 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:04:46,282 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:04:46,282 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:04:46,283 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:04:46,283 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:04:46,283 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733686.873018602 and callback=>; now=10733656.873018602; delay=30.0 DEBUG 2023-03-01 12:04:46,284 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:04:46,284 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:04:46,284 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:04:56,262 pika.heartbeat _check_heartbeat 124 : Received 109 heartbeat frames, sent 134, idle intervals 0 DEBUG 2023-03-01 12:04:56,262 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733731.851665165 and callback=>; now=10733666.851665165; delay=65 {"message": "Method called handle", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:07.109", "timestamp": "2023-03-01T12:05:07.249185Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 12:05:07,249 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 9f12db48-c16d-4beb-afbe-d5c5f5fddd2a arrived", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:07.109", "timestamp": "2023-03-01T12:05:07.249455Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 12:05:07,249 RabbitMQRPCConsumer handle 60 : Message with id 9f12db48-c16d-4beb-afbe-d5c5f5fddd2a arrived {"message": "Method called action with parameters {'message': '{\"skillExecution\":[\"413\"]}'}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:07.109", "timestamp": "2023-03-01T12:05:07.249611Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 12:05:07,249 AnnotationCallback action 29 : Method called action with parameters {'message': '{"skillExecution":["413"]}'} {"message": "Method called count with parameters {'args': {'skillExecution': ['413']}}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:07.109", "timestamp": "2023-03-01T12:05:07.250231Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 510} INFO 2023-03-01 12:05:07,250 AnnotationService count 510 : Method called count with parameters {'args': {'skillExecution': ['413']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:07.109", "timestamp": "2023-03-01T12:05:07.250670Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 12:05:07,250 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:07.109", "timestamp": "2023-03-01T12:05:07.250887Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 12:05:07,250 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended count", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:07.109", "timestamp": "2023-03-01T12:05:07.274198Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 518} INFO 2023-03-01 12:05:07,274 AnnotationService count 518 : Method ended count {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:07.109", "timestamp": "2023-03-01T12:05:07.274581Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 12:05:07,274 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:07.109", "timestamp": "2023-03-01T12:05:07.274768Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 12:05:07,274 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:07.109", "timestamp": "2023-03-01T12:05:07.274918Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 52} INFO 2023-03-01 12:05:07,274 AnnotationCallback action 52 : Method ended action {"message": "Sending response on queue annotation-request-queue_COUNT_ANNOTATION_107cd404-7801-434b-9d90-8122bb7fcd7e_1677672307129", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:07.109", "timestamp": "2023-03-01T12:05:07.275105Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 12:05:07,275 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_COUNT_ANNOTATION_107cd404-7801-434b-9d90-8122bb7fcd7e_1677672307129 DEBUG 2023-03-01 12:05:07,275 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:05:07,275 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:05:07,275 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:07.109", "timestamp": "2023-03-01T12:05:07.275830Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 12:05:07,275 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:07.109", "timestamp": "2023-03-01T12:05:07.276012Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 12:05:07,275 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 12:05:07,276 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:05:07,276 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:05:07,276 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:05:07,276 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:14.253", "timestamp": "2023-03-01T12:05:14.287956Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 12:05:14,287 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 76a5f1b9-baf5-4546-ac05-e018e545b471 arrived", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:14.253", "timestamp": "2023-03-01T12:05:14.288306Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 12:05:14,288 RabbitMQRPCConsumer handle 60 : Message with id 76a5f1b9-baf5-4546-ac05-e018e545b471 arrived {"message": "Method called action with parameters {'message': '{\"document\":[\"41400\"]}'}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:14.253", "timestamp": "2023-03-01T12:05:14.288510Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 12:05:14,288 AnnotationCallback action 29 : Method called action with parameters {'message': '{"document":["41400"]}'} {"message": "Method called count with parameters {'args': {'document': ['41400']}}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:14.253", "timestamp": "2023-03-01T12:05:14.288906Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 510} INFO 2023-03-01 12:05:14,288 AnnotationService count 510 : Method called count with parameters {'args': {'document': ['41400']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:14.253", "timestamp": "2023-03-01T12:05:14.289226Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 12:05:14,289 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:14.253", "timestamp": "2023-03-01T12:05:14.289444Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 12:05:14,289 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended count", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:14.253", "timestamp": "2023-03-01T12:05:14.294572Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 518} INFO 2023-03-01 12:05:14,294 AnnotationService count 518 : Method ended count {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:14.253", "timestamp": "2023-03-01T12:05:14.295081Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 12:05:14,295 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:14.253", "timestamp": "2023-03-01T12:05:14.295277Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 12:05:14,295 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:14.253", "timestamp": "2023-03-01T12:05:14.295426Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 52} INFO 2023-03-01 12:05:14,295 AnnotationCallback action 52 : Method ended action {"message": "Sending response on queue annotation-request-queue_COUNT_ANNOTATION_2c3088cb-027b-40e5-8e67-a0c092608e77_1677672314269", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:14.253", "timestamp": "2023-03-01T12:05:14.295612Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 12:05:14,295 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_COUNT_ANNOTATION_2c3088cb-027b-40e5-8e67-a0c092608e77_1677672314269 DEBUG 2023-03-01 12:05:14,295 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:05:14,296 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:05:14,296 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:14.253", "timestamp": "2023-03-01T12:05:14.296412Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 12:05:14,296 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:14.253", "timestamp": "2023-03-01T12:05:14.296684Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 12:05:14,296 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 12:05:14,296 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:05:14,297 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:05:14,297 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:05:14,297 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:05:16,286 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:05:16,287 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:05:16,287 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:05:16,287 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:05:16,287 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:05:16,287 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733716.87667348 and callback=>; now=10733686.87667348; delay=30.0 DEBUG 2023-03-01 12:05:16,287 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:05:16,287 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:05:16,287 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: {"message": "Method called handle", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:16.619", "timestamp": "2023-03-01T12:05:16.691116Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 59} INFO 2023-03-01 12:05:16,691 RabbitMQRPCConsumer handle 59 : Method called handle {"message": "Message with id 42258b35-734c-4318-9640-6ecdb04383d9 arrived", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:16.619", "timestamp": "2023-03-01T12:05:16.691408Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 60} INFO 2023-03-01 12:05:16,691 RabbitMQRPCConsumer handle 60 : Message with id 42258b35-734c-4318-9640-6ecdb04383d9 arrived {"message": "Method called action with parameters {'message': '{\"skillExecution\":[\"413\"],\"document\":[\"41400\"]}'}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:16.619", "timestamp": "2023-03-01T12:05:16.691546Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 29} INFO 2023-03-01 12:05:16,691 AnnotationCallback action 29 : Method called action with parameters {'message': '{"skillExecution":["413"],"document":["41400"]}'} {"message": "Method called count with parameters {'args': {'skillExecution': ['413'], 'document': ['41400']}}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:16.619", "timestamp": "2023-03-01T12:05:16.691878Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 510} INFO 2023-03-01 12:05:16,691 AnnotationService count 510 : Method called count with parameters {'args': {'skillExecution': ['413'], 'document': ['41400']}} {"message": "Setup starting PipelineBuilder", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:16.619", "timestamp": "2023-03-01T12:05:16.692187Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 21} DEBUG 2023-03-01 12:05:16,692 PipelineBuilder __init__ 21 : Setup starting PipelineBuilder {"message": "Setup ended PipelineBuilder", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:16.619", "timestamp": "2023-03-01T12:05:16.692373Z", "level": "DEBUG", "pid": 6, "threadName": "MainThread", "source": "PipelineBuilder", "lineNumber": 24} DEBUG 2023-03-01 12:05:16,692 PipelineBuilder __init__ 24 : Setup ended PipelineBuilder {"message": "Method ended count", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:16.619", "timestamp": "2023-03-01T12:05:16.698074Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationService", "lineNumber": 518} INFO 2023-03-01 12:05:16,697 AnnotationService count 518 : Method ended count {"message": "Method called build_response_message_payload with parameters {}", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:16.619", "timestamp": "2023-03-01T12:05:16.698573Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 58} INFO 2023-03-01 12:05:16,698 ResponseBuilder build_response_message_payload 58 : Method called build_response_message_payload with parameters {} {"message": "Method ended build_response_message_payload", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:16.619", "timestamp": "2023-03-01T12:05:16.698801Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "ResponseBuilder", "lineNumber": 70} INFO 2023-03-01 12:05:16,698 ResponseBuilder build_response_message_payload 70 : Method ended build_response_message_payload {"message": "Method ended action", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:16.619", "timestamp": "2023-03-01T12:05:16.699302Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "AnnotationCallback", "lineNumber": 52} INFO 2023-03-01 12:05:16,699 AnnotationCallback action 52 : Method ended action {"message": "Sending response on queue annotation-request-queue_COUNT_ANNOTATION_080e2e0e-0a7c-4f64-b573-e5e9ee721d1b_1677672316655", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:16.619", "timestamp": "2023-03-01T12:05:16.699511Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 63} INFO 2023-03-01 12:05:16,699 RabbitMQRPCConsumer handle 63 : Sending response on queue annotation-request-queue_COUNT_ANNOTATION_080e2e0e-0a7c-4f64-b573-e5e9ee721d1b_1677672316655 DEBUG 2023-03-01 12:05:16,699 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:05:16,699 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:05:16,699 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: {"message": "Response sended", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:16.619", "timestamp": "2023-03-01T12:05:16.700191Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 68} INFO 2023-03-01 12:05:16,700 RabbitMQRPCConsumer handle 68 : Response sended {"message": "Method ended handle", "tenant": "altilia", "user": "antonio.patrizio", "correlationId": "IAAPI-annotationCount-2023-03-01 12:05:16.619", "timestamp": "2023-03-01T12:05:16.700464Z", "level": "INFO", "pid": 6, "threadName": "MainThread", "source": "RabbitMQRPCConsumer", "lineNumber": 70} INFO 2023-03-01 12:05:16,700 RabbitMQRPCConsumer handle 70 : Method ended handle DEBUG 2023-03-01 12:05:16,700 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:05:16,701 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:05:16,701 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:05:16,701 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:05:46,290 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:05:46,290 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:05:46,290 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:05:46,290 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:05:46,290 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:05:46,290 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733746.880030164 and callback=>; now=10733716.880030164; delay=30.0 DEBUG 2023-03-01 12:05:46,291 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:05:46,291 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:05:46,291 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:06:01,264 pika.heartbeat _check_heartbeat 124 : Received 109 heartbeat frames, sent 136, idle intervals 0 DEBUG 2023-03-01 12:06:01,264 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733796.853374336 and callback=>; now=10733731.853374336; delay=65 DEBUG 2023-03-01 12:06:16,189 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:06:16,189 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:06:16,291 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:06:16,291 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:06:16,292 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:06:16,292 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:06:16,292 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:06:16,292 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733776.881548056 and callback=>; now=10733746.881548056; delay=30.0 DEBUG 2023-03-01 12:06:16,292 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:06:16,292 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:06:16,292 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:06:46,189 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:06:46,189 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:06:46,292 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:06:46,293 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:06:46,293 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:06:46,293 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:06:46,293 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:06:46,293 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733806.882588416 and callback=>; now=10733776.882588416; delay=30.0 DEBUG 2023-03-01 12:06:46,293 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:06:46,293 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:06:46,293 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:07:06,270 pika.heartbeat _check_heartbeat 124 : Received 111 heartbeat frames, sent 138, idle intervals 0 DEBUG 2023-03-01 12:07:06,270 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733861.859441897 and callback=>; now=10733796.859441897; delay=65 DEBUG 2023-03-01 12:07:16,195 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:07:16,195 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:07:16,294 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:07:16,294 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:07:16,294 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:07:16,294 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:07:16,295 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:07:16,295 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733836.884303095 and callback=>; now=10733806.884303095; delay=30.0 DEBUG 2023-03-01 12:07:16,295 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:07:16,295 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:07:16,295 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:07:46,143 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 12:07:46,144 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:07:46,144 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 14: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:07:46,145 kafka.protocol.parser _process_response 139 : Received correlation id: 14 DEBUG 2023-03-01 12:07:46,145 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 12:07:46,146 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 14 (2.3870468139648438 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 12:07:46,148 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 12:07:46,196 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:07:46,196 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:07:46,295 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:07:46,296 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:07:46,296 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:07:46,296 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:07:46,296 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:07:46,296 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733866.885714928 and callback=>; now=10733836.885714928; delay=30.0 DEBUG 2023-03-01 12:07:46,296 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:07:46,296 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:07:46,297 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:08:11,274 pika.heartbeat _check_heartbeat 124 : Received 113 heartbeat frames, sent 140, idle intervals 0 DEBUG 2023-03-01 12:08:11,274 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733926.863391973 and callback=>; now=10733861.863391973; delay=65 DEBUG 2023-03-01 12:08:16,196 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:08:16,197 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:08:16,296 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:08:16,297 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:08:16,297 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:08:16,297 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:08:16,297 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:08:16,297 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733896.886726417 and callback=>; now=10733866.886726417; delay=30.0 DEBUG 2023-03-01 12:08:16,297 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:08:16,298 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:08:16,298 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:08:46,197 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:08:46,198 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:08:46,298 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:08:46,298 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:08:46,299 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:08:46,299 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:08:46,299 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:08:46,299 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733926.88860974 and callback=>; now=10733896.88860974; delay=30.0 DEBUG 2023-03-01 12:08:46,299 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:08:46,299 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:08:46,299 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:09:16,198 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:09:16,198 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:09:16,275 pika.heartbeat _check_heartbeat 124 : Received 116 heartbeat frames, sent 142, idle intervals 0 DEBUG 2023-03-01 12:09:16,275 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733991.864301268 and callback=>; now=10733926.864301268; delay=65 DEBUG 2023-03-01 12:09:16,300 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:09:16,300 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:09:16,300 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:09:16,300 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:09:16,301 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:09:16,301 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733956.890323743 and callback=>; now=10733926.890323743; delay=30.0 DEBUG 2023-03-01 12:09:16,301 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:09:16,301 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:09:16,301 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:09:46,199 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:09:46,199 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:09:46,301 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:09:46,301 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:09:46,302 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:09:46,302 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:09:46,302 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:09:46,302 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10733986.891689084 and callback=>; now=10733956.891689084; delay=30.0 DEBUG 2023-03-01 12:09:46,302 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:09:46,302 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:09:46,303 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:10:16,200 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:10:16,200 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:10:16,303 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:10:16,303 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:10:16,303 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:10:16,304 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:10:16,304 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:10:16,304 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734016.893441932 and callback=>; now=10733986.893441932; delay=30.0 DEBUG 2023-03-01 12:10:16,304 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:10:16,304 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:10:16,304 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:10:21,279 pika.heartbeat _check_heartbeat 124 : Received 118 heartbeat frames, sent 145, idle intervals 0 DEBUG 2023-03-01 12:10:21,280 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734056.869179131 and callback=>; now=10733991.869179131; delay=65 DEBUG 2023-03-01 12:10:46,201 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:10:46,201 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:10:46,305 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:10:46,305 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:10:46,305 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:10:46,305 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:10:46,305 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:10:46,306 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734046.895261705 and callback=>; now=10734016.895261705; delay=30.0 DEBUG 2023-03-01 12:10:46,306 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:10:46,306 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:10:46,306 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:11:16,201 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:11:16,201 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:11:16,306 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:11:16,306 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:11:16,306 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:11:16,306 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:11:16,306 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:11:16,307 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734076.896164345 and callback=>; now=10734046.896164345; delay=30.0 DEBUG 2023-03-01 12:11:16,307 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:11:16,307 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:11:16,307 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:11:26,286 pika.heartbeat _check_heartbeat 124 : Received 120 heartbeat frames, sent 147, idle intervals 0 DEBUG 2023-03-01 12:11:26,286 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734121.875457428 and callback=>; now=10734056.875457428; delay=65 DEBUG 2023-03-01 12:11:46,202 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:11:46,202 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:11:46,308 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:11:46,308 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:11:46,308 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:11:46,308 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:11:46,308 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:11:46,309 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734106.898199255 and callback=>; now=10734076.898199255; delay=30.0 DEBUG 2023-03-01 12:11:46,309 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:11:46,309 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:11:46,309 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:12:16,203 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:12:16,204 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:12:16,309 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:12:16,309 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:12:16,309 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:12:16,310 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:12:16,310 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:12:16,310 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734136.899476975 and callback=>; now=10734106.899476975; delay=30.0 DEBUG 2023-03-01 12:12:16,310 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:12:16,310 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:12:16,310 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:12:31,291 pika.heartbeat _check_heartbeat 124 : Received 122 heartbeat frames, sent 149, idle intervals 0 DEBUG 2023-03-01 12:12:31,291 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734186.880817512 and callback=>; now=10734121.880817512; delay=65 DEBUG 2023-03-01 12:12:46,148 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 12:12:46,148 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:12:46,148 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 15: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:12:46,150 kafka.protocol.parser _process_response 139 : Received correlation id: 15 DEBUG 2023-03-01 12:12:46,150 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 12:12:46,151 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 15 (2.780437469482422 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 12:12:46,153 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 12:12:46,204 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:12:46,204 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:12:46,311 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:12:46,311 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:12:46,311 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:12:46,311 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:12:46,311 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:12:46,311 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734166.901031133 and callback=>; now=10734136.901031133; delay=30.0 DEBUG 2023-03-01 12:12:46,312 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:12:46,312 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:12:46,312 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:13:16,205 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:13:16,205 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:13:16,312 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:13:16,312 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:13:16,312 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:13:16,312 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:13:16,312 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:13:16,313 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734196.902178794 and callback=>; now=10734166.902178794; delay=30.0 DEBUG 2023-03-01 12:13:16,313 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:13:16,313 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:13:16,313 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:13:36,294 pika.heartbeat _check_heartbeat 124 : Received 124 heartbeat frames, sent 151, idle intervals 0 DEBUG 2023-03-01 12:13:36,294 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734251.8833482 and callback=>; now=10734186.8833482; delay=65 DEBUG 2023-03-01 12:13:46,207 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:13:46,207 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:13:46,313 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:13:46,313 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:13:46,313 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:13:46,313 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:13:46,313 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:13:46,314 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734226.903144335 and callback=>; now=10734196.903144335; delay=30.0 DEBUG 2023-03-01 12:13:46,314 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:13:46,314 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:13:46,314 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:14:16,208 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:14:16,208 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:14:16,314 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:14:16,314 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:14:16,315 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:14:16,315 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:14:16,315 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:14:16,315 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734256.90444758 and callback=>; now=10734226.90444758; delay=30.0 DEBUG 2023-03-01 12:14:16,315 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:14:16,315 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:14:16,315 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:14:41,298 pika.heartbeat _check_heartbeat 124 : Received 126 heartbeat frames, sent 153, idle intervals 0 DEBUG 2023-03-01 12:14:41,298 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734316.887371443 and callback=>; now=10734251.887371443; delay=65 DEBUG 2023-03-01 12:14:46,209 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:14:46,210 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:14:46,316 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:14:46,316 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:14:46,317 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:14:46,317 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:14:46,317 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:14:46,317 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734286.906478517 and callback=>; now=10734256.906478517; delay=30.0 DEBUG 2023-03-01 12:14:46,317 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:14:46,317 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:14:46,317 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:15:16,210 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:15:16,211 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:15:16,318 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:15:16,318 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:15:16,318 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:15:16,319 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:15:16,319 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:15:16,319 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734316.908350656 and callback=>; now=10734286.908350656; delay=30.0 DEBUG 2023-03-01 12:15:16,319 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:15:16,319 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:15:16,319 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:15:46,212 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:15:46,212 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:15:46,299 pika.heartbeat _check_heartbeat 124 : Received 129 heartbeat frames, sent 155, idle intervals 0 DEBUG 2023-03-01 12:15:46,299 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734381.88831461 and callback=>; now=10734316.88831461; delay=65 DEBUG 2023-03-01 12:15:46,319 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:15:46,319 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:15:46,319 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:15:46,319 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:15:46,319 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:15:46,320 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734346.90915534 and callback=>; now=10734316.90915534; delay=30.0 DEBUG 2023-03-01 12:15:46,320 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:15:46,320 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:15:46,320 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:16:16,213 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:16:16,213 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:16:16,321 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:16:16,321 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:16:16,321 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:16:16,321 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:16:16,321 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:16:16,321 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734376.910923244 and callback=>; now=10734346.910923244; delay=30.0 DEBUG 2023-03-01 12:16:16,322 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:16:16,322 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:16:16,322 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:16:46,214 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:16:46,214 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:16:46,322 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:16:46,322 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:16:46,322 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:16:46,323 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:16:46,323 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:16:46,323 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734406.912326904 and callback=>; now=10734376.912326904; delay=30.0 DEBUG 2023-03-01 12:16:46,323 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:16:46,323 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:16:46,323 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:16:51,304 pika.heartbeat _check_heartbeat 124 : Received 131 heartbeat frames, sent 158, idle intervals 0 DEBUG 2023-03-01 12:16:51,305 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734446.89415392 and callback=>; now=10734381.89415392; delay=65 DEBUG 2023-03-01 12:17:16,215 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:17:16,215 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:17:16,324 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:17:16,324 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:17:16,324 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:17:16,324 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:17:16,324 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:17:16,324 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734436.913818195 and callback=>; now=10734406.913818195; delay=30.0 DEBUG 2023-03-01 12:17:16,324 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:17:16,325 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:17:16,325 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:17:46,154 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 12:17:46,154 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:17:46,154 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 16: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:17:46,156 kafka.protocol.parser _process_response 139 : Received correlation id: 16 DEBUG 2023-03-01 12:17:46,156 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 12:17:46,157 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 16 (2.649545669555664 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 12:17:46,159 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 12:17:46,216 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:17:46,217 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:17:46,325 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:17:46,325 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:17:46,325 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:17:46,326 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:17:46,326 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:17:46,326 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734466.915806636 and callback=>; now=10734436.915806636; delay=30.0 DEBUG 2023-03-01 12:17:46,326 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:17:46,327 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:17:46,327 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:17:56,311 pika.heartbeat _check_heartbeat 124 : Received 133 heartbeat frames, sent 160, idle intervals 0 DEBUG 2023-03-01 12:17:56,311 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734511.900423793 and callback=>; now=10734446.900423793; delay=65 DEBUG 2023-03-01 12:18:16,217 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:18:16,217 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:18:16,327 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:18:16,327 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:18:16,327 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:18:16,327 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:18:16,327 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:18:16,328 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734496.917117316 and callback=>; now=10734466.917117316; delay=30.0 DEBUG 2023-03-01 12:18:16,328 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:18:16,328 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:18:16,328 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:18:46,219 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:18:46,219 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:18:46,328 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:18:46,329 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:18:46,329 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:18:46,329 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:18:46,329 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:18:46,329 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734526.918685 and callback=>; now=10734496.918685; delay=30.0 DEBUG 2023-03-01 12:18:46,329 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:18:46,330 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:18:46,330 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:19:01,314 pika.heartbeat _check_heartbeat 124 : Received 135 heartbeat frames, sent 162, idle intervals 0 DEBUG 2023-03-01 12:19:01,314 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734576.90346564 and callback=>; now=10734511.90346564; delay=65 DEBUG 2023-03-01 12:19:16,220 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:19:16,220 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:19:16,330 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:19:16,330 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:19:16,331 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:19:16,331 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:19:16,331 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:19:16,331 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734556.92055336 and callback=>; now=10734526.92055336; delay=30.0 DEBUG 2023-03-01 12:19:16,331 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:19:16,331 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:19:16,331 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:19:46,221 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:19:46,221 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:19:46,332 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:19:46,332 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:19:46,332 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:19:46,332 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:19:46,332 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:19:46,332 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734586.921690656 and callback=>; now=10734556.921690656; delay=30.0 DEBUG 2023-03-01 12:19:46,332 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:19:46,332 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:19:46,332 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:20:06,318 pika.heartbeat _check_heartbeat 124 : Received 137 heartbeat frames, sent 164, idle intervals 0 DEBUG 2023-03-01 12:20:06,318 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734641.907364052 and callback=>; now=10734576.907364052; delay=65 DEBUG 2023-03-01 12:20:16,222 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:20:16,222 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:20:16,333 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:20:16,333 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:20:16,333 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:20:16,333 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:20:16,333 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:20:16,334 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734616.923159292 and callback=>; now=10734586.923159292; delay=30.0 DEBUG 2023-03-01 12:20:16,334 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:20:16,334 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:20:16,334 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:20:46,223 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:20:46,223 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:20:46,334 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:20:46,334 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:20:46,334 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:20:46,334 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:20:46,334 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:20:46,335 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734646.924202505 and callback=>; now=10734616.924202505; delay=30.0 DEBUG 2023-03-01 12:20:46,335 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:20:46,335 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:20:46,335 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:21:11,323 pika.heartbeat _check_heartbeat 124 : Received 139 heartbeat frames, sent 166, idle intervals 0 DEBUG 2023-03-01 12:21:11,323 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734706.912341336 and callback=>; now=10734641.912341336; delay=65 DEBUG 2023-03-01 12:21:16,224 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:21:16,224 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:21:16,336 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:21:16,336 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:21:16,336 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:21:16,336 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:21:16,336 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:21:16,337 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734676.926114699 and callback=>; now=10734646.926114699; delay=30.0 DEBUG 2023-03-01 12:21:16,337 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:21:16,337 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:21:16,337 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:21:46,226 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:21:46,226 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:21:46,337 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:21:46,338 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:21:46,338 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:21:46,338 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:21:46,338 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:21:46,338 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734706.9275882 and callback=>; now=10734676.9275882; delay=30.0 DEBUG 2023-03-01 12:21:46,338 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:21:46,338 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:21:46,338 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:22:16,227 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:22:16,227 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:22:16,323 pika.heartbeat _check_heartbeat 124 : Received 142 heartbeat frames, sent 168, idle intervals 0 DEBUG 2023-03-01 12:22:16,324 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734771.913138064 and callback=>; now=10734706.913138064; delay=65 DEBUG 2023-03-01 12:22:16,339 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:22:16,339 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:22:16,339 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:22:16,339 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:22:16,340 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:22:16,340 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734736.92926574 and callback=>; now=10734706.92926574; delay=30.0 DEBUG 2023-03-01 12:22:16,340 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:22:16,340 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:22:16,340 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:22:46,160 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 12:22:46,160 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:22:46,160 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 17: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:22:46,162 kafka.protocol.parser _process_response 139 : Received correlation id: 17 DEBUG 2023-03-01 12:22:46,162 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 12:22:46,163 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 17 (2.182483673095703 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 12:22:46,164 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 12:22:46,228 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:22:46,228 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:22:46,341 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:22:46,341 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:22:46,341 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:22:46,341 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:22:46,341 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:22:46,342 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734766.931232339 and callback=>; now=10734736.931232339; delay=30.0 DEBUG 2023-03-01 12:22:46,342 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:22:46,342 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:22:46,342 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:23:16,229 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:23:16,229 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:23:16,343 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:23:16,343 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:23:16,343 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:23:16,343 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:23:16,344 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:23:16,344 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734796.93336706 and callback=>; now=10734766.93336706; delay=30.0 DEBUG 2023-03-01 12:23:16,344 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:23:16,344 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:23:16,344 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:23:21,328 pika.heartbeat _check_heartbeat 124 : Received 144 heartbeat frames, sent 171, idle intervals 0 DEBUG 2023-03-01 12:23:21,329 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734836.918152528 and callback=>; now=10734771.918152528; delay=65 DEBUG 2023-03-01 12:23:46,230 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:23:46,230 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:23:46,344 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:23:46,345 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:23:46,345 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:23:46,345 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:23:46,345 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:23:46,345 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734826.934507614 and callback=>; now=10734796.934507614; delay=30.0 DEBUG 2023-03-01 12:23:46,345 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:23:46,345 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:23:46,345 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:24:16,231 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:24:16,231 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:24:16,345 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:24:16,346 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:24:16,346 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:24:16,346 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:24:16,346 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:24:16,346 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734856.935669623 and callback=>; now=10734826.935669623; delay=30.0 DEBUG 2023-03-01 12:24:16,346 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:24:16,346 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:24:16,346 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:24:26,334 pika.heartbeat _check_heartbeat 124 : Received 146 heartbeat frames, sent 173, idle intervals 0 DEBUG 2023-03-01 12:24:26,334 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734901.923755068 and callback=>; now=10734836.923755068; delay=65 DEBUG 2023-03-01 12:24:46,231 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:24:46,231 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:24:46,346 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:24:46,347 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:24:46,347 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:24:46,347 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:24:46,347 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:24:46,347 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734886.936982788 and callback=>; now=10734856.936982788; delay=30.0 DEBUG 2023-03-01 12:24:46,348 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:24:46,348 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:24:46,348 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:25:16,231 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:25:16,232 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:25:16,348 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:25:16,348 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:25:16,348 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:25:16,348 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:25:16,348 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:25:16,349 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734916.938355513 and callback=>; now=10734886.938355513; delay=30.0 DEBUG 2023-03-01 12:25:16,349 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:25:16,349 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:25:16,349 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:25:31,339 pika.heartbeat _check_heartbeat 124 : Received 148 heartbeat frames, sent 175, idle intervals 0 DEBUG 2023-03-01 12:25:31,340 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734966.929253643 and callback=>; now=10734901.929253643; delay=65 DEBUG 2023-03-01 12:25:46,232 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:25:46,232 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:25:46,350 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:25:46,350 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:25:46,350 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:25:46,350 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:25:46,351 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:25:46,351 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734946.940293966 and callback=>; now=10734916.940293966; delay=30.0 DEBUG 2023-03-01 12:25:46,351 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:25:46,351 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:25:46,351 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:26:16,233 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:26:16,233 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:26:16,352 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:26:16,352 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:26:16,352 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:26:16,352 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:26:16,352 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:26:16,352 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10734976.94177448 and callback=>; now=10734946.94177448; delay=30.0 DEBUG 2023-03-01 12:26:16,352 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:26:16,353 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:26:16,353 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:26:36,344 pika.heartbeat _check_heartbeat 124 : Received 150 heartbeat frames, sent 177, idle intervals 0 DEBUG 2023-03-01 12:26:36,344 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10735031.933575436 and callback=>; now=10734966.933575436; delay=65 DEBUG 2023-03-01 12:26:46,234 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:26:46,234 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:26:46,353 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:26:46,354 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:26:46,354 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:26:46,354 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:26:46,354 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:26:46,354 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10735006.943742208 and callback=>; now=10734976.943742208; delay=30.0 DEBUG 2023-03-01 12:26:46,354 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:26:46,355 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:26:46,355 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:27:16,234 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:27:16,235 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:27:16,355 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:27:16,355 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:27:16,355 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:27:16,356 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:27:16,356 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:27:16,356 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10735036.945413824 and callback=>; now=10735006.945413824; delay=30.0 DEBUG 2023-03-01 12:27:16,356 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:27:16,356 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:27:16,356 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:27:41,349 pika.heartbeat _check_heartbeat 124 : Received 152 heartbeat frames, sent 179, idle intervals 0 DEBUG 2023-03-01 12:27:41,349 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10735096.938530564 and callback=>; now=10735031.938530564; delay=65 DEBUG 2023-03-01 12:27:46,165 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 12:27:46,165 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:27:46,165 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 18: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:27:46,167 kafka.protocol.parser _process_response 139 : Received correlation id: 18 DEBUG 2023-03-01 12:27:46,167 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 12:27:46,168 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 18 (2.4023056030273438 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 12:27:46,169 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 12:27:46,235 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:27:46,235 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:27:46,357 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:27:46,357 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:27:46,357 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:27:46,358 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:27:46,358 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:27:46,358 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10735066.947443029 and callback=>; now=10735036.947443029; delay=30.0 DEBUG 2023-03-01 12:27:46,358 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:27:46,358 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:27:46,358 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:28:16,236 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:28:16,236 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:28:16,359 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:28:16,359 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:28:16,359 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:28:16,359 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:28:16,359 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:28:16,359 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10735096.949016457 and callback=>; now=10735066.949016457; delay=30.0 DEBUG 2023-03-01 12:28:16,360 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:28:16,360 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:28:16,360 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:28:46,237 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:28:46,237 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:28:46,350 pika.heartbeat _check_heartbeat 124 : Received 155 heartbeat frames, sent 181, idle intervals 0 DEBUG 2023-03-01 12:28:46,350 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10735161.939553488 and callback=>; now=10735096.939553488; delay=65 DEBUG 2023-03-01 12:28:46,360 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:28:46,360 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:28:46,361 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:28:46,361 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:28:46,361 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:28:46,361 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10735126.950503556 and callback=>; now=10735096.950503556; delay=30.0 DEBUG 2023-03-01 12:28:46,361 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:28:46,361 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:28:46,361 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:29:16,238 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:29:16,238 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:29:16,362 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:29:16,362 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:29:16,363 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:29:16,363 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:29:16,363 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:29:16,363 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10735156.952710712 and callback=>; now=10735126.952710712; delay=30.0 DEBUG 2023-03-01 12:29:16,363 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:29:16,363 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:29:16,364 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:29:46,239 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:29:46,239 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:29:46,364 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:29:46,364 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:29:46,364 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:29:46,364 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:29:46,364 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:29:46,364 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10735186.953989172 and callback=>; now=10735156.953989172; delay=30.0 DEBUG 2023-03-01 12:29:46,365 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:29:46,365 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:29:46,365 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:29:51,355 pika.heartbeat _check_heartbeat 124 : Received 157 heartbeat frames, sent 184, idle intervals 0 DEBUG 2023-03-01 12:29:51,355 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10735226.944491293 and callback=>; now=10735161.944491293; delay=65 DEBUG 2023-03-01 12:30:16,240 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:30:16,240 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:30:16,366 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:30:16,366 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:30:16,366 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:30:16,366 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:30:16,366 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:30:16,366 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10735216.955967844 and callback=>; now=10735186.955967844; delay=30.0 DEBUG 2023-03-01 12:30:16,367 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:30:16,367 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:30:16,367 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:30:46,241 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:30:46,241 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:30:46,367 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:30:46,367 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:30:46,367 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:30:46,367 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:30:46,368 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:30:46,368 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10735246.957344666 and callback=>; now=10735216.957344666; delay=30.0 DEBUG 2023-03-01 12:30:46,368 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:30:46,368 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:30:46,368 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:30:56,358 pika.heartbeat _check_heartbeat 124 : Received 159 heartbeat frames, sent 186, idle intervals 0 DEBUG 2023-03-01 12:30:56,358 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10735291.947338205 and callback=>; now=10735226.947338205; delay=65 DEBUG 2023-03-01 12:31:16,242 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:31:16,242 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:31:16,369 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:31:16,372 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:31:16,372 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:31:16,372 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:31:16,372 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:31:16,372 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10735276.961706512 and callback=>; now=10735246.961706512; delay=30.0 DEBUG 2023-03-01 12:31:16,372 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:31:16,372 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:31:16,372 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:31:46,243 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:31:46,244 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:31:46,373 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:31:46,373 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:31:46,374 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:31:46,374 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:31:46,374 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:31:46,374 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10735306.963586992 and callback=>; now=10735276.963586992; delay=30.0 DEBUG 2023-03-01 12:31:46,374 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:31:46,374 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:31:46,374 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:32:01,362 pika.heartbeat _check_heartbeat 124 : Received 161 heartbeat frames, sent 188, idle intervals 0 DEBUG 2023-03-01 12:32:01,362 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10735356.951427892 and callback=>; now=10735291.951427892; delay=65 DEBUG 2023-03-01 12:32:16,244 pika.heartbeat received 101 : Received heartbeat frame DEBUG 2023-03-01 12:32:16,245 pika.adapters.utils.io_services_utils _on_socket_readable 1069: Recv would block on DEBUG 2023-03-01 12:32:16,375 pika.heartbeat _send_heartbeat 108 : Sending heartbeat frame DEBUG 2023-03-01 12:32:16,375 pika.heartbeat _send_heartbeat_frame 180 : Sending heartbeat frame DEBUG 2023-03-01 12:32:16,375 pika.adapters.utils.selector_ioloop_adapter set_writer 312 : SelectorIOServicesAdapter.set_writer(11, >) DEBUG 2023-03-01 12:32:16,376 pika.adapters.utils.selector_ioloop_adapter set_writer 334 : set_writer(11, _) updated handler RdWr DEBUG 2023-03-01 12:32:16,376 pika.adapters.utils.io_services_utils write 1031: Turned on writability watcher: DEBUG 2023-03-01 12:32:16,376 pika.adapters.select_connection call_later 263 : call_later: added timeout with deadline=10735336.965475963 and callback=>; now=10735306.965475963; delay=30.0 DEBUG 2023-03-01 12:32:16,376 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:32:16,376 pika.adapters.utils.selector_ioloop_adapter remove_writer 367 : remove_writer(11) updated handler Rd DEBUG 2023-03-01 12:32:16,376 pika.adapters.utils.io_services_utils _on_socket_writable 1118: Turned off writability watcher: DEBUG 2023-03-01 12:32:36,322 pika.callback process 217 : Processing 0:Connection.Close DEBUG 2023-03-01 12:32:36,322 pika.callback _use_one_shot_callback 401 : Processing use of oneshot callback DEBUG 2023-03-01 12:32:36,322 pika.callback _use_one_shot_callback 403 : 0 registered uses left DEBUG 2023-03-01 12:32:36,322 pika.callback remove 265 : Removing callback #0: {'callback': params=>>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 0} DEBUG 2023-03-01 12:32:36,322 pika.callback process 231 : Calling params=>> for "0:Connection.Close" DEBUG 2023-03-01 12:32:36,322 pika.connection _on_connection_close_from_broker 1777: _on_connection_close_from_broker: frame='])> DEBUG 2023-03-01 12:32:36,322 pika.heartbeat stop 138 : Removing timer for next heartbeat send interval DEBUG 2023-03-01 12:32:36,322 pika.adapters.select_connection remove_timeout 284 : remove_timeout: removing timeout with deadline=10735336.965475963 and callback=> DEBUG 2023-03-01 12:32:36,323 pika.heartbeat stop 142 : Removing timer for next heartbeat check interval DEBUG 2023-03-01 12:32:36,323 pika.adapters.select_connection remove_timeout 284 : remove_timeout: removing timeout with deadline=10735356.951427892 and callback=> INFO 2023-03-01 12:32:36,323 pika.adapters.utils.io_services_utils abort 731 : Aborting transport connection: state=1; INFO 2023-03-01 12:32:36,323 pika.adapters.utils.io_services_utils _initiate_abort 904 : _AsyncTransportBase._initate_abort(): Initiating abrupt asynchronous transport shutdown: state=1; error=None; INFO 2023-03-01 12:32:36,323 pika.adapters.utils.io_services_utils _deactivate 869 : Deactivating transport: state=1; DEBUG 2023-03-01 12:32:36,323 pika.adapters.utils.selector_ioloop_adapter remove_reader 280 : SelectorIOServicesAdapter.remove_reader(11) DEBUG 2023-03-01 12:32:36,324 pika.adapters.utils.selector_ioloop_adapter remove_reader 300 : remove_reader(11) removed handler DEBUG 2023-03-01 12:32:36,324 pika.adapters.utils.selector_ioloop_adapter remove_writer 344 : SelectorIOServicesAdapter.remove_writer(11) DEBUG 2023-03-01 12:32:36,324 pika.adapters.utils.selector_ioloop_adapter remove_writer 351 : remove_writer(11) neither was set. DEBUG 2023-03-01 12:32:36,324 pika.adapters.select_connection add_callback_threadsafe 481 : add_callback_threadsafe: added callback=functools.partial(>, None) DEBUG 2023-03-01 12:32:36,324 pika.adapters.utils.io_services_utils _on_socket_readable 1081: Leaving Plaintext consumer due to inactive state: state=3; DEBUG 2023-03-01 12:32:36,324 pika.adapters.select_connection process_timeouts 494 : process_timeouts: invoking callback=functools.partial(>, None) DEBUG 2023-03-01 12:32:36,325 pika.adapters.utils.io_services_utils _connection_lost_notify_async 957 : Concluding transport shutdown: state=3; error=None DEBUG 2023-03-01 12:32:36,325 pika.adapters.base_connection _proto_connection_lost 428 : connection_lost: None INFO 2023-03-01 12:32:36,325 pika.connection _on_stream_terminated 1996: AMQP stack terminated, failed to connect, or aborted: opened=True, error-arg=None; pending-error=ConnectionClosedByBroker: (320) "CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'" DEBUG 2023-03-01 12:32:36,325 pika.connection _set_connection_state 2273: New Connection state: CLOSED (prev=OPEN) DEBUG 2023-03-01 12:32:36,325 pika.channel _on_close_meta 1110: Handling meta-close on >>: ConnectionClosedByBroker: (320) "CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'" DEBUG 2023-03-01 12:32:36,325 pika.callback process 217 : Processing 1:_on_channel_cleanup DEBUG 2023-03-01 12:32:36,325 pika.callback _use_one_shot_callback 401 : Processing use of oneshot callback DEBUG 2023-03-01 12:32:36,325 pika.callback _use_one_shot_callback 403 : 0 registered uses left DEBUG 2023-03-01 12:32:36,325 pika.callback remove 265 : Removing callback #0: {'callback': >>, 'one_shot': True, 'only': >>, 'arguments': None, 'calls': 0} DEBUG 2023-03-01 12:32:36,326 pika.callback process 231 : Calling >> for "1:_on_channel_cleanup" DEBUG 2023-03-01 12:32:36,326 pika.connection _on_channel_cleanup 1680: Removed channel 1 DEBUG 2023-03-01 12:32:36,326 pika.callback cleanup 182 : Clearing out '1' from the stack INFO 2023-03-01 12:32:36,326 pika.connection _on_stream_terminated 2065: Stack terminated due to ConnectionClosedByBroker: (320) "CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'" DEBUG 2023-03-01 12:32:36,326 pika.connection _set_connection_state 2273: New Connection state: CLOSED (prev=CLOSED) DEBUG 2023-03-01 12:32:36,326 pika.callback add 165 : Added: {'callback': >>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} DEBUG 2023-03-01 12:32:36,326 pika.callback add 165 : Added: {'callback': >>, 'one_shot': True, 'only': None, 'arguments': None, 'calls': 1} DEBUG 2023-03-01 12:32:36,326 pika.callback add 165 : Added: {'callback': functools.partial(>>, >), 'one_shot': False, 'only': None, 'arguments': None} DEBUG 2023-03-01 12:32:36,326 pika.callback add 165 : Added: {'callback': functools.partial(>>, >), 'one_shot': False, 'only': None, 'arguments': None} INFO 2023-03-01 12:32:36,326 pika.adapters.utils.io_services_utils _close_and_finalize 882 : Closing transport socket and unlinking: state=3; DEBUG 2023-03-01 12:32:46,173 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 12:32:46,174 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:32:46,175 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 19: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:32:46,176 kafka.protocol.parser _process_response 139 : Received correlation id: 19 DEBUG 2023-03-01 12:32:46,176 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 12:32:46,177 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 19 (2.549409866333008 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 12:32:46,179 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 12:37:46,179 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 12:37:46,179 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:37:46,179 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 20: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:37:46,181 kafka.protocol.parser _process_response 139 : Received correlation id: 20 DEBUG 2023-03-01 12:37:46,181 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 12:37:46,182 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 20 (2.190113067626953 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 12:37:46,183 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 12:42:46,184 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 12:42:46,184 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:42:46,185 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 21: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:42:46,187 kafka.protocol.parser _process_response 139 : Received correlation id: 21 DEBUG 2023-03-01 12:42:46,187 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 12:42:46,189 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 21 (3.519296646118164 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 12:42:46,190 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 12:47:46,191 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 12:47:46,191 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:47:46,192 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 22: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:47:46,193 kafka.protocol.parser _process_response 139 : Received correlation id: 22 DEBUG 2023-03-01 12:47:46,193 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 12:47:46,194 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 22 (2.0203590393066406 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 12:47:46,195 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 12:52:46,196 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 12:52:46,196 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:52:46,197 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 23: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:52:46,198 kafka.protocol.parser _process_response 139 : Received correlation id: 23 DEBUG 2023-03-01 12:52:46,198 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 12:52:46,199 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 23 (2.1643638610839844 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 12:52:46,200 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 12:57:46,200 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 12:57:46,201 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:57:46,201 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 24: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 12:57:46,202 kafka.protocol.parser _process_response 139 : Received correlation id: 24 DEBUG 2023-03-01 12:57:46,202 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 12:57:46,203 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 24 (2.3050308227539062 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 12:57:46,204 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 13:02:46,205 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 13:02:46,205 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:02:46,205 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 25: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:02:46,207 kafka.protocol.parser _process_response 139 : Received correlation id: 25 DEBUG 2023-03-01 13:02:46,207 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 13:02:46,208 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 25 (2.415895462036133 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 13:02:46,209 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 13:07:46,213 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 13:07:46,213 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:07:46,213 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 26: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:07:46,216 kafka.protocol.parser _process_response 139 : Received correlation id: 26 DEBUG 2023-03-01 13:07:46,216 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 13:07:46,217 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 26 (3.706693649291992 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 13:07:46,218 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 13:12:46,219 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 13:12:46,220 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:12:46,220 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 27: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:12:46,222 kafka.protocol.parser _process_response 139 : Received correlation id: 27 DEBUG 2023-03-01 13:12:46,222 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 13:12:46,223 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 27 (2.9816627502441406 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 13:12:46,224 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 13:17:46,225 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 13:17:46,226 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:17:46,226 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 28: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:17:46,227 kafka.protocol.parser _process_response 139 : Received correlation id: 28 DEBUG 2023-03-01 13:17:46,228 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 13:17:46,229 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 28 (3.0603408813476562 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 13:17:46,230 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 13:22:46,231 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 13:22:46,231 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:22:46,232 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 29: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:22:46,233 kafka.protocol.parser _process_response 139 : Received correlation id: 29 DEBUG 2023-03-01 13:22:46,233 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 13:22:46,234 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 29 (2.521991729736328 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 13:22:46,235 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 13:27:46,236 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 13:27:46,236 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:27:46,236 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 30: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:27:46,238 kafka.protocol.parser _process_response 139 : Received correlation id: 30 DEBUG 2023-03-01 13:27:46,238 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 13:27:46,239 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 30 (2.5415420532226562 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 13:27:46,240 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 13:32:46,241 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 13:32:46,242 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:32:46,242 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 31: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:32:46,243 kafka.protocol.parser _process_response 139 : Received correlation id: 31 DEBUG 2023-03-01 13:32:46,243 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 13:32:46,245 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 31 (2.9594898223876953 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 13:32:46,247 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 13:37:46,248 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 13:37:46,248 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:37:46,248 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 32: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:37:46,249 kafka.protocol.parser _process_response 139 : Received correlation id: 32 DEBUG 2023-03-01 13:37:46,249 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 13:37:46,250 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 32 (2.112865447998047 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 13:37:46,251 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 13:42:46,252 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 13:42:46,252 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:42:46,252 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 33: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:42:46,254 kafka.protocol.parser _process_response 139 : Received correlation id: 33 DEBUG 2023-03-01 13:42:46,254 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 13:42:46,255 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 33 (2.294778823852539 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 13:42:46,256 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 13:47:46,257 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 13:47:46,257 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:47:46,258 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 34: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:47:46,259 kafka.protocol.parser _process_response 139 : Received correlation id: 34 DEBUG 2023-03-01 13:47:46,259 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 13:47:46,261 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 34 (2.713441848754883 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 13:47:46,262 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 13:52:46,262 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 13:52:46,262 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:52:46,263 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 35: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:52:46,264 kafka.protocol.parser _process_response 139 : Received correlation id: 35 DEBUG 2023-03-01 13:52:46,264 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 13:52:46,265 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 35 (2.699613571166992 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 13:52:46,267 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 13:57:46,268 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 13:57:46,268 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:57:46,268 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 36: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 13:57:46,270 kafka.protocol.parser _process_response 139 : Received correlation id: 36 DEBUG 2023-03-01 13:57:46,270 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 13:57:46,271 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 36 (2.54058837890625 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 13:57:46,273 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 14:02:46,273 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 14:02:46,274 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:02:46,274 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 37: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:02:46,275 kafka.protocol.parser _process_response 139 : Received correlation id: 37 DEBUG 2023-03-01 14:02:46,276 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 14:02:46,277 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 37 (2.519369125366211 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 14:02:46,278 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 14:07:46,279 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 14:07:46,279 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:07:46,280 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 38: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:07:46,282 kafka.protocol.parser _process_response 139 : Received correlation id: 38 DEBUG 2023-03-01 14:07:46,282 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 14:07:46,283 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 38 (3.0198097229003906 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 14:07:46,285 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 14:12:46,285 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 14:12:46,285 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:12:46,285 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 39: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:12:46,287 kafka.protocol.parser _process_response 139 : Received correlation id: 39 DEBUG 2023-03-01 14:12:46,287 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 14:12:46,288 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 39 (2.435922622680664 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 14:12:46,289 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 14:17:46,290 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 14:17:46,290 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:17:46,290 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 40: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:17:46,292 kafka.protocol.parser _process_response 139 : Received correlation id: 40 DEBUG 2023-03-01 14:17:46,292 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 14:17:46,293 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 40 (2.1104812622070312 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 14:17:46,294 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 14:22:46,295 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 14:22:46,295 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:22:46,296 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 41: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:22:46,297 kafka.protocol.parser _process_response 139 : Received correlation id: 41 DEBUG 2023-03-01 14:22:46,297 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 14:22:46,298 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 41 (2.357006072998047 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 14:22:46,299 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 14:27:46,300 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 14:27:46,301 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:27:46,301 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 42: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:27:46,302 kafka.protocol.parser _process_response 139 : Received correlation id: 42 DEBUG 2023-03-01 14:27:46,303 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 14:27:46,304 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 42 (2.7332305908203125 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 14:27:46,305 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 14:32:46,307 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 14:32:46,308 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:32:46,308 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 43: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:32:46,310 kafka.protocol.parser _process_response 139 : Received correlation id: 43 DEBUG 2023-03-01 14:32:46,310 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 14:32:46,311 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 43 (2.361297607421875 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 14:32:46,312 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 14:37:46,312 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 14:37:46,312 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:37:46,312 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 44: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:37:46,314 kafka.protocol.parser _process_response 139 : Received correlation id: 44 DEBUG 2023-03-01 14:37:46,314 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 14:37:46,315 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 44 (2.1004676818847656 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 14:37:46,316 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 14:42:46,317 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 14:42:46,318 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:42:46,318 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 45: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:42:46,319 kafka.protocol.parser _process_response 139 : Received correlation id: 45 DEBUG 2023-03-01 14:42:46,319 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 14:42:46,321 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 45 (2.678394317626953 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 14:42:46,322 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 14:47:46,323 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 14:47:46,324 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:47:46,324 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 46: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:47:46,325 kafka.protocol.parser _process_response 139 : Received correlation id: 46 DEBUG 2023-03-01 14:47:46,326 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 14:47:46,327 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 46 (3.2203197479248047 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 14:47:46,329 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 14:52:46,331 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 14:52:46,331 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:52:46,331 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 47: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:52:46,334 kafka.protocol.parser _process_response 139 : Received correlation id: 47 DEBUG 2023-03-01 14:52:46,334 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 14:52:46,336 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 47 (4.232645034790039 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 14:52:46,338 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 14:57:46,338 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 14:57:46,338 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:57:46,339 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 48: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 14:57:46,341 kafka.protocol.parser _process_response 139 : Received correlation id: 48 DEBUG 2023-03-01 14:57:46,341 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 14:57:46,342 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 48 (3.489971160888672 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 14:57:46,345 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 15:02:46,346 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 15:02:46,346 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:02:46,346 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 49: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:02:46,348 kafka.protocol.parser _process_response 139 : Received correlation id: 49 DEBUG 2023-03-01 15:02:46,348 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 15:02:46,349 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 49 (2.2649765014648438 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 15:02:46,350 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 15:07:46,351 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 15:07:46,351 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:07:46,351 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 50: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:07:46,353 kafka.protocol.parser _process_response 139 : Received correlation id: 50 DEBUG 2023-03-01 15:07:46,353 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 15:07:46,354 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 50 (2.3920536041259766 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 15:07:46,355 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 15:12:46,356 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 15:12:46,356 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:12:46,357 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 51: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:12:46,358 kafka.protocol.parser _process_response 139 : Received correlation id: 51 DEBUG 2023-03-01 15:12:46,358 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 15:12:46,359 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 51 (2.2830963134765625 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 15:12:46,360 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 15:17:46,361 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 15:17:46,361 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:17:46,362 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 52: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:17:46,363 kafka.protocol.parser _process_response 139 : Received correlation id: 52 DEBUG 2023-03-01 15:17:46,363 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 15:17:46,365 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 52 (2.997875213623047 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 15:17:46,366 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 15:22:46,367 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 15:22:46,367 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:22:46,367 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 53: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:22:46,369 kafka.protocol.parser _process_response 139 : Received correlation id: 53 DEBUG 2023-03-01 15:22:46,369 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 15:22:46,370 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 53 (2.6292800903320312 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 15:22:46,371 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 15:27:46,372 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 15:27:46,373 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:27:46,373 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 54: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:27:46,374 kafka.protocol.parser _process_response 139 : Received correlation id: 54 DEBUG 2023-03-01 15:27:46,374 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 15:27:46,375 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 54 (2.2389888763427734 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 15:27:46,376 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 15:32:46,377 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 15:32:46,377 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:32:46,378 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 55: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:32:46,379 kafka.protocol.parser _process_response 139 : Received correlation id: 55 DEBUG 2023-03-01 15:32:46,379 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 15:32:46,380 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 55 (2.526521682739258 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 15:32:46,381 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 15:37:46,382 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 15:37:46,382 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:37:46,382 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 56: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:37:46,384 kafka.protocol.parser _process_response 139 : Received correlation id: 56 DEBUG 2023-03-01 15:37:46,384 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 15:37:46,385 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 56 (2.452373504638672 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 15:37:46,387 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 15:42:46,388 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 15:42:46,388 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:42:46,389 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 57: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:42:46,390 kafka.protocol.parser _process_response 139 : Received correlation id: 57 DEBUG 2023-03-01 15:42:46,390 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 15:42:46,391 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 57 (2.3229122161865234 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 15:42:46,392 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 15:47:46,393 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 15:47:46,393 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:47:46,393 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 58: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:47:46,395 kafka.protocol.parser _process_response 139 : Received correlation id: 58 DEBUG 2023-03-01 15:47:46,395 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 15:47:46,396 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 58 (2.150297164916992 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 15:47:46,397 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 15:52:46,398 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 15:52:46,398 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:52:46,398 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 59: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:52:46,399 kafka.protocol.parser _process_response 139 : Received correlation id: 59 DEBUG 2023-03-01 15:52:46,400 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 15:52:46,401 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 59 (2.7883052825927734 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 15:52:46,402 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 15:57:46,403 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 15:57:46,403 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:57:46,403 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 60: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 15:57:46,405 kafka.protocol.parser _process_response 139 : Received correlation id: 60 DEBUG 2023-03-01 15:57:46,405 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 15:57:46,406 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 60 (2.218961715698242 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 15:57:46,407 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 16:02:46,408 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 16:02:46,408 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 16:02:46,408 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 61: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 16:02:46,409 kafka.protocol.parser _process_response 139 : Received correlation id: 61 DEBUG 2023-03-01 16:02:46,410 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 16:02:46,410 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 61 (2.0346641540527344 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 16:02:46,411 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 16:07:46,412 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 16:07:46,412 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 16:07:46,413 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 62: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 16:07:46,414 kafka.protocol.parser _process_response 139 : Received correlation id: 62 DEBUG 2023-03-01 16:07:46,414 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 16:07:46,415 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 62 (2.717256546020508 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 16:07:46,416 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 16:12:46,418 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 16:12:46,418 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 16:12:46,418 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 63: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 16:12:46,419 kafka.protocol.parser _process_response 139 : Received correlation id: 63 DEBUG 2023-03-01 16:12:46,420 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 16:12:46,420 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 63 (2.104520797729492 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 16:12:46,421 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 16:17:46,423 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 16:17:46,423 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 16:17:46,423 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 64: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 16:17:46,425 kafka.protocol.parser _process_response 139 : Received correlation id: 64 DEBUG 2023-03-01 16:17:46,425 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 16:17:46,426 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 64 (3.080129623413086 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 16:17:46,428 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0) DEBUG 2023-03-01 16:22:46,429 kafka.client _maybe_refresh_metadata 837 : Sending metadata request MetadataRequest_v1(topics=NULL) to node 1 DEBUG 2023-03-01 16:22:46,430 kafka.protocol.parser send_request 59 : Sending request MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 16:22:46,430 kafka.conn _send 972 : [IPv4 ('10.244.8.209', 9092)]> Request 65: MetadataRequest_v1(topics=NULL) DEBUG 2023-03-01 16:22:46,431 kafka.protocol.parser _process_response 139 : Received correlation id: 65 DEBUG 2023-03-01 16:22:46,431 kafka.protocol.parser _process_response 166 : Processing response MetadataResponse_v1 DEBUG 2023-03-01 16:22:46,432 kafka.conn recv 1074: [IPv4 ('10.244.8.209', 9092)]> Response 65 (2.2280216217041016 ms): MetadataResponse_v1(brokers=[(node_id=0, host='kafka-0.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=2, host='kafka-2.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None), (node_id=1, host='kafka-1.kafka-headless.kafka.svc.cluster.local', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic='topic_connector', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_annotation', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='topic_source', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=20, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=40, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=31, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=13, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=8, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=32, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=43, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=29, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=34, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=1, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=25, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=46, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=26, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=16, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=37, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=17, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=28, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=2, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=14, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=47, leader=1, replicas=[1], isr=[1]), (error_code=0, partition=49, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=2, replicas=[2], isr=[2]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_dataset', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic='topic_workflow', is_internal=False, partitions=[(error_code=0, partition=0, leader=1, replicas=[1], isr=[1])]), (error_code=0, topic='topic_kb', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])]), (error_code=0, topic='dataset_error_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=2, replicas=[2], isr=[2])])]) DEBUG 2023-03-01 16:22:46,433 kafka.cluster update_metadata 325 : Updated cluster metadata to ClusterMetadata(brokers: 3, topics: 9, groups: 0)