Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error viewing logs in UI #2

Closed
saritatewari4 opened this issue Nov 23, 2022 · 35 comments
Closed

Error viewing logs in UI #2

saritatewari4 opened this issue Nov 23, 2022 · 35 comments
Assignees

Comments

@saritatewari4
Copy link

saritatewari4 commented Nov 23, 2022

Hello @snjypl ,

I used this plugin with airflow 2.4.2 version. It worked fine. I am able to see logs in loki UI. I couldn't see the logs in airflow ui for dags and task when using remote logging as loki.

How I can get those logs from loki to airflow ui.

Please help me to get the solution.

@snjypl
Copy link
Owner

snjypl commented Nov 28, 2022

@saritatewari4 can you please share some additional info?

  • airflow version
  • python version
  • websever log after you try to view the logs in airflow UI.
  • try to manually trigger the dag and check if you are able to see this particular instance's log in Loki. [ view the last 5 mins log etc]

@saritatewari4
Copy link
Author

saritatewari4 commented Nov 28, 2022

Hello @snjypl ,

Please find details below:

Python: 3.9.6
Airflow version : 2.4.3 (I am running airflow stand alone in local and tried 2.4.2 version too)

Airflow configuration for logging as below:

remote_logging = True
remote_log_conn_id =loki
remote_base_log_folder =loki
logging_config_class = log_config.DEFAULT_LOGGING_CONFIG

Connection hook details:

connection id= loki
connection type= grafana loki
host= localhost
port=3101

These line of code I appended in log_config.py inside config folder:

elif REMOTE_BASE_LOG_FOLDER.startswith('loki'):
        LOKI_HANDLER: Dict[str, Dict[str, Union[str, bool]]] = {
            'task': {
                'class': 'grafana_loki_provider.log.loki_task_handler.LokiTaskHandler',
                'formatter': 'airflow',
                'name':"airflow_task",
                'base_log_folder': str(os.path.expanduser(BASE_LOG_FOLDER)),
                'filename_template': FILENAME_TEMPLATE
            },
        }
        DEFAULT_LOGGING_CONFIG['handlers'].update(LOKI_HANDLER)

Logs in airflow ui trying to load but never loaded . Getting this error on inspecting the code in ui console: ERR_EMPTY_RESPONSE

In grafana loki running on localhost getting logs:

`

    2022-11-28 20:52:37 {"line": "[2022-11-28T20:52:37.216+0530] {taskinstance.py:2623} INFO - 2 downstream tasks scheduled from follow-on schedule check\n", "run_id": "manual__2022-11-28T15:22:33.900770+00:00", "try_number": 1, "map_index": -1}
    2022-11-28 20:52:37 {"line": "[2022-11-28T20:52:37.197+0530] {local_task_job.py:159} INFO - Task exited with return code 0\n", "run_id": "manual__2022-11-28T15:22:33.900770+00:00", "try_number": 1, "map_index": -1}
    2022-11-28 20:52:37 {"line": "[2022-11-28T20:52:37.166+0530] {taskinstance.py:1401} INFO - Marking task as SUCCESS. dag_id=tutorial, task_id=print_date, execution_date=20221128T152233, start_date=20221128T152236, end_date=20221128T152237\n", "run_id": "manual__2022-11-28T15:22:33.900770+00:00", "try_number": 1, "map_index": -1}
    2022-11-28 20:52:37 {"line": "[2022-11-28T20:52:37.129+0530] {subprocess.py:97} INFO - Command exited with return code 0\n", "run_id": "manual__2022-11-28T15:22:33.900770+00:00", "try_number": 1, "map_index": -1}
    2022-11-28 20:52:37 {"line": "[2022-11-28T20:52:37.127+0530] {subprocess.py:93} INFO - Mon 28 Nov 2022 20:52:37 IST\n", "run_id": "manual__2022-11-28T15:22:33.900770+00:00", "try_number": 1, "map_index": -1}
    2022-11-28 20:52:37 {"line": "[2022-11-28T20:52:37.116+0530] {subprocess.py:86} INFO - Output:\n", "run_id": "manual__2022-11-28T15:22:33.900770+00:00", "try_number": 1, "map_index": -1}
    2022-11-28 20:52:37 {"line": "[2022-11-28T20:52:37.110+0530] {subprocess.py:75} INFO - Running command: ['/bin/bash', '-c', 'date']\n", "run_id": "manual__2022-11-28T15:22:33.900770+00:00", "try_number": 1, "map_index": -1}
    2022-11-28 20:52:37 {"line": " /var/folders/g4/vlgk9mmd58gfrqm1t3348k880000gn/T\n", "run_id": "manual__2022-11-28T15:22:33.900770+00:00", "try_number": 1, "map_index": -1}
    2022-11-28 20:52:37 {"line": "[2022-11-28T20:52:37.108+0530] {subprocess.py:63} INFO - Tmp dir root location: \n", "run_id": "manual__2022-11-28T15:22:33.900770+00:00", "try_number": 1, "map_index": -1}
    2022-11-28 20:52:37 {"line": "AIRFLOW_CTX_DAG_RUN_ID=manual__2022-11-28T15:22:33.900770+00:00\n", "run_id": "manual__2022-11-28T15:22:33.900770+00:00", "try_number": 1, "map_index": -1}
    2022-11-28 20:52:37 {"line": "AIRFLOW_CTX_TRY_NUMBER=1\n", "run_id": "manual__2022-11-28T15:22:33.900770+00:00", "try_number": 1, "map_index": -1}
    2022-11-28 20:52:37 {"line": "AIRFLOW_CTX_EXECUTION_DATE=2022-11-28T15:22:33.900770+00:00\n", "run_id": "manual__2022-11-28T15:22:33.900770+00:00", "try_number": 1, "map_index": -1}
    2022-11-28 20:52:37 {"line": "AIRFLOW_CTX_TASK_ID=print_date\n", "run_id": "manual__2022-11-28T15:22:33.900770+00:00", "try_number": 1, "map_index": -1}
    2022-11-28 20:52:37 {"line": "AIRFLOW_CTX_DAG_ID=tutorial\n", "run_id": "manual__2022-11-28T15:22:33.900770+00:00", "try_number": 1, "map_index": -1}

`

I am using s3 bucket as backend for loki storage but switching to in-memory storage also I tried and found logs are not loading in airflow ui.

These are the airflow logs in terminal:

webserver | [2022-11-28 20:56:46,441] {base.py:71} INFO - Using connection ID 'loki' for task execution. webserver | [2022-11-28 20:56:46,445] {http.py:148} INFO - Sending 'GET' to url: http://localhost:3101/loki/api/v1/query_range webserver | 127.0.0.1 - - [28/Nov/2022:20:56:46 +0530] "GET /object/next_run_datasets/tutorial HTTP/1.1" 200 2 "http://localhost:8080/log?dag_id=tutorial&task_id=print_date&execution_date=2022-11-28T15%3A22%3A33.900770%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36 Edg/107.0.1418.56" webserver | [2022-11-28 20:56:46 +0530] [40428] [WARNING] Worker with pid 43235 was terminated due to signal 11 webserver | [2022-11-28 20:56:46 +0530] [44448] [INFO] Booting worker with pid: 44448

NOTE: Logs are present in grafana loki running in local but not loading in airflow ui.

@snjypl
Copy link
Owner

snjypl commented Nov 28, 2022

@saritatewari4
can you update to latest dev.

pip install --force git+https://github.com/snjypl/airflow-provider-grafana-loki.git --no-deps

restart your websever. can try to retrieve the log from airflow ui.

in the websever log you should see the loki query params:

[2022-11-28 21:07:18,804] {loki_task_handler.py:128} INFO - loki log query params {'query': ' {dag_id="example_bash_operator",task_id="runme_0"}\n                    | json try_number="try_number",map_index="map_index",run_id="run_id"\n                    | try_number="1" and\n                      map_index="-1" and\n
  run_id="manual__2022-11-28T14:03:50.286188+00:00"\n                    | __error__!="JSONParserErr"\n                ', 'start': '2022-11-13T14:03:52.553797+00:00', 'end': '2022-11-28T15:03:53.816927+00:00', 'direction': 'forward'}
[2022-11-28 21:07:18,811] {base.py:73} INFO - Using connection ID 'loki_default' for task execution.
[2022-11-28 21:07:18,813] {http.py:150} INFO - Sending 'GET' to url: https://logs-xxxxx.grafana.net/loki/api/v1/query_range

also, verify that the logs are having proper labels in loki.
image

@saritatewari4
Copy link
Author

Hi @snjypl ,

I updated the version to latest dev as you mentioned but in airflow still logs are not loading.

Logs are having labels in loki:

Screenshot 2022-11-28 at 9 47 46 PM

These are the logs in airflow console:

webserver | 127.0.0.1 - - [28/Nov/2022:21:47:53 +0530] "GET /static/dist/tiLog.7864c61b0b31ef37f084.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial&task_id=print_date&execution_date=2022-11-28T16%3A16%3A57.622614%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36 Edg/107.0.1418.56"
 webserver | [2022-11-28 21:47:53,749] {loki_task_handler.py:128} INFO - loki log query params {'query': ' {dag_id="tutorial",task_id="print_date"}\n                    | json try_number="try_number",map_index="map_index",run_id="run_id"\n                    | try_number="1" and\n                      map_index="-1" and\n                      run_id="manual__2022-11-28T16:16:57.622614+00:00"\n                    | __error__!="JSONParserErr"\n                ', 'start': '2022-11-13T16:17:01.389030+00:00', 'end': '2022-11-28T17:17:01.636801+00:00', 'direction': 'forward'}
 webserver | 127.0.0.1 - - [28/Nov/2022:21:47:53 +0530] "GET /object/next_run_datasets/tutorial HTTP/1.1" 200 2 "http://localhost:8080/log?dag_id=tutorial&task_id=print_date&execution_date=2022-11-28T16%3A16%3A57.622614%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36 Edg/107.0.1418.56"
 webserver | [2022-11-28 21:47:53,757] {base.py:71} INFO - Using connection ID 'loki' for task execution.
 webserver | [2022-11-28 21:47:53,759] {http.py:148} INFO - Sending 'GET' to url: http://localhost:3101/loki/api/v1/query_range
 webserver | [2022-11-28 21:47:53 +0530] [56340] [WARNING] Worker with pid 56748 was terminated due to signal 11
 webserver | [2022-11-28 21:47:53 +0530] [56856] [INFO] Booting worker with pid: 56856
 scheduler | [2022-11-28 21:51:01,392] {scheduler_job.py:1380} INFO - Resetting orphaned tasks for active dag runs
 triggerer | [2022-11-28 21:51:09,318] {triggerer_job.py:344} ERROR - Triggerer's async thread was blocked for 0.27 seconds, likely by a badly-written trigger. Set PYTHONASYNCIODEBUG=1 to get more information on overrunning coroutines.

@snjypl
Copy link
Owner

snjypl commented Nov 28, 2022

@saritatewari4 the webserver worker is exiting due to error

webserver | [2022-11-28 21:47:53 +0530] [56340] [WARNING] Worker with pid 56748 was terminated due to signal 11
will have to debug the reason for that.

can you check if you are getting this issue with fileloghandler? just to make sure the issue is with the loki handler.

@saritatewari4
Copy link
Author

@snjypl , I am not getting any error when setting remote logging to false. could you please elaborate what I should use in case of fileloghandler.

@snjypl
Copy link
Owner

snjypl commented Nov 28, 2022

@saritatewari4 can you try this gist. it queries the loki for airflow log.

wanted to verify that there is no issue retrieving logs from loki.

you will have to update the loki credentails in the code.

@snjypl snjypl self-assigned this Nov 28, 2022
@saritatewari4
Copy link
Author

@snjypl , This is the output when I ran this:

tutorial % python3 loki.py
{'status': 'success', 'data': {'resultType': 'streams', 'result': [{'stream': {'dag_id': 'tutorial', 'map_index': '-1', 'run_id': 'manual__2022-11-28T16:16:57.622614+00:00', 'task_id': 'print_date', 'try_number': '1'}, 'values': [['1669652221724952064', '{"line": "[2022-11-28T21:47:01.388+0530] {taskinstance.py:1165} INFO - Dependencies all met for <TaskInstance: tutorial.print_date manual__2022-11-28T16:16:57.622614+00:00 [queued]>\\n", "run_id": "manual__2022-11-28T16:16:57.622614+00:00", "try_number": 1, "map_index": -1}']]}], 'stats': {'summary': {'bytesProcessedPerSecond': 54749, 'linesProcessedPerSecond': 247, 'totalBytesProcessed': 20147, 'totalLinesProcessed': 91, 'execTime': 0.3679847}, 'store': {'totalChunksRef': 4, 'totalChunksDownloaded': 4, 'chunksDownloadTime': 0.0211991, 'headChunkBytes': 0, 'headChunkLines': 0, 'decompressedBytes': 20147, 'decompressedLines': 91, 'compressedBytes': 5847, 'totalDuplicates': 0}, 'ingester': {'totalReached': 1, 'totalChunksMatched': 0, 'totalBatches': 0, 'totalLinesSent': 0, 'headChunkBytes': 0, 'headChunkLines': 0, 'decompressedBytes': 0, 'decompressedLines': 0, 'compressedBytes': 0, 'totalDuplicates': 0}}}}

@snjypl
Copy link
Owner

snjypl commented Nov 29, 2022

@saritatewari4
seems like there is no issue with fetching log from loki. the response seems to be correct.

Can you please share the complete websever log?

you can restart the webserver and access the log from UI, and share the whole log, it will help in debugging.

also the airflow webserver config, worker class etc.

@saritatewari4
Copy link
Author

@snjypl , Please check the logs below:

Screenshot 2022-11-29 at 4 17 09 PM

@snjypl
Copy link
Owner

snjypl commented Nov 29, 2022

@saritatewari4 i meant the airflow logs in the terminal. you had share part of it previously. please share the complete logs.

@snjypl
Copy link
Owner

snjypl commented Nov 29, 2022

also, which webserver worker class are you using? is it sync, gevent or eventlet? i will be able to see it in the start of the airflow webserver log.

@snjypl
Copy link
Owner

snjypl commented Nov 29, 2022

eg:
image

@saritatewari4
Copy link
Author

saritatewari4 commented Nov 29, 2022

Please get the logs below:

airflow-tut % airflow standalone
standalone | Starting Airflow Standalone
standalone | Checking database is initialized
INFO  [alembic.runtime.migration] Context impl SQLiteImpl.
INFO  [alembic.runtime.migration] Will assume non-transactional DDL.
WARNI [unusual_prefix_13845c1f2ab26cc55402f614e7ba73520a00bff2_example_local_kubernetes_executor] Could not import DAGs in example_local_kubernetes_executor.py
Traceback (most recent call last):
  File "/Users/l003107/Library/Python/3.9/lib/python/site-packages/airflow/example_dags/example_local_kubernetes_executor.py", line 37, in <module>
    from kubernetes.client import models as k8s
ModuleNotFoundError: No module named 'kubernetes'
WARNI [unusual_prefix_13845c1f2ab26cc55402f614e7ba73520a00bff2_example_local_kubernetes_executor] Install Kubernetes dependencies with: pip install apache-airflow[cncf.kubernetes]
WARNI [airflow.task.operators] Dependency <Task(BashOperator): create_entry_group>, delete_entry_group already registered for DAG: example_complex
WARNI [airflow.task.operators] Dependency <Task(BashOperator): delete_entry_group>, create_entry_group already registered for DAG: example_complex
WARNI [airflow.task.operators] Dependency <Task(BashOperator): create_entry_gcs>, delete_entry already registered for DAG: example_complex
WARNI [airflow.task.operators] Dependency <Task(BashOperator): delete_entry>, create_entry_gcs already registered for DAG: example_complex
WARNI [airflow.task.operators] Dependency <Task(BashOperator): create_tag>, delete_tag already registered for DAG: example_complex
WARNI [airflow.task.operators] Dependency <Task(BashOperator): delete_tag>, create_tag already registered for DAG: example_complex
WARNI [airflow.task.operators] Dependency <Task(_PythonDecoratedOperator): print_the_context>, log_sql_query already registered for DAG: example_python_operator
WARNI [airflow.task.operators] Dependency <Task(_PythonDecoratedOperator): log_sql_query>, print_the_context already registered for DAG: example_python_operator
WARNI [airflow.task.operators] Dependency <Task(_PythonDecoratedOperator): print_the_context>, log_sql_query already registered for DAG: example_python_operator
WARNI [airflow.task.operators] Dependency <Task(_PythonDecoratedOperator): log_sql_query>, print_the_context already registered for DAG: example_python_operator
WARNI [airflow.task.operators] Dependency <Task(_PythonDecoratedOperator): print_the_context>, log_sql_query already registered for DAG: example_python_operator
WARNI [airflow.task.operators] Dependency <Task(_PythonDecoratedOperator): log_sql_query>, print_the_context already registered for DAG: example_python_operator
WARNI [airflow.task.operators] Dependency <Task(_PythonDecoratedOperator): print_the_context>, log_sql_query already registered for DAG: example_python_operator
WARNI [airflow.task.operators] Dependency <Task(_PythonDecoratedOperator): log_sql_query>, print_the_context already registered for DAG: example_python_operator
WARNI [airflow.task.operators] Dependency <Task(_PythonDecoratedOperator): prepare_email>, send_email already registered for DAG: example_dag_decorator
WARNI [airflow.task.operators] Dependency <Task(EmailOperator): send_email>, prepare_email already registered for DAG: example_dag_decorator
WARNI [unusual_prefix_9c57613aa821abd8d8230eaf23040b4e388f2ee5_example_kubernetes_executor] The example_kubernetes_executor example DAG requires the kubernetes provider. Please install it with: pip install apache-airflow[cncf.kubernetes]
WARNI [airflow.models.crypto] empty cryptography key - values will not be stored encrypted.
standalone | Database ready
 triggerer | ____________       _____________
 triggerer | ____    |__( )_________  __/__  /________      __
 triggerer | ____  /| |_  /__  ___/_  /_ __  /_  __ \_ | /| / /
 triggerer | ___  ___ |  / _  /   _  __/ _  / / /_/ /_ |/ |/ /
 triggerer | _/_/  |_/_/  /_/    /_/    /_/  \____/____/|__/
 triggerer | [2022-11-29 16:35:35,503] {triggerer_job.py:101} INFO - Starting the triggerer
 scheduler | ____________       _____________
 scheduler | ____    |__( )_________  __/__  /________      __
 scheduler | ____  /| |_  /__  ___/_  /_ __  /_  __ \_ | /| / /
 scheduler | ___  ___ |  / _  /   _  __/ _  / / /_/ /_ |/ |/ /
 scheduler | _/_/  |_/_/  /_/    /_/    /_/  \____/____/|__/
 scheduler | [2022-11-29 16:35:35,686] {scheduler_job.py:700} INFO - Starting the scheduler
 scheduler | [2022-11-29 16:35:35,686] {scheduler_job.py:705} INFO - Processing each file at most -1 times
 scheduler | [2022-11-29 16:35:35,693] {executor_loader.py:107} INFO - Loaded executor: SequentialExecutor
 scheduler | [2022-11-29 16:35:35,697] {manager.py:163} INFO - Launched DagFileProcessorManager with pid: 55471
 scheduler | [2022-11-29 16:35:35,699] {scheduler_job.py:1380} INFO - Resetting orphaned tasks for active dag runs
 scheduler | [2022-11-29 16:35:35 +0530] [55470] [INFO] Starting gunicorn 20.1.0
 scheduler | [2022-11-29 16:35:35 +0530] [55470] [INFO] Listening at: http://[::]:8793 (55470)
 scheduler | [2022-11-29 16:35:35 +0530] [55470] [INFO] Using worker: sync
 scheduler | [2022-11-29 16:35:35,764] {settings.py:58} INFO - Configured default timezone Timezone('UTC')
 scheduler | [2022-11-29 16:35:35,802] {logging_config.py:47} INFO - Successfully imported user-defined logging config from log_config.DEFAULT_LOGGING_CONFIG
 scheduler | [2022-11-29 16:35:35 +0530] [55472] [INFO] Booting worker with pid: 55472
 scheduler | [2022-11-29 16:35:35 +0530] [55473] [INFO] Booting worker with pid: 55473
 scheduler | [2022-11-29T16:35:35.850+0530] {manager.py:409} WARNING - Because we cannot use more than 1 thread (parsing_processes = 2) when using sqlite. So we set parallelism to 1.
 webserver | [2022-11-29 16:35:38,865] {logging_config.py:47} INFO - Successfully imported user-defined logging config from log_config.DEFAULT_LOGGING_CONFIG
 webserver | [2022-11-29 16:35:42 +0530] [55469] [INFO] Starting gunicorn 20.1.0
 webserver | [2022-11-29 16:35:42 +0530] [55469] [INFO] Listening at: http://0.0.0.0:8080 (55469)
 webserver | [2022-11-29 16:35:42 +0530] [55469] [INFO] Using worker: sync
 webserver | [2022-11-29 16:35:43 +0530] [55533] [INFO] Booting worker with pid: 55533
 webserver | [2022-11-29 16:35:43 +0530] [55534] [INFO] Booting worker with pid: 55534
 webserver | [2022-11-29 16:35:43 +0530] [55535] [INFO] Booting worker with pid: 55535
 webserver | [2022-11-29 16:35:43 +0530] [55536] [INFO] Booting worker with pid: 55536
standalone | 
standalone | Airflow is ready
standalone | Login with username: admin  password: AEtBEC5Rh32haqM6
standalone | Airflow Standalone is for development purposes only. Do not use this in production!
standalone | 

@saritatewari4
Copy link
Author

@snjypl . worker_class is set as sync

@snjypl
Copy link
Owner

snjypl commented Nov 29, 2022

@saritatewari4 thanks, there is a known issue with 'gevent' worker class, but since you are using sync worker class that shouldn't be a problem.

locally, i tested it on airflow standalone , am not getting any issue.

i have pushed some changes with extra logging to debug/issue-2-webserver-signal-11-on-log-read branch.
you can install it using the below command.

pip install --force git+https://github.com/snjypl/airflow-provider-grafana-loki.git@debug/issue-2-webserver-signal-11-on-log-read --no-deps

@saritatewari4
Copy link
Author

@snjypl , which version of python and airflow you are using?

@saritatewari4
Copy link
Author

Hello @snjypl ,

To quickly spin up grafana and loki in local I have uploaded the composer file here

Please use this command this command :

docker-compose -f docker-compose-with-otel.yml up

Script to install airflow as standalone: script

Airflow custom logging folder

Airflow configuration for logging as below:

remote_logging = True
remote_log_conn_id =loki
remote_base_log_folder =loki
logging_config_class = log_config.DEFAULT_LOGGING_CONFIG

Loki connection hook details:

connection id= loki
connection type= grafana loki
host= localhost
port=3101

Installed airflow grafana provider as follows:

pip install --force git+https://github.com/snjypl/airflow-provider-grafana-loki.git@debug/issue-2-webserver-signal-11-on-log-read --no-dep

Please let me know where I am missing the configuration.

@snjypl
Copy link
Owner

snjypl commented Nov 29, 2022

@saritatewari4 can you please share the latest logs?

@snjypl
Copy link
Owner

snjypl commented Nov 29, 2022

Hello @snjypl ,

To quickly spin up grafana and loki in local I have uploaded the composer file here

Please use this command this command :

docker-compose -f docker-compose-with-otel.yml up

Script to install airflow as standalone: script

Airflow custom logging folder

Airflow configuration for logging as below:

remote_logging = True
remote_log_conn_id =loki
remote_base_log_folder =loki
logging_config_class = log_config.DEFAULT_LOGGING_CONFIG

Loki connection hook details:

connection id= loki
connection type= grafana loki
host= localhost
port=3101

Installed airflow grafana provider as follows:

pip install --force git+https://github.com/snjypl/airflow-provider-grafana-loki.git@debug/issue-2-webserver-signal-11-on-log-read --no-dep

Please let me know where I am missing the configuration.

thanks @saritatewari4 i will try to replicate your environment, in the meanwhile, can you please share the terminal logs while viewing the logs in UI

@saritatewari4
Copy link
Author

@snjypl , Please check the logs:

airflow standalone
standalone | Starting Airflow Standalone
standalone | Checking database is initialized
INFO [alembic.runtime.migration] Context impl SQLiteImpl.
INFO [alembic.runtime.migration] Will assume non-transactional DDL.
WARNI [unusual_prefix_1fed6ad580d2b2998ee5722f307cbd959e6c73a1_example_local_kubernetes_executor] Could not import DAGs in example_local_kubernetes_executor.py
Traceback (most recent call last):
File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/example_dags/example_local_kubernetes_executor.py", line 37, in
from kubernetes.client import models as k8s
ModuleNotFoundError: No module named 'kubernetes'
WARNI [unusual_prefix_1fed6ad580d2b2998ee5722f307cbd959e6c73a1_example_local_kubernetes_executor] Install Kubernetes dependencies with: pip install apache-airflow[cncf.kubernetes]
WARNI [airflow.task.operators] Dependency <Task(BashOperator): create_entry_group>, delete_entry_group already registered for DAG: example_complex
WARNI [airflow.task.operators] Dependency <Task(BashOperator): delete_entry_group>, create_entry_group already registered for DAG: example_complex
WARNI [airflow.task.operators] Dependency <Task(BashOperator): create_entry_gcs>, delete_entry already registered for DAG: example_complex
WARNI [airflow.task.operators] Dependency <Task(BashOperator): delete_entry>, create_entry_gcs already registered for DAG: example_complex
WARNI [airflow.task.operators] Dependency <Task(BashOperator): create_tag>, delete_tag already registered for DAG: example_complex
WARNI [airflow.task.operators] Dependency <Task(BashOperator): delete_tag>, create_tag already registered for DAG: example_complex
WARNI [airflow.task.operators] Dependency <Task(PythonDecoratedOperator): print_the_context>, log_sql_query already registered for DAG: example_python_operator
WARNI [airflow.task.operators] Dependency <Task(PythonDecoratedOperator): log_sql_query>, print_the_context already registered for DAG: example_python_operator
WARNI [airflow.task.operators] Dependency <Task(PythonDecoratedOperator): print_the_context>, log_sql_query already registered for DAG: example_python_operator
WARNI [airflow.task.operators] Dependency <Task(PythonDecoratedOperator): log_sql_query>, print_the_context already registered for DAG: example_python_operator
WARNI [airflow.task.operators] Dependency <Task(PythonDecoratedOperator): print_the_context>, log_sql_query already registered for DAG: example_python_operator
WARNI [airflow.task.operators] Dependency <Task(PythonDecoratedOperator): log_sql_query>, print_the_context already registered for DAG: example_python_operator
WARNI [airflow.task.operators] Dependency <Task(PythonDecoratedOperator): print_the_context>, log_sql_query already registered for DAG: example_python_operator
WARNI [airflow.task.operators] Dependency <Task(PythonDecoratedOperator): log_sql_query>, print_the_context already registered for DAG: example_python_operator
WARNI [unusual_prefix_42ce6dccd802843a25dd01f6a494613f58a7a4a7_example_python_operator] The virtalenv_python example task requires virtualenv, please install it.
WARNI [unusual_prefix_b0bec3949a8cb484b2a8b62f897e0d56279e9eb4_tutorial_taskflow_api_virtualenv] The tutorial_taskflow_api_virtualenv example DAG requires virtualenv, please install it.
WARNI [airflow.task.operators] Dependency <Task(PythonDecoratedOperator): prepare_email>, send_email already registered for DAG: example_dag_decorator
WARNI [airflow.task.operators] Dependency <Task(EmailOperator): send_email>, prepare_email already registered for DAG: example_dag_decorator
WARNI [unusual_prefix_4331674026d34722800968de75796581b97a0045_example_kubernetes_executor] The example_kubernetes_executor example DAG requires the kubernetes provider. Please install it with: pip install apache-airflow[cncf.kubernetes]
WARNI [airflow.models.crypto] empty cryptography key - values will not be stored encrypted.
standalone | Database ready
[2022-11-29 21:58:41,635] {providers_manager.py:208} INFO - Optional provider feature disabled when importing 'airflow.providers.google.cloud.hooks.cloud_sql.CloudSQLHook' from 'apache-airflow-providers-google' package
[2022-11-29 21:58:41,636] {providers_manager.py:208} INFO - Optional provider feature disabled when importing 'airflow.providers.google.cloud.hooks.cloud_sql.CloudSQLDatabaseHook' from 'apache-airflow-providers-google' package
[2022-11-29 21:58:42,123] {providers_manager.py:208} INFO - Optional provider feature disabled when importing 'airflow.providers.google.cloud.hooks.compute_ssh.ComputeEngineSSHHook' from 'apache-airflow-providers-google' package
[2022-11-29 21:58:42,124] {providers_manager.py:208} INFO - Optional provider feature disabled when importing 'airflow.providers.google.leveldb.hooks.leveldb.LevelDBHook' from 'apache-airflow-providers-google' package
[2022-11-29 21:58:42,243] {providers_manager.py:208} INFO - Optional provider feature disabled when importing 'airflow.providers.google.cloud.hooks.cloud_sql.CloudSQLHook' from 'apache-airflow-providers-google' package
[2022-11-29 21:58:42,244] {providers_manager.py:208} INFO - Optional provider feature disabled when importing 'airflow.providers.google.cloud.hooks.cloud_sql.CloudSQLDatabaseHook' from 'apache-airflow-providers-google' package
[2022-11-29 21:58:42,244] {providers_manager.py:208} INFO - Optional provider feature disabled when importing 'airflow.providers.google.cloud.hooks.compute_ssh.ComputeEngineSSHHook' from 'apache-airflow-providers-google' package
[2022-11-29 21:58:42,245] {providers_manager.py:208} INFO - Optional provider feature disabled when importing 'airflow.providers.google.leveldb.hooks.leveldb.LevelDBHook' from 'apache-airflow-providers-google' package
scheduler | ____________ _____________
scheduler | ____ |( )
/ /________ __
scheduler | ____ /| |
/__ / / __ / __ _ | /| / /
scheduler | ___ ___ | / _ / _ __/ _ / / /
/ /_ |/ |/ /
scheduler | // |// // // // _//|/
scheduler | [2022-11-29 21:58:47,081] {scheduler_job.py:700} INFO - Starting the scheduler
scheduler | [2022-11-29 21:58:47,082] {scheduler_job.py:705} INFO - Processing each file at most -1 times
scheduler | [2022-11-29 21:58:47,089] {executor_loader.py:107} INFO - Loaded executor: SequentialExecutor
scheduler | [2022-11-29 21:58:47,097] {manager.py:163} INFO - Launched DagFileProcessorManager with pid: 23652
scheduler | [2022-11-29 21:58:47,100] {scheduler_job.py:1380} INFO - Resetting orphaned tasks for active dag runs
triggerer | ____________ _____________
triggerer | ____ |( )
_______ / /________ __
triggerer | ____ /| |_ /__ / / __ / __ _ | /| / /
triggerer | ___ ___ | / _ / _ / _ / / // / |/ |/ /
triggerer | // |// // // // _
/____/|__/
triggerer | [2022-11-29 21:58:47,117] {triggerer_job.py:101} INFO - Starting the triggerer
scheduler | [2022-11-29 21:58:48 +0530] [23651] [INFO] Starting gunicorn 20.1.0
scheduler | [2022-11-29 21:58:48 +0530] [23651] [INFO] Listening at: http://[::]:8793 (23651)
scheduler | [2022-11-29 21:58:48 +0530] [23651] [INFO] Using worker: sync
scheduler | [2022-11-29 21:58:48 +0530] [23654] [INFO] Booting worker with pid: 23654
scheduler | [2022-11-29 21:58:48 +0530] [23655] [INFO] Booting worker with pid: 23655
scheduler | [2022-11-29 21:58:48,710] {settings.py:58} INFO - Configured default timezone Timezone('UTC')
scheduler | [2022-11-29 21:58:48,712] {logging_config.py:47} INFO - Successfully imported user-defined logging config from log_config.DEFAULT_LOGGING_CONFIG
scheduler | [2022-11-29T21:58:48.719+0530] {manager.py:409} WARNING - Because we cannot use more than 1 thread (parsing_processes = 2) when using sqlite. So we set parallelism to 1.
webserver | [2022-11-29 21:58:50,101] {logging_config.py:47} INFO - Successfully imported user-defined logging config from log_config.DEFAULT_LOGGING_CONFIG
webserver | [2022-11-29 21:58:52,044] {providers_manager.py:208} INFO - Optional provider feature disabled when importing 'airflow.providers.google.cloud.hooks.cloud_sql.CloudSQLHook' from 'apache-airflow-providers-google' package
webserver | [2022-11-29 21:58:52,045] {providers_manager.py:208} INFO - Optional provider feature disabled when importing 'airflow.providers.google.cloud.hooks.cloud_sql.CloudSQLDatabaseHook' from 'apache-airflow-providers-google' package
webserver | [2022-11-29 21:58:52,846] {providers_manager.py:208} INFO - Optional provider feature disabled when importing 'airflow.providers.google.cloud.hooks.compute_ssh.ComputeEngineSSHHook' from 'apache-airflow-providers-google' package
webserver | [2022-11-29 21:58:52,849] {providers_manager.py:208} INFO - Optional provider feature disabled when importing 'airflow.providers.google.leveldb.hooks.leveldb.LevelDBHook' from 'apache-airflow-providers-google' package
webserver | [2022-11-29 21:58:53,046] {providers_manager.py:208} INFO - Optional provider feature disabled when importing 'airflow.providers.google.cloud.hooks.cloud_sql.CloudSQLHook' from 'apache-airflow-providers-google' package
webserver | [2022-11-29 21:58:53,047] {providers_manager.py:208} INFO - Optional provider feature disabled when importing 'airflow.providers.google.cloud.hooks.cloud_sql.CloudSQLDatabaseHook' from 'apache-airflow-providers-google' package
webserver | [2022-11-29 21:58:53,048] {providers_manager.py:208} INFO - Optional provider feature disabled when importing 'airflow.providers.google.cloud.hooks.compute_ssh.ComputeEngineSSHHook' from 'apache-airflow-providers-google' package
webserver | [2022-11-29 21:58:53,049] {providers_manager.py:208} INFO - Optional provider feature disabled when importing 'airflow.providers.google.leveldb.hooks.leveldb.LevelDBHook' from 'apache-airflow-providers-google' package
webserver | [2022-11-29 21:58:54 +0530] [23653] [INFO] Starting gunicorn 20.1.0
webserver | [2022-11-29 21:58:54,780] {providers_manager.py:208} INFO - Optional provider feature disabled when importing 'airflow.providers.google.cloud.hooks.cloud_sql.CloudSQLHook' from 'apache-airflow-providers-google' package
webserver | [2022-11-29 21:58:54,781] {providers_manager.py:208} INFO - Optional provider feature disabled when importing 'airflow.providers.google.cloud.hooks.cloud_sql.CloudSQLDatabaseHook' from 'apache-airflow-providers-google' package
webserver | [2022-11-29 21:58:54,782] {providers_manager.py:208} INFO - Optional provider feature disabled when importing 'airflow.providers.google.cloud.hooks.compute_ssh.ComputeEngineSSHHook' from 'apache-airflow-providers-google' package
webserver | [2022-11-29 21:58:54,783] {providers_manager.py:208} INFO - Optional provider feature disabled when importing 'airflow.providers.google.leveldb.hooks.leveldb.LevelDBHook' from 'apache-airflow-providers-google' package
webserver | [2022-11-29 21:58:54 +0530] [23653] [INFO] Listening at: http://0.0.0.0:8080 (23653)
webserver | [2022-11-29 21:58:54 +0530] [23653] [INFO] Using worker: sync
webserver | [2022-11-29 21:58:54 +0530] [23665] [INFO] Booting worker with pid: 23665
webserver | [2022-11-29 21:58:54 +0530] [23666] [INFO] Booting worker with pid: 23666
webserver | [2022-11-29 21:58:54 +0530] [23667] [INFO] Booting worker with pid: 23667
webserver | [2022-11-29 21:58:54 +0530] [23668] [INFO] Booting worker with pid: 23668
standalone |
standalone | Airflow is ready
standalone | Login with username: admin password: gddbkdsgsCDUmtwa
standalone | Airflow Standalone is for development purposes only. Do not use this in production!
standalone |
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00 HTTP/1.1" 200 43697 "http://localhost:8080/dags/tutorial_dag/graph" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/appbuilder/select2/select2.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/appbuilder/datepicker/bootstrap-datepicker.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/appbuilder/css/bootstrap.min.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/appbuilder/css/flags/flags16.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/appbuilder/css/font-awesome.min.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/dist/materialIcons.f9559e4953177b8b9a4a.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/dist/airflowDefaultTheme.731e57571b52cca4350d.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/dist/loadingDots.5da42d00b5455806e709.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/appbuilder/css/ab.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/dist/bootstrap-datetimepicker.min.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/dist/main.a53ccbaa4ca384c91837.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/dist/switch.0e45299d29df3c0c8282.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/dist/flash.2b1a873e0aabc828a165.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/appbuilder/js/ab_filters.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/appbuilder/js/jquery-latest.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/appbuilder/js/ab_actions.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/appbuilder/js/bootstrap.min.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/appbuilder/select2/select2.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/appbuilder/js/ab.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/appbuilder/datepicker/bootstrap-datepicker.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/dist/moment.197a6f3cab42e240f8bd.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/dist/main.a53ccbaa4ca384c91837.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/dist/bootstrap3-typeahead.min.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/dist/bootstrap-datetimepicker.min.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/loading.gif HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/dist/dag.a9efcc271e92a9bdc654.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /static/dist/tiLog.7864c61b0b31ef37f084.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:03 +0530] "GET /object/next_run_datasets/tutorial_dag HTTP/1.1" 200 2 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:04 +0530] "GET /static/pin_32.png HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | [2022-11-29 21:59:04,211] {loki_task_handler.py:128} INFO - loki log query params {'query': ' {dag_id="tutorial_dag",task_id="transform"}\n | json try_number="try_number",map_index="map_index",run_id="run_id"\n | try_number="1" and\n map_index="-1" and\n run_id="manual__2022-11-29T15:41:54.124092+00:00"\n | error!="JSONParserErr"\n ', 'start': '2022-11-14T15:42:06.551709+00:00', 'end': '2022-11-29T16:42:07.036169+00:00', 'direction': 'forward'}
webserver | [2022-11-29 21:59:04,222] {base.py:71} INFO - Using connection ID 'loki' for task execution.
webserver | [2022-11-29 21:59:04,225] {http.py:148} INFO - Sending 'GET' to url: http://localhost:3101/loki/api/v1/query_range
webserver | [2022-11-29 21:59:04 +0530] [23653] [WARNING] Worker with pid 23665 was terminated due to signal 11
webserver | [2022-11-29 21:59:04 +0530] [23679] [INFO] Booting worker with pid: 23679
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00 HTTP/1.1" 200 12169 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/appbuilder/css/bootstrap.min.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/appbuilder/datepicker/bootstrap-datepicker.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/appbuilder/css/ab.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/appbuilder/select2/select2.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/appbuilder/css/flags/flags16.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/dist/materialIcons.f9559e4953177b8b9a4a.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/dist/loadingDots.5da42d00b5455806e709.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/dist/main.a53ccbaa4ca384c91837.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/dist/bootstrap-datetimepicker.min.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/appbuilder/css/font-awesome.min.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/dist/airflowDefaultTheme.731e57571b52cca4350d.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/dist/flash.2b1a873e0aabc828a165.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/dist/switch.0e45299d29df3c0c8282.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/dist/graph.46650434f8a0c4037b38.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/appbuilder/js/ab_filters.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/appbuilder/js/ab_actions.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/appbuilder/js/bootstrap.min.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/appbuilder/select2/select2.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/appbuilder/datepicker/bootstrap-datepicker.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/dist/moment.197a6f3cab42e240f8bd.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/appbuilder/js/ab.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/dist/main.a53ccbaa4ca384c91837.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/dist/bootstrap-datetimepicker.min.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/dist/bootstrap3-typeahead.min.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/dist/dag.a9efcc271e92a9bdc654.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/dist/d3.min.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/dist/d3-shape.min.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/dist/dagre-d3.min.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/dist/d3-tip.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/dist/graph.46650434f8a0c4037b38.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:06 +0530] "GET /static/appbuilder/js/jquery-latest.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:07 +0530] "GET /object/next_run_datasets/tutorial_dag HTTP/1.1" 200 2 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:07 +0530] "GET /object/next_run_datasets/tutorial_dag HTTP/1.1" 200 2 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/www/views.py:1931 RemovedInAirflow3Warning: This attribute is deprecated. Please use airflow.models.DAG.get_is_paused method.
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:15 +0530] "POST /trigger HTTP/1.1" 302 409 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:16 +0530] "GET /dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00 HTTP/1.1" 200 12231 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/appbuilder/css/font-awesome.min.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/appbuilder/css/bootstrap.min.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/appbuilder/select2/select2.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/appbuilder/datepicker/bootstrap-datepicker.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/appbuilder/css/flags/flags16.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/appbuilder/css/ab.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/dist/airflowDefaultTheme.731e57571b52cca4350d.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/dist/main.a53ccbaa4ca384c91837.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/dist/bootstrap-datetimepicker.min.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/dist/materialIcons.f9559e4953177b8b9a4a.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/dist/loadingDots.5da42d00b5455806e709.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/dist/switch.0e45299d29df3c0c8282.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/dist/graph.46650434f8a0c4037b38.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/appbuilder/js/jquery-latest.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/dist/flash.2b1a873e0aabc828a165.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/appbuilder/js/ab_filters.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/appbuilder/js/ab_actions.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/appbuilder/datepicker/bootstrap-datepicker.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/appbuilder/js/bootstrap.min.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/appbuilder/js/ab.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/appbuilder/select2/select2.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/dist/moment.197a6f3cab42e240f8bd.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/dist/main.a53ccbaa4ca384c91837.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/dist/bootstrap3-typeahead.min.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/dist/dag.a9efcc271e92a9bdc654.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/dist/dagre-d3.min.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/dist/d3-shape.min.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/dist/bootstrap-datetimepicker.min.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/dist/d3-tip.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/dist/graph.46650434f8a0c4037b38.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /static/dist/d3.min.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /object/next_run_datasets/tutorial_dag HTTP/1.1" 200 2 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:17 +0530] "GET /object/next_run_datasets/tutorial_dag HTTP/1.1" 200 2 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
scheduler | [2022-11-29 21:59:18,157] {scheduler_job.py:346} INFO - 1 tasks up for execution:
scheduler | <TaskInstance: tutorial_dag.extract manual__2022-11-29T16:29:15.840904+00:00 [scheduled]>
scheduler | [2022-11-29 21:59:18,157] {scheduler_job.py:411} INFO - DAG tutorial_dag has 0/16 running and queued tasks
scheduler | [2022-11-29 21:59:18,158] {scheduler_job.py:497} INFO - Setting the following tasks to queued state:
scheduler | <TaskInstance: tutorial_dag.extract manual__2022-11-29T16:29:15.840904+00:00 [scheduled]>
scheduler | [2022-11-29 21:59:18,161] {scheduler_job.py:536} INFO - Sending TaskInstanceKey(dag_id='tutorial_dag', task_id='extract', run_id='manual__2022-11-29T16:29:15.840904+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default
scheduler | [2022-11-29 21:59:18,162] {base_executor.py:95} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'tutorial_dag', 'extract', 'manual__2022-11-29T16:29:15.840904+00:00', '--local', '--subdir', '/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/example_dags/tutorial_dag.py']
scheduler | [2022-11-29 21:59:18,164] {sequential_executor.py:61} INFO - Executing command: ['airflow', 'tasks', 'run', 'tutorial_dag', 'extract', 'manual__2022-11-29T16:29:15.840904+00:00', '--local', '--subdir', '/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/example_dags/tutorial_dag.py']
scheduler | [2022-11-29 21:59:19,423] {dagbag.py:537} INFO - Filling up the DagBag from /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/example_dags/tutorial_dag.py
scheduler | [2022-11-29 21:59:19,853] {task_command.py:376} INFO - Running <TaskInstance: tutorial_dag.extract manual__2022-11-29T16:29:15.840904+00:00 [queued]> on host 192.168.1.21
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /dags/tutorial_dag/grid?root= HTTP/1.1" 200 10507 "http://localhost:8080/dags/tutorial_dag/graph?root=&execution_date=2022-11-29T15%3A41%3A54.124092%2B00%3A00" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /static/appbuilder/css/bootstrap.min.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /static/appbuilder/css/font-awesome.min.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /static/appbuilder/datepicker/bootstrap-datepicker.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /static/appbuilder/css/flags/flags16.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /static/dist/airflowDefaultTheme.731e57571b52cca4350d.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /static/appbuilder/css/ab.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /static/dist/materialIcons.f9559e4953177b8b9a4a.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /static/dist/main.a53ccbaa4ca384c91837.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /static/dist/loadingDots.5da42d00b5455806e709.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /static/dist/bootstrap-datetimepicker.min.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /static/dist/switch.0e45299d29df3c0c8282.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /static/dist/flash.2b1a873e0aabc828a165.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /static/appbuilder/js/jquery-latest.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /static/appbuilder/js/ab_actions.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /static/appbuilder/js/ab_filters.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /static/appbuilder/js/bootstrap.min.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /static/appbuilder/datepicker/bootstrap-datepicker.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /static/appbuilder/select2/select2.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /static/dist/moment.197a6f3cab42e240f8bd.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /static/dist/main.a53ccbaa4ca384c91837.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /static/appbuilder/js/ab.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /static/dist/bootstrap-datetimepicker.min.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:20 +0530] "GET /static/dist/bootstrap3-typeahead.min.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:21 +0530] "GET /static/dist/dag.a9efcc271e92a9bdc654.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:21 +0530] "GET /static/dist/grid.e8b0d49ea9d4525371ed.js HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
scheduler | [2022-11-29 21:59:21,067] {scheduler_job.py:588} INFO - Executor reports execution of tutorial_dag.extract run_id=manual__2022-11-29T16:29:15.840904+00:00 exited with status success for try_number 1
scheduler | [2022-11-29 21:59:21,086] {scheduler_job.py:631} INFO - TaskInstance Finished: dag_id=tutorial_dag, task_id=extract, run_id=manual__2022-11-29T16:29:15.840904+00:00, map_index=-1, run_start_date=2022-11-29 16:29:19.956905+00:00, run_end_date=2022-11-29 16:29:20.154234+00:00, run_duration=0.197329, state=success, executor_state=success, try_number=1, max_tries=2, job_id=20, pool=default_pool, queue=default, priority_weight=3, operator=PythonOperator, queued_dttm=2022-11-29 16:29:18.158558+00:00, queued_by_job_id=18, pid=23700
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:21 +0530] "GET /static/appbuilder/select2/select2.css HTTP/1.1" 304 0 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:21 +0530] "GET /object/grid_data?dag_id=tutorial_dag&num_runs=25 HTTP/1.1" 200 2399 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:21 +0530] "GET /object/next_run_datasets/tutorial_dag HTTP/1.1" 200 2 "http://localhost:8080/dags/tutorial_dag/grid?root=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
scheduler | [2022-11-29 21:59:23,597] {scheduler_job.py:346} INFO - 1 tasks up for execution:
scheduler | <TaskInstance: tutorial_dag.transform manual__2022-11-29T16:29:15.840904+00:00 [scheduled]>
scheduler | [2022-11-29 21:59:23,598] {scheduler_job.py:411} INFO - DAG tutorial_dag has 0/16 running and queued tasks
scheduler | [2022-11-29 21:59:23,598] {scheduler_job.py:497} INFO - Setting the following tasks to queued state:
scheduler | <TaskInstance: tutorial_dag.transform manual__2022-11-29T16:29:15.840904+00:00 [scheduled]>
scheduler | [2022-11-29 21:59:23,601] {scheduler_job.py:536} INFO - Sending TaskInstanceKey(dag_id='tutorial_dag', task_id='transform', run_id='manual__2022-11-29T16:29:15.840904+00:00', try_number=1, map_index=-1) to executor with priority 2 and queue default
scheduler | [2022-11-29 21:59:23,601] {base_executor.py:95} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'tutorial_dag', 'transform', 'manual__2022-11-29T16:29:15.840904+00:00', '--local', '--subdir', '/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/example_dags/tutorial_dag.py']
scheduler | [2022-11-29 21:59:23,603] {sequential_executor.py:61} INFO - Executing command: ['airflow', 'tasks', 'run', 'tutorial_dag', 'transform', 'manual__2022-11-29T16:29:15.840904+00:00', '--local', '--subdir', '/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/example_dags/tutorial_dag.py']
webserver | [2022-11-29 21:59:24,233] {app.py:1741} ERROR - Exception on /api/v1/dags/tutorial_dag/dagRuns/manual__2022-11-29T16:29:15.840904+00:00/taskInstances/transform/logs/1 [GET]
webserver | Traceback (most recent call last):
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/flask/app.py", line 2525, in wsgi_app
webserver | response = self.full_dispatch_request()
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/flask/app.py", line 1822, in full_dispatch_request
webserver | rv = self.handle_user_exception(e)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/flask/app.py", line 1820, in full_dispatch_request
webserver | rv = self.dispatch_request()
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/flask/app.py", line 1796, in dispatch_request
webserver | return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/decorators/decorator.py", line 68, in wrapper
webserver | response = function(request)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/decorators/uri_parsing.py", line 149, in wrapper
webserver | response = function(request)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/decorators/validation.py", line 399, in wrapper
webserver | return function(request)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/decorators/response.py", line 113, in wrapper
webserver | return _wrapper(request, response)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/decorators/response.py", line 90, in _wrapper
webserver | self.operation.api.get_connexion_response(response, self.mimetype)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/apis/abstract.py", line 366, in get_connexion_response
webserver | return cls._framework_to_connexion_response(response=response, mimetype=mimetype)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/apis/flask_api.py", line 165, in _framework_to_connexion_response
webserver | body=response.get_data() if not response.direct_passthrough else None,
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/werkzeug/wrappers/response.py", line 314, in get_data
webserver | self._ensure_sequence()
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/werkzeug/wrappers/response.py", line 376, in _ensure_sequence
webserver | self.make_sequence()
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/werkzeug/wrappers/response.py", line 391, in make_sequence
webserver | self.response = list(self.iter_encoded())
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/werkzeug/wrappers/response.py", line 50, in _iter_encoded
webserver | for item in iterable:
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/utils/log/log_reader.py", line 81, in read_log_stream
webserver | logs, metadata = self.read_log_chunks(ti, current_try_number, metadata)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/utils/log/log_reader.py", line 58, in read_log_chunks
webserver | logs, metadatas = self.log_handler.read(ti, try_number, metadata=metadata)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/utils/log/file_task_handler.py", line 284, in read
webserver | log, metadata = self._read(task_instance, try_number_element, metadata)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/grafana_loki_provider/log/loki_task_handler.py", line 118, in _read
webserver | start = ti.start_date - timedelta(days=15)
webserver | TypeError: unsupported operand type(s) for -: 'NoneType' and 'datetime.timedelta'
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:24 +0530] "GET /api/v1/dags/tutorial_dag/dagRuns/manual__2022-11-29T16:29:15.840904+00:00/taskInstances/transform/logs/1?full_content=false HTTP/1.1" 500 1543 "http://localhost:8080/dags/tutorial_dag/grid?root=&dag_run_id=manual__2022-11-29T16%3A29%3A15.840904%2B00%3A00&task_id=transform" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | [2022-11-29 21:59:24,822] {app.py:1741} ERROR - Exception on /api/v1/dags/tutorial_dag/dagRuns/manual__2022-11-29T16:29:15.840904+00:00/taskInstances/transform/logs/1 [GET]
webserver | Traceback (most recent call last):
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/flask/app.py", line 2525, in wsgi_app
webserver | response = self.full_dispatch_request()
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/flask/app.py", line 1822, in full_dispatch_request
webserver | rv = self.handle_user_exception(e)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/flask/app.py", line 1820, in full_dispatch_request
webserver | rv = self.dispatch_request()
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/flask/app.py", line 1796, in dispatch_request
webserver | return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/decorators/decorator.py", line 68, in wrapper
webserver | response = function(request)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/decorators/uri_parsing.py", line 149, in wrapper
webserver | response = function(request)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/decorators/validation.py", line 399, in wrapper
webserver | return function(request)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/decorators/response.py", line 113, in wrapper
webserver | return _wrapper(request, response)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/decorators/response.py", line 90, in _wrapper
webserver | self.operation.api.get_connexion_response(response, self.mimetype)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/apis/abstract.py", line 366, in get_connexion_response
webserver | return cls._framework_to_connexion_response(response=response, mimetype=mimetype)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/apis/flask_api.py", line 165, in _framework_to_connexion_response
webserver | body=response.get_data() if not response.direct_passthrough else None,
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/werkzeug/wrappers/response.py", line 314, in get_data
webserver | self._ensure_sequence()
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/werkzeug/wrappers/response.py", line 376, in _ensure_sequence
webserver | self.make_sequence()
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/werkzeug/wrappers/response.py", line 391, in make_sequence
webserver | self.response = list(self.iter_encoded())
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/werkzeug/wrappers/response.py", line 50, in _iter_encoded
webserver | for item in iterable:
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/utils/log/log_reader.py", line 81, in read_log_stream
webserver | logs, metadata = self.read_log_chunks(ti, current_try_number, metadata)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/utils/log/log_reader.py", line 58, in read_log_chunks
webserver | logs, metadatas = self.log_handler.read(ti, try_number, metadata=metadata)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/utils/log/file_task_handler.py", line 284, in read
webserver | log, metadata = self._read(task_instance, try_number_element, metadata)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/grafana_loki_provider/log/loki_task_handler.py", line 118, in _read
webserver | start = ti.start_date - timedelta(days=15)
webserver | TypeError: unsupported operand type(s) for -: 'NoneType' and 'datetime.timedelta'
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:24 +0530] "GET /api/v1/dags/tutorial_dag/dagRuns/manual__2022-11-29T16:29:15.840904+00:00/taskInstances/transform/logs/1?full_content=false HTTP/1.1" 500 1543 "http://localhost:8080/dags/tutorial_dag/grid?root=&dag_run_id=manual__2022-11-29T16%3A29%3A15.840904%2B00%3A00&task_id=transform" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:25 +0530] "GET /object/grid_data?dag_id=tutorial_dag&num_runs=25 HTTP/1.1" 200 2396 "http://localhost:8080/dags/tutorial_dag/grid?root=&dag_run_id=manual__2022-11-29T16%3A29%3A15.840904%2B00%3A00&task_id=transform" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | [2022-11-29 21:59:25,260] {app.py:1741} ERROR - Exception on /api/v1/dags/tutorial_dag/dagRuns/manual__2022-11-29T16:29:15.840904+00:00/taskInstances/transform/logs/1 [GET]
webserver | Traceback (most recent call last):
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/flask/app.py", line 2525, in wsgi_app
webserver | response = self.full_dispatch_request()
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/flask/app.py", line 1822, in full_dispatch_request
webserver | rv = self.handle_user_exception(e)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/flask/app.py", line 1820, in full_dispatch_request
webserver | rv = self.dispatch_request()
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/flask/app.py", line 1796, in dispatch_request
webserver | return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/decorators/decorator.py", line 68, in wrapper
webserver | response = function(request)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/decorators/uri_parsing.py", line 149, in wrapper
webserver | response = function(request)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/decorators/validation.py", line 399, in wrapper
webserver | return function(request)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/decorators/response.py", line 113, in wrapper
webserver | return _wrapper(request, response)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/decorators/response.py", line 90, in _wrapper
webserver | self.operation.api.get_connexion_response(response, self.mimetype)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/apis/abstract.py", line 366, in get_connexion_response
webserver | return cls._framework_to_connexion_response(response=response, mimetype=mimetype)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/apis/flask_api.py", line 165, in _framework_to_connexion_response
webserver | body=response.get_data() if not response.direct_passthrough else None,
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/werkzeug/wrappers/response.py", line 314, in get_data
webserver | self._ensure_sequence()
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/werkzeug/wrappers/response.py", line 376, in _ensure_sequence
webserver | self.make_sequence()
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/werkzeug/wrappers/response.py", line 391, in make_sequence
webserver | self.response = list(self.iter_encoded())
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/werkzeug/wrappers/response.py", line 50, in _iter_encoded
webserver | for item in iterable:
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/utils/log/log_reader.py", line 81, in read_log_stream
webserver | logs, metadata = self.read_log_chunks(ti, current_try_number, metadata)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/utils/log/log_reader.py", line 58, in read_log_chunks
webserver | logs, metadatas = self.log_handler.read(ti, try_number, metadata=metadata)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/utils/log/file_task_handler.py", line 284, in read
webserver | log, metadata = self._read(task_instance, try_number_element, metadata)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/grafana_loki_provider/log/loki_task_handler.py", line 118, in _read
webserver | start = ti.start_date - timedelta(days=15)
webserver | TypeError: unsupported operand type(s) for -: 'NoneType' and 'datetime.timedelta'
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:25 +0530] "GET /api/v1/dags/tutorial_dag/dagRuns/manual__2022-11-29T16:29:15.840904+00:00/taskInstances/transform/logs/1?full_content=false HTTP/1.1" 500 1543 "http://localhost:8080/dags/tutorial_dag/grid?root=&dag_run_id=manual__2022-11-29T16%3A29%3A15.840904%2B00%3A00&task_id=transform" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
scheduler | [2022-11-29 21:59:25,322] {dagbag.py:537} INFO - Filling up the DagBag from /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/example_dags/tutorial_dag.py
webserver | [2022-11-29 21:59:25,824] {app.py:1741} ERROR - Exception on /api/v1/dags/tutorial_dag/dagRuns/manual__2022-11-29T16:29:15.840904+00:00/taskInstances/transform/logs/1 [GET]
webserver | Traceback (most recent call last):
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/flask/app.py", line 2525, in wsgi_app
webserver | response = self.full_dispatch_request()
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/flask/app.py", line 1822, in full_dispatch_request
webserver | rv = self.handle_user_exception(e)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/flask/app.py", line 1820, in full_dispatch_request
webserver | rv = self.dispatch_request()
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/flask/app.py", line 1796, in dispatch_request
webserver | return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/decorators/decorator.py", line 68, in wrapper
webserver | response = function(request)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/decorators/uri_parsing.py", line 149, in wrapper
webserver | response = function(request)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/decorators/validation.py", line 399, in wrapper
webserver | return function(request)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/decorators/response.py", line 113, in wrapper
webserver | return _wrapper(request, response)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/decorators/response.py", line 90, in _wrapper
webserver | self.operation.api.get_connexion_response(response, self.mimetype)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/apis/abstract.py", line 366, in get_connexion_response
webserver | return cls._framework_to_connexion_response(response=response, mimetype=mimetype)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/connexion/apis/flask_api.py", line 165, in _framework_to_connexion_response
webserver | body=response.get_data() if not response.direct_passthrough else None,
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/werkzeug/wrappers/response.py", line 314, in get_data
webserver | self._ensure_sequence()
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/werkzeug/wrappers/response.py", line 376, in _ensure_sequence
webserver | self.make_sequence()
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/werkzeug/wrappers/response.py", line 391, in make_sequence
webserver | self.response = list(self.iter_encoded())
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/werkzeug/wrappers/response.py", line 50, in _iter_encoded
webserver | for item in iterable:
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/utils/log/log_reader.py", line 81, in read_log_stream
webserver | logs, metadata = self.read_log_chunks(ti, current_try_number, metadata)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/utils/log/log_reader.py", line 58, in read_log_chunks
webserver | logs, metadatas = self.log_handler.read(ti, try_number, metadata=metadata)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/utils/log/file_task_handler.py", line 284, in read
webserver | log, metadata = self._read(task_instance, try_number_element, metadata)
webserver | File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/grafana_loki_provider/log/loki_task_handler.py", line 118, in _read
webserver | start = ti.start_date - timedelta(days=15)
webserver | TypeError: unsupported operand type(s) for -: 'NoneType' and 'datetime.timedelta'
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:25 +0530] "GET /api/v1/dags/tutorial_dag/dagRuns/manual__2022-11-29T16:29:15.840904+00:00/taskInstances/transform/logs/1?full_content=false HTTP/1.1" 500 1543 "http://localhost:8080/dags/tutorial_dag/grid?root=&dag_run_id=manual__2022-11-29T16%3A29%3A15.840904%2B00%3A00&task_id=transform" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
scheduler | [2022-11-29 21:59:25,967] {task_command.py:376} INFO - Running <TaskInstance: tutorial_dag.transform manual__2022-11-29T16:29:15.840904+00:00 [queued]> on host 192.168.1.21
scheduler | [2022-11-29 21:59:26,544] {scheduler_job.py:588} INFO - Executor reports execution of tutorial_dag.transform run_id=manual__2022-11-29T16:29:15.840904+00:00 exited with status success for try_number 1
scheduler | [2022-11-29 21:59:26,555] {scheduler_job.py:631} INFO - TaskInstance Finished: dag_id=tutorial_dag, task_id=transform, run_id=manual__2022-11-29T16:29:15.840904+00:00, map_index=-1, run_start_date=2022-11-29 16:29:26.099527+00:00, run_end_date=2022-11-29 16:29:26.279744+00:00, run_duration=0.180217, state=success, executor_state=success, try_number=1, max_tries=2, job_id=21, pool=default_pool, queue=default, priority_weight=2, operator=PythonOperator, queued_dttm=2022-11-29 16:29:23.598850+00:00, queued_by_job_id=18, pid=23709
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:28 +0530] "GET /object/grid_data?dag_id=tutorial_dag&num_runs=25 HTTP/1.1" 200 2464 "http://localhost:8080/dags/tutorial_dag/grid?root=&dag_run_id=manual__2022-11-29T16%3A29%3A15.840904%2B00%3A00&task_id=transform" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | [2022-11-29 21:59:28,431] {loki_task_handler.py:128} INFO - loki log query params {'query': ' {dag_id="tutorial_dag",task_id="transform"}\n | json try_number="try_number",map_index="map_index",run_id="run_id"\n | try_number="1" and\n map_index="-1" and\n run_id="manual__2022-11-29T16:29:15.840904+00:00"\n | error!="JSONParserErr"\n ', 'start': '2022-11-14T16:29:26.099527+00:00', 'end': '2022-11-29T17:29:26.279744+00:00', 'direction': 'forward'}
webserver | [2022-11-29 21:59:28,446] {base.py:71} INFO - Using connection ID 'loki' for task execution.
webserver | [2022-11-29 21:59:28,449] {http.py:148} INFO - Sending 'GET' to url: http://localhost:3101/loki/api/v1/query_range
webserver | [2022-11-29 21:59:28 +0530] [23653] [WARNING] Worker with pid 23667 was terminated due to signal 11
webserver | [2022-11-29 21:59:28 +0530] [23712] [INFO] Booting worker with pid: 23712
scheduler | [2022-11-29 21:59:28,504] {scheduler_job.py:346} INFO - 1 tasks up for execution:
scheduler | <TaskInstance: tutorial_dag.load manual__2022-11-29T16:29:15.840904+00:00 [scheduled]>
scheduler | [2022-11-29 21:59:28,504] {scheduler_job.py:411} INFO - DAG tutorial_dag has 0/16 running and queued tasks
scheduler | [2022-11-29 21:59:28,505] {scheduler_job.py:497} INFO - Setting the following tasks to queued state:
scheduler | <TaskInstance: tutorial_dag.load manual__2022-11-29T16:29:15.840904+00:00 [scheduled]>
scheduler | [2022-11-29 21:59:28,508] {scheduler_job.py:536} INFO - Sending TaskInstanceKey(dag_id='tutorial_dag', task_id='load', run_id='manual__2022-11-29T16:29:15.840904+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default
scheduler | [2022-11-29 21:59:28,508] {base_executor.py:95} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'tutorial_dag', 'load', 'manual__2022-11-29T16:29:15.840904+00:00', '--local', '--subdir', '/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/example_dags/tutorial_dag.py']
scheduler | [2022-11-29 21:59:28,511] {sequential_executor.py:61} INFO - Executing command: ['airflow', 'tasks', 'run', 'tutorial_dag', 'load', 'manual__2022-11-29T16:29:15.840904+00:00', '--local', '--subdir', '/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/example_dags/tutorial_dag.py']
webserver | [2022-11-29 21:59:29,056] {loki_task_handler.py:128} INFO - loki log query params {'query': ' {dag_id="tutorial_dag",task_id="transform"}\n | json try_number="try_number",map_index="map_index",run_id="run_id"\n | try_number="1" and\n map_index="-1" and\n run_id="manual__2022-11-29T16:29:15.840904+00:00"\n | error!="JSONParserErr"\n ', 'start': '2022-11-14T16:29:26.099527+00:00', 'end': '2022-11-29T17:29:26.279744+00:00', 'direction': 'forward'}
webserver | [2022-11-29 21:59:29,063] {base.py:71} INFO - Using connection ID 'loki' for task execution.
webserver | [2022-11-29 21:59:29,065] {http.py:148} INFO - Sending 'GET' to url: http://localhost:3101/loki/api/v1/query_range
webserver | [2022-11-29 21:59:29 +0530] [23653] [WARNING] Worker with pid 23666 was terminated due to signal 11
webserver | [2022-11-29 21:59:29 +0530] [23714] [INFO] Booting worker with pid: 23714
scheduler | [2022-11-29 21:59:29,784] {dagbag.py:537} INFO - Filling up the DagBag from /Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/example_dags/tutorial_dag.py
scheduler | [2022-11-29 21:59:30,279] {task_command.py:376} INFO - Running <TaskInstance: tutorial_dag.load manual__2022-11-29T16:29:15.840904+00:00 [queued]> on host 192.168.1.21
scheduler | [2022-11-29 21:59:30,937] {scheduler_job.py:588} INFO - Executor reports execution of tutorial_dag.load run_id=manual__2022-11-29T16:29:15.840904+00:00 exited with status success for try_number 1
scheduler | [2022-11-29 21:59:30,949] {scheduler_job.py:631} INFO - TaskInstance Finished: dag_id=tutorial_dag, task_id=load, run_id=manual__2022-11-29T16:29:15.840904+00:00, map_index=-1, run_start_date=2022-11-29 16:29:30.396662+00:00, run_end_date=2022-11-29 16:29:30.650976+00:00, run_duration=0.254314, state=success, executor_state=success, try_number=1, max_tries=2, job_id=22, pool=default_pool, queue=default, priority_weight=1, operator=PythonOperator, queued_dttm=2022-11-29 16:29:28.505990+00:00, queued_by_job_id=18, pid=23718
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:31 +0530] "GET /object/grid_data?dag_id=tutorial_dag&num_runs=25 HTTP/1.1" 200 2522 "http://localhost:8080/dags/tutorial_dag/grid?root=&dag_run_id=manual__2022-11-29T16%3A29%3A15.840904%2B00%3A00&task_id=transform" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:31 +0530] "GET /log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1 HTTP/1.1" 200 43714 "http://localhost:8080/dags/tutorial_dag/grid?root=&dag_run_id=manual__2022-11-29T16%3A29%3A15.840904%2B00%3A00&task_id=transform" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:31 +0530] "GET /static/appbuilder/datepicker/bootstrap-datepicker.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:31 +0530] "GET /static/appbuilder/select2/select2.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:31 +0530] "GET /static/appbuilder/css/bootstrap.min.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:31 +0530] "GET /static/appbuilder/css/font-awesome.min.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:31 +0530] "GET /static/appbuilder/css/ab.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:31 +0530] "GET /static/appbuilder/css/flags/flags16.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:31 +0530] "GET /static/dist/airflowDefaultTheme.731e57571b52cca4350d.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:31 +0530] "GET /static/dist/materialIcons.f9559e4953177b8b9a4a.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:31 +0530] "GET /static/dist/main.a53ccbaa4ca384c91837.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:31 +0530] "GET /static/dist/switch.0e45299d29df3c0c8282.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:31 +0530] "GET /static/dist/loadingDots.5da42d00b5455806e709.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:31 +0530] "GET /static/dist/bootstrap-datetimepicker.min.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:31 +0530] "GET /static/dist/flash.2b1a873e0aabc828a165.css HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:31 +0530] "GET /static/appbuilder/js/jquery-latest.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:32 +0530] "GET /static/appbuilder/js/ab_actions.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:32 +0530] "GET /static/appbuilder/js/ab_filters.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:32 +0530] "GET /static/loading.gif HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:32 +0530] "GET /static/appbuilder/js/bootstrap.min.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:32 +0530] "GET /static/appbuilder/datepicker/bootstrap-datepicker.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:32 +0530] "GET /static/appbuilder/select2/select2.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:32 +0530] "GET /static/appbuilder/js/ab.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:32 +0530] "GET /static/dist/bootstrap-datetimepicker.min.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:32 +0530] "GET /static/dist/main.a53ccbaa4ca384c91837.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:32 +0530] "GET /static/dist/moment.197a6f3cab42e240f8bd.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:32 +0530] "GET /static/dist/bootstrap3-typeahead.min.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:32 +0530] "GET /static/dist/dag.a9efcc271e92a9bdc654.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:32 +0530] "GET /static/dist/tiLog.7864c61b0b31ef37f084.js HTTP/1.1" 304 0 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:32 +0530] "GET /object/next_run_datasets/tutorial_dag HTTP/1.1" 200 2 "http://localhost:8080/log?dag_id=tutorial_dag&task_id=transform&execution_date=2022-11-29T16%3A29%3A15.840904%2B00%3A00&map_index=-1" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
webserver | [2022-11-29 21:59:32,490] {loki_task_handler.py:128} INFO - loki log query params {'query': ' {dag_id="tutorial_dag",task_id="transform"}\n | json try_number="try_number",map_index="map_index",run_id="run_id"\n | try_number="1" and\n map_index="-1" and\n run_id="manual__2022-11-29T16:29:15.840904+00:00"\n | error!="JSONParserErr"\n ', 'start': '2022-11-14T16:29:26.099527+00:00', 'end': '2022-11-29T17:29:26.279744+00:00', 'direction': 'forward'}
webserver | [2022-11-29 21:59:32,506] {base.py:71} INFO - Using connection ID 'loki' for task execution.
webserver | [2022-11-29 21:59:32,509] {http.py:148} INFO - Sending 'GET' to url: http://localhost:3101/loki/api/v1/query_range
webserver | [2022-11-29 21:59:32 +0530] [23653] [WARNING] Worker with pid 23679 was terminated due to signal 11
webserver | [2022-11-29 21:59:32 +0530] [23721] [INFO] Booting worker with pid: 23721
scheduler | [2022-11-29 21:59:34,099] {dagrun.py:597} INFO - Marking run <DagRun tutorial_dag @ 2022-11-29 16:29:15.840904+00:00: manual__2022-11-29T16:29:15.840904+00:00, state:running, queued_at: 2022-11-29 16:29:15.880063+00:00. externally triggered: True> successful
scheduler | [2022-11-29 21:59:34,101] {dagrun.py:644} INFO - DagRun Finished: dag_id=tutorial_dag, execution_date=2022-11-29 16:29:15.840904+00:00, run_id=manual__2022-11-29T16:29:15.840904+00:00, run_start_date=2022-11-29 16:29:18.101155+00:00, run_end_date=2022-11-29 16:29:34.101777+00:00, run_duration=16.000622, state=success, external_trigger=True, run_type=manual, data_interval_start=2022-11-29 16:29:15.840904+00:00, data_interval_end=2022-11-29 16:29:15.840904+00:00, dag_hash=405c804d6e96798fd7ada01b2ac9e710
scheduler | [2022-11-29 21:59:34,110] {dag.py:3336} INFO - Setting next_dagrun for tutorial_dag to None, run_after=None

@snjypl
Copy link
Owner

snjypl commented Nov 29, 2022

webserver | start = ti.start_date - timedelta(days=15)
webserver | TypeError: unsupported operand type(s) for -: 'NoneType' and 'datetime.timedelta'
webserver | 127.0.0.1 - - [29/Nov/2022:21:59:25 +0530] "GET /api/v1/dags/tutorial_dag/dagRuns

where you seeing this error previously?

@saritatewari4
Copy link
Author

saritatewari4 commented Nov 29, 2022

I could see these error lines in previous run also in terminal. @snjypl I am running this in mac machine (JFYI). Could you please share your setup details.

@snjypl
Copy link
Owner

snjypl commented Nov 29, 2022

python 3.8
apache-airflow==2.4.3
ubuntu 20.04

@snjypl
Copy link
Owner

snjypl commented Nov 29, 2022

I could see these error lines in previous run also in terminal. @snjypl I am running this in mac machine (JFYI). Could you please share your setup details.

the issue could be because of that error.

please stop the airflow standalone process.
and run only the webserver

run airflow webserver -d

and try to access the task log in airflow ui. it will give you a cleaner error logs in terminal . please share the log.

later maybe you can also try a clean installation of airflow and see if you are getting the error.

@snjypl
Copy link
Owner

snjypl commented Nov 29, 2022

the following commands would help you in doing a db reset.

backup airflow connections
airflow connections export /tmp/backup-airflow-connection.json --format json
airflow db reset
airflow connections import /tmp/backup-airflow-connection.json

@saritatewari4
Copy link
Author

@snjypl ,

when I ran airflow webserver -d , I was able to see the logs in ui.

Logs you can check here:

error!="JSONParserErr"\n ', 'start': '2022-11-14T16:29:26.099527+00:00', 'end': '2022-11-29T17:29:26.279744+00:00', 'direction': 'forward'}
[2022-11-29 22:45:15,116] {base.py:71} INFO - Using connection ID 'loki' for task execution.
[2022-11-29 22:45:15,118] {http.py:148} INFO - Sending 'GET' to url: http://localhost:3101/loki/api/v1/query_range
[2022-11-29 22:45:15,147] {loki_task_handler.py:135} INFO - got response from loki
[2022-11-29 22:45:15,147] {loki_task_handler.py:139} INFO - {'status': 'success', 'data': {'resultType': 'streams', 'result': [{'stream': {'try_number': '1', 'dag_id': 'tutorial_dag', 'map_index': '-1', 'run_id': 'manual__2022-11-29T16:29:15.840904+00:00', 'task_id': 'transform'}, 'values': [['1669739366347013120', '{"line": "[2022-11-29T21:59:26.098+0530] {taskinstance.py:1165} INFO - Dependencies all met for <TaskInstance: tutorial_dag.transform manual__2022-11-29T16:29:15.840904+00:00 [queued]>\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347068928', '{"line": "[2022-11-29T21:59:26.108+0530] {taskinstance.py:1165} INFO - Dependencies all met for <TaskInstance: tutorial_dag.transform manual__2022-11-29T16:29:15.840904+00:00 [queued]>\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347086080', '{"line": "[2022-11-29T21:59:26.108+0530] {taskinstance.py:1362} INFO - \n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347098112', '{"line": "--------------------------------------------------------------------------------\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347107072', '{"line": "[2022-11-29T21:59:26.109+0530] {taskinstance.py:1363} INFO - Starting attempt 1 of 3\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347117056', '{"line": "[2022-11-29T21:59:26.109+0530] {taskinstance.py:1364} INFO - \n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347122944', '{"line": "--------------------------------------------------------------------------------\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347129088', '{"line": "[2022-11-29T21:59:26.122+0530] {taskinstance.py:1383} INFO - Executing <Task(PythonOperator): transform> on 2022-11-29 16:29:15.840904+00:00\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347134976', '{"line": "[2022-11-29T21:59:26.126+0530] {standard_task_runner.py:55} INFO - Started process 23709 to run task\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347140096', '{"line": "[2022-11-29T21:59:26.132+0530] {standard_task_runner.py:82} INFO - Running: ['airflow', 'tasks', 'run', 'tutorial_dag', 'transform', 'manual__2022-11-29T16:29:15.840904+00:00', '--job-id', '21', '--raw', '--subdir', '/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/example_dags/tutorial_dag.py', '--cfg-path', '/var/folders/s7/clzd54vd5g51zp3c5_5dsbs00000gn/T/tmp3nvu9alc']\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347148032', '{"line": "[2022-11-29T21:59:26.135+0530] {standard_task_runner.py:83} INFO - Job 21: Subtask transform\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347153920', '{"line": "[2022-11-29T21:59:26.207+0530] {task_command.py:376} INFO - Running <TaskInstance: tutorial_dag.transform manual__2022-11-29T16:29:15.840904+00:00 [running]> on host 192.168.1.21\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347162880', '{"line": "[2022-11-29T21:59:26.260+0530] {taskinstance.py:1590} INFO - Exporting the following env vars:\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347271936', '{"line": "AIRFLOW_CTX_DAG_OWNER=airflow\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347287040', '{"line": "AIRFLOW_CTX_DAG_ID=tutorial_dag\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347293952', '{"line": "AIRFLOW_CTX_TASK_ID=transform\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347299072', '{"line": "AIRFLOW_CTX_EXECUTION_DATE=2022-11-29T16:29:15.840904+00:00\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347304960', '{"line": "AIRFLOW_CTX_TRY_NUMBER=1\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347310080', '{"line": "AIRFLOW_CTX_DAG_RUN_ID=manual__2022-11-29T16:29:15.840904+00:00\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347315968', '{"line": "[2022-11-29T21:59:26.274+0530] {python.py:177} INFO - Done. Returned value was: None\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347323904', '{"line": "[2022-11-29T21:59:26.280+0530] {taskinstance.py:1401} INFO - Marking task as SUCCESS. dag_id=tutorial_dag, task_id=transform, execution_date=20221129T162915, start_date=20221129T162926, end_date=20221129T162926\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347331072', '{"line": "[2022-11-29T21:59:26.316+0530] {local_task_job.py:159} INFO - Task exited with return code 0\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347335936', '{"line": "[2022-11-29T21:59:26.336+0530] {taskinstance.py:2623} INFO - 1 downstream tasks scheduled from follow-on schedule check\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}']]}], 'stats': {'summary': {'bytesProcessedPerSecond': 1134695, 'linesProcessedPerSecond': 5252, 'totalBytesProcessed': 14905, 'totalLinesProcessed': 69, 'execTime': 0.013135678}, 'store': {'totalChunksRef': 1, 'totalChunksDownloaded': 1, 'chunksDownloadTime': 0.002217682, 'headChunkBytes': 0, 'headChunkLines': 0, 'decompressedBytes': 5275, 'decompressedLines': 23, 'compressedBytes': 1175, 'totalDuplicates': 0}, 'ingester': {'totalReached': 1, 'totalChunksMatched': 1, 'totalBatches': 1, 'totalLinesSent': 23, 'headChunkBytes': 9630, 'headChunkLines': 46, 'decompressedBytes': 0, 'decompressedLines': 0, 'compressedBytes': 0, 'totalDuplicates': 0}}}}
[2022-11-29 22:45:15,149] {loki_task_handler.py:143} INFO - [['1669739366347013120', '{"line": "[2022-11-29T21:59:26.098+0530] {taskinstance.py:1165} INFO - Dependencies all met for <TaskInstance: tutorial_dag.transform manual__2022-11-29T16:29:15.840904+00:00 [queued]>\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347068928', '{"line": "[2022-11-29T21:59:26.108+0530] {taskinstance.py:1165} INFO - Dependencies all met for <TaskInstance: tutorial_dag.transform manual__2022-11-29T16:29:15.840904+00:00 [queued]>\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347086080', '{"line": "[2022-11-29T21:59:26.108+0530] {taskinstance.py:1362} INFO - \n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347098112', '{"line": "--------------------------------------------------------------------------------\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347107072', '{"line": "[2022-11-29T21:59:26.109+0530] {taskinstance.py:1363} INFO - Starting attempt 1 of 3\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347117056', '{"line": "[2022-11-29T21:59:26.109+0530] {taskinstance.py:1364} INFO - \n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347122944', '{"line": "--------------------------------------------------------------------------------\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347129088', '{"line": "[2022-11-29T21:59:26.122+0530] {taskinstance.py:1383} INFO - Executing <Task(PythonOperator): transform> on 2022-11-29 16:29:15.840904+00:00\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347134976', '{"line": "[2022-11-29T21:59:26.126+0530] {standard_task_runner.py:55} INFO - Started process 23709 to run task\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347140096', '{"line": "[2022-11-29T21:59:26.132+0530] {standard_task_runner.py:82} INFO - Running: ['airflow', 'tasks', 'run', 'tutorial_dag', 'transform', 'manual__2022-11-29T16:29:15.840904+00:00', '--job-id', '21', '--raw', '--subdir', '/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/airflow/example_dags/tutorial_dag.py', '--cfg-path', '/var/folders/s7/clzd54vd5g51zp3c5_5dsbs00000gn/T/tmp3nvu9alc']\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347148032', '{"line": "[2022-11-29T21:59:26.135+0530] {standard_task_runner.py:83} INFO - Job 21: Subtask transform\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347153920', '{"line": "[2022-11-29T21:59:26.207+0530] {task_command.py:376} INFO - Running <TaskInstance: tutorial_dag.transform manual__2022-11-29T16:29:15.840904+00:00 [running]> on host 192.168.1.21\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347162880', '{"line": "[2022-11-29T21:59:26.260+0530] {taskinstance.py:1590} INFO - Exporting the following env vars:\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347271936', '{"line": "AIRFLOW_CTX_DAG_OWNER=airflow\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347287040', '{"line": "AIRFLOW_CTX_DAG_ID=tutorial_dag\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347293952', '{"line": "AIRFLOW_CTX_TASK_ID=transform\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347299072', '{"line": "AIRFLOW_CTX_EXECUTION_DATE=2022-11-29T16:29:15.840904+00:00\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347304960', '{"line": "AIRFLOW_CTX_TRY_NUMBER=1\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347310080', '{"line": "AIRFLOW_CTX_DAG_RUN_ID=manual__2022-11-29T16:29:15.840904+00:00\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347315968', '{"line": "[2022-11-29T21:59:26.274+0530] {python.py:177} INFO - Done. Returned value was: None\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347323904', '{"line": "[2022-11-29T21:59:26.280+0530] {taskinstance.py:1401} INFO - Marking task as SUCCESS. dag_id=tutorial_dag, task_id=transform, execution_date=20221129T162915, start_date=20221129T162926, end_date=20221129T162926\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347331072', '{"line": "[2022-11-29T21:59:26.316+0530] {local_task_job.py:159} INFO - Task exited with return code 0\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}'], ['1669739366347335936', '{"line": "[2022-11-29T21:59:26.336+0530] {taskinstance.py:2623} INFO - 1 downstream tasks scheduled from follow-on schedule check\n", "run_id": "manual__2022-11-29T16:29:15.840904+00:00", "try_number": 1, "map_index": -1}']]
[2022-11-29 22:45:15,150] {loki_task_handler.py:154} INFO - lines count 23
[2022-11-29 22:45:15,163] {_internal.py:224} INFO - 127.0.0.1 - - [29/Nov/2022 22:45:15] "GET /get_logs_with_metadata?dag_id=tutorial_dag&task_id=transform&map_index=-1&execution_date=2022-11-29T16%3A29%3A15.840904+00%3A00&try_number=1&metadata=null HTTP/1.1" 200 -

@snjypl
Copy link
Owner

snjypl commented Nov 29, 2022

@saritatewari4 standalone mode is not recommended for production. i would recommend you run webserver, scheduler and workers in separate process.

later when i get a chance, i will try to reproduce your issue.

@snjypl
Copy link
Owner

snjypl commented Nov 29, 2022

Hello @snjypl ,

To quickly spin up grafana and loki in local I have uploaded the composer file here

Please use this command this command :

docker-compose -f docker-compose-with-otel.yml up

Script to install airflow as standalone: script

Airflow custom logging folder

Airflow configuration for logging as below:

remote_logging = True
remote_log_conn_id =loki
remote_base_log_folder =loki
logging_config_class = log_config.DEFAULT_LOGGING_CONFIG

Loki connection hook details:

connection id= loki
connection type= grafana loki
host= localhost
port=3101

Installed airflow grafana provider as follows:

pip install --force git+https://github.com/snjypl/airflow-provider-grafana-loki.git@debug/issue-2-webserver-signal-11-on-log-read --no-dep

Please let me know where I am missing the configuration.

the links are broken. can you please check them

@saritatewari4
Copy link
Author

@snjypl , I am trying to run them severalty using docker composer. I will update you.

Thanks a lot for your prompt response and support.

@saritatewari4
Copy link
Author

Hello @snjypl ,
To quickly spin up grafana and loki in local I have uploaded the composer file here
Please use this command this command :
docker-compose -f docker-compose-with-otel.yml up
Script to install airflow as standalone: script
Airflow custom logging folder
Airflow configuration for logging as below:

remote_logging = True
remote_log_conn_id =loki
remote_base_log_folder =loki
logging_config_class = log_config.DEFAULT_LOGGING_CONFIG

Loki connection hook details:

connection id= loki
connection type= grafana loki
host= localhost
port=3101

Installed airflow grafana provider as follows:
pip install --force git+https://github.com/snjypl/airflow-provider-grafana-loki.git@debug/issue-2-webserver-signal-11-on-log-read --no-dep
Please let me know where I am missing the configuration.

the links are broken. can you please check them

Please use this repo. All the files are updated here. I will update the read me file.

@snjypl
Copy link
Owner

snjypl commented Nov 29, 2022

@snjypl
Copy link
Owner

snjypl commented Nov 29, 2022

@saritatewari4 i have opened another issue to debug the airflow standalone mode issue:

#3

will close this issue,

@snjypl snjypl closed this as completed Nov 29, 2022
@snjypl snjypl changed the title Logs not restoring when pushing them to loki Error viewing logs in UI Nov 29, 2022
@snjypl
Copy link
Owner

snjypl commented Nov 29, 2022

@snjypl , I am trying to run them severalty using docker composer. I will update you.

Thanks a lot for your prompt response and support.

You are welcome !!

@saritatewari4
Copy link
Author

@saritatewari4 is it a private repo? https://github.com/saritatewari4/airflow-loki

@snjypl Please try to access that repo now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants