Skip to content

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[error] airflow postgres #18327

Closed
2 tasks done
Geronium opened this issue Sep 17, 2021 · 1 comment
Closed
2 tasks done

[error] airflow postgres #18327

Geronium opened this issue Sep 17, 2021 · 1 comment
Labels
area:core kind:bug This is a clearly a bug

Comments

@Geronium
Copy link

Apache Airflow version

2.1.2

Operating System

Debian GNU/Linux 10 (buster)

Versions of Apache Airflow Providers

airflow@airflow-webserver-54b99db477-fs46m:/opt/airflow$ pip freeze | grep providers
apache-airflow-providers-amazon==2.0.0
apache-airflow-providers-celery==2.0.0
apache-airflow-providers-cncf-kubernetes==2.0.0
apache-airflow-providers-docker==2.0.0
apache-airflow-providers-elasticsearch==2.0.2
apache-airflow-providers-ftp==2.0.0
apache-airflow-providers-google==4.0.0
apache-airflow-providers-grpc==2.0.0
apache-airflow-providers-hashicorp==2.0.0
apache-airflow-providers-http==2.0.0
apache-airflow-providers-imap==2.0.0
apache-airflow-providers-microsoft-azure==3.0.0
apache-airflow-providers-mysql==2.0.0
apache-airflow-providers-postgres==2.0.0
apache-airflow-providers-redis==2.0.0
apache-airflow-providers-sendgrid==2.0.0
apache-airflow-providers-sftp==2.0.0
apache-airflow-providers-slack==4.0.0
apache-airflow-providers-sqlite==2.0.0
apache-airflow-providers-ssh==2.0.0

Deployment

Official Apache Airflow Helm Chart

Deployment details

just do a :

helm upgrade --debug --cleanup-on-fail --install airflow ./airflow.tgz --namespace airflow --create-namespace

What happened

after the installation, i added an example of a dag inside the dag directory, and i don't saw this dag with the navigator

https://airflow.apache.org/docs/apache-airflow/stable/tutorial.html

so i done a db init

airflow@airflow-webserver-54b99db477-fs46m:/opt/airflow$ airflow db init
DB: postgresql://postgres:***@airflow-postgresql.airflow:5432/postgres?sslmode=disable
[2021-09-17 13:14:21,956] {db.py:692} INFO - Creating tables
INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
INFO [alembic.runtime.migration] Will assume transactional DDL.
Initialization done

after that i can saw my dag

Capture d’écran de 2021-09-17 15-14-37

but it disappear after something like 2 minutes

Capture d’écran de 2021-09-17 15-18-57

and i can saw in the logs of postgres this errors at the starting of the postgresql pod, i don't know if this is the reason of the disappearing of my dag

`[root] # kubectl logs airflow-postgresql-0 -n airflow
postgresql 12:26:27.57
postgresql 12:26:27.58 Welcome to the Bitnami postgresql container
postgresql 12:26:27.59 Subscribe to project updates by watching https://github.com/bitnami/bitnami-docker-postgresql
postgresql 12:26:27.59 Submit issues and feature requests at https://github.com/bitnami/bitnami-docker-postgresql/issues
postgresql 12:26:27.60
postgresql 12:26:27.65 INFO ==> ** Starting PostgreSQL setup **
postgresql 12:26:27.69 INFO ==> Validating settings in POSTGRESQL_* env vars..
postgresql 12:26:27.71 INFO ==> Loading custom pre-init scripts...
postgresql 12:26:27.73 INFO ==> Initializing PostgreSQL database...
postgresql 12:26:27.80 INFO ==> pg_hba.conf file not detected. Generating it...
postgresql 12:26:27.81 INFO ==> Generating local authentication configuration
postgresql 12:26:29.04 INFO ==> Starting PostgreSQL in background...
postgresql 12:26:29.22 INFO ==> Changing password of postgres
postgresql 12:26:29.30 INFO ==> Configuring replication parameters
postgresql 12:26:29.39 INFO ==> Configuring fsync
postgresql 12:26:29.52 INFO ==> Loading custom scripts...
postgresql 12:26:29.54 INFO ==> Enabling remote connections
postgresql 12:26:29.58 INFO ==> Stopping PostgreSQL...
waiting for server to shut down.... done
server stopped
postgresql 12:26:29.71 INFO ==> ** PostgreSQL setup finished! **

postgresql 12:26:29.75 INFO ==> ** Starting PostgreSQL **
2021-09-17 12:26:29.784 GMT [1] LOG: pgaudit extension initialized
2021-09-17 12:26:29.785 GMT [1] LOG: listening on IPv4 address "0.0.0.0", port 5432
2021-09-17 12:26:29.785 GMT [1] LOG: listening on IPv6 address "::", port 5432
2021-09-17 12:26:29.788 GMT [1] LOG: listening on Unix socket "/tmp/.s.PGSQL.5432"
2021-09-17 12:26:29.812 GMT [130] LOG: database system was shut down at 2021-09-17 12:26:29 GMT
2021-09-17 12:26:29.819 GMT [1] LOG: database system is ready to accept connections
2021-09-17 12:26:38.853 GMT [143] LOG: incomplete startup packet
2021-09-17 12:26:38.912 GMT [144] LOG: incomplete startup packet
2021-09-17 12:26:39.567 GMT [145] LOG: incomplete startup packet
2021-09-17 12:26:39.634 GMT [146] LOG: incomplete startup packet
2021-09-17 12:26:42.909 GMT [149] ERROR: relation "log" does not exist at character 13
2021-09-17 12:26:42.909 GMT [149] STATEMENT: INSERT INTO log (dttm, dag_id, task_id, event, execution_date, owner, extra) VALUES ('2021-09-17T12:26:42.877318+00:00'::timestamptz, NULL, NULL, 'cli_upgradedb', NULL, 'airflow', '{"host_name": "airflow-run-airflow-migrations-wwccb", "full_command": "[''/home/airflow/.local/bin/airflow'', ''db'', ''upgrade'']"}') RETURNING log.id
2021-09-17 12:26:43.238 GMT [149] ERROR: relation "connection" does not exist at character 55
2021-09-17 12:26:43.238 GMT [149] STATEMENT: SELECT connection.conn_id AS connection_conn_id
FROM connection GROUP BY connection.conn_id
HAVING count(*) > 1
2021-09-17 12:26:43.240 GMT [149] ERROR: current transaction is aborted, commands ignored until end of transaction block
2021-09-17 12:26:43.240 GMT [149] STATEMENT: SELECT connection.password AS connection_password, connection.extra AS connection_extra, connection.id AS connection_id, connection.conn_id AS connection_conn_id, connection.conn_type AS connection_conn_type, connection.description AS connection_description, connection.host AS connection_host, connection.schema AS connection_schema, connection.login AS connection_login, connection.port AS connection_port, connection.is_encrypted AS connection_is_encrypted, connection.is_extra_encrypted AS connection_is_extra_encrypted
FROM connection
WHERE connection.conn_type IS NULL
2021-09-17 12:26:43.302 GMT [150] ERROR: relation "log" does not exist at character 13
2021-09-17 12:26:43.302 GMT [150] STATEMENT: INSERT INTO log (dttm, dag_id, task_id, event, execution_date, owner, extra) VALUES ('2021-09-17T12:26:43.269569+00:00'::timestamptz, NULL, NULL, 'cli_flower', NULL, 'airflow', '{"host_name": "airflow-flower-545dd8bf97-pwjbp", "full_command": "[''/home/airflow/.local/bin/airflow'', ''celery'', ''flower'']"}') RETURNING log.id
2021-09-17 12:27:01.648 GMT [166] LOG: incomplete startup packet
2021-09-17 12:27:02.277 GMT [167] LOG: incomplete startup packet
2021-09-17 12:27:02.919 GMT [168] LOG: incomplete startup packet`

What you expected to happen

No response

How to reproduce

No response

Anything else

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@Geronium Geronium added area:core kind:bug This is a clearly a bug labels Sep 17, 2021
@boring-cyborg
Copy link

boring-cyborg bot commented Sep 17, 2021

Thanks for opening your first issue here! Be sure to follow the issue template!

@apache apache locked and limited conversation to collaborators Sep 17, 2021

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

Labels
area:core kind:bug This is a clearly a bug
Projects
None yet
Development

No branches or pull requests

2 participants