Skip to content

Starting scheduler for SequentialExecutor#359

Merged
puckel merged 1 commit into
puckel:masterfrom
nsepetys:patch-1
Aug 14, 2019
Merged

Starting scheduler for SequentialExecutor#359
puckel merged 1 commit into
puckel:masterfrom
nsepetys:patch-1

Conversation

@nsepetys

Copy link
Copy Markdown
Contributor

No description provided.

@nsepetys nsepetys changed the title starting scheduler for SequentialExecutor Starting scheduler for SequentialExecutor Apr 30, 2019
@puckel puckel merged commit c654707 into puckel:master Aug 14, 2019
@datarods-svc

Copy link
Copy Markdown

@puckel Is it possible to release this merged fix as a tagged release? It is not fixed in the current latest version 1.10.4, and this makes it unreasonably difficult to use the scheduler at all with sequential executor.

@puckel

puckel commented Nov 21, 2019

Copy link
Copy Markdown
Owner

Available in docker-airflow:1.10.6

vpavlin referenced this pull request in opendatahub-io-contrib/docker-airflow Apr 15, 2020
* Bump airflow version (#2) (#304)

* Bump Airflow Version to 1.10.2
* Fix CI

* Bump Airflow version to 1.10.3 (#355)

* Bump airflow 1 10 3 (#3)
* use the user home as airflow home
* remove unused var env
* set default config & remove duplicated line

* Pin Debian version to prevent unintended OS upgrade (#401)

* Bump to Airflow 1.10.4 and Python 3.7

* starting scheduler for SequentialExecutor (#359)

* Bump to Airflow 1.10.6

* circleci - remove docker_layer_caching

* remove circleci

* Create ci.yml

* Update README.md

* Fix bug with kubernetes executor (#470)

* Bump to Airflow 1.10.7

* FIX entrypoint.sh preventing regular and legitimate use-cases (#495)

This commit fixes the entrypoint.sh script in order to comply to the user provided
configurations. If they provided AIRFLOW__ environment variables, the entrypoint.sh
*must not* override them.

It also adds a new PostgreSQL configuration variable POSTGRES_EXTRAS in order to enable
TLS encryption. See the Airflow documentation "PostgreSQL Connection" about this.

It also adds two new Redis configuration variables REDIS_PROTO which was previously hardcoded
to redis:// (in order to prepare the possible use of rediss://), and REDIS_DBNUM which was
previously hardcoded to 1 (that prevents any use of a mutual broker between Airflow instances).

It also adds the corresponding documentation about PostgreSQL and Redis variables.

* Bump to Airflow 1.10.8

* Fix issue between flask-admin and werkzeug 1.0.0

* Bump to Airflow 1.10.9

* Debian base image - Move from 3.7-slim-stretch to 3.7-slim-buster

* user Airflow in group root

* user Airflow in group root

* user Airflow in group root

* testing entrypoint from barneys/docker-airflow

* change sql host to pc-base-sql

* bug fixes

* added ./profile to propogate db connection string

* Make load examples False

Co-authored-by: Med <medmrgh@users.noreply.github.com>
Co-authored-by: Jesus Abarca <jabas06@gmail.com>
Co-authored-by: Puckel_ <contact@puckel.fr>
Co-authored-by: nsepetys <noah@workmarket.com>
Co-authored-by: Kevin O'Riordan <koriordan@earnestresearch.com>
Co-authored-by: Noël Bardelot <noel@bardelot.fr>
@deepak6446

Copy link
Copy Markdown

sequentail executor is not running in puckel/docker-airflow:1.10.9
getting error

The scheduler does not appear to be running. Last heartbeat was received 4 minutes ago.

The DAGs list may not update, and new tasks will not be scheduled.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants