Airflow successfully installed but failed to run!!!!

[Ahmed0028]

Hi Airflow community,

The Problem :

I have installed airflow on my local : magOS Big Sur .

Commands to install Airflow:

(airflow) p@MBP airflow % pip install airflow[gcp, statsd, sentry]

After i initialized the DB as the following:

airflow db init

I got the following error:

`DB: sqlite:////Users/p/airflow/airflow.db
[2021-08-06 11:47:52,921] {db.py:678} INFO - Creating tables
/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/airflow/utils/db.py:613 SAWarning: relationship 'DagRun.serialized_dag' will copy column serialized_dag.dag_id to column dag_run.dag_id, which conflicts with relationship(s): 'DagRun.task_instances' (copies task_instance.dag_id to dag_run.dag_id), 'TaskInstance.dag_run' (copies task_instance.dag_id to dag_run.dag_id). If this is not the intention, consider if these relationships should be linked with back_populates, or if viewonly=True should be applied to one or more if they are read-only. For the less common case that foreign key constraints are partially overlapping, the orm.foreign() annotation can be used to isolate the columns that should be written towards. To silence this warning, add the parameter 'overlaps="dag_run,task_instances"' to the 'DagRun.serialized_dag' relationship.
/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/airflow/utils/db.py:613 SAWarning: relationship 'SerializedDagModel.dag_runs' will copy column serialized_dag.dag_id to column dag_run.dag_id, which conflicts with relationship(s): 'DagRun.task_instances' (copies task_instance.dag_id to dag_run.dag_id), 'TaskInstance.dag_run' (copies task_instance.dag_id to dag_run.dag_id). If this is not the intention, consider if these relationships should be linked with back_populates, or if viewonly=True should be applied to one or more if they are read-only. For the less common case that foreign key constraints are partially overlapping, the orm.foreign() annotation can be used to isolate the columns that should be written towards. To silence this warning, add the parameter 'overlaps="dag_run,task_instances"' to the 'SerializedDagModel.dag_runs' relationship.
INFO [alembic.runtime.migration] Context impl SQLiteImpl.
INFO [alembic.runtime.migration] Will assume non-transactional DDL.
Traceback (most recent call last):
File "/Users/p/opt/anaconda3/envs/airflow/bin/airflow", line 8, in
sys.exit(main())
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/airflow/main.py", line 40, in main
args.func(args)
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/airflow/cli/cli_parser.py", line 48, in command
return func(*args, **kwargs)
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/airflow/cli/commands/db_command.py", line 31, in initdb
db.initdb()
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/airflow/utils/db.py", line 549, in initdb
upgradedb()
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/airflow/utils/db.py", line 688, in upgradedb
command.upgrade(config, 'heads')
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/alembic/command.py", line 294, in upgrade
script.run_env()
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/alembic/script/base.py", line 490, in run_env
util.load_python_file(self.dir, "env.py")
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/alembic/util/pyfiles.py", line 97, in load_python_file
module = load_module_py(module_id, path)
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/alembic/util/compat.py", line 184, in load_module_py
spec.loader.exec_module(module)
File "", line 843, in exec_module
File "", line 219, in _call_with_frames_removed
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/airflow/migrations/env.py", line 108, in
run_migrations_online()
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/airflow/migrations/env.py", line 102, in run_migrations_online
context.run_migrations()
File "", line 8, in run_migrations
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/alembic/runtime/environment.py", line 813, in run_migrations
self.get_context().run_migrations(**kw)
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/alembic/runtime/migration.py", line 549, in run_migrations
for step in self._migrations_fn(heads, self):
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/alembic/command.py", line 283, in upgrade
return script._upgrade_revs(revision, rev)
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/alembic/script/base.py", line 365, in _upgrade_revs
revs = list(revs)
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/alembic/script/revision.py", line 706, in iterate_revisions
revisions, heads = fn(
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/alembic/script/revision.py", line 1262, in _collect_upgrade_revisions
targets = self._parse_upgrade_target(
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/alembic/script/revision.py", line 1071, in _parse_upgrade_target
return self.get_revisions(target)
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/alembic/script/revision.py", line 459, in get_revisions
resolved_id, branch_label = self.resolve_revision_number(id)
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/alembic/script/revision.py", line 661, in _resolve_revision_number
self._revision_map
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/alembic/util/langhelpers.py", line 234, in get
obj.dict[self.name] = result = self.fget(obj)
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/alembic/script/revision.py", line 158, in _revision_map
for revision in self._generator():
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/alembic/script/base.py", line 115, in _load_revisions
script = Script.from_filename(self, vers, file)
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/alembic/script/base.py", line 904, in from_filename
module = util.load_python_file(dir, filename)
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/alembic/util/pyfiles.py", line 97, in load_python_file
module = load_module_py(module_id, path)
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/alembic/util/compat.py", line 184, in load_module_py
spec.loader.exec_module(module)
File "", line 843, in exec_module
File "", line 219, in _call_with_frames_removed
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/airflow/migrations/versions/2c6edca13270_resource_based_permissions.py", line 27, in
from airflow.www.app import create_app
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/airflow/www/app.py", line 38, in
from airflow.www.extensions.init_views import (
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/airflow/www/extensions/init_views.py", line 29, in
from airflow.www.views import lazy_add_provider_discovered_options_to_connection_form
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/airflow/www/views.py", line 2836, in
class ConnectionFormWidget(FormWidget):
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/airflow/www/views.py", line 2839, in ConnectionFormWidget
field_behaviours = json.dumps(ProvidersManager().field_behaviours)
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/airflow/providers_manager.py", line 397, in field_behaviours
self.initialize_providers_manager()
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/airflow/providers_manager.py", line 129, in initialize_providers_manager
self._discover_all_providers_from_packages()
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/airflow/providers_manager.py", line 149, in _discover_all_providers_from_packages
self._provider_schema_validator.validate(provider_info)
File "/Users/p/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/jsonschema/validators.py", line 353, in validate
raise error
jsonschema.exceptions.ValidationError: Additional properties are not allowed ('logo' was unexpected)

Failed validating 'additionalProperties' in schema['properties']['integrations']['items']:
{'additionalProperties': False,
'properties': {'external-doc-url': {'description': 'URL to external '
'documentation for '
'the integration.',
'type': 'string'},
'how-to-guide': {'description': 'List of paths to '
'how-to-guide for the '
'integration. The path '
'must start with '
"'/docs/'",
'items': {'type': 'string'},
'type': 'array'},
'integration-name': {'description': 'Name of the '
'integration.',
'type': 'string'},
'tags': {'description': 'List of tags describing the '
"integration. While we're "
'using RST, only one tag is '
'supported per integration.',
'items': {'enum': ['apache',
'aws',
'azure',
'gcp',
'gmp',
'google',
'protocol',
'service',
'software',
'yandex'],
'type': 'string'},
'maxItems': 1,
'minItems': 1,
'type': 'array'}},
'required': ['integration-name', 'external-doc-url', 'tags'],
'type': 'object'}

On instance['integrations'][0]:
{'external-doc-url': 'https://tools.ietf.org/html/rfc3501',
'integration-name': 'Internet Message Access Protocol (IMAP)',
'logo': '/integration-logos/imap/IMAP.png',
'tags': ['protocol']}
`

Also I got the same Error when i try to run Airflow Webserver

Really appreciate your help!

[ephraimbuddy]

To install Airflow, you should use a constraint file. Example:

pip install apache-airflow[postgres,google]==2.1.2 \
 --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-2.1.2/constraints-3.7.txt"

[Ahmed0028]

Thanks for your quick reply .

should i uninstall airflow and reinstall it with constraint again?

[ephraimbuddy]

Yes. But it should work either ways

[potiuk]

I think the big problemn is that you are likely using Airflow 2.0.0 (only this version has this problem - even Airflow 2.0.1 should not produce this error) - the "logo" error can only be produced by Airflow 2.0.0 which is already superseded by new versions of Airflow that do not exhibit this behaviour (even with latest providers). There are three built-in-providers that we cannot limit to Airflow 2.1 and if you try to install the latest version of those on top of Airfow 2.0.0 - they will produce this error.

Please use latest 2.1* version of Airflow and use constraints as @ephraimbuddy rightfully pointed out. This should solve the problem and it also is the "only" installation mechanism that we officially recommend for installing airflow : https://airflow.apache.org/docs/apache-airflow/stable/installation.html#installation-script

[Ahmed0028]

Your Suggestions helped me out to solve the problem.

It asked me for login . user and password. should i have been registered somewhere before open the Airflow GUI ?

Thanks For Your Support @ephraimbuddy @potiuk !

[ephraimbuddy]

@Ahmed0028 , you have to create a new user as explained here: https://airflow.apache.org/docs/apache-airflow/stable/start/local.html#running-airflow-locally with this command:

airflow users create \
    --username admin \
    --firstname Peter \
    --lastname Parker \
    --role Admin \
    --email spiderman@superhero.org