Skip to content

sql_alchemy_conn_cmd cause failed connect to backend database and fallback to sqlite #19833

Closed

Description

@karry-li-lego

Apache Airflow version

2.2.2 (latest released)

Operating System

macOS 10.15.7

Versions of Apache Airflow Providers

apache-airflow-providers-amazon | 1.3.0
apache-airflow-providers-apache-spark | 1.0.3
apache-airflow-providers-celery | 2.1.0
apache-airflow-providers-ftp | 1.0.1
apache-airflow-providers-http | 1.1.1
apache-airflow-providers-imap | 1.0.1
apache-airflow-providers-mongo | 2.1.0
apache-airflow-providers-mysql | 1.1.0
apache-airflow-providers-postgres | 2.0.0
apache-airflow-providers-sqlite | 1.0.2

Deployment

Virtualenv installation

Deployment details

Apache Airflow
version | 2.2.2
executor | CeleryExecutor
task_logging_handler | airflow.utils.log.file_task_handler.FileTaskHandler
sql_alchemy_conn | postgresql+psycopg2://airflow_user:airflow_pass@localhost:5432/airflow_db
dags_folder | /Users//airflow/dags
plugins_folder | /Users/
/airflow/plugins
base_log_folder | /Users/**/airflow/logs
remote_base_log_folder |

System info
OS | Mac OS
architecture | x86_64
uname | uname_result(system='Darwin', node='', release='19.6.0', version='Darwin Kernel Version 19.6.0: Thu Sep 16 20:58:47 PDT 2021; root:xnu-6153.141.40.1~1/RELEASE_X86_64', machine='x86_64',
| processor='i386')
locale | (None, 'UTF-8')
python_version | 3.8.8 (default, Apr 13 2021, 12:59:45) [Clang 10.0.0 ]
python_location | /Users/
/opt/anaconda3/envs/airflow/bin/python

Tools info
git | git version 2.24.3 (Apple Git-128)
ssh | OpenSSH_8.1p1, LibreSSL 2.7.3
kubectl | Client Version: v1.21.5
gcloud | NOT AVAILABLE
cloud_sql_proxy | NOT AVAILABLE
mysql | mysql Ver 8.0.27 for macos10.15 on x86_64 (Homebrew)
sqlite3 | 3.35.4 2021-04-02 15:20:15 5d4c65779dab868b285519b19e4cf9d451d50c6048f06f653aa701ec212df45e
psql | psql (PostgreSQL) 14.1

What happened

if use sql_alchemy_conn_cmd param, then execute any job will get this error,
sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) no such table: dag_run
but if I use sql_alchemy_conn, everything is ok.

What you expected to happen

sql_alchemy_conn_cmd is work for airflow deploy.

How to reproduce

just use sql_alchemy_conn_cmd to set backend database.

Anything else

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Activity

  1. boring-cyborg commented on Nov 26, 2021

    @boring-cyborg

    Thanks for opening your first issue here! Be sure to follow the issue template!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions