Skip to content

Don't overwrite connection extra with invalid json - #27142

Merged
jedcunningham merged 1 commit into
apache:mainfrom
astronomer:invalid_json_extra
Oct 19, 2022
Merged

jedcunningham merged 1 commit into
apache:mainfrom
astronomer:invalid_json_extra

Conversation

@jedcunningham

Copy link
Copy Markdown
Member

If invalid json is provided for a connection's extra, don't actually overwrite it with the invalid data. This matches the intended behavior, based on the flash message we show the user.

If invalid json is provided for a connection's extra, don't actually
overwrite it with the invalid data. This matches the intended behavior,
based on the flash message we show the user.
@ephraimbuddy ephraimbuddy added this to the Airflow 2.4.2 milestone Oct 19, 2022
@jedcunningham
jedcunningham merged commit fece7f0 into apache:main Oct 19, 2022
@jedcunningham
jedcunningham deleted the invalid_json_extra branch October 19, 2022 16:13
@ephraimbuddy ephraimbuddy added the type:bug-fix Changelog: Bug Fixes label Oct 19, 2022
ephraimbuddy pushed a commit that referenced this pull request Oct 19, 2022
If invalid json is provided for a connection's extra, don't actually
overwrite it with the invalid data. This matches the intended behavior,
based on the flash message we show the user.

(cherry picked from commit fece7f0)
PDUCLOS added a commit to PDUCLOS/lyonflowfull that referenced this pull request Jun 13, 2026
Sprint 12+ — silver_archive_to_minio.py a ModuleNotFoundError sur 'polars'.
polars etait dans requirements.txt mais PAS dans requirements-airflow.txt,
donc le container airflow ne l'avait jamais (image construite avant Sprint 9+
ou rebuild oublie).

Rebuild requis : docker compose build airflow-* puis up -d.

Cf. apache/airflow#27142 — pas de moyen d'installer
polars dans un running container sans casser l'env (pas de pip dans PATH
par defaut, sinon l'image pollue).
PDUCLOS added a commit to PDUCLOS/lyonflowfull that referenced this pull request Jun 13, 2026
…archive_to_minio

Sprint 12+ — boto3 casse sur airflow:2.9.3 (conflit pyOpenSSL/cryptography :
AttributeError: module 'lib' has no attribute 'GEN_EMAIL').

Le DAG silver_archive_to_minio importait boto3 ligne 28 + l'utilisait dans
_get_s3_client(), ce qui faisait crasher l'Airflow DAG bag au parse time et
rendait tous les autres DAGs 'No data found'.

Solution : nouveau module src/minio_s3v4_upload.py (140 lignes) qui signe
les requêtes PUT à la main (HMAC-SHA256, canonical request, Sig V4). Pas de
boto3 dans les deps, pas de magie.

cf. apache/airflow#27142 — boto3 1.34+ incompat
avec pyOpenSSL 23+ via cryptography 41+. Reactivation de boto3 dans Sprint
12+ si le conflit est resolu en upgrade Airflow 2.10+.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:webserver Webserver related Issues type:bug-fix Changelog: Bug Fixes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants