Repository navigation
Status of testing of Apache Airflow 2.9.2rc1 #40093
Description
Body
We are kindly requesting that contributors to Apache Airflow RC 2.9.2rc1 help test the RC.
Please let us know by commenting if the issue is addressed in the latest RC.
- Fix visible DagRun doesn't point to the same dag run id (#38365): @lotrias17 @nivdror
Linked issues: - Fix TaskHandlerWithCustomFormatter now adds prefix only once (#38502): @TiDeane @Aakcht
Linked issues: - Fix inconsistency of cache-directive vs. docker-cache (#38580): @potiuk
- Add support for OrbStack in breeze (#38725): @jedcunningham
- Fix Mark Instance state buttons stay disabled if user lacks permission (#37451) (#38732): @RodrigoGanancia @sreenusuuda
Linked issues: - Add "use self-hosted runners" to CI setup (#38779): @potiuk
- Fix
sql_alchemy_engine_argsconfig example (#38971): @jedcunningham - Fix alembic autogeneration and rename mismatching constraints (#39032): @ephraimbuddy
- Fix stacklevel for TaskContextLogger (#39142): @dstandish
- Remove unused index
idx_last_scheduling_decisionondag_runtable (#39275): @pankajkoti - add missing conn_id to string representation of ObjectStoragePath (#39313): @Lee-W
- Do not provide deprecated
execution_datein@apply_lineage(#39327): @Taragolis
Linked issues: - Fix static file caching is disabled in Airflow Webserver. (#39345): @VertexToEdge
Linked issues: - Refactor
SafeDogStatsdLoggerto useget_validatorto enable pattern matching (#39370): @rawwar
Linked issues: - Add the existing_nullable to the downgrade side of the migration (#39374): @ephraimbuddy
- Fix HTTP 500 Internal Server Error if DAG is triggered with bad params (#39409): @jscheffl
- Resolve SA warnings in migrations scripts (#39418): @Taragolis
- Fix custom actions in security manager
has_access(#39421): @jedcunningham @vincbeck
Linked issues: - add lost space to breeze help (#39458): @uzhastik
- Increase volume size for ARM instance (#39472): @potiuk
- Add hatch_build.py to k8s test venv cache calculation (#39473): @potiuk
- Update uv to 0.1.41 (#39476): @potiuk
- Add Cache-Control "no-store" to all dynamically generated content (#39550): @potiuk
- Update uv to 0.1.42 (#39561): @potiuk
- Remove mysql/postgres from extras before determining the installation_command_flags (#39610): @macchiang
- Change dataset URI validation to raise warning instead of error in Airflow 2.9 (#39670): @uranusjr @tatiana
Linked issues: - More typing in TimeSensor and TimeSensorAsync (#39696): @jedcunningham
- Reraise exception from strict dataset URI checks (#39719): @uranusjr @tatiana
Linked issues: - Better typing for BaseOperator
defer(#39742): @jedcunningham - Use SKIP LOCKED instead of NOWAIT in mini scheduler (#39745): @VladimirYushkevich
- Change type definition for
provider_info_cachedecorator (#39750): @Taragolis - Warn on mini scheduler failures instead of debug (#39760): @RNHTTR
- Fix example_branch_operator failing in python 3.12 (#39783): @ephraimbuddy
- Limit concurrent downloads by UV (#39810): @potiuk
- Add
max_consecutive_failed_dag_runsin API spec (#39830): @pankajastro - Also limit concurrent uv downloads when building (#39852): @potiuk
Linked issues: - Remove DAG Run Add option from FAB view (#39881): @jscheffl @fliaj
Linked issues: - Fix bug that makes
AirflowSecurityManagerV2leave transactions in theidle in transactionstate (#39935): @alejandro-rivera - Limit yandex provider to avoid mypy errors (#39990): @potiuk
- Fix mocking in kerberos integration test (#40042): @potiuk
Thanks to all who contributed to the release (probably not a complete list!):
@jscheffl @nivdror @dstandish @ephraimbuddy @pankajastro @VladimirYushkevich @uzhastik @sreenusuuda @uranusjr @VertexToEdge @RodrigoGanancia @lotrias17 @rawwar @macchiang @Lee-W @potiuk @pankajkoti @Taragolis @Aakcht @alejandro-rivera @RNHTTR @fliaj @TiDeane @jedcunningham @tatiana @vincbeck
Committer
- I acknowledge that I am a maintainer/committer of the Apache Airflow project.
Activity
potiuk commentedon Jun 6, 2024
Checked my changes. Unfortunately there is likely a breaking "celery" change that we should make sure to handle. See #40097
potiuk commentedon Jun 6, 2024
UPDATE: so it seems (see #40097 ) we should also cherry-pick #40012 and #40035 in order to include fix for that (cc: @o-nikolas ). I marked them as 2.9.2 milestone.
utkarsharma2 commentedon Jun 6, 2024
Sure @potiuk, we will cherry-pick those commit and release rc2
ephraimbuddy commentedon Jun 6, 2024
I'm confused here. #40012 is provider only change but #40035 is only test changes. I think the fix would be by releasing a new celery provider or am I missing something?
pankajastro commentedon Jun 6, 2024
#39830 looking good
potiuk commentedon Jun 6, 2024
I looked closer and yes - you are absolutely right @ephraimbuddy. This looks like celery provider bug for 3.7.1 and that we should wait with 2.9.2 until celery provider is 3.7.2 with the fix is released and we should - I think - yank celery provider 3.7.1
See: #40097 (comment)
jscheffl commentedon Jun 8, 2024
Tested the two contributed fixes, works as expected.
utkarsharma2 commentedon Jun 10, 2024
Airflow 2.9.2 has been released. Thank you all for testing this release