Skip to content

fail backfill command before loading DAGs if missing args - #18994

Merged
kaxil merged 1 commit into
apache:mainfrom
SamWheating:sw-fail-fast-backfill-command
Oct 15, 2021
Merged

kaxil merged 1 commit into
apache:mainfrom
SamWheating:sw-fail-fast-backfill-command

Conversation

@SamWheating

Copy link
Copy Markdown
Contributor

I was looking through some of the CLI code last week trying to improve the speed of airflow user commands and I noticed this small issue.

If neither the start_date or end_date argument is provided then the command will fail, but it will first parse all of the DAGs which can take up to several minutes in large deployments.

Now the command will fail faster, allowing the user to adjust their command and retry.

@github-actions

Copy link
Copy Markdown
Contributor

The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not modify the core of Airflow. If the committers decide that the full tests matrix is needed, they will add the label 'full tests needed'. Then you should rebase to the latest main or amend the last commit of the PR, and push it with --force-with-lease.

@github-actions github-actions Bot added the okay to merge It's ok to merge this PR as it does not require more tests label Oct 15, 2021
@kaxil
kaxil merged commit b814ab4 into apache:main Oct 15, 2021
@kaxil kaxil added this to the Airflow 2.2.1 milestone Oct 15, 2021
jedcunningham pushed a commit that referenced this pull request Oct 15, 2021
…18994)

I was looking through some of the CLI code last week trying to improve the speed of `airflow user` commands and I noticed this small issue.

If neither the `start_date` or `end_date` argument is provided then the command will fail, but it will first parse all of the DAGs which can take up to several minutes in large deployments.

Now the command will fail faster, allowing the user to adjust their command and retry.

(cherry picked from commit b814ab4)
@potiuk potiuk mentioned this pull request Oct 27, 2021
24 of 37 tasks
@jedcunningham jedcunningham added the type:bug-fix Changelog: Bug Fixes label Apr 7, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:CLI okay to merge It's ok to merge this PR as it does not require more tests type:bug-fix Changelog: Bug Fixes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants