Add API endpoint that lets you see what happened in the backfill #46250

Activity

1. dstandish

   added

   kind:metaHigh-level information important to the communityHigh-level information important to the community

   on Jan 29, 2025
2. dstandish

   added this to AIP-78 backfills in scheduleron Jan 29, 2025
3. dstandish

   assigned

   dstandish

   and

   vatsrahul1001

   and unassigned

   dstandish

   on Jan 29, 2025
4. dosubot

   added

   area:APIAirflow's REST/HTTP APIAirflow's REST/HTTP API

   area:backfillSpecifically for backfill relatedSpecifically for backfill related

   on Jan 29, 2025
5. phanikumv

   moved this to Todo in AIP-78 backfills in scheduleron Feb 3, 2025
6. vatsrahul1001 commented on Feb 10, 2025

   

   vatsrahul1001

   on Feb 10, 2025

   Contributor

   More actions

   As discussd with @dstandish this is only good to have. I will look into this later
7. shivaam commented on Apr 9, 2026

   

   shivaam

   on Apr 9, 2026

   Last edited by shivaam

   Contributor

   More actions

   Hi @dstandish — I'd like to pick this up.

   I started with a prototype in #64089 (adding state counts directly to BackfillResponse), but based on feedback from @uranusjr and thinking through the design, I'm going to take a different approach:

   Plan: New GET /backfills/{backfill_id}/dag_runs endpoint

   This would return the BackfillDagRun entries with their linked DagRun state, logical_date, and exception_reason (for skipped slots). The UI can then compute progress counts client-side.

   Benefits over enriching BackfillResponse:

   • Keeps the backfill model stable
   • Returns the actual dag run data (not just aggregated counts)
   • Enables linking individual dag runs to backfills in the UI
   • Supports future CLI airflow backfill status use case

   I'll close #64089 and open a new PR with this approach. Let me know if the approach makes sense to you.
8. shivaam commented on May 23, 2026

   

   shivaam

   on May 23, 2026

   Contributor

   More actions

   @dstandish published a PR for adding get backfill dag runs api.
   #67381
9. shivaam

   added a commit that references this issue on May 26, 2026

   Add GET /backfills/{backfill_id}/dag_runs endpoint

   ...

   This issue will close once commit 376f5f5 is merged into the 'main' branch.

   376f5f5
10. shivaam

    added a commit that references this issue on Jun 27, 2026

    Add GET /backfills/{backfill_id}/dag_runs endpoint

    ...

    This issue will close once commit bdc0bcc is merged into the 'main' branch.

    bdc0bcc
11. shivaam

    added a commit that references this issue on Jul 10, 2026

    Add GET /backfills/{backfill_id}/dag_runs endpoint

    ...

    This issue will close once commit 34aa8b6 is merged into the 'main' branch.

    34aa8b6
12. pierrejeambrun

    closed this as completedin #67381on Jul 20, 2026
13. pierrejeambrun

    added 2 commits that reference this issue on Jul 20, 2026

    Add API endpoint for backfill dag run entries (#67381)

    ...

    This issue will close once commit 6f88f29 is merged into the 'main' branch.

    6f88f29

    Add API endpoint for backfill dag run entries (#67381) (#70127)

    ...

    This issue will close once commit 2b68a62 is merged into the 'main' branch.

    2b68a62
14. dabla

    added a commit that references this issue on Jul 21, 2026

    Add API endpoint for backfill dag run entries (apache#67381)

    ...

    This issue will close once commit 89e76b2 is merged into the 'main' branch.

    89e76b2
15. eladkal

    added a commit that references this issue on Jul 22, 2026

    Flag missing conn-fields when hook-only files change in static checks (…

    ...

    This issue will close once commit ffe49c7 is merged into the 'main' branch.

    ffe49c7
16. potiuk

    added a commit that references this issue on Jul 30, 2026

    [v3-3-test] Flag missing conn-fields when hook-only files change in s…

    ...

    This issue will close once commit 179b1f0 is merged into the 'main' branch.

    179b1f0
17. vatsrahul1001

    added a commit that references this issue on Aug 5, 2026

    Add API endpoint for backfill dag run entries (#67381) (#70127)

    ...

    This issue will close once commit bedaeae is merged into the 'main' branch.

    bedaeae