Repository navigation
Prepare providers release 2026-11-03 - #76490
Conversation
shahar1
left a comment
There was a problem hiding this comment.
I compared each changelog entry with the diff of the PR it cites, looking only at that provider's files, and checked related PRs for reverts and dependencies. There are no revert pairs in this wave. The comments below are factual or scope mismatches, not wording preferences.
On the checklist item about the fab and keycloak notes: 3.4.1 matches #76474 and the #76329 milestone, and AccessView.DAG_BUNDLES is not in the 3.4.0rc2 tag. It was also not on v3-4-test when I checked, so the notes depend on that change landing. #76474 is still open, and it also carries a code fix that this wave does not include (see the comment on the fab entry).
Drafted-by: Claude Code (Opus 5.5); reviewed by shahar1 before posting
potiuk
left a comment
There was a problem hiding this comment.
The mechanical side of this wave checks out. Versions agree across provider.yaml, pyproject.toml, __init__.py, the README, the docs index and the changelog for all 30 providers. The changelogs cover every PR since each provider's last tag, and the common.ai>=1.0.0 floors match what databricks and snowflake import. I ran these checks on b93289a7; the commit after it only edits changelogs.
I'm not approving yet, but I know the remaining items will be addressed: 533b9cd already takes up much of the changelog feedback, and the rest follows once #76474 and #76161 merge and you fold them in at the rebase. Since that changes the fab, keycloak and google content, I'll take another look after the rebase rather than review it twice.
This review was drafted by an AI-assisted tool and
confirmed by an Apache Airflow maintainer. The findings
below are observations, not blockers; an Apache Airflow
maintainer — a real person — will take the next look at the
PR. If you think a finding is mis-applied, please reply on
the PR and a maintainer will weigh in.More on how Apache Airflow handles maintainer review:
Contributing guide.
533b9cd to
9580811
Compare
potiuk
left a comment
There was a problem hiding this comment.
The rebase and the common.ai exclusion look good: versions agree across all 29 providers and the folded PRs are in the changelogs. Two small inline notes suggest saying that the Dag bundle permission needs Airflow 3.4.1. That also depends on #76329 reaching v3-4-test: its automatic backport failed and it is not on the branch yet.
Smaller observations
- See inline comments on
providers/fab/docs/changelog.rst:42,providers/keycloak/docs/changelog.rst:43.
This review was drafted by an AI-assisted tool and
confirmed by an Apache Airflow maintainer. The maintainer
approving this PR has read the findings and signed off. If
something feels off, please reply on the PR and a maintainer
will follow up.More on how Apache Airflow handles maintainer review:
Contributing guide.
potiuk
left a comment
There was a problem hiding this comment.
Approval stands. CI is green at this head and the /auth/token thread is resolved. My two inline notes about the Airflow 3.4.1 wording are not blocking: I am leaving it to the release manager to apply them or resolve them as they are. The v3-4-test backport of #76329 is also left to the maintainers, and it should land before 3.4.1 is cut.
This review was drafted by an AI-assisted tool and
confirmed by an Apache Airflow maintainer. The maintainer
approving this PR has read the findings and signed off. If
something feels off, please reply on the PR and a maintainer
will follow up.More on how Apache Airflow handles maintainer review:
Contributing guide.
30 provider version bumps with regenerated metadata, documentation and the workspace lockfile.
Add the missing arrow note for the new fast_executemany default, warn about the Airflow 3.0.x example Dag that imports the removed TimeDeltaSensorAsync, reword the BigQuery get_records entry to match what changed, and list the common.ai review loop example under Doc-only.
The cncf.kubernetes floor for amazon and the common.ai floor for snowflake changed after the templates were regenerated, so their README and docs index still listed the old floors.
Correct entries that overstated or misdescribed what shipped, add notes for behaviour changes the review found (the AwsEksExecutor cncf.kubernetes requirement, the BigQueryStreamingBufferEmptySensor default, Viewer and User losing the Dag bundle pages), and list the runtime dependency floors that the CI environment upgrades raised.
Its maintainers asked for a few more days on pending changes, so it moves to the next wave and keeps its 1.1.0 release metadata.
Add the changes that merged after the wave was prepared: the Dag bundle menu fix for Airflow 3.4.0 in fab and keycloak, the Google Cloud IdP extra parameters fix, the AwsDuckDBHook credential refresh, and the new trigger endpoint permissions in the fab docs.
Rebase onto main pulled in more provider changes after approval. Fold the new entries into amazon (SAML IdP XXE hardening), snowflake (Workload Identity Federation), apache.arrow (build ADBC URI from connection fields) and postgres (dialect caching). Release http 6.4.0, microsoft.mssql 4.7.3 and dbt.cloud 4.11.2, which gained code since the cut, and repoint openai's doc-only marker. Apply the reviewer's Airflow 3.4.1 wording to the fab and keycloak Dag bundle entries.
9580811 to
6f31dfa
Compare
Prepare the 2026-11-03 provider wave for release-note review: 32 provider version bumps with
regenerated package metadata, documentation and the workspace lockfile.
Baseline for each provider is its last final release. Classified from
mainat the wave base.The CI-environment bot commits (the
flit_corebuild-requirement bump and the earlier dependencybump) are recorded in each provider's changelog excluded block, as in previous waves, and do not on
their own trigger a release.
Prepared versions
Version-bump rationale
Major (11). Ten come from the deprecation removals merged on 2026-10-31:
OSSKeySensor.get_hook(usehook).deprecated
get_pandas_df/get_pandas_df_by_chunkshook methods (useget_df(..., df_type="pandas")).cleanup_stuck_queued_tasksexecutor method (use
revoke_task).TimeDeltaSensorAsync(useTimeDeltaSensor(..., deferrable=True)).DataprocHook.client(usedataproc_client).The eleventh is apache.kafka 3.0.0: the
EventProducerplugin now emitsschema_version2, withDag-run date fields formatted via
datetime.isoformat()and a missing date sent asnullratherthan
"". Consumers that parse those fields need to adapt, so it is breaking for plugin users eventhough it does not affect everyone. See the checklist below.
Minor (9).
on_killforSageMakerTrainingOperator, parallel ECS executor launches(
run_task_concurrency, default1preserves current behaviour),SqlToS3Operatorpaging,S3Hook.aload_bytes, an EKS pod-exec operator, Bedrock scheduling options, andfail_on_exit_codeon the ECS run operator. The per-team EKS executor change is additive; in multi-team mode (an
experimental feature) a team's
[aws_eks_executor]config no longer falls back to the globalsection, and the executor now needs
cncf.kubernetes>=11.0.0, which the changelog note calls out.The SAML IdP-response parser now disables external-entity resolution (defence-in-depth hardening).
BigQueryAsyncHook.aget_records(the sync
get_recordsis deprecated, not removed), the IdP-extra-parameters connection fix, plusother fixes. The Cloud Logging reader fix is a bug fix:
prepare_log_filteris not a supportedpublic interface (confirmed by the maintainer on the PR). The "remove unused … helper" PRs touch
private helpers only (misc); "HO mode" only raises the
google-cloud-dataprocfloor.POST /auth/tokenand/auth/token/clichange is a bug fix: they now honour only the configuredAUTH_TYPE.Workload Identity Federation support for Snowflake REST API auth.
asyncmybecomes the default async driver;aiomysqlstays installed and gets adedicated
[aiomysql]extra.AdbcHook.insert_rowsnow defaultsfast_executemany=Trueand routes throughthe driver's bulk ingest (a changelog note records how to keep the previous path), and the hook now
builds the ADBC database URI from the connection fields. Pre-1.0, so a behaviour change rides a minor
bump.
HttpEventTriggernow passes asset state store accessors to the response-checkcallable when it accepts them (backward compatible).
Patch (12). common.compat 1.23.1, common.io 1.11.1, dbt.cloud 4.11.2, edge3 5.1.1, ftp 3.16.2,
microsoft.azure 15.3.1, microsoft.mssql 4.7.3, postgres 7.1.2, sendgrid 4.2.6, smtp 3.2.1, ssh 7.0.2,
teradata 3.7.2.
S3ToAzureBlobStorageOperatornow defaultss3_verify=None, so it followsthe connection / botocore default and matches both its own docstring and the sibling transfer
operators. Classified a bug fix; the note tells anyone who relied on the old default to pass
s3_verify=False.PostgresHook/MsSqlHook.timeout_secondsand connection proxies.aiosmtplibfloor to 5.1.0.Doc-only
.latest-doc-only-change.txtmarker isrepointed and no artifact is released.
Inter-provider dependency pins
cncf.kubernetesextra moves to>=11.0.0(the per-team executor needs this wave'scncf.kubernetes change).
common.aiextra is set to>=1.0.0(the managed-agent module it imports first shippedin common.ai 1.0.0) rather than auto-bumped to this wave's version.
common.aiextra is raised to>=1.0.0. It merged as>=0.11.0(Add Databricks agent invocation operator and hook #74386), but themanaged-agent base it imports first shipped in common.ai 1.0.0, and
0.11.0was never finallyreleased, so
>=1.0.0is the accurate floor. Flagging for visibility since it adjusts a floor set bythe original PR.
Not released
changes. Its unreleased changes stay on main for the next wave.
Rebased onto main
Rebased onto
mainafter review and folded in the provider changes that merged since the wave wasprepared:
now work.
extra) and the SAML IdP-response XXE hardening (disable external entities in SAML idp response parsing #71423).
fields (Build the ADBC database URI from the connection fields #74454). postgres: dialect caching (Cache the dialect on PostgresHook and MsSqlHook #75656).
(Cache the dialect on PostgresHook and MsSqlHook #75656), dbt.cloud 4.11.2 (Apply timeout_seconds and connection proxies to dbt Cloud sync requests #74684). openai is doc-only.
apache.kafka ships as a major in this wave, without waiting for #73276.
Was generative AI tooling used to co-author this PR?