Status of testing Providers that were prepared on August 07, 2025

@pierceroberts

Body

I have a kind request for all the contributors to the latest provider distributions release.
Could you please help us to test the RC versions of the providers?

The guidelines on how to test providers can be found in

Verify providers by contributors

Let us know in the comments, whether the issue is addressed.

These are providers that require testing as there were some substantial changes introduced:

Provider airbyte: 5.2.3rc1

50937, add debug logging for airbyte (#51503): @pierceroberts

Provider amazon: 9.12.0rc1

Provider apache.tinkerpop: 1.0.3rc1

Bump gremlinpython to 3.7.3 (#54109): @gopidesupavan

Provider cncf.kubernetes: 10.7.0rc1

Provider common.sql: 1.27.5rc1

Fix SnowflakeCheckOperator and SnowflakeValueCheckOperator to use parameters arg correctly (#53837): @gopidesupavan

Provider databricks: 7.7.1rc1

Bump deltalake to 1.1.3 (#54108): @gopidesupavan

Provider edge3: 1.1.3rc1

Fix: Prevent duplicate edge_job insertions for deferrable tasks in EdgeExecutor (#53610) (#53927): @Prasanth345

Provider fab: 2.4.0rc1

Provider google: 17.1.0rc1

Provider microsoft.azure: 12.6.1rc1

fix typo in AdminClientHook.create_subscription (#54130): @eladkal

Provider microsoft.winrm: 3.11.0rc1

Add test_connection method to WinRMHook (#47477): @fritz-astronomer

Provider openlineage: 2.6.1rc1

Provider postgres: 6.2.3rc1

Fix the PostgresHook ignoring custom adapters registered (#53707): @olegkachur-e
Linked issues:
- Linked Issue #50976: @plutaniano

Provider redis: 4.3.0rc1

AIP-82: Add RedisPubSubMessageQueueProvider (#53556): @Jasperora
Linked issues:
- Linked Issue #52712: @jason810496
- Linked Issue #52917: @Jasperora

Provider samba: 4.10.3rc1

Fix: make samba hook open_file method return (#54107): @gopidesupavan

Provider sftp: 5.3.4rc1

Fix missing prefetch arg to SFTPOperator (#53906): @gopidesupavan

Provider slack: 9.1.4rc1

Remove deprecated method check send_file usage from slack operators (#54061): @gopidesupavan

Provider smtp: 2.2.0rc1

feat-51094: add OAuth 2 / XOAUTH2 support via auth_type & token/credential extras (#53554): @nailo2c
Linked issues:
- Linked Issue #51094: @boelaars

Provider snowflake: 6.5.2rc1

Fix SnowflakeCheckOperator and SnowflakeValueCheckOperator to use parameters arg correctly (#53837): @gopidesupavan

Provider standard: 1.6.0rc1

Provider trino: 6.3.3rc1

Added functionality to only allow one auth method simultaneously in the TrinoHook (#53134): @dominikhei

All users involved in the PRs:
@fritz-astronomer @Dev-iL @eladkal @Lee-W @gopidesupavan @dominikhei @isaiahiruoha @Prasanth345 @seanghaeli @vincbeck @jroachgolf84 @nailo2c @sjyangkevin @MaksYermak @LipuFei @Jasperora @GrumpyCat51

Committer

I acknowledge that I am a maintainer/committer of the Apache Airflow project.

@eladkal

Hi @eladkal , #53542 works for me.

Did the PMC member verification all looks good. But I am -1 on standard. Repeating the arguments from devlist discussion:

Technically this is not a regression - because we have released it in 1.5.0 but we had #54124 (comment) that Pavan found and already fixed (I just merged) in #54214

Since this is affects PythonVirtualenv (badly), I think we should fix it rather quickly and have rc2 for standard provider (especially that the fix is already in)

found one more issue, created latest package locally and ran example its giving me this error. it seems atleast the default python version needs to be set for uv.

Fix is coming..

It affects mainly when UV is installed and here its default to auto to check https://github.com/apache/airflow/blob/main/providers/standard/src/airflow/providers/standard/utils/python_virtualenv.py#L48, i think its better to handle this setting default python version?

I think you should use "path to python" (that's what venv expects) - "python" is not a valid path ?

I think you should use "path to python" (that's what venv expects) - "python" is not a valid path ?

nah this was failing to create venv given provided path, the command its running this one eg:

Executing cmd: uv venv --allow-existing --seed --python python /var/folders/36/wmkhxjrx523cl98ggtm496m00000gn/T/venvwf85vx2b

Output:: source="airflow.utils.process_utils"
[2025-08-07, 16:25:34] INFO -   × No interpreter found for executable name `python` in managed installations: source="airflow.utils.process_utils"
[2025-08-07, 16:25:34] INFO -   │ or search path: source="airflow.utils.process_utils"

so here --python python is not recognising python as valid interpreter. as per this https://docs.astral.sh/uv/reference/cli/#uv-python the request format we are using wrong? 🤔

okay i just ran that command in breeze it gives me this: so if the interpreter is set as python in system then there is no issue, otherwise its failing.

Should we default to some version or leave it as empty ? i think this error is valid if there is no interpreter configures then user should provide which python version they want use ?

I've tested my part on my local device, looking good!

okay i just ran that command in breeze it gives me this: so if the interpreter is set as python in system then there is no issue, otherwise its failing.

Let's take it offline :) -> I don't think that is a "bug" - possibly an improvement in diagnostics/defaults :)

@eladkal

Hi @eladkal , #53927, Tested the fix for duplicate edge_job insertions in edge3 provider (v1.1.3). Everything is working as expected — no issues found.

Tested apache-airflow-providers-standard==1.5.0 with apache-airflow==3.0.4rc2.

If a dag does not have HITLOperator, it works as expected. If a dag contains HITLOperators, it failed as expected.

I'd like to point out that a dag containing HITLOperators with Airflow < 3.1 kills the dag processor due to AirflowOptionalProviderFeatureException not caught in

airflow/airflow-core/src/airflow/dag_processing/processor.py

Lines 123 to 141 in dc952f0

    
           def _pre_import_airflow_modules(file_path: str, log: FilteringBoundLogger) -> None: 
        
               """ 
        
               Pre-import Airflow modules found in the given file. 
        
               This prevents modules from being re-imported in each processing process, 
        
               saving CPU time and memory. 
        
               (The default value of "parsing_pre_import_modules" is set to True) 
        
               :param file_path: Path to the file to scan for imports 
        
               :param log: Logger instance to use for warnings 
        
               """ 
        
               if not conf.getboolean("dag_processor", "parsing_pre_import_modules", fallback=True): 
        
                   return 
        
               for module in iter_airflow_imports(file_path): 
        
                   try: 
        
                       importlib.import_module(module) 
        
                   except ModuleNotFoundError as e: 
        
                       log.warning("Error when trying to pre-import module '%s' found in %s: %s", module, file_path, e)

. It failed as expected, but I'm a bit not sure whether it's how we want it to fail

or should we change it to ImportError instead

Checked the #53707, #53865, #54014, all looks good.

@eladkal

@eladkal Anything I need to do specifically for #51503?
It's adding a few debug logs and updating a test.
The pipeline passed and tests passed locally.

Verified my changes LGTM.

@eladkal

There are still some concerns regarding the Redis provider that need to be discussed for AIP-82: Add RedisPubSubMessageQueueProvider, related dicussion #53556 (review) .

We might need to exclude Redis Provider for this batch release.
cc @eladkal

@Lee-W

The following tests have been done for #54043. In 3.1.0+, should be good, but some caveats we can have a look into it.
CC: @Lee-W , @guan404ming

Unit Test

breeze shell --python 3.12 --backend postgres --db-reset
pip install apache-airflow-providers-fab==2.4.0rc1
cd providers/fab/tests/unit/
pytest --log-level=INFO -s fab/auth_manager

HITL-related permission test

other tests related to fab/auth_manager

Airflow Manual Functional Test

In Airflow < 3.1.0, DAG processor will not start when there is a HITL DAG.

In Airflow 3.1.0+

breeze start-airflow --python 3.12 --backend postgres --auth-manager FabAuthManager --db-reset --load-default-connections
pip install apache-airflow-providers-fab==2.4.0rc1
>restart all the Airflow services

Initialization

Create a new user
Create a new role

Test without permission, access is forbidden

Test with permission, access is good task can be triggered, but pop up 409 Conflict even task can be successfully run.

DAG is executed successfully if a user is assigned both edit permission to DAG and HITL_Detail resource

Thank you everyone. Providers are released.
Providers Standard and Redis are excluded from this release

I invite everyone to help improve providers for the next release, a list of open issues can be found here.

Navigation Menu

Repository navigation

Status of testing Providers that were prepared on August 07, 2025 #54209

Body

Provider airbyte: 5.2.3rc1

Provider amazon: 9.12.0rc1

Provider apache.tinkerpop: 1.0.3rc1

Provider cncf.kubernetes: 10.7.0rc1

Provider common.sql: 1.27.5rc1

Provider databricks: 7.7.1rc1

Provider edge3: 1.1.3rc1

Provider fab: 2.4.0rc1

Provider google: 17.1.0rc1

Provider microsoft.azure: 12.6.1rc1

Provider microsoft.winrm: 3.11.0rc1

Provider openlineage: 2.6.1rc1

Provider postgres: 6.2.3rc1

Provider redis: 4.3.0rc1

Provider samba: 4.10.3rc1

Provider sftp: 5.3.4rc1

Provider slack: 9.1.4rc1

Provider smtp: 2.2.0rc1

Provider snowflake: 6.5.2rc1

Provider standard: 1.6.0rc1

Provider trino: 6.3.3rc1

Committer

Unit Test

Airflow Manual Functional Test

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

	def _pre_import_airflow_modules(file_path: str, log: FilteringBoundLogger) -> None:
	"""
	Pre-import Airflow modules found in the given file.

	This prevents modules from being re-imported in each processing process,
	saving CPU time and memory.
	(The default value of "parsing_pre_import_modules" is set to True)

	:param file_path: Path to the file to scan for imports
	:param log: Logger instance to use for warnings
	"""
	if not conf.getboolean("dag_processor", "parsing_pre_import_modules", fallback=True):
	return

	for module in iter_airflow_imports(file_path):
	try:
	importlib.import_module(module)
	except ModuleNotFoundError as e:
	log.warning("Error when trying to pre-import module '%s' found in %s: %s", module, file_path, e)

Status of testing Providers that were prepared on August 07, 2025 #54209

Description

Body

Provider airbyte: 5.2.3rc1

Provider amazon: 9.12.0rc1

Provider apache.tinkerpop: 1.0.3rc1

Provider cncf.kubernetes: 10.7.0rc1

Provider common.sql: 1.27.5rc1

Provider databricks: 7.7.1rc1

Provider edge3: 1.1.3rc1

Provider fab: 2.4.0rc1

Provider google: 17.1.0rc1

Provider microsoft.azure: 12.6.1rc1

Provider microsoft.winrm: 3.11.0rc1

Provider openlineage: 2.6.1rc1

Provider postgres: 6.2.3rc1

Provider redis: 4.3.0rc1

Provider samba: 4.10.3rc1

Provider sftp: 5.3.4rc1

Provider slack: 9.1.4rc1

Provider smtp: 2.2.0rc1

Provider snowflake: 6.5.2rc1

Provider standard: 1.6.0rc1

Provider trino: 6.3.3rc1

Committer

Activity

LipuFei commented on Aug 7, 2025

potiuk commented on Aug 7, 2025

gopidesupavan commented on Aug 7, 2025

gopidesupavan commented on Aug 7, 2025

potiuk commented on Aug 7, 2025

gopidesupavan commented on Aug 7, 2025

gopidesupavan commented on Aug 7, 2025

aaron-y-chen commented on Aug 8, 2025

potiuk commented on Aug 8, 2025

Prasanth345 commented on Aug 8, 2025

Lee-W commented on Aug 8, 2025

olegkachur-e commented on Aug 8, 2025

pierceroberts commented on Aug 8, 2025

gopidesupavan commented on Aug 8, 2025

jason810496 commented on Aug 9, 2025

sjyangkevin commented on Aug 10, 2025

Unit Test

Airflow Manual Functional Test

eladkal commented on Aug 11, 2025

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions