Repository navigation
Status of testing Providers that were prepared on July 09, 2023 #32460
Description
Body
I have a kind request for all the contributors to the latest provider packages release.
Could you please help us to test the RC versions of the providers?
Let us know in the comment, whether the issue is addressed.
Those are providers that require testing as there were some substantial changes introduced:
I marked PRs that were tested in RC2 #32389 as tested.
Provider amazon: 8.3.0rc4
- Add
ChimeWebhookHook(#31939): @cjames23 - Add
ChimeNotifier(#32222): @cjames23 - Add deferrable mode to S3KeysUnchangedSensor (#31940): @sunank200
- Add deferrable mode to
RdsCreateDbInstanceOperatorandRdsDeleteDbInstanceOperator(#32171): @syedahsn - Add deferrable mode for
AthenaOperator(#32186): @vandonr-amz - Add a deferrable mode to
BatchCreateComputeEnvironmentOperator(#32036): @vandonr-amz - Add deferrable mode in EMR operator and sensor (#32029): @pankajastro
- add async wait method to the "with logging" aws utils (#32055): @vandonr-amz
- Add custom waiters to EMR Serverless (#30463): @syedahsn
- Add an option to
GlueJobOperatorto stop the job run when the TI is killed (#32155): @hussein-awala - deferrable mode for
SageMakerTuningOperatorandSageMakerEndpointOperator(#32112): @vandonr-amz - EKS Create/Delete Nodegroup Deferrable mode (#32165): @syedahsn
- Deferrable mode for ECS operators (#31881): @vandonr-amz
- Add
job_poll_intervalargument to AWS GlueJobOperator (#32147): @raphaelauv - Added
AzureBlobStorageToS3Operatortransfer operator (#32270): @Adaverse - Introduce a base class for aws triggers (#32274): @vandonr-amz
- bugfix: break down run+wait method in ECS operator (#32104): @vandonr-amz
- Handle
UnboundLocalErrorwhile parsing invalids3_url(#32120): @Adaverse - Fix
LambdaInvokeFunctionOperatorpayload parameter type (#32259): @eladi99 - Bug fix GCSToS3Operator: avoid
ValueErrorwhenreplace=Falsewith files already in S3 (#32322): @Adaverse - Deprecate
delimiterparam and source object's wildcards in GCS, introducematch_globparam. (#31261): @shahar1 - aws waiter util: log status info with error level on waiter error (#32247): @vandonr-amz
- rewrite method used in ecs to fetch less logs (#31786): @vandonr-amz
- Refactor Eks Create Cluster Operator code (#31960): @syedahsn
- Use a waiter in
AthenaHook(#31942): @vandonr-amz - Add
on_finish_actiontoKubernetesPodOperator(#30718): @hussein-awala - Add default_deferrable config (#31712): @Lee-W
- deprecate arbitrary parameter passing to RDS hook (#32352): @vandonr-amz
- quick fix on RDS operator to prevent parameter collision (#32436): @vandonr-amz
- Remove ability to specify arbitrary hook params in AWS RDS trigger (#32386): @vandonr-amz
- Only update crawler tags if present in config dict (#32331): @luos-fc
The guidelines on how to test providers can be found in
Verify providers by contributors
All users involved in the PRs:
@Lee-W @hussein-awala @sunank200 @eladi99 @raphaelauv @cjames23 @pankajastro @luos-fc @syedahsn @Adaverse @shahar1 @vandonr-amz
Committer
- I acknowledge that I am a maintainer/committer of the Apache Airflow project.
Activity
Adaverse commentedon Jul 9, 2023
Tested #32270, Works as expected!
Updating setup.cfg with RC provider packages on apache/airflow#32460
Lee-W commentedon Jul 10, 2023
Tested with our example amazon DAG and worked fine.
pankajastro commentedon Jul 10, 2023
#32029 looks good. thank you!
eladkal commentedon Jul 10, 2023
Thank you everyone.
Amazon provider is released
I invite everyone to help improve providers for the next release, a list of open issues can be found here.