Repository navigation
Status of testing Providers that were prepared on October 04, 2022 #26864
Description
Body
I have a kind request for all the contributors to the latest provider packages release.
Could you please help us to test the RC versions of the providers?
Let us know in the comment, whether the issue is addressed.
Those are providers that require testing as there were some substantial changes introduced:
Provider google: 8.4.0rc2
- Add BigQuery Column and Table Check Operators (#26368): @denimalpaca
- Add deferrable big query operators and sensors (#26156): @phanikumv
- Add
outputproperty to MappedOperator (#25604): @josh-fell - Added append_job_name parameter to DataflowTemplatedJobStartOperator (#25746): @Voldurk
- Adding a parameter for exclusion of trashed files in GoogleDriveHook (#25675): @alexkruc
- Cloud Data Loss Prevention Operators assets (AIP-47) (#26618): @bkossakowska
- Cloud Storage Transfer Operators assets & system tests migration (AIP-47) (#26072): @bkossakowska
- Merge deferrable BigQuery operators to exisitng one (#26433): @lwyszomi
- specifying project id when calling wait_for_operation in delete/create cluster (#26418): @SPTKL
- Auto tail file logs in Web UI (#26169): @jens-scheffler-bosch
- Cloud Functions Operators assets & system tests migration (AIP-47) (#26073): @bkossakowska
- GCSToBigQueryOperator Resolve
max_id_keyjob retrieval and xcom return (#26285): @patricker - Allow for the overriding of
stringify_dictfor json export format on BaseSQLToGCSOperator (#26277): @patricker - Use common url base for Google links (#26057): @bhirsz
- Cloud Video Intelligence Operators assets & system tests migration (AIP-47) (#26132): @bkossakowska
- Life Science assets & system tests migration (AIP-47) (#25548): @bkossakowska
- GCSToBigQueryOperator allow for schema_object in alternate GCS Bucket (#26190): @patricker
- Use AsyncClient for Composer Operators in deferrable mode (#25951): @lwyszomi
- Fix BigQueryCreateEmptyDatasetOperator to use the provided project_id (#25984): @phanikumv
- Cloud Build assets & system tests migration (AIP-47) (#25895): @bkossakowska
- Dataproc submit job operator async (#25302): @bjankie1
- Support project_id argument in BigQueryGetDataOperator (#25782): @sudohainguyen
- Fix JSONDecodeError in Datafusion operators (#26202): @VladaZakharova
- Fixed never ending loop in CreateWorkflowInvocation (#25737): @lwyszomi
- Fix error message on gcs.py (#26570): @Corea
- Don't throw an exception when a BQ cursor job has no schema (#26096): @patricker
- Google Cloud Tasks Sensor for queue being empty (#25622): @vinitpayal
- Correcting the transfer config name. (#25719): @prajyotnaik3
- Fix parsing of optional
modefield in BigQuery Result Schema (#26786): @patricker - Fix MaxID logic for GCSToBigQueryOperator (#26768): @patricker
- SQL to GCS operators update docs for parquet format (#25878): @pierrejeambrun
- Limit Google Protobuf for compatibility with biggtable client (#25886): @potiuk
- Make GoogleBaseHook credentials functions public (#25785): @feluelle
- Consolidate to one
scheduleparam (#25410): @dstandish
Provider slack: 6.0.0rc2
- Refactor
SlackWebhookOperator: Get rid of mandatory http-provider dependency (#26648): @Taragolis - Refactor SlackWebhookHook in order to use
slack_sdkinstead of HttpHook methods (#26452): @Taragolis - Move send_file method into SlackHook (#26118): @Taragolis
- Refactor Slack API Hook and add new Connection type (#25852): @Taragolis
- Remove unsafe imports in Slack API Connection (#26459): @Taragolis
- Add common-sql lower bound for common-sql (#25789): @potiuk
- Fix Slack Connections created in the UI (#26845): @Taragolis
The guidelines on how to test providers can be found in
Verify providers by contributors
Committer
- I acknowledge that I am a maintainer/committer of the Apache Airflow project.
Activity
Taragolis commentedon Oct 4, 2022
#26845, #25852, #26459, #26452: Test on different airflow version with upgrade from one to another. Looks good
#26648: Working fine with not significant findings (could be change in next version of provider): Warning message about unused parameters shown unless explicit set
link_namestoNone, default valueFalse#26118: Seems ok
josh-fell commentedon Oct 4, 2022
#25604 looks good
Voldurk commentedon Oct 5, 2022
#25746 Tested OK on Composer with Airflow 2.2.5
potiuk commentedon Oct 5, 2022
I also marked as tested the RC1 tested issues as there have been tested in rc1 and we had a very few changes since that should not impact those.
eladkal commentedon Oct 8, 2022
Released