Status of testing Providers that were prepared on July 27, 2021 (rc2) #17268

Activity

1. potiuk

   added

   kind:bugThis is a clearly a bugThis is a clearly a bug

   on Jul 27, 2021
2. raphaelauv commented on Jul 27, 2021

   

   raphaelauv

   on Jul 27, 2021

   Last edited by raphaelauv

   Contributor

   More actions

   for docker 2.1.0rc2 it's all good

   docker in docker work and also the XCOM

   ---

   t3 = DockerOperator(
       api_version='auto',
       docker_url="unix://var/run/docker.sock",
       command='/bin/echo toto',
       image='centos:latest',
       network_mode='bridge',
       do_xcom_push=True,
       task_id='docker_op_tester',
       dag=dag,
   )
   

   give

   [2021-07-27 19:38:44,647] {docker.py:246} INFO - Starting docker container from image centos:latest
   [2021-07-27 19:38:44,682] {docker.py:256} WARNING - Using remote engine or docker-in-docker and mounting temporary volume from host is not supported. Falling back to `mount_tmp_dir=False` mode. You can set `mount_tmp_dir` parameter to False to disable mounting and remove the warning
   [2021-07-27 19:38:46,975] {docker.py:307} INFO - toto
   [2021-07-27 19:38:47,664] {taskinstance.py:1204} INFO - Marking task as SUCCESS. dag_id=docker_sample, task_id=docker_op_tester, execution_date=20210727T150000, start_date=20210727T193839, end_date=20210727T193847
   [2021-07-27 19:38:47,770] {taskinstance.py:1265} INFO - 0 downstream tasks scheduled from follow-on schedule check
   [2021-07-27 19:38:47,815] {local_task_job.py:149} INFO - Task exited with return code 0
   

   and

   t3 = DockerOperator(
       api_version='auto',
       docker_url="unix://var/run/docker.sock",
       command='/bin/echo toto',
       image='centos:latest',
       network_mode='bridge',
       mount_tmp_dir=False,
       do_xcom_push=True,
       task_id='docker_op_tester',
       dag=dag,
   )
   

   give

   [2021-07-27 19:39:27,176] {docker.py:246} INFO - Starting docker container from image centos:latest
   [2021-07-27 19:39:28,091] {docker.py:307} INFO - toto
   [2021-07-27 19:39:28,383] {taskinstance.py:1204} INFO - Marking task as SUCCESS. dag_id=docker_sample, task_id=docker_op_tester, execution_date=20210727T180000, start_date=20210727T193926, end_date=20210727T193928
   [2021-07-27 19:39:28,424] {taskinstance.py:1265} INFO - 0 downstream tasks scheduled from follow-on schedule check
   [2021-07-27 19:39:28,464] {local_task_job.py:149} INFO - Task exited with return code 0
   

   and in all case a XCOM

   key : return_value
   value : toto

   👍React with 👍1Reacted by Jarek Potiuk
3. levyitay commented on Jul 27, 2021

   

   levyitay

   on Jul 27, 2021

   Contributor

   More actions

   qubole: 2.0.0rc2 tested and working

   👍React with 👍1Reacted by Jarek Potiuk
4. josh-fell commented on Jul 27, 2021

   

   josh-fell

   on Jul 27, 2021

   Contributor

   More actions

   Contributions for Google, Amazon, and Salesforce providers look good!

   👍React with 👍1Reacted by Jarek Potiuk
5. pmalafosse commented on Jul 27, 2021

   

   pmalafosse

   on Jul 27, 2021

   Contributor

   More actions

   amazon: 2.1.0rc2:

   • Allow attaching to previously launched task in ECSOperator (Allow attaching to previously launched task in ECSOperator #16685)
   • ECSOperator / pass context to self.xcom_pull as it was missing (when using reattach) (ECSOperator / pass context to self.xcom_pull as it was missing (when using reattach) #17141)

   I just tried it and ECSOperator is working as expected

   👍React with 👍1Reacted by Jarek Potiuk
6. pmalafosse commented on Jul 27, 2021

   

   pmalafosse

   on Jul 27, 2021

   Contributor

   More actions

   This one is fine too:

   • Update Boto3 API calls in ECSOperator (Update Boto3 API calls in ECSOperator #16050)

   👍React with 👍1Reacted by Jarek Potiuk
7. Goodkat commented on Jul 28, 2021

   

   Goodkat

   on Jul 28, 2021

   Contributor

   More actions

   Tested again the odbc connection, it works as expected with the boolean parameters:
   #15016 (comment)

   👍React with 👍1Reacted by Jarek Potiuk
8. potiuk commented on Jul 28, 2021

   

   potiuk

   on Jul 28, 2021

   MemberAuthor

   More actions

   Getting very good progress on testing with this release :) . Thanks a bunch for those! looking forward for more quick tests :)
9. pavelhlushchanka commented on Jul 28, 2021

   

   pavelhlushchanka

   on Jul 28, 2021

   Contributor

   More actions

   #16820 is also good to go

   👍React with 👍1Reacted by Jarek Potiuk
10. baolsen commented on Jul 28, 2021

    

    baolsen

    on Jul 28, 2021 via email

    Contributor

    More actions

    #16771 and #16612 tested and working as expected.

    …

    On Wed, 28 Jul 2021, 10:41 AM Pavel Hlushchanka, ***@***.***> wrote: #16820 <#16820> is also good to go — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#17268 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AGLEIYZHSJOW72BLXQVJWYTTZ67CFANCNFSM5BCTM7EQ> .

    👍React with 👍1Reacted by Jarek Potiuk
11. ayushchauhan0811 commented on Jul 28, 2021

    

    ayushchauhan0811

    on Jul 28, 2021

    Contributor

    More actions

    #17081 is also good to go

    👍React with 👍1Reacted by Jarek Potiuk
12. iostreamdoth commented on Jul 28, 2021

    

    iostreamdoth

    on Jul 28, 2021

    Contributor

    More actions

    fix: get_cluster call project_id as self.project_id (#17075) looks good.

    👍React with 👍1Reacted by Jarek Potiuk
13. infused-kim commented on Jul 29, 2021

    

    infused-kim

    on Jul 29, 2021

    Contributor

    More actions

    Google ads #17160 is working fine, but I am the one who submitted the PR and it would be good to get it tested by a few more people.

    👍React with 👍1Reacted by Jarek Potiuk
14. potiuk commented on Jul 29, 2021

    

    potiuk

    on Jul 29, 2021

    Last edited by potiuk

    MemberAuthor

    More actions

    Google ads #17160 is working fine, but I am the one who submitted the PR and it would be good to get it tested by a few more people.

    @Overbryd and @rv-irosario - since this was addressing your issues #17113 and #17111 - could you please also take a look if https://pypi.org/project/apache-airflow-providers-google/5.0.0rc2 solves the ads compatibility ?
15. potiuk commented on Jul 30, 2021

    

    potiuk

    on Jul 30, 2021

    MemberAuthor

    More actions

    Hey @oyarushe @scottypate @uranusjr @msumit @Daniel-Han-Yang @rv-irosario @aslantar @malthe @LukeHong
    @sunkickr @mmenarguezpear @fredthomsen @ngaranko @namjals @dstandish @BKronenbitter @freget @ashb @ciancolo @samgans - last chance to test before we release later tonight :)
16. oyarushe commented on Jul 30, 2021

    

    oyarushe

    on Jul 30, 2021

    Contributor

    More actions

    I'm trying to check #16521, but the fix was provided in DbApiHook, which is a general class and I suppose will be released with Airflow itself.
    So I think we need to release the Postgres provider after Airflow.
17. potiuk commented on Jul 30, 2021

    

    potiuk

    on Jul 30, 2021

    Last edited by potiuk

    MemberAuthor

    More actions

    So I think we need to release the Postgres provider after Airflow.

    Ah yeah. This is backwards-compatible change, so it's ok to release Postgres now, but indeed testing will be possible only with new Airflow released (and it i's a new feature so it should be only released in 2.2. Good that you raised it!

    👍React with 👍1Reacted by Oleksandr Yarushevskyi
18. ciancolo commented on Jul 30, 2021

    

    ciancolo

    on Jul 30, 2021

    Contributor

    More actions

    Tested #16365 and #17125 on my local Tableau Server and they works.

    👍React with 👍1Reacted by Jarek Potiuk
19. potiuk commented on Aug 2, 2021

    

    potiuk

    on Aug 2, 2021

    MemberAuthor

    More actions

    Thanks everyone who tested! This is really great help for the community. The vote has passed and I am proceeding to release the providers!

    👍React with 👍1Reacted by raphaelauv
20. potiuk

    closed this as completedon Aug 2, 2021
21. potiuk

    added

    kind:metaHigh-level information important to the communityHigh-level information important to the community

    and removed

    kind:bugThis is a clearly a bugThis is a clearly a bug

    on Aug 2, 2021
22. potiuk

    added

    testing statusStatus of testing releasesStatus of testing releases

    on Feb 14, 2022