Skip to content

NeptuneStopDbClusterOperator - Handle invalid cluster states - #38287

Merged
eladkal merged 13 commits into
apache:mainfrom
ellisms:main
May 22, 2024
Merged

eladkal merged 13 commits into
apache:mainfrom
ellisms:main

Conversation

@ellisms

@ellisms ellisms commented Mar 19, 2024

Copy link
Copy Markdown
Contributor

closes #38120

Handles case where the stop cluster api returns either InvalidClusterState or InvalidDBInstanceState exceptions. The operator now uses the waiter to wait for the cluster to be available. Also updated the start cluster operator to do the same.

@boring-cyborg boring-cyborg Bot added area:providers provider:amazon AWS/Amazon - related issues labels Mar 19, 2024
@ellisms

ellisms commented Mar 19, 2024

Copy link
Copy Markdown
Contributor Author

@ferruzzi This is the PR for the neptune operators.

@eladkal

eladkal commented Apr 3, 2024

Copy link
Copy Markdown
Contributor

@ellisms is the PR ready for re-review?

@ellisms

ellisms commented Apr 3, 2024

Copy link
Copy Markdown
Contributor Author

@eladkal Not yet, just getting back into the office. Working on making the suggested changes.

@ellisms

ellisms commented Apr 16, 2024

Copy link
Copy Markdown
Contributor Author

This is ready for re-review.

@ferruzzi ferruzzi left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left a couple nitpicks, but nothing blocking. Feel free to resolve them if you disagree with any of them.

ellisms and others added 2 commits May 21, 2024 20:20
@eladkal
eladkal merged commit a78ee74 into apache:main May 22, 2024
romsharon98 pushed a commit to romsharon98/airflow that referenced this pull request Jul 26, 2024
…apache#38287)

* Cache s3 resource to reduce memory usage

* Fixed missing rebase changes and error in resource init

* catch invalid state exceptions and wait if not terminal status

* PR changes

* Update airflow/providers/amazon/aws/triggers/neptune.py

Co-authored-by: Niko Oliveira <onikolas@amazon.com>

* Update airflow/providers/amazon/aws/operators/neptune.py

Co-authored-by: Niko Oliveira <onikolas@amazon.com>

* PR review changes. Created helper function to deal with waitable ClientErrors

* added missing exception code

* Update airflow/providers/amazon/aws/operators/neptune.py

Co-authored-by: Vincent <97131062+vincbeck@users.noreply.github.com>

* fix static checks

* Update airflow/providers/amazon/aws/operators/neptune.py

Co-authored-by: D. Ferruzzi <ferruzzi@amazon.com>

* Update airflow/providers/amazon/aws/operators/neptune.py

Co-authored-by: D. Ferruzzi <ferruzzi@amazon.com>

* minor PR changes

---------

Co-authored-by: Niko Oliveira <onikolas@amazon.com>
Co-authored-by: Vincent <97131062+vincbeck@users.noreply.github.com>
Co-authored-by: Elad Kalif <45845474+eladkal@users.noreply.github.com>
Co-authored-by: D. Ferruzzi <ferruzzi@amazon.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:providers provider:amazon AWS/Amazon - related issues

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Amazon NeptuneStopDbClusterOperator bug

7 participants