Repository navigation
Status of testing Providers that were prepared on July 02, 2024 #40555
Description
I have a kind request for all the contributors to the latest provider packages release.
Could you please help us to test the RC versions of the providers?
The guidelines on how to test providers can be found in
Verify providers by contributors
Let us know in the comment, whether the issue is addressed.
Those are providers that require testing as there were some substantial changes introduced:
Provider openlineage: 1.9.0rc2
- local task job: add overtime mechanism, to not kill task prematurely when auxiliary processes are running (#39890): @mobuchowski
- openlineage: add some debug logging around sql parser call sites (#40200): @mobuchowski
- openlineage: Add task SLA and queued datetime to AirflowRunFacet (#40091): @kacpermuda
- [openlineage] Add error stacktrace to task fail event (#39813): @kacpermuda
Linked issues: - [OPENLINEAGE] Introduce AirflowJobFacet and AirflowStateRunFacet (#39520): @kacpermuda
Linked issues: - Use UUIDv7 for OpenLineage runIds (#39889): @dolfinus
- openlineage: isolate metadata extraction by executing OL methods in separate, forked process (#40078): @mobuchowski
- openlineage: readd few removed Task properties in AirflowRunFacet (#40371): @mobuchowski
- openlineage, redshift: do not call DB for schemas below Airflow 2.10 (#40197): @mobuchowski
- openlineage: fix scheduler crashing on airflow standalone (#40459): @kacpermuda
Linked issues: - openlineage: nit: fix logging level (#40461): @kacpermuda
Linked issues: - openlineage: provide stack trace under proper key in error facet (#40372): @kacpermuda
Linked issues: - fix: sqa deprecations for airflow providers (#39293): @dondaum
Linked issues: - Enable enforcing pydocstyle rule D213 in ruff. (#40448): @ferruzzi
All users involved in the PRs:
@dondaum @dolfinus @kacpermuda @mobuchowski @ferruzzi
Activity
kacpermuda commentedon Jul 2, 2024
Thanks for the rc2, I'll look into it tomorrow and confirm all the PR's included.
Updating setup.cfg with RC provider packages on apache/airflow#40555
kacpermuda commentedon Jul 3, 2024
I've run a couple of different DAGs on different environments (standalone, breeze, Astro) and it looks like all the changes work as expected.
dondaum commentedon Jul 3, 2024
#39293 is good.
kacpermuda commentedon Jul 5, 2024
OpenLineage provider 1.9.0 has been released 🎉
potiuk commentedon Jul 5, 2024
Indeed!
Thank you everyone. Providers are released.
I invite everyone to help improve providers for the next release, a list of open issues can be found here.