Releases: raystack/meteor
v0.7.4
Highlights
Adds GCS sink, BigQuery clustering/partition fields, and Kafka TLS auth support.
New Features
- GCS sink — New sink for Google Cloud Storage.
- Kafka TLS auth — Support TLS authentication in Kafka extractor plugin.
Improvements
- BigQuery — Add clustering fields and extra fields for partition information.
Full Changelog: v0.7.3...v0.7.4
v0.7.2
Highlights
Enhances HTTP extractor scripting and updates Optimus dependency.
Improvements
- HTTP extractor — Enhanced script options for the HTTP extractor.
- Optimus — Updated Optimus dependency version.
- Extractors — Updated extractor descriptions.
Full Changelog: v0.7.1...v0.7.2
v0.7.3
v0.7.1
Highlights
Patch fix for the recipe generator.
Bug Fixes
- Fixed IO writer extraction in recipe generator.
Full Changelog: v0.7.0...v0.7.1
v0.7.0
Highlights
Major release with extended HTTP extractor, Merlin extractor, BigQuery improvements, and numerous stability fixes.
New Features
- HTTP extractor — Add new HTTP extractor with extended scripting capabilities.
- Merlin extractor — New extractor for Merlin ML platform.
- Application YAML extractor — New extractor for application YAML files.
- BigQuery policy tags — Save policy tags in column attributes.
- BigQuery exclusion filters — Add exclusion filters for datasets and tables.
- BigQuery credentials — Support service_account_base64 for passing credentials.
Improvements
- Caramlstore — Populate new Entity fields in caramlstore extractor.
- BigQuery — Set max page size for iterators.
Breaking Changes
- Extended HTTP extractor with new configuration format.
Bug Fixes
- Fixed loading env vars with $ in value.
- Fixed sinks not being closed after records are written.
- Fixed race conditions from concurrent data modification.
- Fixed processors not carrying forward changes to the next processor.
- Fixed recipe scope validation being applied when unneeded.
Full Changelog: v0.6.0...v0.7.0
v0.6.0
Highlights
Adds Tengo script processor, Shield sink, Google Workspace and Caramlstore extractors, plus several important fixes.
New Features
- Script processor — Add script processor using Tengo scripting language.
- Shield sink — New sink for Shield service.
- Caramlstore extractor — New extractor for CaraML feature store.
- Google Workspace extractor — New extractor for Google Workspace.
Improvements
- Recipe generation — Accept and use scope for generating recipes; format sample configs.
- Compass sink — Send asset metadata create_time and update_time to Compass.
Breaking Changes
- Dropped ml prefix from types for feature/model entities.
Bug Fixes
- Fixed BigQuery panic due to invalid type for structpb.
- Fixed lint format error message with appropriate line breaks.
- Fixed context cancellation not being respected for sink retries.
Full Changelog: v0.5.2...v0.6.0
v0.5.2
Highlights
Introduces new v1beta2 asset models and adds sink retry controls.
New Features
- Disable sink retries — Allow disabling sink retries via configuration.
Improvements
- Sink logging — Improved log statement for retry sink.
Breaking Changes
- New v1beta2 asset models introduced.
Bug Fixes
- Fixed config load being required for commands that don't need it.
Full Changelog: v0.5.1...v0.5.2
v0.5.1
Highlights
Fixes a critical bug in the enrich processor.
Breaking Changes
- Enrich processor configuration has changed as part of the fix.
Bug Fixes
- Fixed enrich processor not working.
Full Changelog: v0.5.0...v0.5.1
v0.5.0
Highlights
Standardizes URN format to follow the ODPF standard and adds HTTP sink.
New Features
- HTTP sink — New sink for sending records over HTTP.
Breaking Changes
- Modified URN format to follow ODPF standard. Existing URNs will change.
Full Changelog: v0.4.0...v0.5.0
v0.4.0
Highlights
Adds Stencil sink, Redash extractor, and file metadata sink.
New Features
- Stencil sink — New sink for Stencil schema registry.
- Redash extractor — New extractor for Redash dashboards.
- File metadata sink — Add metadata sink for file output.
- Tableau auth — Add auth_token in Tableau config.
Improvements
- Metrics — Add metric collection to catch sink errors.
Bug Fixes
- Fixed BigQuery unicode null sequence sanitization.
- Fixed file sink to flush all records after stream closes.
- Fixed failing Elasticsearch tests due to unsorted indexes.
Full Changelog: v0.3.3...v0.4.0