Skip to content

Latest commit

 

History

History
1278 lines (703 loc) · 46.7 KB

File metadata and controls

1278 lines (703 loc) · 46.7 KB

Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

Breaking changes

Bugfixes

  • Sort packages by name instead of title for a more stable and deterministic sort order. #1689

Added

Deprecated

Known Issues

Breaking changes

  • Require proxy targets to be HTTPS by default. #1647
  • Require local indexers to include signatures for packages. #1646

Bugfixes

  • Update Go runtime to 1.26.2 #1675

Added

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Update Go runtime to 1.25.8 1613

Added

  • Add requires field to package index and search responses so clients can inspect package dependencies (input and content) before downloading. #1612
  • Support for referencing inputs and streams by package: type (for inputs) and input (for streams) are no longer required when package is set (format_version 3.6.0+, aligns with package-spec and composable packages). #1605
  • Sort packages by semver when searching, after existing title sorting. #1585

Deprecated

Known Issues

Breaking changes

Bugfixes

Added

  • Add deprecated field support. #1516
  • Return tech preview package without prerelease flag. #1538

Deprecated

Known Issues

Breaking changes

  • Package registry container image runs by default as a non-root user (UID 1000). #1503

Bugfixes

Added

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Add missing mapping for azure/metrics input. #1474
  • Update Go runtime to 1.25.5. #1496

Added

  • Optimize package loading by reading package ZIP archives and package folders concurrently. #1489
  • Allow empty package paths on startup. #1482

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Update Go runtime to 1.25.3. #1468
  • Fix performance issues when parsing some invalid certificates. #1468

Added

  • Add new agent.version condition to search and categories endpoints. #1460
  • Avoid parsing JSON columns in queries performed to artifacts related endpoints (SQL storage indexer). #1386
  • Include SQL functions to improve filtering (SQL storage indexer). #1442
  • Return just latest packages based on semantic versioning if all=false (SQL storage indexer). #1445
  • Apply a capabilities filter at database level if capabilities query parameter is set (SQL storage indexer). #1448
  • Apply the discovery filter at database level if discovery query parameter is set (SQL storage indexer). #1454

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Include ingestion method also for input packages. #1431

Added

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Update Go runtime to 1.25.1. #1426
  • Fix context propagation in APM instrumentation in proxy mode. #1424

Added

  • Added "ingestion_method" mapping to data_streams to provide a high-level understanding of data collection in order to support downstream documentation. #1402
  • Add data_streams to search policy_templates. #1408
  • Added Security Subcategory "misconfiguration_workflow" and "vulnerability_workflow" #1414
  • Add "opentelemetry" category for packages related to OpenTelemetry. #1415
  • Added APM information (trace.id, transaction.id, service.name, service.version, service.environment) to the logs in order to correlate signals in Kibana. #1413

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Fix filtering by category in search endpoint (SQL Storage Indexer). #1394
  • Update -allow-unknown-query-parameters flag to allow unknown query parameters by default. #1395
  • Narrow the scope of the endpoints that validate the unknown parameters to just /search and /categories. #1395
  • Fix filtering by capabilities in search and categories endpoint (SQL Storage Indexer). #1396

Added

Deprecated

Known Issues

Breaking changes

  • Fail requests with 400 error code if there are unknown query parameters. This can be disabled via flag (-allow-unknown-query-parameters). #1382

Bugfixes

  • Update Go runtime to 1.24.6. #1388

Added

  • New Security subcategory "asset_inventory" #1357
  • Update default value for the batch size used in SQL storage indexer. #1372
  • Skip adding to cache requests containing package query parameter. #1378
  • Added cache for categories endpoint (SQL storage indexer). #1379
  • Update default values for cache search and TTL settings search (SQL storage indexer). #1379
  • Storage indexer based on Google Cloud Storage is now GA. #1374

Deprecated

Known Issues

  • This release includes a breaking change introduced in #1382. Requests with unknown query parameters fail with a 400 error code. This behaviour changes in the next release: Elastic Package Registry will accept any unknown query parameters by default. If you choose to enable query parameter validation, it will only affect the search and categories endpoints.#1395

Breaking changes

Bugfixes

  • Reorder fields in primary key to keep same ordering as before (technical preview). #1348

Added

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Fix spans used in SQL storage indexer (technical preview). #1334
  • Update Go runtime to 1.24.5. #1346

Added

  • Add new method MustParsePackage to create new packages, running more validations. #1333
  • Allow to customize settings related to SQL storage indexer (technical preview). #1334 #1337
  • Cleanup SQL storage indexer backup database only when a new index version is downloaded (technical preview). #1334
  • Add support to discover content packages based on the datasets defined in the discovery parameter. #1338
  • Include deployment modes in responses when they are defined at inputs of the policy templates. #1345

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Update Go runtime to 1.24.4. #1324
  • Ignore unknown categories instead of producing fatal errors. #1297
  • Fix usages of time.Since in defer statements used to obtain duration Prometheus metrics in the indexer. #1304
  • Rename some spans to avoid conflicts. #1306

Added

  • Change license from Elastic License to Elastic License 2.0. #1298
  • Add APM spans for proxy requests and storage indexer Get calls. #1306
  • Add SQL storage indexer in technical preview. #1313 #1326

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Update Go runtime to 1.24.1. #1286

Added

  • Added new security subcategory siem. #1284

Deprecated

Known Issues

Breaking changes

  • Remove support for TLS1.0. #1259

Bugfixes

  • Update Go Runtime to 1.23.4. #1261

Added

  • Include summary of data streams in search responses. #1264
  • Add Access-Control-Allow-Origin header for all origins. #1266
  • Expose is_default flag in agentless deployment modes. #1269

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Update Go Runtime to 1.23.2. #1242

Added

  • Add new discovery parameter to search and category endpoints. #1235
  • Expose policy_templates.*.deployment_modes field in both search and package endpoints. #1244
  • Expose policy_templates_behavior field in both search and package endpoints. #1244

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Update Go Runtime to 1.23.1. #1222

Added

  • Added support for content packages and its discovery fields. #1220

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Update Go Runtime to 1.22.6. #1215

Added

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Fix context propagation in APM transaction for watcher backend process. #1150 #1152
  • Update Go Runtime to 1.22.2. #1170

Added

  • Add support for multi-platform container images. #1162
  • Use Wolfi as base for container images. #1169
  • Reuse HTTP client when proxifying resolver requests. #1147

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Update Go Runtime to 1.21.7. #1144

Added

  • New Security subcategory "cloudsecurity_cdr" #1142

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Update Go Runtime to 1.21.4. #1124

Added

  • Add package and datastream agent privileges in the package endpoint #1109
  • Add owner.type to the package endpoint #1109

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Update Go runtime to 1.21.3. #1102
  • Raise an error if the value of environment variables used to set parameters are not valid #1103

Added

  • Add new parameter to specify minimum TLS version #1103

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Update Go runtime to 1.20.7. #1075
  • Return all packages when using proxy mode and "all" query parameter is not set #1055

Added

  • Add new query parameter "capabilities" in search endpoint #1054
  • Add new query parameter "capabilities" in categories endpoint #1061)
  • Add new query parameters "spec.min" and "spec.max" in search endpoint #1058
  • Add new query parameters "spec.min" and "spec.max" in categories endpoint #1059

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Update Go runtime to 1.20.4. #987 #1002
  • Add fields related to subcategories into categories entrypoint with proxy mode #1004

Added

  • New Security subcategory "Advanced Analytics (UEBA)" #997

Deprecated

Known Issues

Breaking changes

Bugfixes

Added

  • Update Go runtime to 1.20.2. #957

Deprecated

  • Deprecate Infrastructure category. #970

Known Issues

Breaking changes

Bugfixes

  • Fix typo in "enterprise_search" category. #952
  • Update Go runtime to 1.19.6. #959

Added

  • Capitalize "Email" category title. #952
  • New Security subcategory "Vulnerability Management". #953
  • Add support for Windows. #956

Deprecated

Known Issues

Breaking changes

Bugfixes

Added

  • Add some APM instrumentation to storage indexer. #939
  • Errors are logged through APM. #941 #942

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Fix internal server error when proxy mode is used and a package that doesn't exist is requested. #925
  • Don't forward headers when requesting files from the package storage, just download them. #935

Added

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Remove range headers when forwarding requests to package storage. #932

Added

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Update Go runtime to 1.19.4. #924
  • Fix headers forwarding when forwarding artifacts requests to the package storage. #928

Added

Deprecated

Known Issues

Breaking changes

  • Updated titles of some categories. #914

Bugfixes

Added

  • Forward requests from package-storage instead of doing http redirects. #915
  • Update default value for proxy-url parameter to be Elastic Package Registry production. #899
  • Add additional categories and subcategories. #914
  • Support subcategories. Include parent category in categories API. #914
  • Update Go runtime to 1.19.3. #919

Deprecated

Known Issues

Breaking changes

  • Search results for requests including experimental=true don't return prerelease versions of packages that have been released at least once as GA. #893

Bugfixes

  • Return experimental packages on searches with prerelease=true and without experimental=true. #894

Added

Deprecated

Known Issues

Breaking changes

Bugfixes

Added

  • Add support for "Infrastructure" category. #888

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Reduce peak memory footprint of recycling indices from storage. #881

Added

  • Use retriable HTTP client in proxy mode. #883

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Don't use io.ReadAll while recycling indices. #878

Added

Deprecated

Known Issues

Breaking changes

Bugfixes

Added

  • Update favicon to be the Elastic Package Registry logo. #858
  • Implement proxy mode. #860 #871 #873
  • Update Go runtime to 1.19.1. #872

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Return only the latest version of each package when a combined index is used. #849
  • Return only first appearance of the same version of a package when it is available in multiple indexes. #849
  • Rename indexer metrics related to get operations and add the indexer name label to it. #853

Added

  • Add elastic.subscription condition to package index metadata, use this value for backwards compatibility with previous license field. #826
  • Add source.license to relevant API responses when available. #854

Deprecated

Known Issues

Breaking changes

Bugfixes

Added

  • Update Go version and base Ubuntu image. #821
  • Add support for "threat_intel" category. #841
  • Instrument package registry with Prometheus metrics. #827

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Data streams are properly read from Zip packages without entries for directories. #817

Added

  • Prepare stub for Storage Indexer. Disable fetching packages from Package Storage v1. #811
  • Support input packages. #809
  • Implement storage indexer. #814
  • Implement remote resolver for storage indexer. #823

Deprecated

Known Issues

Breaking changes

  • Structured logging following JSON ECS format. #796.

Bugfixes

  • Apply release fallback to datastreams validation. #804.

Added

  • Add -log-level and -log-type flags to configure logging. #796.
  • Update Go runtime to 1.18.0. #805

Deprecated

Known Issues

Breaking changes

  • Packages with major version 0 or with prerelease labels are only returned by search requests when they include prerelease=true or experimental=true. #785
  • Release level of a package without release tag is based on its semantic versioning now, previously it was experimental. #785
  • Release level of a data stream without release tag is the same as the package that contains it, previously it was experimental. #785

Bugfixes

Added

  • Add the prerelease parameter in search requests to include in-development versions of packages. #785

Deprecated

  • experimental parameter in search requests is deprecated. #785

Known Issues

Breaking changes

  • Ignore the internal parameter in packages and /search requests. #765

Bugfixes

  • Fix panic when opening specially crafted Zip file. #764
  • Fix unbounded memory issue when handling HTTP/2 requests. #788

Added

  • Update APM Go Agent to 1.14.0. #759
  • Update Gorilla to 1.8.0. #759
  • Support package signatures. #760
  • Update Go runtime to 1.17.6. #788
  • Use Ubuntu LTS as base image instead of CentOS #787

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Properly handle modification headers (If-Modified-Since, Last-Modified) for static resources. #756

Added

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Fix: remove duplicated Categories property. #748

Added

  • Configuration file path can be selected with the -config flag. #745
  • Configuration flags can be provided using environment variables. #745
  • Add -tls-cert and -tls-key flags to configure HTTPS. #711 #746
  • Support for elasticsearch.privileges.cluster in package manifest. #750
  • Update Go runtime to 1.17.1. #753

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Fix issue with relative paths when loading data streams. #742

Added

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Search API: sort packages by title. #647 #739

Added

  • Decouple API from backend "indexers". #703
  • Add support to serve packages stored as zip archives. #703

Deprecated

Known Issues

  • Individual packages cannot be load if their path is specified with a trailing slash. #742

Breaking changes

  • Change format of responses to /package to make {"constraint": {"kibana.version": "7.16.0"}} be {"constraint": {"kibana": {"version": "7.16.0"}}}. #733

Bugfixes

Added

  • Added constraints and owner fields to /search responses. #731 #734
  • Add categories to /search output. Categories are added to the package and policy-templates. #735

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Fix: don't list old packages with categories incompatible with latest revisions. #719

Added

  • Support elasticsearch.privileges.indices in data stream manifests. #713

Deprecated

Known Issues

Breaking changes

Bugfixes

Added

  • Add -httpprof flag to enable HTTP profiling with pprof. #709
  • Adjust counting logic for categories/policy templates. #716

Deprecated

Known Issues

Breaking changes

Bugfixes

Added

  • Update Go to 1.16.7 #706.

Deprecated

Known Issues

Breaking changes

Bugfixes

Added

  • Add instrumentation with the APM Go Agent #702.

Deprecated

Known Issues

Breaking changes

Bugfixes

Added

  • Support filtering /categories using kibana.version query param #695

Deprecated

Known Issues

Breaking changes

Bugfixes

  • Disable Handlebars parsing. [#692] (#692)

Added

  • Add input groups support. [#685] (#685)

Deprecated

Known Issues

Breaking changes

Bugfixes

Added

  • Support "synthetics" type. [#688] (#688)

Deprecated

Known Issues

Bugfixes

  • Fix the package not loading if it has an accidental file left in the package root directory. Add semver validation of the version directory. [#673] (#673)

Added

  • Add "dataset_is_prefix" field to data stream. [#674] (#674)

Breaking changes

Bugfixes

Added

  • Package validation can be disabled via command line option. [#667] (#667)

Deprecated

Known Issues

Breaking changes

Bugfixes

Added

  • Add "hidden" field to data stream. [#660] (#660)
  • Add "ilm_policy" field to data stream. [#657] (#657)

Deprecated

Known Issue

Breaking changes

Bugfixes

  • Set cache headers for 404 for all API endpoints to private, no-store.#652

Added

  • Add "traces" as legal event type. #656
  • Add input-level template_path field. #655

Deprecated

Known Issue

Breaking changes

Bugfixes

  • Set cache headers for 404 and 400 to 0. #649

Added

Deprecated

Known Issue

Breaking changes

Bugfixes

  • Expose proper EPR version. #644

Added

Deprecated

Known Issue

Breaking changes

  • Rename config template to policy template and dataset to data stream. #641

Bugfixes

Added

  • Add validation for icons and screenshots. #537

Deprecated

Known Issue

Breaking changes

  • Rename version to service.version in index handler. #633
  • Remove config public_dir which is replaced by package_paths. #632
  • Ship packages as zip instead of tar.gz #628
  • Rename image src to path and have src as the original value from the manifest. #629

Added

  • Add cache_time.index as config option. #631

Breaking changes

  • Change dataset.* fields to data_stream.* fields. #622

Breaking changes

  • Change dataset.* fields to datastream.* fields. #618

Breaking changes

Bugfixes

Added

  • Allow numbers in package names. #614

Deprecated

Known Issue

Bugfixes

  • Always populate template_path. #600

Bugfixes

  • Fix Gogle Cloud tag typo. #592

Added

  • Add missing MIME types. #599
  • Make release field available as part of /search endpoint. #591

Deprecated

  • Remove development mode. #597

Breaking changes

  • Change stream.* fields to dataset.* fields. #492
  • Remove solution entry support in package manfiest. #504
  • Remove support for Elasticsearch requirements #516
  • Rename kibana query param to kibana.version. #518
  • Remove removable flag from package manifest. #532
  • Rename datasources to config_templates in dataset manifest. #570
  • Remove support for logs and metrics category. #571
  • Remove dataset.type: event as suported type. #567
  • Remove support for requirements. Use conditions instead. #574

Added

  • Use filepath.Walk to find valid package content data. #438
  • Validate handlebarsjs stream configuration templates. #445
  • Serve favicon as embedded resource. #468
  • Generate index.json file. #470
  • Stream archived package content. #472
  • Generate package index.json files. #479
  • Add validation for dataset type. #501
  • Add -dry-run flag. #503
  • Encode fields in Kibana objects if not encoded. #506
  • Validate required fields in datasets. #507
  • Do not require "config.yml". #508
  • Validate version consistency. #510
  • Remove package code generator. #513
  • Support multiple packages paths. #525
  • Added support for ecs style validation for dataset fields. #520
  • Use BasePackage for search output data. #529
  • Add support for owner field in package manifest. #536
  • Introduce development mode. #543
  • Add additional supported categories to package. #533
  • Apply rule: first package found served. #546
  • Implement package watcher. #553
  • Add conditions as future replacement of requirements. #519
  • Introduce elasticsearch.ingest_pipeline.name as config option. #

Deprecated

  • Delete package index.json from archives. Don't serve index.json as resource. #488

Breaking changes

  • Change package path from /package/{packagename}-{version} to /package/{packagename}/{version} #300
  • By default /search?package= now only returns the most recent package. #301
  • Stream configuration filenames have .hbs suffix appended #308
  • Align package storage directories with public dir structure #376
  • Use index template v2 format for pre-built and generated index templates. #392

Bugfixes

  • Remove caching headers in case of errors. #275

Added

  • Allow to set cache times through config. #271
  • Make README.md file a required file for a package. #287
  • Add stream fields to each dataset #296
  • Add all query param to return all packages. By default is set false. #301
  • Add multiple config for datasource. By default true. #361
  • Add removable flag to package manifest. Default is true. #359
  • Add stream template to package json. #335
  • Add support for multiple inputs per dataset. #346
  • Add experimental releases for packages and datasets. #382
  • Handle invalid query params and return error. #382
  • Add basic access logs. #400
  • Validate ingest pipeline during packaging phrase. #426
  • Use http.FileServer to serve package content and define HTTP headers #425
  • Remove requirement for streams definition in dataset manifest. #483

Breaking changes

  • Change requirements.kibana.version.min/max to requirements.kibana.versions: {semver-range}
  • Encode Kibana objects during packaging. #157
  • Prefix package download url with /epr/{package-name}.
  • Remove dataset.name but introduce dataset.id and dataset.path. #176

Bugfixes

  • Fix header for tar.gz files from application/json to application/gzip. #154

Added

  • Add /health and /health?ready=1 endpoint for healthcheck. #151
  • Add default config to dataset manifest. #148
  • Update Golang version to 1.13.4. #159
  • Add missing assets from datasets. #146
  • Add format_version to define the package format.
  • Add dataset array to package info endpoint. #162
  • Add path field to search and package info endpoint. #174
  • Add download field to package info endpoint. #174
  • Add package field to dataset. #189
  • Add support for datasources. #216 #212

Breaking changes

  • Package Kibana compatiblity version is changed to "kibana": { "max": "1.2.3"} #134
  • Rename integrations-registry to package-registry. #138
  • Remove packages.path config and replace it with public_dir config. #118

Bugfixes

  • Change empty /search API output from null to []. #111

Added

  • Add validation check that Kibana min/max are valid semver versions. #99
  • Adding Cache-Control max-age headers to all http responses set to 1h. #101
  • Validate packages to guarantee only predefined categories can be used. #100
  • Cache all manifest on service startup for resource optimisation. #103
  • Fix Docker image to specific Golang version. #107
  • Add .dockerignore file for slimmer image. #104
  • Move package generation to its own package. #112
  • Remove not needed files in Docker image. #106
  • Add healthcheck to docker file. #115
  • Make caching headers configurable per endpoint. #116
  • Add readme entry to package endpoint. #128

[0.1.0]

First tagged release. No changelog existed so far.