Releases: k0rdent/kof
v1.9.0
❗ Upgrade Instructions ❗
KOF v1.9.0 introduces the Gateway API support
and migrates from Ingress Nginx to Envoy Gateway by default.
Please apply the Upgrade to v1.9.0 guide.
🚀 New Features 🚀
- f6626ef: feat: migrate to Envoy Gateway from Nginx ingress (#798) by @gmlexx
- 778bfa2: feat(ui): add dark theme (#843) by @AndrejsPon00
- dfc2f55: feat(ui): add istio connectivity monitoring (#851) by @AndrejsPon00
- 0dd4821: feat: make gateway api the default (#873) by @gmlexx
- 650c0e7: feat: add agent troubleshooting skill (#917) by @gmlexx
- 1f062b8: feat: add stacklight ceph alert rules and dashboard (#879) by @gmlexx
- 0491045: feat: simplify KCM Region and cross-namespace resource propagation (#926) by @AndrejsPon00
- 64e0004: feat: add external-dns and envoy-gateway to mothership helm chart (#958) by @gmlexx
🐛 Notable Fixes 🐛
- 9bb035b: fix: change git branch for ci tests (#849) by @Alex-Vovchuk
- 332cdc2: fix: .Cluster.metadata.annotations: map has no entry for key "annotations" (#855) by @denis-ryzhkov
- 6acfec3: fix: set persistent storage class name for victoria traces from global (#859) by @gmlexx
- 7724b8e: fix: Customizable
HelmRepository.specin umbrellakofchart (#860) by @denis-ryzhkov - e9d9ad5: fix: change collectors tolerations (#866) by @Alex-Vovchuk
- 31094d6: fix: Double custom registry in pod image (#870) by @denis-ryzhkov
- b3c1b97: fix: change logic to a collector waiter (#805) by @Alex-Vovchuk
- e71370a: fix: Instrumentation sidecar on worker node failed on traces export to daemon collector on cp node (#883) by @denis-ryzhkov
- e2a517d: fix: pass daemon collector image tag from chart version (#888) by @gmlexx
- abf295d: fix: gateway deployment on clouds (#891) by @gmlexx
- 9a33f6d: fix: Release flow without cherry-picks and
mainupdates. Added latest version for cloud clusters (#892) by @denis-ryzhkov - 86858d5: fix: solvers values chart (#896) by @gmlexx
- 1d51422: fix: Fix NVLink panel (#913) by @MirgDenis
- f0f45d2: fix: split kof-storage and victoria-metrics-operator installation (#920) by @gmlexx
- 1ccd95a: fix: add CLUSTER_NAME to opencost extraEnv list (#935) by @gmlexx
- e2b7aff: fix: Merge of envoy-gateway related fixes from release/v1.8.1 (#947) by @denis-ryzhkov
- 6744099: fix: update vmuser MCS propagation when spec changes (#963) by @AndrejsPon00
- c70a9ba: fix: add
take-ownershipto Helm install/upgrade options for vmuser MCS (#970) by @AndrejsPon00 - c663f29: fix: Conditional
VM_GATEWAY_API_ENABLEDto avoidno matches for kind "HTTPRoute"in Istio or Nginx cases (#972) by @denis-ryzhkov - 56c30fa: fix: add dependsOn to VMUser MCS to wait for VM CRDs (#971) by @AndrejsPon00
✨ More Improvements ✨
- 8333e04: Update upgrade workflows from release 1.8.0 by @gmlexx
- 993cda7: chore(deps-dev): bump @types/node by @dependabot[bot]
- 3cc8355: chore(deps): bump go.opentelemetry.io/otel/sdk in /kof-operator by @dependabot[bot]
- d5b6e50: revert: add automatic traces datasource generation for regional clusters (#837) by @AndrejsPon00
- 903ba2a: chore: npm audit fixes by @gmlexx
- 0ed8791: chore: add dependabot auto-updates for kof-operator gomod by @gmlexx
- d3e1dc9: chore(deps-dev): bump the all group (#845) by @dependabot[bot]
- 2f70270: chore: vendor opentelemetry types and events recordign to bump kcm to 1.8.0 (#846) by @gmlexx
- 8e1ce6d: chore(deps-dev): bump hono in /kof-operator/webapp/collector (#850) by @dependabot[bot]
- 87bdfbf: ci: add main branch integration tests (#852) by @gmlexx
- 49082f5: ci: fix test main integration (#854) by @gmlexx
- 13696b8: chore(deps-dev): bump the all group across 1 directory with 3 updates (#857) by @dependabot[bot]
- c8c4262: chore(deps): bump google.golang.org/grpc in /kof-operator (#871) by @dependabot[bot]
- b1450a3: chore(deps): bump the all group across 1 directory with 4 updates (#872) by @dependabot[bot]
- 6ab84d0: chore: ignore prometheus package update (#874) by @gmlexx
- 22b3e46: chore(deps): bump the all group across 1 directory with 14 updates (#875) by @dependabot[bot]
- 9ae4b46: chore(deps): bump k8s.io/apiextensions-apiserver (#876) by @dependabot[bot]
- 8fe8e17: chore(deps-dev): bump the all group (#878) by @dependabot[bot]
- 5d80ada: chore(deps-dev): bump picomatch in /kof-operator/webapp/collector (#886) by @dependabot[bot]
- 54455db: chore(deps): bump github.com/prometheus-operator/prometheus-operator/pkg/apis/monitoring (#887) by @dependabot[bot]
- 08809cb: chore(deps): bump the all group in /kof-operator with 3 updates (#893) by @dependabot[bot]
- 7ca4ee4: chore(deps): bump the all group across 1 directory with 4 updates (#894) by @dependabot[bot]
- 7b91329: chore(deps): bump github.com/go-jose/go-jose/v4 (#898) by @dependabot[bot]
- d2f5319: chore(deps): bump dexie (#897) by @dependabot[bot]
- 940d079: chore(deps): bump lodash-es in /kof-operator/webapp/collector (#900) by @dependabot[bot]
- e2ee6f9: chore(deps-dev): bump vite in /kof-operator/webapp/collector (#902) by @dependabot[bot]
- bb01d72: ci: switch KCM to main branch (#909) by @gmlexx
- 0167bff: chore: update copilot instructions (#903) by @gmlexx
- dba2179: chore(dev): add opencode skill for local kof deployment (#904) by @gmlexx
- 92b9574: chore(deps): bump lodash in /kof-operator/webapp/collector (#905) by @dependabot[bot]
- e685365: chore: merge 1.8.1 fixes to main (#911) by @gmlexx
- 2c1d5bf: chore: add istio to kind-deploy skill (#919) by @gmlexx
- 207bc28: chore(deps-dev): bump hono in /kof-operator/webapp/collector (#927) by @dependabot[bot]
- 066c6ec: chore(deps): bump the all group (#924) by @dependabot[bot]
- 958f55c: chore: run adopted clusters workflows on kof-operator changes (#929) by @gmlexx
- dd0f543: chore: dependabot updates (#930) by @gmlexx
- 424fbb1: chore(deps): bump actions/setup-go from 5 to 6 (#932) by @dependabot[bot]
- 91fc509: chore(deps): bump the all group across 1 directory with 10 updates (#928) by @dependabot[bot]
- e6b1c7c: chore(deps): bump actions/setup-python from 5 to 6 (#933) by @dependabot[bot]
- 7633f7b: chore(deps): bump opencost in /charts/kof-collectors (#931) by @dependabot[bot]
- 345c723: chore(deps): bump arnested/go-version-action from 1 to 2 (#938) by @dependabot[bot]
- c3db337: chore(deps): bump @uiw/react-json-view (#937) by @dependabot[bot]
- 6a4ab91: chore: scripts/create-support-bundle.sh with dynamic list of namespaces and hints (#936) by @denis-ryzhkov
- a19a97e: chore(deps): bump docker/setup-buildx-action from 3 to 4 (#944) by @dependabot[bot]
- 93ac265: ci: add cross-namespace installation test (#939) by @AndrejsPon00
- b5f5037: chore(deps): bump ytanikin/pr-conventional-commits from 1.4.1 to 1.5.2 (#949) by @dependabot[bot]
- 33770c5: refactor: split utils into crypto, logging, env packages (#945) by @AndrejsPon00
- 1822adc: chore(deps): bump metrics-server from 3.12.1 to 3.13.0 in charts (#946) by @gmlexx
- 28965ba: chore(deps): bump goreleaser/goreleaser-action from 6 to 7 (#952) by @dependabot[bot]
- 155dd94: chore(deps): bump the all group across 1 directory with 6 updates (#948) by @dependabot[bot]
- 974a943: chore(deps): ignore k8s autoupdates (#955) by @gmlexx
- 2eb2cbe: chore(deps): bump actions/stale from 9 to...
v1.8.0
❗ Upgrade Instructions ❗
KOF v1.8.0 introduces a new umbrella chart that consolidates the installation of all KOF components using FluxCD for orchestration. This represents a significant structural change in how KOF is deployed.
Please apply the Upgrade to v1.8.0 docs.
NOTE: the tenantId label in metrics was replaced with tenant label for consistency with cluster, namespace, and others.
📚 New Docs 📚
- Installing KOF and Storing KOF data -
kofumbrella chart, expandable examples for readability, OpenStackClusterDeployments, fixes. - Upgrade to v1.8.0 -
kofumbrella chart, Istio upgrade. - Multi-tenancy in KOF: Usage Examples, Single Sign-On, Access Control, Sign In Options.
- Maintaining KOF: new Uninstallation steps.
- Architecture: Full-Stack Observability, Autoconfig.
🚀 New Features 🚀
- 776b6d7: feat: kof helm chart for simplified deployment (#725) by @gmlexx
- 411f890: feat: implement multi-tenancy access control layer for data querying (#736) by @AndrejsPon00
- 5f11fdf: feat: add script file for waiting opentelemetry collectors (#795) by @Alex-Vovchuk
- 371b346: feat: support bundle analyzer for ci and simplified failures analysis (#763) by @Alex-Vovchuk
- e504f30: feat: auto check values consistency (#769) by @Alex-Vovchuk
- c4ca1f8: feat: integrate vlogxy for cross-cluster log aggregation (#810) by @AndrejsPon00
- eba9821: feat: add multi-tenancy support for alert rules (#814) by @AndrejsPon00
- f24023e: feat(acl): support tenant validation via
tenantclaim (#822) by @AndrejsPon00 - ebb08c2: feat(acl): support POST for large queries (#826) by @AndrejsPon00
🐛 Notable Fixes 🐛
- ff7a8b3: fix: determine adopted cluster secret name without suffix parsing (#714) by @AndrejsPon00
- 5e501bf: fix: disable VMAuth ingress on Istio clusters (#727) by @AndrejsPon00
- 0876216: fix: duplication in kubelet metric led to wrong ContainerHightMemoryUsage calculation (#735) by @gmlexx
- b95dc7d: fix: trim duplicated v prefix for operator version (#762) by @gmlexx
- 8ba810c: fix: force KOF components upgrade after
make dev-deploy(#766) by @AndrejsPon00 - 2ac0a5e: fix: merge values properly for kof-collectors (#767) by @gmlexx
- a1d4866: fix: block Istio traffic for all services except VMAuth (#771) by @AndrejsPon00
- ed81c98: fix: disable resource detection progapation (#777) by @gmlexx
- 446c8b2: fix: disable victoriametrics for kof-storage using kof chart (#793) by @gmlexx
- 9fbc8d1: fix: npm audit, skip dev deps (#802) by @gmlexx
- 8f597d7: fix: disable ACL by default to prevent errors when dex is not configured (#800) by @AndrejsPon00
- 61f8dfc: fix: duplicate MultiClusterService rendering when Istio is disabled (#804) by @mcd01
- 1522261: fix: add missed logic for custom resources in support bundle (#807) by @Alex-Vovchuk
- 39d2e2e: fix: Renamed
tenantIdlabel totenantand added it to aggregations in rules to allow filtering (#812) by @denis-ryzhkov - d0e9eb5: fix(acl): prevent error from duplicate header write (#818) by @AndrejsPon00
- 81fa4e3: fix: correct
kof.mcsposition in values-local.yaml (#817) by @AndrejsPon00 - 4ab2e81: fix(acl): correct tenant label in Vlogxy query injection (#823) by @AndrejsPon00
- 1f68bf0: fix(acl): support alerts endpoint and restrict status endpoints per tenant (#824) by @AndrejsPon00
- d99dcfe: fix: set kof-repo namespace to kcm-system due to servicetemplates by @gmlexx
- 5830f90: fix: use kcm-system namespace for fluxcd helm charts (#828) by @gmlexx
- 39262c0: fix: protect vmauth debug and metrics endpoints with basic auth (#829) by @AndrejsPon00
✨ More Improvements ✨
- 418624e: chore: installTemplates: true, KOF 1.8.0-rc0 (#726) by @denis-ryzhkov
- a36fc9a: chore: bump opentelemetry-collector helm chart to 0.104.0 (#728) by @AndrejsPon00
- 3275c4c: chore: remove kubeadm references from dashboard (#730) by @AndrejsPon00
- 1cc59ec: chore: npm audit fix (#740) by @gmlexx
- 9ebf8b7: chore: change dependabot versioning strategy to lockfile-only (#751) by @gmlexx
- 23833f0: chore(deps-dev): bump @vitest/ui in /kof-operator/webapp/collector (#749) by @dependabot[bot]
- 665cea3: chore(deps): bump @uiw/react-json-view in /kof-operator/webapp/collector (#747) by @dependabot[bot]
- f4b28d4: chore(deps-dev): bump @testing-library/jest-dom (#745) by @dependabot[bot]
- 5edb01b: chore(deps-dev): bump typescript-eslint (#744) by @dependabot[bot]
- f6b9c97: chore(deps): bump @radix-ui/react-popover (#742) by @dependabot[bot]
- ce194eb: ci: update Istio installation instructions (#768) by @AndrejsPon00
- 3766ac3: chore: pass helm chart name to dev-deploy make target (#772) by @gmlexx
- 40bdfa3: chore(deps-dev): bump @types/react-dom in /kof-operator/webapp/collector (#780) by @dependabot[bot]
- d4734f0: chore(deps): bump versions by dependabot (#778) by @gmlexx
- 4a5d28f: chore(deps-dev): bump typescript-eslint (#783) by @dependabot[bot]
- 5706057: chore(deps-dev): bump @vitejs/plugin-react (#785) by @dependabot[bot]
- 33e3328: chore(deps-dev): bump @testing-library/react (#786) by @dependabot[bot]
- db770d9: chore(deps): bump zustand in /kof-operator/webapp/collector (#787) by @dependabot[bot]
- 1f9c10a: chore(deps): bump @radix-ui/react-hover-card (#788) by @dependabot[bot]
- 96477bb: chore(deps): bump @radix-ui/react-dialog (#782) by @dependabot[bot]
- 326450d: chore(deps): group all dependabot updates (#790) by @gmlexx
- b513ad1: chore(deps): bump the all group (#791) by @dependabot[bot]
- 34f93fd: chore: upgrade victoria-metrics-operator chart to 0.58.1 (#779) by @gmlexx
- c373d2a: chore: update dev makefile and doc for operator image loading (#792) by @gmlexx
- 12d8f1d: chore(deps-dev): bump typescript-eslint (#794) by @dependabot[bot]
- bbc2ef6: chore: enable dex for local development (#799) by @AndrejsPon00
- da287f6: chore: bump VictoriaLogs to v1.33.0 (#806) by @AndrejsPon00
- 7b5c906: chore(deps): bump the all group across 1 directory with 5 updates (#808) by @dependabot[bot]
- b87fd6a: chore(deps): bump the all group (#809) by @dependabot[bot]
- a85bb4b: docs: dex-sso: How to enable multi-tenancy (#811) by @denis-ryzhkov
- d3b7897: ci: switch KCM release to v1.8.0 (#815) by @AndrejsPon00
- 65efd8b: chore(deps-dev): bump @types/node (#813) by @dependabot[bot]
- 8a1de74: chore: downgrade kind to v0.29.0 (#816) by @AndrejsPon00
- b5d28d6: chore: bump vlogxy to v0.1.0-rc3 (#819) by @AndrejsPon00
- ad18ca7: chore: KOF 1.8.0-rc1, Go 1.26 (#820) by @denis-ryzhkov
- d0187f0: chore(deps-dev): bump @types/node (#821) by @dependabot[bot]
- 57ff40d: chore: add Alex-Vovchuk to codeowners by @gmlexx
- 2dac5f3: chore: KOF 1.8.0-rc2 (#827) by @denis-ryzhkov
- 103792a: chore: bump vlogxy to 0.1.0-rc4 (#830) by @AndrejsPon00
- 5ca788e: chor...
v1.7.1
This patch-release fixes the partial data flow in the istio case.
Changelog
📚 Fixed Docs 📚
🐛 Notable Fixes 🐛
- 5e501bf: fix: disable VMAuth ingress on Istio clusters (#727) by @AndrejsPon00
- a36fc9a: fix: bump opentelemetry-collector helm chart to 0.104.0 (#728) by @AndrejsPon00
- ff7a8b3: fix: determine adopted cluster secret name without suffix parsing (#714) by @AndrejsPon00
✨ More Improvements ✨
- 418624e: chore: installTemplates: true, KOF 1.8.0-rc0 (#726) by @denis-ryzhkov
- 3275c4c: chore: remove kubeadm references from dashboard (#730) by @AndrejsPon00
- 45a3c9d: chore: KOF 1.7.1 patch-release by @denis-ryzhkov
Full Changelog: v1.7.0...v1.7.1
See also: KOF 1.7.0 release notes
v1.7.0
❗ Upgrade Instructions ❗
- Notice the big changes documented below.
📚 New Docs 📚
- Grafana in KOF is now disabled by default
- Using KOF without Grafana
- KOF Tracing with VictoriaTraces instead of Jaeger
- KOF Multi-tenancy and new
kof-tenant-idlabel - Deprecated
kof-storage-secretslabel
Changelog
🚀 New Features 🚀
- acac355: feat: Disable Grafana (#684) by @denis-ryzhkov
- 99b1a09: feat: replace Jaeger with VictoriaTraces (#679) by @AndrejsPon00
- 6c66bb3: feat: automate VMUser credential provisioning per cluster (#699) by @AndrejsPon00
- d568541: feat: add cluster name label automatically to
ClusterDeploymentresources (#703) by @AndrejsPon00
🐛 Notable Fixes 🐛
- a7bf460: fix: add metrics-server to resolve metric errors in KOF UI in local environment (#655) by @AndrejsPon00
- f0ce998: fix: update kind clusters creation with squid proxy (#694) by @gmlexx
- 7a1e64a: fix: prevent SANs checking error (#695) by @gmlexx
- 4cfc3a8: fix: npm security audit (#697) by @gmlexx
- ec8e70e: fix: update default storage values to align with the default retention (#696) by @gmlexx
- cc27d68: fix: upgrade opentelemetry operator and collector to 0.143.0 (#706) by @gmlexx
- 2e8e043: fix: increase default CPU limit for collectors, k0s collector affinity (#710) by @gmlexx
- ee267a6: fix: CPUThrottlingHigh and KubeletPodStartUpLatencyHigh rules expressions (#711) by @gmlexx
- d72c299: fix: move PKI_PATH to defaultCR env (#713) by @gmlexx
- 8d2cf38: fix: MCS valuesFrom has no namespace, helm v3 warns, helm v4 fails (#717) by @denis-ryzhkov
- 10c99da: fix: prevent
k0s-collectorcrashes caused by values merge issue (#719) by @AndrejsPon00 - 24dacc9: fix: Workaround for
kubeadm-config not found, KOF 1.7.0 (#723) by @denis-ryzhkov
✨ More Improvements ✨
- 7d90536: chore: use oci-registry instead of chart-museum (#671) by @gmlexx
- 18cb990: chore: Bump to upcoming 1.7.0-rc0 (#677) by @AndrejsPon00
- 8791bc1: chore: use mcs instead of sveltos clusterprofile for secrets propagation (#678) by @gmlexx
- 4909b4a: chore: Apache License by @denis-ryzhkov
- 8667e1e: chore: use Mirantis registry instead of Docker registry in CI workflows (#681) by @AndrejsPon00
- 3f2e8cd: chore: fix npm audit issue with qs package (#687) by @gmlexx
- 76cdd1a: chore: prevent kcm-controller OOM causing CI failure (#688) by @AndrejsPon00
- ea1f79b: chore: prevent kcm controller crashes after kcm update in CI (#693) by @AndrejsPon00
- 2819c64: ci: add CI test for new KCM region with KOF (#660) by @AndrejsPon00
- a5456bf: ci: test Istio upgrade (#680) by @gmlexx
- a3e9dc6: chore: add storage volumes sizes for demo clusters (#698) by @gmlexx
- 2747089: chore: Usage with and without Grafana is moved to docs website (#700) by @denis-ryzhkov
- ace0c19: chore: update KOF UI dependency to fix security vulnerability (#701) by @AndrejsPon00
- fb3ce85: chore: update KOF UI dependencies for security fixes (#704) by @AndrejsPon00
- 7887e82: docs: add VM storage credentials and multi-tenancy docs (#705) by @AndrejsPon00
- 227c9d3: chore: update copilot instructions (#707) by @gmlexx
- fd95eb1: ci: add tenant isolation test (#709) by @AndrejsPon00
- df180a2: chore: KOF 1.7.0-rc1 (#712) by @denis-ryzhkov
- 2e3e383: chore: update KOF UI dependencies for security fixes (#720) by @AndrejsPon00
- 7a36996: chore: KOF 1.7.0-rc2 (#718) by @denis-ryzhkov
Full Changelog: v1.6.0...v1.7.0
v1.6.0
❗ Upgrade Instructions ❗
-
Before upgrading
kof-mothership, ensure the following steps are completed:- Upgrade the
kof-operatorschart using the--take-ownershipflag:helm upgrade --take-ownership \ --reset-values --wait -n kof kof-operators -f operators-values.yaml \ oci://ghcr.io/k0rdent/kof/charts/kof-operators --version 1.6.0
- Make sure to upgrade
kof-operatorsusing the--take-ownershipflag on each KOF Regional cluster:KUBECONFIG=regional-kubeconfig helm upgrade --take-ownership \ --reset-values --wait -n kof kof-operators -f operators-values.yaml \ oci://ghcr.io/k0rdent/kof/charts/kof-operators --version 1.6.0
- Upgrade the
-
If you are using
k0rdent-istiochart with KOF, apply the Upgrade to v1.6.0 guide.
📚 New Docs 📚
- Updated Installing KOF - Istio
🚀 New Features 🚀
- c4355e2: feat: add adopted cluster support for KCM Region (#630) by @AndrejsPon00
- 9e8f0b1: feat: add OTel Collector misconfiguration detection to KOF UI (#636) by @AndrejsPon00
🐛 Notable Fixes 🐛
- 599450e: fix: update KOF operator ClusterRole to prevent KOF UI errors (#620) by @AndrejsPon00
- 1b776d6: fix: mothership upgrade fails due to
ServiceTemplateChainspec changes (#625) by @AndrejsPon00 - 1bd87dc: fix: prevent chart reinstallation by adding service dependsOn to region/child MCS (#623) by @AndrejsPon00
- 2cc87cf: fix: split queue utilization widgets (#629) by @gmlexx
- 7bf9adc: fix: align operator service labels and ports to match operator pod (#622) by @AndrejsPon00
- b39f52c: fix: false positive misconfiguration alert for localhost (#631) by @gmlexx
- df6f7ac: fix: change duplicated dashboard uid (#635) by @gmlexx
- e5a752a: fix: prevent grafana operator reconciliation issue due to missing credentials (#645) by @gmlexx
- 4308893: fix: vmauth used vmalert image (#646) by @denis-ryzhkov
- 92e3f45: fix: improve cluster cloud detection logic (#651) by @AndrejsPon00
- e0c6619: fix: remove unused
ServiceTemplateChainthat blocked KOF installation (#654) by @AndrejsPon00 - 67e6b09: fix: remove
Patch Kind Configstep from upgrade CIs (#656) by @AndrejsPon00 - 22992c5: fix: prevent grafana operator reconciliation issue due to missing creds (#657) by @gmlexx
- 2521760: fix: Make global values compatible with new collectors (#663) by @denis-ryzhkov
- 809f0df: fix: add missing version field in ServiceTemplateChain upgrades (#668) by @AndrejsPon00
- f81c50e: fix: prevent chart reinstallation in MCS by adding
waitto Helm options (#664) by @AndrejsPon00 - f9a23a5: fix: add datasource regex to KPS dashboards to lock datasource selection (#662) by @AndrejsPon00
- 0f483e6: fix: use nodename instead of instance in
k8s-views-nodesdashboard queries (#674) by @AndrejsPon00 - 436980a: fix: incorrect kof reinstallation on istio upgrade (#673) by @AndrejsPon00
✨ More Improvements ✨
- 1bbc643: chore: Bump to upcoming 1.6.0-rc0 (#621) by @denis-ryzhkov
- 284103f: chore: fix metrics port binding for kind clusters (#626) by @gmlexx
- 23c7cfc: chore: update Istio-related files due to Istio charts merge (#627) by @AndrejsPon00
- 62b0057: chore: upgrade grafana operator to v5.20.0 (#634) by @gmlexx
- 9e6886a: chore: upgrade opencost to 1.118.0 (#641) by @gmlexx
- 65e2eea: chore: automatically label
kofnamespace for Istio sidecar injection (#643) by @AndrejsPon00 - e7d854e: chore: Pinned image tags in kof-collectors values (#647) by @denis-ryzhkov
- dad50f2: ci: fix docker pull rate limit issue (#650) by @AndrejsPon00
- c24750a: ci: add workaround for CI failures caused by grafana-operator (#659) by @AndrejsPon00
- 1bbf73d: ci: check go version before setup (#670) by @gmlexx
- 5c75056: chore: add squid proxy server for local caching and ssl bumping (#658) by @gmlexx
Full Changelog: v1.5.0...v1.6.0
v1.5.0
❗ Upgrade Instructions ❗
- If you are using
kof-istiochart, apply the Upgrade to v1.5.0 guide. - To use the new KCM Regional Clusters with KOF, apply the KCM Region With KOF guide.
📚 New Docs 📚
- Data Backup
- Data migration to a new regional cluster
- Installing KOF - istio
- KCM Region With KOF
- Resource Requirements
- Upgrade to v1.5.0
All docs: https://docs.k0rdent.io/v1.5.0/admin/kof/#guides
🚀 New Features 🚀
- 1921ddb: feat: add journald receiver to daemon collector (#568) by @gmlexx
- c9cd562: feat: CI checks version of upgraded charts in regional and child clusters,
make set-charts-version(#566) by @denis-ryzhkov - 8b8a6a3: feat: add metrics migration script (#606) by @gmlexx
- b52fdf9: feat: add and unify logs and metrics migration script (#612) by @gmlexx
- 5cc80a6: feat: add support for KCM Regional clusters in KOF UI (#609) by @AndrejsPon00
- 8389360: feat: add support for KCM Region feature in KOF (#610) by @AndrejsPon00
- e94c329: feat: add dependsOn for
kof-istioMCS to depend onIstioMCS (#616) by @AndrejsPon00
🐛 Notable Fixes 🐛
- a34128b: fix: do client-side processing of logs table to allow immediate pivot to Explore and live-tail (#563) by @aglarendil
- 5f42879: fix: extra comma (#565) by @aglarendil
- 779e877: fix: shorten profile name to fit in 63 characters limitation (#574) by @gmlexx
- 9577d59: fix: autodetect external dns credentials in regional MCS to enable it (#577) by @gmlexx
- cd7a91c: fix: Reload the Target Allocator on cert renewal (#599) by @denis-ryzhkov
- bd383eb: fix: Updated port of
kiwigrid/k8s-sidecarto avoidaddress already in useinkube-state-metricscontainer (#604) by @denis-ryzhkov - 90f85ae: fix: cluster variable and expression filters in etcd dashboard (#611) by @gmlexx
- 92915e0: fix: cleanup child ConfigMap propagation MCS after ClusterDeployment deletion (#617) by @AndrejsPon00
✨ More Improvements ✨
- 8399308: chore: fix ci to re-apply adopted clusters config and upload up-to-date collector image (#578) by @gmlexx
- 256f083: chore: move system requirements doc to docs project (#579) by @gmlexx
- c3b1704: ci: Using bigger GitHub runner (#581) by @denis-ryzhkov
- 4443ad1: ci: Unification of intermediate versions for charts, images, KCM, QA (#584) by @denis-ryzhkov
- aa2c9f2: ci: Switching to arc-runner-set-k0rdent-public (#586) by @denis-ryzhkov
- 1985222: ci: Fix of
go-version input was not specified(#587) by @denis-ryzhkov - 93f028d: ci: use self-hosted runners with docker creds (#588) by @gmlexx
- 6cff136: chore: update victoria metrics and logs ds plugins with the latest bugfixes (#583) by @gmlexx
- f989f01: chore: add test kof installation CI (#585) by @AndrejsPon00
- e05f3e0: chore: upgrade CLI tools to align with KCM (#590) by @gmlexx
- 5cf4437: ci: Fix permissions of self-hosted GitHub runner, switch to ARC (#591) by @denis-ryzhkov
- 8a0882d: ci: Install required packages to ARC runner (#592) by @denis-ryzhkov
- c509484: ci: Fix ARC CI part 2, switch to GH-hosted runner (#593) by @denis-ryzhkov
- e584c91: chore: add kof cleanup script (#596) by @AndrejsPon00
- 6aee86f: chore: remove Istio code/logic (moved to separate repo) (#547) by @AndrejsPon00
- ad09890: chore: KOF 1.5.0-rc1 (#602) by @denis-ryzhkov
- cedffeb: ci: Fix of
invalid semantic versioninbuild_chartsCI (#608) by @denis-ryzhkov - 2aff077: chore: KOF 1.5.0-rc3 (#614) by @denis-ryzhkov
Full Changelog: v1.4.0...v1.5.0
v1.4.0
❗ Upgrade Instructions ❗
PromxyServerGroupCRD was moved fromcrds/totemplates/directory for auto-upgrade.- Please use
--take-ownershipon upgrade ofkof-mothershipto 1.4.0:helm upgrade --take-ownership \ --reset-values --wait -n kof kof-mothership -f mothership-values.yaml \ oci://ghcr.io/k0rdent/kof/charts/kof-mothership --version 1.4.0
- This will not be required in future upgrades.
🚀 New Features 🚀
- b31f729: feat: add cluster deployment monitoring page to KOF UI (#502) by @AndrejsPon00
- 032fd30: feat: add cluster summaries monitoring page to KOF UI (#505) by @AndrejsPon00
- ffc72f4: feat: Add multi cluster services monitoring page to KOF UI (#508) by @AndrejsPon00
- 48eb9d3: feat: add state management provider monitoring to KOF UI (#509) by @AndrejsPon00
- 4a3c142: feat: add service set monitoring page to KOF UI (#519) by @AndrejsPon00
- faa2c31: feat: migrate to receiver_creator for filelog/containers to support annotation-based discovery (#529) by @gmlexx
- 3803b5a: feat: add sveltos clusters monitoring page to KOF UI (#531) by @AndrejsPon00
- 783fe3a: feat: add k8s audit logs collector config (#539) by @AndrejsPon00
- fbf250b: feat: add parser for key-value logs (#528) by @AndrejsPon00
- 665c3a8: feat: add filestore for filelogreceivers to store offsets (#544) by @gmlexx
- cae1488: feat: add alerts for CAPI Objects states (#526) by @AndrejsPon00
- ad2ff78: feat: add adopted clusters support for Istio (#551) by @gmlexx
🐛 Notable Fixes 🐛
- 82683aa: fix: remove timestamp metrics from kube-state custom resources (#498) by @gmlexx
- fe99e29: fix: Typo
grafana-operator.enables/enabled, dedup of this subchart, updated descriptions (#506) by @denis-ryzhkov - 2e6c66e: fix: Fix of warnings on helm install/upgrade of kof-collectors (#504) by @denis-ryzhkov
- 6d2e339: fix: flatten event fields for better filtering (#510) by @gmlexx
- cc20148: fix: Auto-upgrade KOF CRD PromxyServerGroup (#546) by @denis-ryzhkov
- 90cd7ab: fix: Security fix of vite (#548) by @denis-ryzhkov
- 9be5d40: fix: show log line field in dashboard (#559) by @gmlexx
- 79b2f80: fix: move collectors service extensions list to upper charts values (#558) by @gmlexx
- 3e7b53a: fix: hardcoded DS UID victoria-logs.yaml (#560) by @aglarendil
- cf2d044: fix: Crash of OTelCol without extensions required for storing KOF data of Management cluster (#561) by @denis-ryzhkov
✨ More Improvements ✨
- a45a203: chore: add prettier and reformat all dashboards yamls (#512) by @gmlexx
- 354171d: chore: add copilot instructions file (#514) by @gmlexx
- 3fe3595: refactor: clean up k8s object monitoring pages logic in KOF UI (#515) by @AndrejsPon00
- fc37df0: refactor: unify backend k8s objects handler for UI (#517) by @AndrejsPon00
- 8de2d64: ci: checkout latest KCM main for upgrade test (#520) by @gmlexx
- 0f3a4e9: docs: fix links to dev.md (#521) by @gmlexx
- 567f3ad: chore: add
ui-testsjob topr_test_helm_chart.ymlto run UI tests (#522) by @AndrejsPon00 - 248fd5a: test: fix Victoria dashboard tests in KOF UI (#523) by @AndrejsPon00
- 07582a6: chore: update victorialogs plugin for adhoc filters fixes (#525) by @gmlexx
- 7d67731: test: add tests for dashboard components in KOF UI (#524) by @AndrejsPon00
- 74850ee: chore: update victoriametrics plugin with latest fixes (#527) by @gmlexx
- 8dd3e30: chore: remove sveltos-dashboard from mothership chart (#532) by @AndrejsPon00
- 66391a3: chore: KOF 1.4.0-rc1 (#552) by @denis-ryzhkov
- 44d1960: ci: split management and adopted clusters testing (#557) by @gmlexx
Full Changelog: v1.3.0...v1.4.0
v1.3.0
❗ Upgrade Instructions ❗
- Please apply the "Reconciling MultiClusterService" workaround
and update VMCluster/VMAlertspecvalues
as documented here.
📚 New Docs 📚
- KOF UI docs about misconfiguration detection and VictoriaMetrics/Logs.
🚀 New Features 🚀
- acb9120: feat: add http config for adopted regional cluster by @gmlexx
- 93d1064: feat: add backend for internal observability of VictoriaMetrics/Logs (#463) by @AndrejsPon00
- 6958133: feat: add VictoriaMetrics and VictoriaLogs observability page to KOF UI (#480) by @AndrejsPon00
- 1fa557d: feat: allow full vm custom objects specs definition in values (#478) by @gmlexx
- 6978d1c: feat: add tooltip for metrics description in KOF UI (#483) by @AndrejsPon00
- 370da8f: feat: update helm charts on storage secret change (#484) by @gmlexx
- 838f53a: feat: add raw metrics tab in KOF UI (#487) by @AndrejsPon00
- 1131315: feat: add custom resources to kube-state-metrics (#489) by @gmlexx
- 7832d51: feat: mothership components monitoring (#342) by @aglarendil
- 6df9757: feat: add misconfiguration check for collector scrape in KOF UI (#490) by @AndrejsPon00
- a8c97a6: feat: kube-state-metrics dashboards for k0rdent objects (#497) by @gmlexx
🐛 Notable Fixes 🐛
- cfba650: fix: change opencost prometheus URL to HTTP for local cluster (#451) by @AndrejsPon00
- 7ba9801: fix: correct instrumentation exporter endpoint to resolve trace export error (#452) by @AndrejsPon00
- 1dc8a60: fix: Replacing release notes with auto-generated ones, updated docs/release (#453) by @denis-ryzhkov
- 64b6f5b: fix: slow KOF UI responses due to long proxy timeout (#448) by @AndrejsPon00
- f49b35a: fix: Customized
cert-manager-startupapicheckimage registry (#457) by @denis-ryzhkov - d15e1cb: fix: promxy server group doesn't update after http client config changes (#456) by @AndrejsPon00
- ad3bec4: fix: increase promxy memory requests/limits to prevent OOM (#458) by @AndrejsPon00
- 2c3d50a: fix: move grafana operator to kof-operators helm chart (#461) by @gmlexx
- ada76b5: fix: Jaeger authenticated endpoint of regional cluster became available for other clusters (#462) by @denis-ryzhkov
- 3437957: fix:
istio/gatewaychart repo compatibility with custom registry (#464) by @denis-ryzhkov - 588682e: fix: add promxy suffix to promxy labels by @gmlexx
- f3dbad0: fix: add missing env variable for goreleaser (#466) by @gmlexx
- 6ea8e64: fix: Added
ServiceTemplateChaincert-manager-v1-16-4-from-1-16-4required for upgrade to KOF 1.2.0 (#467) by @denis-ryzhkov - 52b9658: fix: override only defined properties with annotation on config update (#468) by @gmlexx
- 4353a1e: fix: Custom
kcm.serviceMonitor.selector(#472) by @denis-ryzhkov - 2d6104b: fix: "Cluster Deployments Events" dashboard vs "From Management to Regional" case (#469) by @denis-ryzhkov
- 5f6f3dd: fix: Custom
registryCredentialsConfiginhelmChartsofkof-istio(#473) by @denis-ryzhkov - f9ad1e9: fix: use node name in node exporter dashboards (#470) by @gmlexx
- 75f174b: fix: Two cases of
chartNameforcert-managerinkof-istio-networkby @denis-ryzhkov - eb8d43f: fix: Moved
kof-operatorsto be installed beforekof-storageinkof-istio-regionalto avoid "CRDs not found" by @denis-ryzhkov - 06a137d: fix: Updated Jaeger secret name after movingit from
kof-storagetokof-mothershipin #462 to avoidinvalid ownership metadataby @denis-ryzhkov - 48504e1: fix: ContainerHighMemUsage alert has container label missing (#477) by @aglarendil
- a1ce5b9: fix: Typo in
intervalFactorlead to 500 in "Istio Service Dashboard" (#479) by @denis-ryzhkov - 3154164: fix: incorrect log level parsing for uppercase codes (#481) by @AndrejsPon00
- c0098ec: fix: correctly parse and render total metric values and labels (not just last label) in kof UI (#486) by @AndrejsPon00
- b63188f: fix: prevent OOM crash in promxy on large queries (#491) by @AndrejsPon00
- 93599c1: fix: correct memory queries in Grafana dashboard panels (#494) by @AndrejsPon00
- 9107ce6: fix: prevent duplicate metric collection (#488) by @AndrejsPon00
✨ More Improvements ✨
- d3cc733: chore: setup go based on go.mod file by @gmlexx
- fbd2d4a: chore: apply coredns patch for mothership and restart once by @gmlexx
- 7867e05: chore: add promxy port-forward target by @gmlexx
- c62848b: test: check promxy metrics by @gmlexx
- 36154db: chore: add charts and docker images build (#465) by @gmlexx
- 29f0a2b: test: wait until vmauth creates ingress in kind-adopted-regional cluster (#471) by @gmlexx
- 1885064: chore: KOF 1.2.1 patch release by @denis-ryzhkov
- c106d22: test: add unit tests for Victoria pages (KOF UI) (#482) by @AndrejsPon00
- 1ac30b6: chore: KOF 1.3.0-rc1 (#496) by @denis-ryzhkov
- 13e3720: chore: KOF 1.3.0 release (#499) by @denis-ryzhkov
Full Changelog: v1.2.0...v1.3.0
v1.2.1
This is a patch release with a bunch of small but important fixes which require no special upgrade instructions.
🐛 Fixes 🐛
- 9ddd84a: fix: Added
ServiceTemplateChaincert-manager-v1-16-4-from-1-16-4required for upgrade to KOF 1.2.0 (#467) by @denis-ryzhkov - 4cbef06: fix: change opencost prometheus URL to HTTP for local cluster (#451) by @AndrejsPon00
- 3fe1f5a: fix: correct instrumentation exporter endpoint to resolve trace export error (#452) by @AndrejsPon00
- d26f626: fix: Replacing release notes with auto-generated ones, updated docs/release (#453) by @denis-ryzhkov
- 73fc2ab: fix: promxy server group doesn't update after http client config changes (#456) by @AndrejsPon00
- b2e9ea7: fix: Customized
cert-manager-startupapicheckimage registry (#457) by @denis-ryzhkov - e2a59a8: fix: increase promxy memory requests/limits to prevent OOM (#458) by @AndrejsPon00
- f28498a: fix: Jaeger authenticated endpoint of regional cluster became available for other clusters (#462) by @denis-ryzhkov
- e2780eb: fix:
istio/gatewaychart repo compatibility with custom registry (#464) by @denis-ryzhkov - 10e6a60: fix: add missing env variable for goreleaser (#466) by @gmlexx
- 0fe6647: fix: override only defined properties with annotation on config update (#468) by @gmlexx
- a2d23c9: fix: "Cluster Deployments Events" dashboard vs "From Management to Regional" case (#469) by @denis-ryzhkov
- 25138b2: fix: Custom
kcm.serviceMonitor.selector(#472) by @denis-ryzhkov - daca158: fix: Custom
registryCredentialsConfiginhelmChartsofkof-istio(#473) by @denis-ryzhkov - 656b2e3: fix: Two cases of
chartNameforcert-managerinkof-istio-networkby @denis-ryzhkov - 69b1918: fix: Moved
kof-operatorsto be installed beforekof-storageinkof-istio-regionalto avoid "CRDs not found" by @denis-ryzhkov - 9a60cbe: fix: Updated Jaeger secret name after movingit from
kof-storagetokof-mothershipin #462 to avoidinvalid ownership metadataby @denis-ryzhkov - 0d87dec: fix: ContainerHighMemUsage alert has container label missing (#477) by @aglarendil
- 20aa648: fix: Typo in
intervalFactorlead to 500 in "Istio Service Dashboard" (#479) by @denis-ryzhkov
Full Changelog: v1.2.0...v1.2.1
v1.2.0
❗ Upgrade Instructions ❗
- As part of the KOF 1.2.0 overhaul of metrics collection and representation, we switched from the victoria-metrics-k8s-stack metrics and dashboards to opentelemetry-kube-stack metrics and kube-prometheus-stack dashboards.
- Some of the previously collected metrics have slightly different labels.
- If consistency of timeseries labeling is important, users are advised to conduct relabeling of the corresponding timeseries in the metric storage by running a retroactive relabeling procedure of their preference.
- A possible reference solution here would be to use Rules backfilling via vmalert.
- The labels that would require renaming are these:
- Replace
job="integrations/kubernetes/kubelet"withjob="kubelet", metrics_path="/metrics". - Replace
job="integrations/kubernetes/cadvisor"withjob="kubelet", metrics_path="/metrics/cadvisor". - Replace
job="prometheus-node-exporter"withjob="node-exporter".
- Replace
Also:
- To upgrade from
cert-manager-1-16-4tocert-manager-v1-16-4
please apply this patch to management cluster:kubectl apply -f - <<EOF apiVersion: k0rdent.mirantis.com/v1beta1 kind: ServiceTemplateChain metadata: name: patch-cert-manager-v1-16-4-from-1-16-4 namespace: kcm-system annotations: helm.sh/resource-policy: keep spec: supportedTemplates: - name: cert-manager-v1-16-4 - name: cert-manager-1-16-4 availableUpgrades: - name: cert-manager-v1-16-4 EOF
📚 New Docs 📚
- KOF 1.2.0 docs: https://docs.k0rdent.io/v1.2.0/admin/kof/
- k0rdent/docs#493 updates:
- Switch to
opentelemetry-kube-stackcollectors, metrics, dashboards. - Dedicated "Upgrading KOF" page.
- Option to skip regional
ClusterDeployment, create regionalConfigMapinstead. - Optional
crossNamespacediscovery of regional cluster. - OpenStack-specific values.
- Istio does not need
REGIONAL_DOMAIN- never needed, but docs were unclear. - Auto-deletion of
promxyservergroupandgrafanadatasourceon uninstall. - Deleted the outdated "Low-level" diagram.
- Better verification of certs.
- Switch to
🚀 New Features 🚀
- feat: Add cluster filter to Victoria Logs dashboard by @AndrejsPon00 in #382
- feat: Option to allow regional cluster to be in another namespace than the child cluster by @denis-ryzhkov in #390
- feat: add dashboard to monitor OpenTelemetry Collectors metrics across all clusters by @AndrejsPon00 in #391
- feat: Show trend insights for collectors metrics in KOF dashboard by @AndrejsPon00 in #395
- feat: Add collectors list page to KOF dashboard by @AndrejsPon00 in #398
- feat: Switch Metric Collectors to Opentelemetry-kube-stack by @aglarendil in #273
- feat: optional regional cluster by @gmlexx in #396
- feat: Added the
clusterNamespacemetrics label asclustername may be not unique by @denis-ryzhkov in #401 - feat: Speedup kof release workflow by @AndrejsPon00 in #365
- feat: Collect internal metrics from victoria metrics/logs services by @AndrejsPon00 in #403
- feat: add handler to fetch internal metrics from collectors by @AndrejsPon00 in #387
- feat: Add ability to extract metrics port from annotation by @AndrejsPon00 in #423
- feat: Allow exposing kof-operator webui through Ingress by @chramb in #442
🐛 Notable Fixes 🐛
- fix: Do not replace
exprwith int zero0ifexpris not overridden by @denis-ryzhkov in #380 - fix: batch processor order by @gmlexx in #381
- fix: update dev-child-coredns setup to wait ingress ip provisioning by @gmlexx in #386
- fix: Moved
PromxyServerGroupandGrafanaDatasourceto namespace ofClusterDeploymentby @denis-ryzhkov in #394 - fix: Added letter
vtocert-manager:v1.16.4for compatibility with all registries by @denis-ryzhkov in #404 - fix: patch up incorrect alertmanager rules job label variable by @aglarendil in #409
- fix: Add debug info to kof-operator build to prevent auto-instrumentation crash by @AndrejsPon00 in #414
- fix: Enabled "self metrics" of
kube-state-metricsby @denis-ryzhkov in #415 - fix: change cluster filter label in dashboards by @gmlexx in #417
- fix: Increase collectors memory to prevent OOM by @AndrejsPon00 in #408
- fix: Prevent regional clusters selection from cluster-deployments-events dashboard by @AndrejsPon00 in #418
- fix: Incorrect routing fallback for KOF UI on server side by @AndrejsPon00 in #419
- fix: k8s events processor by @aglarendil in #421
- fix: fix collectors observability a bit by @aglarendil in #424
- fix: Made
opentelemetry-go-instrumentationpath and version compatible with all image registries by @denis-ryzhkov in #426 - fix: Aligned versions of
autoinstrumentation-goto v0.21.0 in all image registries by @denis-ryzhkov in #428 - fix: add cluster filter for Victoria logs/metrics Grafana dashboards by @AndrejsPon00 in #431
- fix: fix typo on helpers.tpl by @aglarendil in #434
- fix: Increase
maxLabelsPerTimeseriesto 50 to prevent label dropping in vmInsert by @AndrejsPon00 in #433 - fix: Customizable image registry for
vmauthby @denis-ryzhkov in #436 - fix: Customizable image registries for
kof-istio-network,cert-manager,ingress-nginxby @denis-ryzhkov in #439 - fix: fix collection of metrics from otel collectors by @aglarendil in #425
- fix: make promxy ingress target correct service by @chramb in #441
- fix: Grafana dashboards fixes by @AndrejsPon00 in #440
- fix:
make dev-collectors-deploywas breaking exporters by @denis-ryzhkov in #444 - fix: read vmauth credentials from secret by @gmlexx in #437
- fix: listen on host ip metrics for daemon collector by @aglarendil in #446
- fix: Correct panel alignment in
Kube Prometheus Stackdashboards by @AndrejsPon00 in #445 - fix: kgst 1.2.0 to support
certSecretRefby @denis-ryzhkov in #449
✨ More Improvements ✨
- test: add support bundle to troubleshoot CI issues by @gmlexx in #363
- docs: add data collection recipes by @gmlexx in #379
- docs: add data sending customization recipe by @gmlexx in #383
- chore: Use kgst 1.0.0 by @denis-ryzhkov in #385
- chore: update standalone cluster templates version to match the latest kcm by @gmlexx in #420
- chore: Update dependencies to resolve vulnerabilities in KOF UI by @AndrejsPon00 in #422
- chore: update charts version for release 1.2.0 by @gmlexx in #427
- chore: format changelog with goreleaser by @gmlexx in #430
- refactor: Group grafana dashboards by folders by @AndrejsPon00 in #432
- docs: Deleted the outdated
docs/collect-from-management.mdby @denis-ryzhkov in #447 - chore: KOF 1.2.0 release by @denis-ryzhkov in #450
🧑 New Contributors 🧑
Full Changelog: v1.1.0...v1.2.0