Skip to content

Conversation

@pjknkda
Copy link

@pjknkda pjknkda commented Jan 27, 2026

Summary

Apply a result limit to Azure list_blobs calls used for container (bucket) existence checks.

Details

Barman checks whether an Azure Blob Storage container exists by calling list_blobs.
This check only needs to validate container accessibility, but on large containers an unrestricted listing can return an excessive number of objects, inflating response payload size and network traffic.

This change adds a listing limit only for the list_blobs usage in the container existence check path, ensuring that the check returns a minimal number of objects while preserving correct behavior.

Experiment

In our production environment, we operate 58 databases using CNPG, all sharing a single Azure Blob Storage container as WAL object storage.

Before this change, the container existence check generated approximately 135 GiB of network traffic per hour.
After applying the limit, traffic dropped to around 12 MiB per hour, resulting in roughly a 10,000× reduction in network usage.

@pjknkda pjknkda requested a review from a team as a code owner January 27, 2026 22:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant