Skip to content

Add support for gcp ops agent#6608

Merged
bentsherman merged 4 commits intonextflow-io:masterfrom
ejseqera:add-support-gcp-ops-agent
Mar 3, 2026
Merged

Add support for gcp ops agent#6608
bentsherman merged 4 commits intonextflow-io:masterfrom
ejseqera:add-support-gcp-ops-agent

Conversation

@ejseqera
Copy link
Contributor

Add support for installing the Google Cloud Ops Agent on Google Batch instances through a new configuration option google.batch.installOpsAgent. OpsAgent on GCP helps provide telemetry and monitoring info on VM instances like CPU, memory, disk I/O metrics.

Changes

  • Add installOpsAgent config option to BatchConfig
  • Update GoogleBatchTaskHandler to include installOpsAgent in the allocation policy API request
  • Add test coverage for the new configuration option
  • Update documentation with usage notes and compatibility requirements

Test with:

process {
    executor = 'google-batch'
}

google {
    project = 'google-project'  // Replace with proj
    location = '<your_region>' // Replace with region

    batch {
        bootDiskImage = 'projects/batch-custom-image/global/images/family/batch-debian-11-official' // compatible OS image
        installOpsAgent = true
        spot = true
    }
}
nextflow run nextflow-io/hello -c batch.config

Resultant jobs will use batch-debian as the OS and the Batch job logs will show installation of the OpsAgent.

@ejseqera ejseqera requested a review from a team as a code owner November 24, 2025 21:14
@netlify
Copy link

netlify bot commented Nov 24, 2025

Deploy Preview for nextflow-docs-staging ready!

Name Link
🔨 Latest commit 2ee4937
🔍 Latest deploy log https://app.netlify.com/projects/nextflow-docs-staging/deploys/69a6ee4c4ddc800008d1a0eb
😎 Deploy Preview https://deploy-preview-6608--nextflow-docs-staging.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@ejseqera ejseqera force-pushed the add-support-gcp-ops-agent branch from 7b8b468 to 8e2c0d4 Compare November 24, 2025 21:15
@pditommaso pditommaso requested a review from jorgee November 28, 2025 09:22
@matthdsm
Copy link
Contributor

matthdsm commented Feb 6, 2026

Watching this PR, we need this

@bentsherman
Copy link
Member

@ejseqera can you or someone else address the comments? Otherwise we will close it rather than leave it sitting around

@pditommaso pditommaso force-pushed the master branch 2 times, most recently from d9fa5cd to d752bc2 Compare February 28, 2026 13:10
Signed-off-by: ejseqera <esha.joshi@seqera.io>
Signed-off-by: ejseqera <esha.joshi@seqera.io>
Signed-off-by: ejseqera <esha.joshi@seqera.io>
@ejseqera ejseqera force-pushed the add-support-gcp-ops-agent branch from 8e2c0d4 to 6125c2d Compare March 1, 2026 03:29
@ejseqera
Copy link
Contributor Author

ejseqera commented Mar 1, 2026

@bentsherman I've addressed the comments above, this should be ready to merge now.

@bentsherman bentsherman merged commit 247a53b into nextflow-io:master Mar 3, 2026
24 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants