Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

env config not working with GCP Batch #5623

Open
nick-youngblut opened this issue Dec 21, 2024 · 1 comment
Open

env config not working with GCP Batch #5623

nick-youngblut opened this issue Dec 21, 2024 · 1 comment

Comments

@nick-youngblut
Copy link
Contributor

Bug report

My nextflow.config contains:

env {
    MY_ENV_VAR = "my_value"
}

When the executor is local, the process using MY_ENV_VAR via os.environ["MY_ENV_VAR"] runs successfully.
However, when the executor is google-batch, the process throws KeyError: 'MY_ENV_VAR'.

https://www.nextflow.io/docs/latest/reference/config.html#env does not state that env is not supported for google-batch, so I'm assuming that there is either a bug or a lack of docs.

Expected behavior and actual behavior

Environmental variables set via the env config scope should be available for GCP Batch jobs... or the docs should explicitly state that env is not supported for GCP Batch.

Steps to reproduce the problem

  • Set variables in the env scope
  • Run locally; processes using the env variable should succeed
  • Run on GCP Batch; processes using the env variable should fail

Environment

  • Nextflow version: 24.10.2
  • Java version: 21.0.0
  • Operating system: Ubuntu 22.04.5
  • Bash version: 5.1.16
@pditommaso
Copy link
Member

I'm unable to replicate this. Can you please provide a test case ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants