Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GCP error in v.3.4.1 "Cloud Storage objects are immutable" #1491

Closed
lescai opened this issue Apr 29, 2024 · 2 comments
Closed

GCP error in v.3.4.1 "Cloud Storage objects are immutable" #1491

lescai opened this issue Apr 29, 2024 · 2 comments
Labels
bug Something isn't working

Comments

@lescai
Copy link
Contributor

lescai commented Apr 29, 2024

Description of the bug

Got the error:

Apr-24 16:07:17.072 [Actor Thread 40] ERROR nextflow.extension.OperatorImpl - @unknown
com.google.cloud.storage.contrib.nio.CloudStorageObjectImmutableException: Cloud Storage objects are immutable.
	at com.google.cloud.storage.contrib.nio.CloudStorageFileAttributeView.setTimes(CloudStorageFileAttributeView.java:65)
	at java.base/java.nio.file.CopyMoveHelper.copyToForeignTarget(CopyMoveHelper.java:135)
	at java.base/java.nio.file.CopyMoveHelper.moveToForeignTarget(CopyMoveHelper.java:157)
	at java.base/java.nio.file.Files.move(Files.java:1435)
	at nextflow.file.SimpleFileCollector.saveFile(SimpleFileCollector.groovy:102)
	at nextflow.file.FileCollector.saveTo0(FileCollector.groovy:228)

the pipeline has been launched with a very simple test command (I’ve hidden some parts of the identifiers).
conversation in Slack:
https://nfcore.slack.com/archives/C05V9FRJYMV/p1713976551898249

Command used and terminal output

nextflow run nf-core/sarek -c ../***_profile.config -profile gls,test --outdir .

profiles {
    gls {
        process.executor = 'google-batch'
        workDir = 'gs://****-data/work'
        google.location = 'europe-west4'
        google.region  = 'europe-west4'
        google.project = '*****'
        google.batch.usePrivateAddress = 'true'
        google.batch.spot = true
        fusion.enabled = true
        wave.enabled = true
        process.scratch = false
    }
}
process {
  errorStrategy = { task.exitStatus in [1,143,137,104,134,139,255,108] ? 'retry' : 'finish' }
  maxRetries = 4
  maxErrors = '-1'
}

Relevant files

No response

System information

Google Cloud Batch
nf-core/sarek v3.4.1-gea88402
nextflow 23.10.1
same error when launched from GCP console CLI or when launched from a small VM with CentOS 7

@ejseqera
Copy link

The error comes from this invocation of collectFile which was introduced by an update to the template. Removal of sort: false option results in a successful run, but I don't think we actually want to be enforcing ordering.

        ch_multiqc_files                      = ch_multiqc_files.mix(ch_methods_description.collectFile(name: 'methods_description_mqc.yaml', sort: false))

@FriederikeHanssen
Copy link
Contributor

This was closed in #1494

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants