Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Creating a folder robert failed #3

Closed
haesleinhuepf opened this issue Sep 8, 2022 · 2 comments
Closed

Creating a folder robert failed #3

haesleinhuepf opened this issue Sep 8, 2022 · 2 comments

Comments

@haesleinhuepf
Copy link
Member

Code:

import biapol_taurus as bt

# This is the mount point at the export node. HPCsupport can tell us this:
source_mount = "/grp/g_biapol/robert"

# This is the project space. HPCsupport told us that when we applied for the project:
target_project = "/projects/p_bioimage/robert"

# We setup a connection:
pft = bt.ProjectFileTransfer(source_mount, target_project)

Error:

/app/env/lib/python3.10/site-packages/taurus_datamover/_datamover.py:316: UserWarning: process: /sw/taurus/tools/slurmtools/default/bin/dtrsync -a /tmp/tmpke7dn60a/ /projects/p_bioimage/ --blocking
exited with error: srun: job 28298976 queued and waiting for resources
srun: job 28298976 has been allocated resources
srun: error: ioctl(TIOCGWINSZ): Inappropriate ioctl for device
srun: error: Not using a pseudo-terminal, disregarding --pty option
rsync: change_dir "/tmp/tmpke7dn60a" failed: No such file or directory (2)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1179) [sender=3.1.2]
srun: error: taurusexport4: task 0: Exited with exit code 23
and output: 
  warnings.warn(warning_message)
---------------------------------------------------------------------------
OSError                                   Traceback (most recent call last)
Cell In [5], line 8
      5 target_project = "/projects/p_bioimage/robert"
      7 # We setup a connection:
----> 8 pft = bt.ProjectFileTransfer(source_mount, target_project)

File /app/env/lib/python3.10/site-packages/biapol_taurus/_project_file_transfer.py:56, in ProjectFileTransfer.__init__(self, source_fileserver_dir, target_project_space_dir, datamover_path, workspace_exe_path, quiet)
     54 self.temporary_directory = None
     55 self._initialize_tmp()
---> 56 self._ensure_project_dir_exists()

File /app/env/lib/python3.10/site-packages/biapol_taurus/_project_file_transfer.py:642, in ProjectFileTransfer._ensure_project_dir_exists(self)
    640     exit_code = waitfor(process)
    641 if exit_code > 0:
--> 642     raise IOError('Could not create target project space dir: {}'.format(
    643         str(self.target_project_space_dir)))

OSError: Could not create target project space dir: /projects/p_bioimage/robert
@thawn
Copy link

thawn commented Oct 17, 2022

I found the source of this error: I create the folder with rsync -a, which tries to set permissions, for which it would need superuser access.

thawn added a commit that referenced this issue Oct 17, 2022
@thawn
Copy link

thawn commented Oct 17, 2022

tests within a singularity container confirmed that this error is fixed.

@thawn thawn closed this as completed Oct 17, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants