-
Notifications
You must be signed in to change notification settings - Fork 149
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Failing to open a file #1426
Comments
I think it would be better if this problem is posted on the CMS list as
it's specific to CMS. Looking at it though, it would appear that it
couldn't get a proxy cert to continue the recovery actions. That would
only be possible if this was an interactive session. However, the CMS
experts would be able to give you more information.
…On Fri, 12 Mar 2021, Viesturs Veckalns wrote:
I failed to open a file.
The report is attached below.
12-Mar-2021 12:00:39 CET Initiating request to open file root://eoscms.cern.ch//eos/cms/store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root
%MSG-w XrdAdaptorInternal: file_open 12-Mar-2021 12:00:41 CET pre-events
Failed to open file at URL root://eoscms.cern.ch:1094//eos/cms/store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root.
%MSG
%MSG-w XrdAdaptorInternal: file_open 12-Mar-2021 12:00:41 CET pre-events
Failed to open file at URL root://eoscms.cern.ch:1094//eos/cms/store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root?tried=.
%MSG
12-Mar-2021 12:00:41 CET Fallback request to file root://xrootd-cms.infn.it//store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root
210312 12:00:42 23926 cryptossl_X509CreateProxy: Your identity: /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=vveckaln/CN=746478/CN=Viesturs Veckalns
Enter PEM pass phrase:[2021-03-12 12:03:42.735046 +0100][Error ][XRootD ] [hask.csc.fi:1094] Impossible to send message kXR_open (file: /store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat ). Trying to recover.
[2021-03-12 12:03:42.735185 +0100][Error ][XRootD ] [hask.csc.fi:1094] Unable to get the response to request kXR_open (file: /store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat )
%MSG-w XrdAdaptorInternal: file_open 12-Mar-2021 12:03:42 CET pre-events
Failed to open file at URL root://hask.csc.fi:1094//store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root.
%MSG
[2021-03-12 12:06:56.761060 +0100][Error ][XRootD ] [xrootd-cms.infn.it:1094] Impossible to send message kXR_open (file: /store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root?tried=, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat ). Trying to recover.
[2021-03-12 12:06:56.762293 +0100][Error ][XRootD ] [xrootd-cms.infn.it:1094] Unable to get the response to request kXR_open (file: /store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root?tried=, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat )
%MSG-w XrdAdaptorInternal: file_open 12-Mar-2021 12:06:56 CET pre-events
Failed to open file at URL root://xrootd-cms.infn.it:1094//store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root?tried=.
%MSG
[2021-03-12 12:09:56.781808 +0100][Error ][XRootD ] [xrootd-cms.infn.it:1094] Impossible to send message kXR_open (file: /store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root?tried=, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat ). Trying to recover.
[2021-03-12 12:09:56.781932 +0100][Error ][XRootD ] [xrootd-cms.infn.it:1094] Unable to get the response to request kXR_open (file: /store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root?tried=, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat )
%MSG-w XrdAdaptorInternal: file_open 12-Mar-2021 12:09:56 CET pre-events
Failed to open file at URL root://xrootd-cms.infn.it:1094//store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root?tried=.
%MSG
----- Begin Fatal Exception 12-Mar-2021 12:09:56 CET-----------------------
An exception of category 'FallbackFileOpenError' occurred while
[0] Constructing the EventProcessor
[1] Constructing input source of type PoolSource
[2] Calling RootFileSequenceBase::initTheFile()
[3] Calling StorageFactory::open()
[4] Calling XrdFile::open()
Exception Message:
Failed to open the file 'root://xrootd-cms.infn.it//store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root'
Additional Info:
[a] XrdCl::File::Open(name='root://eoscms.cern.ch//eos/cms/store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root', flags=0x10, permissions=0660) => error '[ERROR] Server responded with an error: [3011] Unable to open file /eos/cms/store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root; No such file or directory
' (errno=3011, code=400). No additional data servers were found.
[b] Last URL tried: root://eoscms.cern.ch:1094//eos/cms/store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root?tried=
[c] Problematic data server: eoscms.cern.ch:1094
[d] Disabled source: eoscms.cern.ch:1094
[e] Input file root://eoscms.cern.ch//eos/cms/store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root could not be opened.
Fallback Input file root://xrootd-cms.infn.it//store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root also could not be opened.
Original exception info is above; fallback exception info is below.
[f] XrdCl::File::Open(name='root://xrootd-cms.infn.it//store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root', flags=0x10, permissions=0660) => error '[ERROR] Operation expired' (errno=0, code=206). No additional data servers were found.
[g] Last URL tried: root://xrootd-cms.infn.it:1094//store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root?tried=
[h] Problematic data server: xrootd-cms.infn.it:1094
[i] Disabled source: hask.csc.fi:1094
[j] Disabled source: xrootd-cms.infn.it:1094
----- End Fatal Exception -------------------------------------------------
--
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
#1426
|
Agreed - this appears to be a CMS internal issue. That said, I suspect Andy's may be on the right path - make sure your CMS proxy exists before running the command. The auto-generated one from XRootD won't contain the VOMS extensions and hence may not be usable with CMS servers. (But there are other potential causes that CMS experts can help with) |
Can you please tell where in CMS could I report problems like this? |
Hi, it looks like a problem on the EOS side that is administered at CERN. The first point of contact to report this would be open up a ticket for CMS here: https://ggus.eu/?mode=ticket_cms And select CMS Support Unit "CMS AAA - WAN Access". Hope this helps. Thanks, |
This has been directed to an appropriate forum. |
I failed to open a file.
The report is attached below.
12-Mar-2021 12:00:39 CET Initiating request to open file root://eoscms.cern.ch//eos/cms/store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root
%MSG-w XrdAdaptorInternal: file_open 12-Mar-2021 12:00:41 CET pre-events
Failed to open file at URL root://eoscms.cern.ch:1094//eos/cms/store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root.
%MSG
%MSG-w XrdAdaptorInternal: file_open 12-Mar-2021 12:00:41 CET pre-events
Failed to open file at URL root://eoscms.cern.ch:1094//eos/cms/store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root?tried=.
%MSG
12-Mar-2021 12:00:41 CET Fallback request to file root://xrootd-cms.infn.it//store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root
210312 12:00:42 23926 cryptossl_X509CreateProxy: Your identity: /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=vveckaln/CN=746478/CN=Viesturs Veckalns
Enter PEM pass phrase:[2021-03-12 12:03:42.735046 +0100][Error ][XRootD ] [hask.csc.fi:1094] Impossible to send message kXR_open (file: /store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat ). Trying to recover.
[2021-03-12 12:03:42.735185 +0100][Error ][XRootD ] [hask.csc.fi:1094] Unable to get the response to request kXR_open (file: /store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat )
%MSG-w XrdAdaptorInternal: file_open 12-Mar-2021 12:03:42 CET pre-events
Failed to open file at URL root://hask.csc.fi:1094//store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root.
%MSG
[2021-03-12 12:06:56.761060 +0100][Error ][XRootD ] [xrootd-cms.infn.it:1094] Impossible to send message kXR_open (file: /store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root?tried=, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat ). Trying to recover.
[2021-03-12 12:06:56.762293 +0100][Error ][XRootD ] [xrootd-cms.infn.it:1094] Unable to get the response to request kXR_open (file: /store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root?tried=, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat )
%MSG-w XrdAdaptorInternal: file_open 12-Mar-2021 12:06:56 CET pre-events
Failed to open file at URL root://xrootd-cms.infn.it:1094//store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root?tried=.
%MSG
[2021-03-12 12:09:56.781808 +0100][Error ][XRootD ] [xrootd-cms.infn.it:1094] Impossible to send message kXR_open (file: /store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root?tried=, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat ). Trying to recover.
[2021-03-12 12:09:56.781932 +0100][Error ][XRootD ] [xrootd-cms.infn.it:1094] Unable to get the response to request kXR_open (file: /store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root?tried=, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat )
%MSG-w XrdAdaptorInternal: file_open 12-Mar-2021 12:09:56 CET pre-events
Failed to open file at URL root://xrootd-cms.infn.it:1094//store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root?tried=.
%MSG
----- Begin Fatal Exception 12-Mar-2021 12:09:56 CET-----------------------
An exception of category 'FallbackFileOpenError' occurred while
[0] Constructing the EventProcessor
[1] Constructing input source of type PoolSource
[2] Calling RootFileSequenceBase::initTheFile()
[3] Calling StorageFactory::open()
[4] Calling XrdFile::open()
Exception Message:
Failed to open the file 'root://xrootd-cms.infn.it//store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root'
Additional Info:
[a] XrdCl::File::Open(name='root://eoscms.cern.ch//eos/cms/store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root', flags=0x10, permissions=0660) => error '[ERROR] Server responded with an error: [3011] Unable to open file /eos/cms/store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root; No such file or directory
' (errno=3011, code=400). No additional data servers were found.
[b] Last URL tried: root://eoscms.cern.ch:1094//eos/cms/store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root?tried=
[c] Problematic data server: eoscms.cern.ch:1094
[d] Disabled source: eoscms.cern.ch:1094
[e] Input file root://eoscms.cern.ch//eos/cms/store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root could not be opened.
Fallback Input file root://xrootd-cms.infn.it//store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root also could not be opened.
Original exception info is above; fallback exception info is below.
[f] XrdCl::File::Open(name='root://xrootd-cms.infn.it//store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root', flags=0x10, permissions=0660) => error '[ERROR] Operation expired' (errno=0, code=206). No additional data servers were found.
[g] Last URL tried: root://xrootd-cms.infn.it:1094//store/mc/RunIISummer16MiniAODv2/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/MINIAODSIM/PUMoriond17_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/50000/0693E0E7-97BE-E611-B32F-0CC47A78A3D8.root?tried=
[h] Problematic data server: xrootd-cms.infn.it:1094
[i] Disabled source: hask.csc.fi:1094
[j] Disabled source: xrootd-cms.infn.it:1094
----- End Fatal Exception -------------------------------------------------
The text was updated successfully, but these errors were encountered: