Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GStream fields specification #1771

Closed
biozit opened this issue Aug 25, 2022 · 4 comments
Closed

GStream fields specification #1771

biozit opened this issue Aug 25, 2022 · 4 comments
Assignees
Labels
Documentation Issue Missing or incorrect documentation

Comments

@biozit
Copy link
Contributor

biozit commented Aug 25, 2022

Hi All,

I think we don't have a specification for each field for gstream.

@biozit biozit changed the title Stream fileds specification GStream fields specification Aug 25, 2022
@biozit
Copy link
Contributor Author

biozit commented Sep 28, 2022

Hi all,

Please, do we have a timeline for this?

Thank you!

@abh3 abh3 self-assigned this Sep 28, 2022
@abh3
Copy link
Member

abh3 commented Sep 28, 2022

Presumably you want the Xcache definition. I have pinged the developer about this.

@osschar
Copy link
Contributor

osschar commented Sep 28, 2022

This is for g-stream PFC file_close record; there are no newlines in actual stream.

https://github.com/xrootd/xrootd/blob/master/src/XrdPfc/XrdPfc.cc#L643

{
"event":"file_close", -- hardcoded event type for record emitted at file_close time
"lfn": "%s",          -- LFN of the file
"size":%lld,          -- file size [bytes]
"blk_size":%d,        -- block size used by cache [bytes]
"n_blks":%d,          -- total number of blocks 
"n_blks_done":%d,     -- number of blocks already downloaded / in cache
"access_cnt":%lu,     -- number of IO objects that were attached to the file during the time the file was opened
"attach_t":%lld,      -- epoch when the first IO object was attached / file was opened at the cache
"detach_t":%lld,      -- epoch when the last IO object was detached
"remotes":%s,         -- list of remote origins where the file was read from during the time the file was opened
"b_hit":%lld,         -- bytes served from the cache (disk or RAM) [bytes]
"b_miss":%lld,        -- bytes served that had to be fetched from the remote [bytes]
"b_bypass":%lld,      -- bytes served in bypass mode, read from remote but not written into cache [bytes]
"n_cks_errs":%d       -- number of checksum errors reported by the XrdCl during remote reads.
}

Note that OSG shoveler renames some of the fields and changes time to doubles with milisecond precision (I think).

@biozit
Copy link
Contributor Author

biozit commented Sep 28, 2022 via email

@abh3 abh3 added the Documentation Issue Missing or incorrect documentation label Jan 30, 2023
@biozit biozit closed this as completed Mar 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Documentation Issue Missing or incorrect documentation
Projects
None yet
Development

No branches or pull requests

3 participants