Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TRSA (Trusted Remote Storage Agent) and variable-level metadata upload #5213

Open
akio-sone opened this issue Oct 18, 2018 · 7 comments

Comments

@akio-sone
Copy link
Contributor

commented Oct 18, 2018

Related issues

  • Provide API and internal framework for modifying variable-level (tabular) metadata. #4448
  • New API endpoints for TRSA (Trusted Remote Storage Agent) of ImPACT project: stage 1 #4750

Related Documents about TRSA

permission required

public

@pdurbin

This comment has been minimized.

Copy link
Member

commented Nov 28, 2018

@akio-sone @jonc1438 I mentioned you over at #4821 (comment) but I wanted to highlight that for Make Data Count, we plan to only count downloads that go through Glassfish which means that downloads from TRSA, downloads from rsync, and downloads directly from Swift won't be counted.

@jonc1438

This comment has been minimized.

Copy link

commented Nov 28, 2018

@pdurbin

This comment has been minimized.

Copy link
Member

commented Nov 28, 2018

@jonc1438 ah, ok, so it sounds like data from a TRSA will still go through Glassfish. This is sort of like how an S3 download works. The user interacts with Glassfish so we'll count the download even if the file ultimately gets downloaded directly from S3 (if dataverse.files.s3-download-redirect is set to true). Thanks!

@pdurbin

This comment has been minimized.

Copy link
Member

commented May 3, 2019

@jonc1438 @akio-sone @donsizemore great meeting this week. Would it be helpful if I stubbed out a workflow diagram similar to the one at http://guides.dataverse.org/en/4.13/admin/make-data-count.html#architecture ? I know you have a nice diagrams at http://cyberimpact.us/architecture-overview/ and http://cyberimpact.us/dataverse-trusted-remote-storage-agent-update/ but @kcondon and I were talking about a diagram that's a little lower level, about communication back and forth between the different components, like that Make Data Count diagram. Please let me know. Thanks.

@djbrooke

This comment has been minimized.

Copy link
Contributor

commented May 3, 2019

@jonc1438 @akio-sone @donsizemore @pdurbin please coordinate this with @scolapasta. Thanks!

@jonc1438

This comment has been minimized.

Copy link

commented May 3, 2019

@scolapasta

This comment has been minimized.

Copy link
Contributor

commented May 3, 2019

@pdurbin @jonc1438 I think a diagram could help us wrap our thoughts around this for our future discussions. Once you get started, let me know, and I can help add my understanding.

@djbrooke djbrooke added this to Community Dev 💻❤️ in IQSS/dataverse May 8, 2019

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.