Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DataCap Application] Solana Lab. - store snapshots in Filecoin #923

Closed
pieceofr opened this issue Sep 5, 2022 · 207 comments
Closed

[DataCap Application] Solana Lab. - store snapshots in Filecoin #923

pieceofr opened this issue Sep 5, 2022 · 207 comments

Comments

@pieceofr
Copy link

pieceofr commented Sep 5, 2022


name: Large Dataset Notary application
about: Clients should use this application form to request a DataCap allocation via a LDN for a dataset
title: "[DataCap Application] Solana Lab. - store snapshots in Filecoin"
labels: 'application, Phase: Diligence'
assignees: ''


Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

  • Organization Name: Solana Lab.
  • Website / Social Media: https://solana.com/ (this is for Solana Lab. & Solana Foundation)
  • Total amount of DataCap being requested (between 500 TiB and 5 PiB): 3.4 PiB
  • Weekly allocation of DataCap requested (usually between 1-100TiB): 50TiB
  • On-chain address for first allocation: f1xw7jxdldohcdu4ec4a5mcnbtvutyjptawojmuzy

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

Solana is a public L1 blockchain. 
Here is the official history page: https://docs.solana.com/history
The project is to store solana snapshots it has produced and the snapshots it will produce in Filecoin network.

What is the primary source of funding for this project?

Solana Lab.

What other projects/ecosystem stakeholders is this project associated with?

solana ecosystem: https://solana.com/ecosystem

Use-case details

Describe the data being stored onto Filecoin

Snapshots are compressed tar archives which store a copy of solana-accounts at a given slot.
Solana warehouse node generates snapshots hourly and in the end of epoch it produces a folder  contains all snapshots of a epoch period.

Where was the data in this dataset sourced from?

A special kind of solana validator called warehouse node produces snapshots. 
The warehouse node generates snapshots and uploads them to a storage every solana-epoch time.

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this.

If you have aws account. 
https://s3.console.aws.amazon.com/s3/buckets/filecoin-snapshot-test?region=ap-southeast-1&tab=objects
download address:
s3://filecoin-snapshot-test

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

Yes. This is a public dataset.

What is the expected retrieval frequency for this data?

less than  5 times per month.

For how long do you plan to keep this dataset stored on Filecoin?

We plan to keep dataset as long as possible unless unavoidable situation. For example, cost of storage is unaffordable.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

Diverse regions and countries are prefered. 

How will you be distributing your data to storage providers? Is there an offline data transfer process?

Prefer online process. 

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

We plan to have 5 replicas and plan to find 5 providers. 

How will you be distributing deals across storage providers?

We are trying possible methods with 2 providers and will find more providers.

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

Solana Lab. will fund the project to store solana snapshots in Filecoin network.
Onboarding documents have been received from Filecoin experts.

@large-datacap-requests
Copy link

Thanks for your request!
Everything looks good. 👌

A Governance Team member will review the information provided and contact you back pretty soon.

@pieceofr pieceofr changed the title [DataCap Application] <Organization> - <Project Name> [DataCap Application] <Solana Lab.> - <store snapshots in Filecoin> Sep 5, 2022
@large-datacap-requests
Copy link

Thanks for your request!
Everything looks good. 👌

A Governance Team member will review the information provided and contact you back pretty soon.

@pieceofr pieceofr changed the title [DataCap Application] <Solana Lab.> - <store snapshots in Filecoin> [DataCap Application] Solana Lab. - store snapshots in Filecoin Sep 5, 2022
@large-datacap-requests
Copy link

Thanks for your request!
Everything looks good. 👌

A Governance Team member will review the information provided and contact you back pretty soon.

@large-datacap-requests
Copy link

Thanks for your request!
Everything looks good. 👌

A Governance Team member will review the information provided and contact you back pretty soon.

@large-datacap-requests
Copy link

Thanks for your request!
Everything looks good. 👌

A Governance Team member will review the information provided and contact you back pretty soon.

@flyworker
Copy link

flyworker commented Sep 5, 2022

As a notary of North America, we want to know if the issue create by Solona core team or ecosystem?
Thanks

@filplus-checker-app
Copy link

DataCap and CID Checker Report Summary1

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 43.05% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients2

⚠️ CID sharing has been observed. (Top 3)

Full report

Click here to view the CID Checker report.
Click here to view the Retrieval Dashboard.

Footnotes

  1. To manually trigger this report, add a comment with text checker:manualTrigger

  2. To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Copy link

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedtibueyd4kihrmlojatonvbjytwnwihu3lpkkls4nlgmc5dvdl44

Address

f1xw7jxdldohcdu4ec4a5mcnbtvutyjptawojmuzy

Datacap Allocated

81.59TiB

Signer Address

f1tbd632f6w62glfaf7wjpimacbnjiz26poyoes2q

Id

f59213b2-e969-4bec-ad94-095ca0aed08e

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedtibueyd4kihrmlojatonvbjytwnwihu3lpkkls4nlgmc5dvdl44

Copy link

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacednwawf52ez5jrbhuuciie5ca4ih5pavvcg3pvsfctgvlckvjeeos

Address

f1xw7jxdldohcdu4ec4a5mcnbtvutyjptawojmuzy

Datacap Allocated

81.59TiB

Signer Address

f1q6bpjlqia6iemqbrdaxr2uehrhpvoju3qh4lpga

Id

f59213b2-e969-4bec-ad94-095ca0aed08e

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacednwawf52ez5jrbhuuciie5ca4ih5pavvcg3pvsfctgvlckvjeeos

Copy link

DataCap Allocation requested

Request number 16

Multisig Notary address

f02049625

Client address

f1xw7jxdldohcdu4ec4a5mcnbtvutyjptawojmuzy

DataCap allocation requested

81.59TiB

Id

13080e78-7473-4762-87d5-ca854b49dfea

@herrehesse
Copy link

checker:manualTrigger

Copy link

DataCap and CID Checker Report Summary1

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 43.05% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients2

⚠️ CID sharing has been observed. (Top 3)

Full report

Click here to view the CID Checker report.
Click here to view the Retrieval Dashboard.

Footnotes

  1. To manually trigger this report, add a comment with text checker:manualTrigger

  2. To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

@herrehesse
Copy link

Screenshot 2023-11-14 at 09 54 27

Selfdealing in this application, again, abusive notaries are signing. Applicant not from solana labs most likely.

@herrehesse
Copy link

@kevzak Can you close this LDN?

Copy link

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

--
Commented by Stale Bot.

Copy link

DataCap and CID Checker Report Summary1

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 43.05% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients2

⚠️ CID sharing has been observed. (Top 3)

Full report

Click here to view the CID Checker report.
Click here to view the Retrieval Dashboard.

Footnotes

  1. To manually trigger this report, add a comment with text checker:manualTrigger

  2. To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Copy link

github-actions bot commented Dec 6, 2023

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

--
Commented by Stale Bot.

Copy link

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to contact the Fil+ Gov team to re-open the application if it is still being processed. Thank you!

--
Commented by Stale Bot.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests