[DataCap Application] NFT.Storage - NFT.Storage #2110

dchoi27 · 2023-07-25T03:02:44Z

Data Owner Name

NFT.Storage

What is your role related to the dataset

Data Preparer

Data Owner Country/Region

United States

Data Owner Industry

Life Science / Healthcare

Website

https://nft.storage

Social Media

https://twitter.com/NFTdotStorage

Total amount of DataCap being requested

15PiB

Expected size of single dataset (one copy)

500TiB and growing

Number of replicas to store

10

Weekly allocation of DataCap requested

250TiB

On-chain address for first allocation

f3watks6wyq5sakerofowyv7q4gwx4z6ukmfe2irh5zitspj6gpceudt3rrbvm5psofkcgoabev3s2mwtkcunq

Data Type of Application

Public, Open Commercial/Enterprise

Custom multisig

Use Custom Multisig

Identifier

No response

Share a brief history of your project and organization

NFT.Storage was created in 2021 to be an "Internet Archive" of NFTs, storing off-chain NFT data as a public good using the Filecoin network.

Is this project associated with other projects/ecosystem stakeholders?

Yes

If answered yes, what are the other projects/ecosystem stakeholders

This project is associated with Protocol Labs. Projects have plans for independence.

Describe the data being stored onto Filecoin

User uploaded data that, per the NFT.Storage Terms of Service (https://nft.storage/terms), must be legitimate off-chain NFT data. In addition, NFT.Storage is likely to scrape NFT data using on-chain references in the future.

Where was the data currently stored in this dataset sourced from

Other

If you answered "Other" in the previous question, enter the details here

User uploads

If you are a data preparer. What is your location (City and Country)

Seattle, WA

If you are a data preparer, how will the data be prepared? Please include tooling used and technical details?

The data preparer is DAG House, which builds client tools and runs infrastructure for NFT.Storage and web3.storage. Users upload CAR files directly, which are then aggregated into sector sized CAR files. Our client libraries do the CAR conversion for users. One example can be found here: https://github.com/web3-storage/w3up-cli

If you are not preparing the data, who will prepare the data? (Provide name and business)

No response

Has this dataset been stored on the Filecoin network before? If so, please explain and make the case why you would like to store this dataset again to the network. Provide details on preparation and/or SP distribution.

Sort of. We previously stored NFT.Storage data using the same Datacap wallet found here (https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/1838). As copies of data expire that were stored using this other wallet, we will use this wallet to re-up the number of replicas.

Please share a sample of the data

- https://ipfs.io/ipfs/bafybeid5jpdqzlb4tqsd6peoa7qstoxat3ovsg62wutyp4gnzqbqsggfsq
- https://ipfs.io/ipfs/bafybeihity6bx24npzvvkzopjbat25ekefjwmnshe7rvldy72dxngzf644
- https://ipfs.io/ipfs/bafybeicvcevx3ktiqjsfwnjguu4lnzejlhgb35brayuod5xdtn7demfdhe

Confirm that this is a public dataset that can be retrieved by anyone on the Network

I confirm

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Daily

For how long do you plan to keep this dataset stored on Filecoin

Permanently

In which geographies do you plan on making storage deals

Asia other than Greater China, Africa, North America, South America, Europe, Australia (continent)

How will you be distributing your data to storage providers

Cloud storage (i.e. S3)

How do you plan to choose storage providers

Others

If you answered "Others" in the previous question, what is the tool or platform you plan to use

We plan to use Spade for SP selection and deal execution. Spade is being developed by the Data Programs team at Protocol Labs (https://github.com/data-preservation-programs/spade) and supports storage client to SP mtching based on requirements like geography, size, retrievability, etc.

If you already have a list of storage providers to work with, fill out their names and provider IDs below

No response

How do you plan to make deals to your storage providers

Others/custom tool

If you answered "Others/custom tool" in the previous question, enter the details here

https://github.com/web3-storage/w3filecoin

Can you confirm that you will follow the Fil+ guideline

Yes

The text was updated successfully, but these errors were encountered:

large-datacap-requests · 2023-07-25T03:02:46Z

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!

kevzak · 2023-07-25T11:43:26Z

@dchoi27 the bot is confused here. How much DataCap are you requesting? Need a number. If its greater than 15PiB it will go through E-Fil+ pathway. Let me know.

dchoi27 · 2023-07-25T17:51:36Z

Got it - I changed to 15PiB. (note that greater than 15PiB is listed as an option in the issue creation form)

kevzak · 2023-07-25T18:24:22Z

Yes, if you need greater than 15PiB, we can add that. Just let me know the amount. Need to do it manually so that I am triggered to work with the large data client via E-Fil processes.

Seems like for now you have 500TiB x 10 copies so ~ 5 to 6 PiB needed?

Sunnyiscoming · 2023-07-30T06:35:01Z

Any update?

dchoi27 · 2023-07-31T00:33:38Z

@Sunnyiscoming what kind of update were you looking for?

ghost · 2023-07-31T12:36:25Z

@dchoi27 can you confirm answer to question above? #2110 (comment)

dchoi27 · 2023-07-31T18:24:22Z

This one? (think the comment was edited to include this question after i adjusted the application)

Seems like for now you have 500TiB x 10 copies so ~ 5 to 6 PiB needed?

The dataset is constantly growing because of new user uploads, so we were advised to submit an application for 15PiB (so we wouldn't need to keep submitting new applications)

kevzak · 2023-07-31T22:10:52Z

Datacap Request Trigger

Total DataCap requested

15PiB

Expected weekly DataCap usage rate

250TiB

Client address

f3watks6wyq5sakerofowyv7q4gwx4z6ukmfe2irh5zitspj6gpceudt3rrbvm5psofkcgoabev3s2mwtkcunq

large-datacap-requests · 2023-07-31T22:10:55Z

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f3watks6wyq5sakerofowyv7q4gwx4z6ukmfe2irh5zitspj6gpceudt3rrbvm5psofkcgoabev3s2mwtkcunq

DataCap allocation requested

125TiB

Id

d467872a-eb72-48c8-babb-26c195b92111

aggregation-and-compliance-bot · 2023-12-01T12:20:02Z

Client f01151139 does not follow the datacap usage rules. More info here.
This application has been failing the requirements for 7 days.
Please take appropiate action to fix the following DataCap usage problems.

Criteria	Treshold	Reason
Cid Checker score	> 25%	The client has a CID checker score of 0%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986

ghost · 2023-12-01T12:25:28Z

checker:manualTrigger

filplus-checker-app · 2023-12-01T12:26:11Z

DataCap and CID Checker Report Summary¹

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 96.35% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients²

⚠️ CID sharing has been observed. (Top 3)

669.34 TiB - f3ugiocmlvcaixff6gisjyi3nupy4l6bwlfbrqfe6
47y3urntcba2quri3v53hie4ad65fuydpiczgz2ol
gd5a - DAGHouse and the users of our tools
247.91 TiB - f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi - Textile
113.31 TiB - f3se4aw3p3tlvggkhsymdg7qmbjnxu4uudjvar6c3
scfwsge6voesbxff4lkoiqyjcl4yot7hxqmukhusx
gurq - DAGHouse and the users of our tools

Full report

Click here to view the CID Checker report.
Click here to view the Retrieval Dashboard.

To manually trigger this report, add a comment with text checker:manualTrigger ↩
To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ... ↩

aggregation-and-compliance-bot · 2023-12-09T00:12:47Z

Client f01151139 does not follow the datacap usage rules. More info here.
This application has been failing the requirements for 14 days.
Please take appropiate action to fix the following DataCap usage problems.

Criteria	Treshold	Reason
Cid Checker score	> 25%	The client has a CID checker score of 0%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986

aggregation-and-compliance-bot · 2023-12-16T00:12:34Z

Client f01151139 does not follow the datacap usage rules. More info here.
This application has been failing the requirements for 21 days.
Please take appropiate action to fix the following DataCap usage problems.

Criteria	Treshold	Reason
Cid Checker score	> 25%	The client has a CID checker score of 0%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986

aggregation-and-compliance-bot · 2023-12-23T00:13:10Z

Client f01151139 does not follow the datacap usage rules. More info here.
This application has been failing the requirements for 28 days.
Please take appropiate action to fix the following DataCap usage problems.

Criteria	Treshold	Reason
Cid Checker score	> 25%	The client has a CID checker score of 0%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986

aggregation-and-compliance-bot · 2023-12-30T00:13:15Z

Client f01151139 does not follow the datacap usage rules. More info here.
This application has been failing the requirements for 35 days.
Please take appropiate action to fix the following DataCap usage problems.

Criteria	Treshold	Reason
Cid Checker score	> 25%	The client has a CID checker score of 0%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986

aggregation-and-compliance-bot · 2024-01-06T12:13:16Z

Client f01151139 does not follow the datacap usage rules. More info here.
This application has been failing the requirements for 43 days.
Please take appropiate action to fix the following DataCap usage problems.

Criteria	Treshold	Reason
Cid Checker score	> 25%	The client has a CID checker score of 0%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986

aggregation-and-compliance-bot · 2024-01-13T12:14:10Z

Client f01151139 does not follow the datacap usage rules. More info here.
This application has been failing the requirements for 50 days.
Please take appropiate action to fix the following DataCap usage problems.

Criteria	Treshold	Reason
Cid Checker score	> 25%	The client has a CID checker score of 0%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986

elizabeth-griffiths · 2024-01-15T00:09:44Z

Hi - This is still active. Can you please advice the impact of failing requirements? Do you need anything from us?

…

On Sat, Jan 13, 2024 at 11:14 PM aggregation-and-compliance-bot[bot] < ***@***.***> wrote: Client f01151139 does not follow the datacap usage rules. More info here <filecoin-project/notary-governance#986>. This application has been failing the requirements for 50 days. Please take appropiate action to fix the following DataCap usage problems. Criteria Treshold Reason Cid Checker score > 25% The client has a CID checker score of 0%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986 <filecoin-project/notary-governance#986> — Reply to this email directly, view it on GitHub <#2110 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/A4YFHQPFRRTPQ7UAFETGRNTYOJ3B5AVCNFSM6AAAAAA2WNHBC6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOJQGQZTKMZSGY> . You are receiving this because you are subscribed to this thread.Message ID: <filecoin-project/filecoin-plus-large-datasets/issues/2110/1890435326@ github.com>

-- Elizabeth Griffiths ***@***.*** Product Manager NFT.Storage | Protocol Labs

aggregation-and-compliance-bot · 2024-01-21T00:13:41Z

Client f01151139 does not follow the datacap usage rules. More info here.
This application has been failing the requirements for 57 days.
Please take appropiate action to fix the following DataCap usage problems.

Criteria	Treshold	Reason
Cid Checker score	> 25%	The client has a CID checker score of 0%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986

aggregation-and-compliance-bot · 2024-01-28T00:13:47Z

Client f01151139 does not follow the datacap usage rules. More info here.
This application has been failing the requirements for 64 days.
Please take appropiate action to fix the following DataCap usage problems.

Criteria	Treshold	Reason
Cid Checker score	> 25%	The client has a CID checker score of 0%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986

aggregation-and-compliance-bot · 2024-02-04T00:14:04Z

Client f01151139 does not follow the datacap usage rules. More info here.
This application has been failing the requirements for 71 days.
Please take appropiate action to fix the following DataCap usage problems.

Criteria	Treshold	Reason
Cid Checker score	> 25%	The client has a CID checker score of 0%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986

aggregation-and-compliance-bot · 2024-02-11T12:13:13Z

Client f01151139 does not follow the datacap usage rules. More info here.
This application has been failing the requirements for 79 days.
Please take appropiate action to fix the following DataCap usage problems.

Criteria	Treshold	Reason
Cid Checker score	> 25%	The client has a CID checker score of 0%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986

aggregation-and-compliance-bot · 2024-02-19T00:13:48Z

Client f01151139 does not follow the datacap usage rules. More info here.
This application has been failing the requirements for 86 days.
Please take appropiate action to fix the following DataCap usage problems.

Criteria	Treshold	Reason
Cid Checker score	> 25%	The client has a CID checker score of 0%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986

aggregation-and-compliance-bot · 2024-02-26T00:13:53Z

Client f01151139 does not follow the datacap usage rules. More info here.
This application has been failing the requirements for 93 days.
Please take appropiate action to fix the following DataCap usage problems.

Criteria	Treshold	Reason
Cid Checker score	> 25%	The client has a CID checker score of 0%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986

aggregation-and-compliance-bot · 2024-03-04T00:14:17Z

Client f01151139 does not follow the datacap usage rules. More info here.
This application has been failing the requirements for 100 days.
Please take appropiate action to fix the following DataCap usage problems.

Criteria	Treshold	Reason
Cid Checker score	> 25%	The client has a CID checker score of 0%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986

aggregation-and-compliance-bot · 2024-03-11T12:17:45Z

Client f01151139 does not follow the datacap usage rules. More info here.
This application has been failing the requirements for 108 days.
Please take appropiate action to fix the following DataCap usage problems.

Criteria	Treshold	Reason
Cid Checker score	> 25%	The client has a CID checker score of 0%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986

aggregation-and-compliance-bot · 2024-03-19T00:15:10Z

Client f01151139 does not follow the datacap usage rules. More info here.
This application has been failing the requirements for 115 days.
Please take appropiate action to fix the following DataCap usage problems.

Criteria	Treshold	Reason
Cid Checker score	> 25%	The client has a CID checker score of 0%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986

aggregation-and-compliance-bot · 2024-03-26T12:16:36Z

Client f01151139 does not follow the datacap usage rules. More info here.
This application has been failing the requirements for 123 days.
Please take appropiate action to fix the following DataCap usage problems.

Criteria	Treshold	Reason
Cid Checker score	> 25%	The client has a CID checker score of 0%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986

aggregation-and-compliance-bot · 2024-04-02T12:17:15Z

Client f01151139 does not follow the datacap usage rules. More info here.
This application has been failing the requirements for 130 days.
Please take appropiate action to fix the following DataCap usage problems.

Criteria	Treshold	Reason
Cid Checker score	> 25%	The client has a CID checker score of 0%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986

aggregation-and-compliance-bot · 2024-04-09T12:18:59Z

Client f01151139 does not follow the datacap usage rules. More info here.
This application has been failing the requirements for 137 days.
Please take appropiate action to fix the following DataCap usage problems.

Criteria	Treshold	Reason
Cid Checker score	> 25%	The client has a CID checker score of 0%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986

aggregation-and-compliance-bot · 2024-04-17T00:15:11Z

Client f01151139 does not follow the datacap usage rules. More info here.
This application has been failing the requirements for 144 days.
Please take appropiate action to fix the following DataCap usage problems.

Criteria	Treshold	Reason
Cid Checker score	> 25%	The client has a CID checker score of 0%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986

large-datacap-requests bot added the data type: commercial public label Jul 25, 2023

large-datacap-requests bot assigned kevzak Jul 25, 2023

large-datacap-requests bot added efil+ designates that an application is going through additional upfront ID checks very large application For LDN applications over 5+ PiB labels Jul 25, 2023

dchoi27 mentioned this issue Jul 25, 2023

[DataCap Application] NFT.Storage #49

Closed

large-datacap-requests bot added the governance review needed label Jul 25, 2023

kevzak removed governance review needed efil+ designates that an application is going through additional upfront ID checks labels Jul 25, 2023

kevzak assigned galen-mcandrew, Kevin-FF-USA, Sunnyiscoming and raghavrmadya Jul 25, 2023

kevzak added the validated label Jul 25, 2023

large-datacap-requests bot added data type: commercial public very large application For LDN applications over 5+ PiB ready to sign and removed validated very large application For LDN applications over 5+ PiB data type: commercial public labels Jul 31, 2023

filecoin-project deleted a comment Jul 31, 2023

large-datacap-requests bot added data type: commercial public verified client very large application For LDN applications over 5+ PiB granted and removed verified client very large application For LDN applications over 5+ PiB data type: commercial public labels Nov 23, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[DataCap Application] NFT.Storage - NFT.Storage #2110

[DataCap Application] NFT.Storage - NFT.Storage #2110

dchoi27 commented Jul 25, 2023 •

edited

large-datacap-requests bot commented Jul 25, 2023

kevzak commented Jul 25, 2023

dchoi27 commented Jul 25, 2023 •

edited

kevzak commented Jul 25, 2023 •

edited

Sunnyiscoming commented Jul 30, 2023

dchoi27 commented Jul 31, 2023

ghost commented Jul 31, 2023

dchoi27 commented Jul 31, 2023

kevzak commented Jul 31, 2023

large-datacap-requests bot commented Jul 31, 2023

aggregation-and-compliance-bot bot commented Dec 1, 2023

ghost commented Dec 1, 2023

filplus-checker-app bot commented Dec 1, 2023

aggregation-and-compliance-bot bot commented Dec 9, 2023

aggregation-and-compliance-bot bot commented Dec 16, 2023

aggregation-and-compliance-bot bot commented Dec 23, 2023

aggregation-and-compliance-bot bot commented Dec 30, 2023

aggregation-and-compliance-bot bot commented Jan 6, 2024

aggregation-and-compliance-bot bot commented Jan 13, 2024

elizabeth-griffiths commented Jan 15, 2024 via email

aggregation-and-compliance-bot bot commented Jan 21, 2024

aggregation-and-compliance-bot bot commented Jan 28, 2024

aggregation-and-compliance-bot bot commented Feb 4, 2024

aggregation-and-compliance-bot bot commented Feb 11, 2024

aggregation-and-compliance-bot bot commented Feb 19, 2024

aggregation-and-compliance-bot bot commented Feb 26, 2024

aggregation-and-compliance-bot bot commented Mar 4, 2024

aggregation-and-compliance-bot bot commented Mar 11, 2024

aggregation-and-compliance-bot bot commented Mar 19, 2024

aggregation-and-compliance-bot bot commented Mar 26, 2024

aggregation-and-compliance-bot bot commented Apr 2, 2024

aggregation-and-compliance-bot bot commented Apr 9, 2024

aggregation-and-compliance-bot bot commented Apr 17, 2024

[DataCap Application] NFT.Storage - NFT.Storage #2110

[DataCap Application] NFT.Storage - NFT.Storage #2110

Comments

dchoi27 commented Jul 25, 2023 • edited

Data Owner Name

What is your role related to the dataset

Data Owner Country/Region

Data Owner Industry

Website

Social Media

Total amount of DataCap being requested

Expected size of single dataset (one copy)

Number of replicas to store

Weekly allocation of DataCap requested

On-chain address for first allocation

Data Type of Application

Custom multisig

Identifier

Share a brief history of your project and organization

Is this project associated with other projects/ecosystem stakeholders?

If answered yes, what are the other projects/ecosystem stakeholders

Describe the data being stored onto Filecoin

Where was the data currently stored in this dataset sourced from

If you answered "Other" in the previous question, enter the details here

If you are a data preparer. What is your location (City and Country)

If you are a data preparer, how will the data be prepared? Please include tooling used and technical details?

If you are not preparing the data, who will prepare the data? (Provide name and business)

Has this dataset been stored on the Filecoin network before? If so, please explain and make the case why you would like to store this dataset again to the network. Provide details on preparation and/or SP distribution.

Please share a sample of the data

Confirm that this is a public dataset that can be retrieved by anyone on the Network

If you chose not to confirm, what was the reason

What is the expected retrieval frequency for this data

For how long do you plan to keep this dataset stored on Filecoin

In which geographies do you plan on making storage deals

How will you be distributing your data to storage providers

How do you plan to choose storage providers

If you answered "Others" in the previous question, what is the tool or platform you plan to use

If you already have a list of storage providers to work with, fill out their names and provider IDs below

How do you plan to make deals to your storage providers

If you answered "Others/custom tool" in the previous question, enter the details here

Can you confirm that you will follow the Fil+ guideline

large-datacap-requests bot commented Jul 25, 2023

kevzak commented Jul 25, 2023

dchoi27 commented Jul 25, 2023 • edited

kevzak commented Jul 25, 2023 • edited

Sunnyiscoming commented Jul 30, 2023

dchoi27 commented Jul 31, 2023

ghost commented Jul 31, 2023

dchoi27 commented Jul 31, 2023

kevzak commented Jul 31, 2023

Datacap Request Trigger

Total DataCap requested

Expected weekly DataCap usage rate

Client address

large-datacap-requests bot commented Jul 31, 2023

DataCap Allocation requested

Multisig Notary address

Client address

DataCap allocation requested

Id

aggregation-and-compliance-bot bot commented Dec 1, 2023

ghost commented Dec 1, 2023

filplus-checker-app bot commented Dec 1, 2023

DataCap and CID Checker Report Summary1

Storage Provider Distribution

Deal Data Replication

Deal Data Shared with other Clients2

Full report

Footnotes

aggregation-and-compliance-bot bot commented Dec 9, 2023

aggregation-and-compliance-bot bot commented Dec 16, 2023

aggregation-and-compliance-bot bot commented Dec 23, 2023

aggregation-and-compliance-bot bot commented Dec 30, 2023

aggregation-and-compliance-bot bot commented Jan 6, 2024

aggregation-and-compliance-bot bot commented Jan 13, 2024

elizabeth-griffiths commented Jan 15, 2024 via email

aggregation-and-compliance-bot bot commented Jan 21, 2024

aggregation-and-compliance-bot bot commented Jan 28, 2024

aggregation-and-compliance-bot bot commented Feb 4, 2024

aggregation-and-compliance-bot bot commented Feb 11, 2024

dchoi27 commented Jul 25, 2023 •

edited

dchoi27 commented Jul 25, 2023 •

edited

kevzak commented Jul 25, 2023 •

edited

DataCap and CID Checker Report Summary¹

Deal Data Shared with other Clients²