Open
Description
The behaviour is confusing but does not cause any issue with execution itself. A user can call import-data multiple times and there is no check to ensure that file path does not change in the middle of the deal. This cause some incorrect logging.
The API should always return an error except:
- When
ds.InboundFilePath
is "" - Deal is in error retry state (to allow user do over in case of supplying incorrect file)
=== Deal 27f6c3ea-8d4a-4661-8a19-d2fe27d1da3c ===
CreatedAt: 2023-05-05 19:10:06.900 (1h ago)
Client Address: f01131298
Client Peer ID: 12D3KooWBy5MM3zGz54QHmimwg72xYiYXUcAuHJWGoh8skzR2NaQ
Signed Proposal CID: bafyreic6zo63ukxpe6tfzkctadu2jofcf5nqfvn6sfosmb5rs4zi7aqto4
Deal Data Root CID: baga6ea4seaqpwcu65urhgwynkkwfofkhlwb7yc3ruzgcvjr5tfz2jfm6oftrcei
Verified: Yes
Keep Unsealed Copy: Yes
Announce To IPNI: Yes
Piece CID: baga6ea4seaqpwcu65urhgwynkkwfofkhlwb7yc3ruzgcvjr5tfz2jfm6oftrcei
Piece Size: 16 GiB (17,179,869,184 bytes)
Client Collateral: 0 atto
Provider Collateral: 0.008 FIL
Storage Price / epoch / GiB: 0 atto
Current Epoch: 2,833,085
Start Epoch: 2,841,558 (in 3 days)
End Epoch: 4,373,718 (in a year)
Duration: 1,532,160 (532 days)
Storage Fee: 0 atto (Price per epoch x Piece Size x Duration)
Transfer Mode: Offline
Transfer Size: 0 B (0 bytes)
Transferred: 0 B (0 bytes)
Inbound File Path: /home/nonsense/EOT20-20210322160330-crawl865-0.car
Delete After Add Piece: Yes
Sector ID: 1610
Sector Data Offset: 0
Sector Data Length: 17,179,869,184
Publish Message CID: bafy2bzaceb7h7ypks3ujlqqq3zfassbh5lbjxfxx3fvffyyb44oy7a2ngmhg6
Chain Deal ID: 35,269,823
Checkpoint: IndexedAndAnnounced (32m ago)
Status: Sealer: SnapDealsWaitDeals
=== Logs ===
2023-05-05 19:10:06.873: executing deal proposal received from network
{
"peer": "12D3KooWBy5MM3zGz54QHmimwg72xYiYXUcAuHJWGoh8skzR2NaQ"
}
2023-05-05 19:10:06.888: processing deal acceptance request
2023-05-05 19:10:06.902: offline deal accepted, waiting for data import
2023-05-05 19:44:40.029: import data for offline deal
{
"filepath": "/home/nonsense/EOT20-20210322160330-crawl865-0.car",
"delete after import": true
}
2023-05-05 19:44:40.031: processing deal acceptance request
2023-05-05 19:44:40.039: tagged funds for deal
{
"tagged for deal publish": "0",
"tagged for deal collateral": "8033818012850560",
"total tagged for publish": "0",
"total tagged for collateral": "8033818012850560",
"total available for publish": "29880110687062780855",
"total available for collateral": "9967535260492120417"
}
2023-05-05 19:44:40.040: offline deal data imported and deal scheduled for execution
2023-05-05 19:44:40.040: deal execution initiated
{
"deal state": {
"DealUuid": "27f6c3ea-8d4a-4661-8a19-d2fe27d1da3c",
"CreatedAt": "2023-05-05T09:40:06.900469606-04:00",
"ClientDealProposal": {
"Proposal": {
"PieceCID": {
"/": "baga6ea4seaqpwcu65urhgwynkkwfofkhlwb7yc3ruzgcvjr5tfz2jfm6oftrcei"
},
"PieceSize": 17179869184,
"VerifiedDeal": true,
"Client": "f01131298",
"Provider": "f01953925",
"Label": "EOT20-20210322160330-crawl865",
"StartEpoch": 2841558,
"EndEpoch": 4373718,
"StoragePricePerEpoch": "0",
"ProviderCollateral": "8033818012850560",
"ClientCollateral": "0"
},
"ClientSignature": {
"Type": 0,
"Data": null
}
},
"IsOffline": true,
"CleanupData": true,
"ClientPeerID": "12D3KooWBy5MM3zGz54QHmimwg72xYiYXUcAuHJWGoh8skzR2NaQ",
"DealDataRoot": {
"/": "baga6ea4seaqpwcu65urhgwynkkwfofkhlwb7yc3ruzgcvjr5tfz2jfm6oftrcei"
},
"InboundFilePath": "/home/nonsense/EOT20-20210322160330-crawl865-0.car", <------ Original path
"Transfer": {
"Type": "",
"ClientID": "",
"Params": null,
"Size": 0
},
"ChainDealID": 0,
"PublishCID": null,
"SectorID": 0,
"Offset": 0,
"Length": 0,
"Checkpoint": 0,
"CheckpointAt": "2023-05-05T09:40:06.900469817-04:00",
"Err": "",
"Retry": "auto",
"NBytesReceived": 0,
"FastRetrieval": true,
"AnnounceToIPNI": true
}
}
2023-05-05 19:44:40.048: size of imported offline deal file
{
"filepath": "/home/nonsense/EOT20-20210322160330-crawl865-0.car",
"size": 9922534466
}
2023-05-05 19:44:40.049: deal execution in progress
2023-05-05 19:44:40.049: checking commP
2023-05-05 19:45:07.325: import data for offline deal
{
"filepath": "/home/nonsense/go1.20.3.linux-amd64.tar.gz", <------ Modified path mid execution
"delete after import": true
}
2023-05-05 19:45:07.327: processing deal acceptance request
2023-05-05 19:45:07.334: tagged funds for deal
{
"tagged for deal publish": "0",
"tagged for deal collateral": "8033818012850560",
"total tagged for publish": "0",
"total tagged for collateral": "16067636025701120",
"total available for publish": "29880110687062780855",
"total available for collateral": "9959501442479269857"
}
2023-05-05 19:45:07.335: offline deal data imported and deal scheduled for execution
2023-05-05 19:45:23.521: commp matched successfully for imported data for offline deal
2023-05-05 19:45:23.523: updated deal checkpoint in DB
{
"old checkpoint": "Accepted",
"new checkpoint": "Transferred"
}
2023-05-05 19:45:23.526: sending deal to deal publisher
2023-05-05 19:45:58.726: import data for offline deal
{
"filepath": "/home/nonsense/EOT20-20210322160330-crawl865-0.car", <------ Modified path mid execution
"delete after import": true
}
2023-05-05 19:48:28.851: import data for offline deal
{
"filepath": "/home/nonsense/go1.20.3.linux-amd64.tar.gz", <------ Modified path mid execution
"delete after import": true
}
2023-05-05 19:54:04.324: updated deal checkpoint in DB
{
"old checkpoint": "Transferred",
"new checkpoint": "Published"
}
2023-05-05 19:54:04.325: deal published successfully, will await deal publish confirmation
2023-05-05 19:54:04.326: awaiting deal publish confirmation
2023-05-05 20:00:29.769: deal publish confirmed
2023-05-05 20:00:29.772: updated deal checkpoint in DB
{
"old checkpoint": "Published",
"new checkpoint": "PublishConfirmed"
}
2023-05-05 20:00:29.773: deal successfully published and confirmed-publish
2023-05-05 20:00:29.776: funds successfully untagged for deal after publish
2023-05-05 20:00:29.778: add piece called
2023-05-05 20:01:11.605: added new deal to sector
{
"sector": "1610"
}
2023-05-05 20:01:11.607: deal successfully handed to the sealing subsystem
{
"sectorNum": "1610",
"offset": 0,
"length": 17179869184
}
2023-05-05 20:01:11.610: updated deal checkpoint in DB
{
"old checkpoint": "PublishConfirmed",
"new checkpoint": "AddedPiece"
}
2023-05-05 20:01:12.340: deal successfully handed over to the sealing subsystem
2023-05-05 20:01:13.471: removed piece data from disk as deal has been added to a sector
{
"path": "/home/nonsense/EOT20-20210322160330-crawl865-0.car" <------ Looks like correct file was removed
}
2023-05-05 20:01:13.476: untagged storage space
2023-05-05 20:01:13.477: storage space successfully untagged for deal after it was handed to sealer
2023-05-05 20:01:27.351: deal successfully added to piece metadata store
2023-05-05 20:01:27.493: announced deal to network indexer
{
"announcement-cid": {
"/": "baguqeerafhtn4vfv34wy5jgax5t4kebcp6ol7mrvc2izxdqrnnasak3zczcq"
}
}
2023-05-05 20:01:27.495: updated deal checkpoint in DB
{
"old checkpoint": "AddedPiece",
"new checkpoint": "IndexedAndAnnounced"
}
2023-05-05 20:01:27.496: deal successfully indexed and announced
2023-05-05 20:01:27.497: cleaning up deal
2023-05-05 20:01:27.497: deal finished
2023-05-05 20:01:27.498: finished cleaning up deal
2023-05-05 20:01:27.499: finished deal cleanup after successful execution
2023-05-05 20:01:27.500: watching deal sealing state changes
2023-05-05 20:01:27.502: current sealing state
{
"state": "SnapDealsWaitDeals"
}
Metadata
Metadata
Assignees
Labels
Type
Projects
Status
No status