client-nd: request status INTERNAL returned

[vanphandinh]

Celestia Node version

v0.8.2

OS

Ubuntu 22.04.2 LTS

Install tools

Docker

Others

No response

Steps to reproduce it

1. Build the latest version of celestia-node docker image
2. Run a light node with the same key with my old bridge node
3. Build the latest version of celestiaorg/ethermint docker image
4. Run ethermint connected to the light node

Expected result

No ERROR

Actual result

2023-04-06T15:49:31.731Z ERROR shrex/nd shrexnd/client.go:195 client-nd: request status INTERNAL returned
2023-04-06T15:49:34.790Z ERROR shrex/nd shrexnd/client.go:195 client-nd: request status INTERNAL returned

Relevant log output

No response

Notes

I still don't know how to reproduce this error again. A just note what I did.

[vanphandinh]

I have found how to reproduce that bug.

When I tried to delete the ethermint container: docker rm -f ethermint and recreate it again with the same NAMESPACE_ID and DA_BLOCK_HEIGHT, that error occurred. If I recreate that container with the different NAMESPACE_ID and DA_BLOCK_HEIGHT, there's nothing in celestial-node and for sure, we have the same errors in ethermint.

Ethermint:

Celestia-node:

[jcstein]

I'm seeing something similar, related to fetching data from the celestia light node, on my rollup:

4:33PM ERR failed to retrieve block from DALC daHeight=226223 errors="failed to retrieve block: Get \"http://localhost:26659/namespaced_data/b705585f236712ed/height/226223\": context deadline exceeded (Client.Timeout exceeded while awaiting headers); failed to retrieve block: Get \"http://localhost:26659/namespaced_data/b705585f236712ed/height/226223\": context deadline exceeded (Client.Timeout exceeded while awaiting headers); failed to retrieve block: Get \"http://localhost:26659/namespaced_data/b705585f236712ed/height/226223\": context deadline exceeded (Client.Timeout exceeded while awaiting headers); failed to retrieve block: Get \"http://localhost:26659/namespaced_data/b705585f236712ed/height/226223\": context deadline exceeded (Client.Timeout exceeded while awaiting headers); failed to retrieve block: Get \"http://localhost:26659/namespaced_data/b705585f236712ed/height/226223\": context deadline exceeded (Client.Timeout exceeded while awaiting headers); failed to retrieve block: Get \"http://localhost:26659/namespaced_data/b705585f236712ed/height/226223\": context deadline exceeded (Client.Timeout exceeded while awaiting headers); failed to retrieve block: Get \"http://localhost:26659/namespaced_data/b705585f236712ed/height/226223\": context deadline exceeded (Client.Timeout exceeded while awaiting headers); failed to retrieve block: Get \"http://localhost:26659/namespaced_data/b705585f236712ed/height/226223\": context deadline exceeded (Client.Timeout exceeded while awaiting headers); failed to retrieve block: Get \"http://localhost:26659/namespaced_data/b705585f236712ed/height/226223\": context deadline exceeded (Client.Timeout exceeded while awaiting headers); failed to retrieve block: Get \"http://localhost:26659/namespaced_data/b705585f236712ed/height/226223\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" module=BlockManager

[walldiss]

Closing as duplicate of #2044