New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
RE: upload cancelled with "stream error: stream no longer needed" #563
Comments
So I don't know if this is the cause of this specific error, but symlinks in sources are basically completely unsupported. They sometimes kind of work, but you're in basically untested ground here so I'm not surprised that something has broken. We do support symlinks in outputs, depending on what exactly it is you're doing it's possible that that may offer a path to working around this limitation |
Thanks for your quick response!
OK, fair enough. In this case it seems to indicate a problem with handling the http2 responses gracefully. I would guess that the upstream server "sees" that some files are already uploaded and replies with cancelling the stream, which just should be ignored perhaps?!
The same problem turns up when we use the output of |
Oof, yeah this sounds very likely to be a bug. This probably requires figuring out exactly what the buck2-RE communication looks like and which of the two is out of spec (guessing that it's us is a good default). I think we probably have logging that can help with that? |
I turned up logging for grpc calls in the bazel-remote-worker (it's explicitly disabled in code in order to avoid "Received DATA frame for an unknown stream 1521" error messages) and got this:
The maximum batch size is set to 4 * 1000 * 1000. I don't know why the message is so much larger than that limit. Maybe it's because symlinks are involved? |
Oh, it's probably just because of the overhead. For each datum, there are at least 72 extra Bytes needed to transmit the hash and the compressor enum value. For one example request that I looked at, there were 7410 entries in one batch; which already adds up to 533520 Bytes. Plus a few Bytes needed for encoding every element of the We have increased the max inbound message size for the bazel-remote-worker to an arbitrarily high number in order to workaround that issue and have not seen this error again. Closing, since I think nothing is to be done here. |
For the following
BUCK
file:when using remote execution (we are currently using the bazel-remote-worker locally) we see the following error:
This seems to be related to the structure of the srcs of the filegroup since the
public
folder contains symlinks into thesrc
folder:After removing either
public/icons
orpublic/webfonts
, the upload succeeds. And once it succeeded, it also succeeds when the symlinks are restored:Also, I noticed that the symlinks are not preserved in the
buck-out/v2/gen/root/524f8da68ea2a374/frontend/__assest__
directory:Is this to be expected?
BTW, I am using
buck2 aa5cc9e36218b3afcad06608d91f9e8baa1d5c88e0b2a2f561b1b695a320afc7
, the 2024-01-02 pre-release.cc: @aherrmann
The text was updated successfully, but these errors were encountered: