Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Azure Storage Data Lake listFileSystem operation causes an infinte loop of requests #2304

Closed
ppalaga opened this issue Mar 2, 2021 · 1 comment · Fixed by #2322
Closed

Comments

@ppalaga
Copy link
Contributor

ppalaga commented Mar 2, 2021

Rel. #2289

Calling azure-storage-datalake:cameltesting?operation=listFileSystem causes the following flood of requests:

2021-03-02 14:04:55,301 INFO  [com.azu.sto.blo.imp.Ser.listBlobContainersSegment] (parallel-3) --> GET https://cqaccpeterpalagap1.blob.core.windows.net?comp=REDACTED(empty body)--> END GET
2021-03-02 14:04:55,363 INFO  [com.azu.sto.blo.imp.Ser.listBlobContainersSegment] (reactor-http-epoll-1) <-- 200 https://cqaccpeterpalagap1.blob.core.windows.net?comp=REDACTED (61 ms, unknown-length body)(body content not logged)<-- END HTTP
2021-03-02 14:04:55,418 INFO  [com.azu.sto.blo.imp.Ser.listBlobContainersSegment] (parallel-5) --> GET https://cqaccpeterpalagap1.blob.core.windows.net?marker=REDACTED&comp=REDACTED(empty body)--> END GET
2021-03-02 14:04:55,487 INFO  [com.azu.sto.blo.imp.Ser.listBlobContainersSegment] (reactor-http-epoll-1) <-- 200 https://cqaccpeterpalagap1.blob.core.windows.net?marker=REDACTED&comp=REDACTED (69 ms, unknown-length body)(body content not logged)<-- END HTTP
2021-03-02 14:04:55,493 INFO  [com.azu.sto.blo.imp.Ser.listBlobContainersSegment] (parallel-7) --> GET https://cqaccpeterpalagap1.blob.core.windows.net?marker=REDACTED&comp=REDACTED(empty body)--> END GET
...

Steps to reproduce:

  1. Open AzureStorageDatalakeTest
  2. Find the two occurrences of the URL of this issue, uncomment the blocks below

Expected: the test should pass
Actual: the above sequence of messages is repeated in the log until one cancels the Maven execution on the command line

@ppalaga
Copy link
Contributor Author

ppalaga commented Mar 5, 2021

This turns out to be a duplicate of #2207 and Azure/azure-sdk-for-java#18876 . I have posted a reproducer in Azure/azure-sdk-for-java#18876 .

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant