Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Many File Open Issue : Spring Boot 2.3.0 -> Spring Boot 2.3.1 #21934

Closed
harutobi opened this issue Jun 16, 2020 · 6 comments
Closed

Many File Open Issue : Spring Boot 2.3.0 -> Spring Boot 2.3.1 #21934

harutobi opened this issue Jun 16, 2020 · 6 comments
Labels
status: duplicate A duplicate of another issue

Comments

@harutobi
Copy link

harutobi commented Jun 16, 2020

I recently upgraded 2.3.0.RELEASE to 2.3.1.RELEASE. (1 days ago)
However, an oddity was discovered in which FileOpen occupancy rapidly increased
I checked through 'lsof' command in the linux terminal, but a lot of 'socket' was found.

(1 process file open count limit over : 65535..)
java      10307 account *505u     sock                0,7       0t0 148421069 protocol: TCP
java      10307 account *506u     sock                0,7       0t0 148416289 protocol: TCP
java      10307 account *507u     sock                0,7       0t0 148416293 protocol: TCP
java      10307 account *508u     sock                0,7       0t0 148421073 protocol: TCP
java      10307 account *509u     sock                0,7       0t0 148421070 protocol: TCP
java      10307 account *510u     sock                0,7       0t0 148421075 protocol: TCP
java      10307 account *511u     sock                0,7       0t0 148416300 protocol: TCP
java      10307 account *512u     sock                0,7       0t0 148416298 protocol: TCP
java      10307 account *513u     sock                0,7       0t0 148416313 protocol: TCP
java      10307 account *514u     sock                0,7       0t0 148421098 protocol: TCP
ErrorCallbackNotImplemented: io.netty.channel.ChannelException: io.netty.channel.unix.Errors$NativeIoException: newSocketStream(..) failed: Too many open files
ChannelException: io.netty.channel.unix.Errors$NativeIoException: newSocketStream(..) failed: Too many open files
    at io.netty.channel.unix.Socket.newSocketStream0(Socket.java:421)
    at io.netty.channel.epoll.LinuxSocket.newSocketStream(LinuxSocket.java:319)
    at io.netty.channel.epoll.LinuxSocket.newSocketStream(LinuxSocket.java:323)
    at io.netty.channel.epoll.EpollSocketChannel.<init>(EpollSocketChannel.java:45)
    at reactor.netty.resources.DefaultLoopEpoll.getChannel(DefaultLoopEpoll.java:45)
...
(36 additional frame(s) were not displayed)

NativeIoException: newSocketStream(..) failed: Too many open files

<Before: SpringBoot 2.3.0>

  • FileOpen Size : 100 (average)

<After: SpringBoot 2.3.1>

  • FileOpen Size Over Flow : 65535 (ulimit open size)

There is no problem until 2.3.0. If you upgrade the version to 2.3.1, a problem occurs.
after downgrade version to 2.3.0, file open problem solved.

@spring-projects-issues spring-projects-issues added the status: waiting-for-triage An issue we've not yet triaged label Jun 16, 2020
@harutobi harutobi changed the title Spring Boot 3.3.0 -> Spring Boot 3.3.1 Many File Open Issue : Spring Boot 3.3.0 -> Spring Boot 3.3.1 Jun 16, 2020
@harutobi harutobi changed the title Many File Open Issue : Spring Boot 3.3.0 -> Spring Boot 3.3.1 Many File Open Issue : Spring Boot 2.3.0 -> Spring Boot 2.3.1 Jun 16, 2020
@bclozel
Copy link
Member

bclozel commented Jun 16, 2020

This looks a lot like #21923

Could you try and downgrade the Netty tcnative dependency as suggested in the other issue and report back here with your findings?

Thanks!

@bclozel bclozel added the status: waiting-for-feedback We need additional information before we can continue label Jun 16, 2020
@bclozel
Copy link
Member

bclozel commented Jun 16, 2020

This seems to be caused by reactor/reactor-netty#1152

Could you try overriding the reactor-netty dependency to the latest 0.9.9.BUILD-SNAPSHOT and this if this fixes the issue?

Thanks!

@snicoll
Copy link
Member

snicoll commented Jun 16, 2020

You can override reactor-bom.version to Dysprosium-BUILD-SNAPSHOT. We've also switched Spring Boot 2.3.2.BUILD-SNAPSHOT to use this version by default so in half an hour you could just switch your build to 2.3.2.BUILD-SNAPSHOT.

@harutobi
Copy link
Author

harutobi commented Jun 16, 2020

@bclozel @snicoll
Thank you for answer.
I solved from dependency override that io.projectreactor.netty
0.9.7.RELEASE and 0.9.9.BUILD-SNAPSHOT.

@bclozel
Copy link
Member

bclozel commented Jun 16, 2020

Downgrading is not fixing the problem, but rather a temporary workaround.

Unless you expect being stuck on that particular reactor netty version forever, testing the version shipping the snapshot would really help the team confirm that this problem is fixed.

Thanks

@spring-projects-issues spring-projects-issues added status: feedback-provided Feedback has been provided and removed status: waiting-for-feedback We need additional information before we can continue labels Jun 16, 2020
@harutobi harutobi reopened this Jun 16, 2020
@bclozel bclozel added status: waiting-for-feedback We need additional information before we can continue and removed status: feedback-provided Feedback has been provided labels Jun 16, 2020
@bclozel
Copy link
Member

bclozel commented Jun 16, 2020

Since 0.9.9 fixed the issue, I'm closing this as a duplicate of #21923

@bclozel bclozel closed this as completed Jun 16, 2020
@bclozel bclozel added status: duplicate A duplicate of another issue and removed status: waiting-for-feedback We need additional information before we can continue status: waiting-for-triage An issue we've not yet triaged labels Jun 16, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
status: duplicate A duplicate of another issue
Projects
None yet
Development

No branches or pull requests

4 participants