Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FreeBSD write to network: Input/output error with jumbo frames #7

Open
andrewbasterfield opened this issue Oct 10, 2015 · 4 comments
Open

Comments

@andrewbasterfield
Copy link
Contributor

vblade running on FreeBSD 10.2-RELEASE x86_64, client is Linux. The 2 boxes have jumbo frames enabled and will happily ping at ~9000 bytes

When I set the MTU to 4131 all is fine; I get 3584 byte data frames
When I set the MTU to 4132 the frame size jumps to 4096 and vblade exits with
write to network: Input/output error

Presumably there is some limitation on FreeBSD with >4096 byte writes to BPF device; I haven't been able to find any reference to this limitation and if it is tweakable. Any suggestions?

@ecashin
Copy link
Contributor

ecashin commented Oct 10, 2015

I don't have much experience with AoE on FreeBSD. You might be able to
find some information by searching the archives of the aoetools-discuss
mailing list, hosted at sourceforge and archived elsewhere, including
gmane, I believe.

On 10/10/2015 03:37 PM, Andrew Basterfield wrote:

vblade running on FreeBSD 10.2-RELEASE x86_64, client is Linux. The 2
boxes have jumbo frames enabled and will happily ping at ~9000 bytes

When I set the MTU to 4131 all is fine; I get 3584 byte data frames
When I set the MTU to 4132 the frame size jumps to 4096 and vblade
exits with
write to network: Input/output error

Presumably there is some limitation on FreeBSD with >4096 byte writes
to BPF device; I haven't been able to find any reference to this
limitation and if it is tweakable. Any suggestions?


Reply to this email directly or view it on GitHub
#7.

@andrewbasterfield
Copy link
Contributor Author

Have taken it to FreeBSD mailing lists; will update with any progress

@andrewbasterfield
Copy link
Contributor Author

@carton-of-mice
Copy link

carton-of-mice commented Nov 19, 2017

Hello. I haven't tracked the project lately. Due to insufficient dog-food-ing, this slipped by.
FreeBSD indeed, as the other BSDs, limits BPF writes to one mbuf (have not checked reads, but behaviour probably matches). I'm going to file a PR to cap MTU at page size, but I'm not sure if a full-sized jumbo frame workaround is available.

carton-of-mice added a commit to carton-of-mice/vblade that referenced this issue Nov 19, 2017
FreeBSD bpf writes are capped at one PAGESIZE'd mbuf on x86. As such we
must limit our sector count. See OpenAoE/vblade OpenAoE#7
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants