bpf_prog_pack allocator #2436
Closed
bpf_prog_pack allocator #2436
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Master branch: 4e95074 |
|
At least one diff in series https://patchwork.kernel.org/project/netdevbpf/list/?series=606724 expired. Closing PR. |
|
Master branch: 4e95074 |
kernel-patches-bot
force-pushed
the
series/595751=>bpf-next
branch
from
825bdb4
to
bba46b3
Compare
|
Master branch: 1058b6a |
kernel-patches-bot
force-pushed
the
series/595751=>bpf-next
branch
from
bba46b3
to
3033f5c
Compare
|
At least one diff in series https://patchwork.kernel.org/project/netdevbpf/list/?series=607031 expired. Closing PR. |
|
Master branch: 820e6e2 |
kernel-patches-bot
force-pushed
the
series/595751=>bpf-next
branch
from
3033f5c
to
0b67a50
Compare
This enables module_alloc() to allocate huge page for 2MB+ requests. To check the difference of this change, we need enable config CONFIG_PTDUMP_DEBUGFS, and call module_alloc(2MB). Before the change, /sys/kernel/debug/page_tables/kernel shows pte for this map. With the change, /sys/kernel/debug/page_tables/ show pmd for thie map. Signed-off-by: Song Liu <songliubraving@fb.com>
This enables sub-page memory charge and allocation. Signed-off-by: Song Liu <songliubraving@fb.com>
|
Master branch: a9921ce |
This is necessary to charge sub page memory for the BPF program. Signed-off-by: Song Liu <songliubraving@fb.com>
With sub page allocation, we cannot simply use bpf_func & PAGE_MASK to find the bpf_binary_header. Add a pointer to struct bpf_prog to avoid this logic. Use this point for x86_64. If the pointer is not set by the jit engine, fall back to original logic. Signed-off-by: Song Liu <song@kernel.org>
This will be used by BPF jit compiler to dump JITed binary to a RX huge page, and thus allow multiple BPF programs sharing the a huge (2MB) page. Acked-by: Peter Zijlstra (Intel) <peterz@infradead.org> Signed-off-by: Song Liu <song@kernel.org>
Most BPF programs are small, but they consume a page each. For systems with busy traffic and many BPF programs, this could add significant pressure to instruction TLB. Introduce bpf_prog_pack allocator to pack multiple BPF programs in a huge page. The memory is then allocated in 64 byte chunks. Memory allocated by bpf_prog_pack allocator is RO protected after initial allocation. To write to it, the user (jit engine) need to use text poke API. Signed-off-by: Song Liu <songliubraving@fb.com>
Use bpf_prog_pack allocator in x86_64 jit. The program header from bpf_prog_pack is read only during the jit process. Therefore, the binary is first written to a temporary buffer, and later copied to final location with text_poke_copy(). Similarly, jit_fill_hole() is updated to fill the hole with 0xcc using text_poke_copy(). Signed-off-by: Song Liu <songliubraving@fb.com>
kernel-patches-bot
force-pushed
the
series/595751=>bpf-next
branch
from
0b67a50
to
ab68490
Compare
|
At least one diff in series https://patchwork.kernel.org/project/netdevbpf/list/?series=607370 expired. Closing PR. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Pull request for series with
subject: bpf_prog_pack allocator
version: 4
url: https://patchwork.kernel.org/project/netdevbpf/list/?series=606724