Yan Zhai eb7422b8cc bpf: report RCU QS in cpumap kthread ... [ Upstream commit 00bf631224 ] When there are heavy load, cpumap kernel threads can be busy polling packets from redirect queues and block out RCU tasks from reaching quiescent states. It is insufficient to just call cond_resched() in such context. Periodically raise a consolidated RCU QS before cond_resched fixes the problem. Fixes: 6710e11269 ("bpf: introduce new bpf cpu map type BPF_MAP_TYPE_CPUMAP") Reviewed-by: Jesper Dangaard Brouer <hawk@kernel.org> Signed-off-by: Yan Zhai <yan@cloudflare.com> Acked-by: Paul E. McKenney <paulmck@kernel.org> Acked-by: Jesper Dangaard Brouer <hawk@kernel.org> Link: https://lore.kernel.org/r/c17b9f1517e19d813da3ede5ed33ee18496bb5d8.1710877680.git.yan@cloudflare.com Signed-off-by: Jakub Kicinski <kuba@kernel.org> Signed-off-by: Sasha Levin <sashal@kernel.org>		2024-03-26 18:17:38 -04:00
..
preload	bpf: make preloaded map iterators to display map elements count	2023-07-06 12:42:25 -07:00
arraymap.c	Revert BPF token-related functionality	2023-12-19 08:23:03 -08:00
bloom_filter.c	bpf: Centralize permissions checks for all BPF map types	2023-06-19 14:04:04 +02:00
bpf_cgrp_storage.c	bpf: Enable bpf_cgrp_storage for cgroup1 non-attach case	2023-12-08 17:08:18 -08:00
bpf_inode_storage.c	Networking changes for 6.4.	2023-04-26 16:07:23 -07:00
bpf_iter.c	bpf: Add __bpf_kfunc_{start,end}_defs macros	2023-11-01 22:33:53 -07:00
bpf_local_storage.c	bpf: bpf_sk_storage: Fix the missing uncharge in sk_omem_alloc	2023-09-06 11:08:14 +02:00
bpf_lru_list.c	bpf: Address KCSAN report on bpf_lru_list	2023-05-12 12:01:03 -07:00
bpf_lru_list.h	bpf: lru: Remove unused declaration bpf_lru_promote()	2023-08-08 17:21:42 -07:00
bpf_lsm.c	Revert BPF token-related functionality	2023-12-19 08:23:03 -08:00
bpf_struct_ops_types.h	bpf: Add dummy BPF STRUCT_OPS for test purpose	2021-11-01 14:10:00 -07:00
bpf_struct_ops.c	x86/cfi,bpf: Fix bpf_struct_ops CFI	2023-12-15 16:25:55 -08:00
bpf_task_storage.c	bpf: Teach verifier that certain helpers accept NULL pointer.	2023-04-04 16:57:16 -07:00
btf.c	bpf: don't emit warnings intended for global subprogs for static subprogs	2024-03-26 18:16:38 -04:00
cgroup_iter.c	bpf: Let verifier consider {task,cgroup} is trusted in bpf_iter_reg	2023-11-07 15:24:25 -08:00
cgroup.c	Revert BPF token-related functionality	2023-12-19 08:23:03 -08:00
core.c	bpf: hardcode BPF_PROG_PACK_SIZE to 2MB * num_possible_nodes()	2024-03-26 18:16:57 -04:00
cpumap.c	bpf: report RCU QS in cpumap kthread	2024-03-26 18:17:38 -04:00
cpumask.c	bpf: Fix dtor CFI	2023-12-15 16:25:55 -08:00
devmap.c	bpf: Fix DEVMAP_HASH overflow check on 32-bit arches	2024-03-26 18:16:55 -04:00
disasm.c	bpf: change bpf_alu_sign_string and bpf_movsx_string to static	2023-08-04 16:15:50 -07:00
disasm.h	bpf: Relicense disassembler as GPL-2.0-only OR BSD-2-Clause	2021-09-02 14:49:23 +02:00
dispatcher.c	bpf: Use arch_bpf_trampoline_size	2023-12-06 17:17:20 -08:00
hashtab.c	bpf: Fix hashtab overflow check on 32-bit arches	2024-03-26 18:16:55 -04:00
helpers.c	bpf: Mark bpf_spin_{lock,unlock}() helpers with notrace correctly	2024-03-26 18:16:43 -04:00
inode.c	bpf: Re-support uid and gid when mounting bpffs	2023-12-21 14:24:30 +01:00
Kconfig	bpf: Add fd-based tcx multi-prog infra with link support	2023-07-19 10:07:27 -07:00
link_iter.c	bpf: Add bpf_link iterator	2022-05-10 11:20:45 -07:00
local_storage.c	cgroup changes for v6.4-rc1	2023-04-29 10:05:22 -07:00
log.c	bpf: emit more dynptr information in verifier log	2023-12-11 19:21:22 -08:00
lpm_trie.c	bpf, lpm: Fix check prefixlen before walking trie	2023-11-09 19:07:38 -08:00
Makefile	Revert BPF token-related functionality	2023-12-19 08:23:03 -08:00
map_in_map.c	bpf: Optimize the free of inner map	2023-12-04 17:50:26 -08:00
map_in_map.h	bpf: Add map and need_defer parameters to .map_fd_put_ptr()	2023-12-04 17:50:26 -08:00
map_iter.c	bpf: Add __bpf_kfunc_{start,end}_defs macros	2023-11-01 22:33:53 -07:00
memalloc.c	bpf: Remove unnecessary cpu == 0 check in memalloc	2024-01-04 10:18:14 -08:00
mmap_unlock_work.h	bpf: Introduce helper bpf_find_vma	2021-11-07 11:54:51 -08:00
mprog.c	bpf: Handle bpf_mprog_query with NULL entry	2023-10-06 17:11:20 -07:00
net_namespace.c	net: Add includes masked by netdevice.h including uapi/bpf.h	2021-12-29 20:03:05 -08:00
offload.c	Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net	2023-09-21 21:49:45 +02:00
percpu_freelist.c	bpf: Initialize same number of free nodes for each pcpu_freelist	2022-11-11 12:05:14 -08:00
percpu_freelist.h
prog_iter.c
queue_stack_maps.c	bpf: Avoid deadlock when using queue and stack maps from NMI	2023-09-11 19:04:49 -07:00
reuseport_array.c	bpf: Centralize permissions checks for all BPF map types	2023-06-19 14:04:04 +02:00
ringbuf.c	bpf: Fold smp_mb__before_atomic() into atomic_set_release()	2023-10-24 14:26:07 +02:00
stackmap.c	bpf: Fix stackmap overflow check on 32-bit arches	2024-03-26 18:16:55 -04:00
syscall.c	bpf: Fix re-attachment branch in bpf_tracing_prog_attach	2024-01-04 20:40:19 -08:00
sysfs_btf.c	bpf: Load and verify kernel module BTFs	2020-11-10 15:25:53 -08:00
task_iter.c	bpf: Fix an issue due to uninitialized bpf_iter_task	2024-02-19 12:28:15 +01:00
tcx.c	bpf, tcx: Get rid of tcx_link_const	2023-10-23 15:01:53 -07:00
tnum.c	bpf: simplify tnum output if a fully known constant	2023-12-02 11:36:51 -08:00
trampoline.c	bpf: Use arch_bpf_trampoline_size	2023-12-06 17:17:20 -08:00
verifier.c	bpf: check bpf_func_state->callback_depth when pruning states	2024-03-05 16:15:56 -08:00