Jianxing Wang b191c9bc33 mm/mmu_gather: limit free batch count and add schedule point in tlb_batch_pages_flush ... free a large list of pages maybe cause rcu_sched starved on non-preemptible kernels. howerver free_unref_page_list maybe can't cond_resched as it maybe called in interrupt or atomic context, especially can't detect atomic context in CONFIG_PREEMPTION=n. The issue is detected in guest with kvm cpu 200% overcommit, however I didn't see the warning in the host with the same application. I'm sure that the patch is needed for guest kernel, but no sure for host. To reproduce, set up two virtual machines in one host machine, per vm has the same number cpu and half memory of host. the run ltpstress.sh in per vm, then will see rcu stall warning.kernel is preempt disabled, append kernel command 'preempt=none' if enable dynamic preempt . It could detected in loongson machine(32 core, 128G mem) and ProLiant DL380 Gen9(x86 E5-2680, 28 core, 64G mem) tlb flush batch count depends on PAGE_SIZE, it's too large if PAGE_SIZE > 4K, here limit free batch count with 512. And add schedule point in tlb_batch_pages_flush. rcu: rcu_sched kthread starved for 5359 jiffies! g454793 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=19 [...] Call Trace: free_unref_page_list+0x19c/0x270 release_pages+0x3cc/0x498 tlb_flush_mmu_free+0x44/0x70 zap_pte_range+0x450/0x738 unmap_page_range+0x108/0x240 unmap_vmas+0x74/0xf0 unmap_region+0xb0/0x120 do_munmap+0x264/0x438 vm_munmap+0x58/0xa0 sys_munmap+0x10/0x20 syscall_common+0x24/0x38 Link: https://lkml.kernel.org/r/20220317072857.2635262-1-wangjianxing@loongson.cn Signed-off-by: Jianxing Wang <wangjianxing@loongson.cn> Signed-off-by: Peter Zijlstra <peterz@infradead.org> Cc: Will Deacon <will@kernel.org> Cc: Nicholas Piggin <npiggin@gmail.com> Signed-off-by: Andrew Morton <akpm@linux-foundation.org>		2022-04-28 23:16:12 -07:00
..
damon	mm/damon: prevent activated scheme from sleeping by deactivated schemes	2022-04-01 11:46:09 -07:00
kasan	kasan: prevent cpu_quarantine corruption when CPU offline and cache shrink occur at same time	2022-04-27 13:28:48 -07:00
kfence	mm, kfence: support kmem_dump_obj() for KFENCE objects	2022-04-15 14:49:55 -07:00
backing-dev.c	remove congestion tracking framework	2022-03-22 15:57:01 -07:00
balloon_compaction.c	mm/balloon_compaction: make balloon page compaction callbacks static	2022-03-28 16:52:57 -04:00
bootmem_info.c	bootmem: Use page->index instead of page->freelist	2022-01-06 12:27:03 +01:00
cma_debug.c
cma_sysfs.c
cma.c	mm/cma: provide option to opt out from exposing pages on activation failure	2022-03-22 15:57:09 -07:00
cma.h	mm/cma: provide option to opt out from exposing pages on activation failure	2022-03-22 15:57:09 -07:00
compaction.c	mm: compaction: use helper isolation_suitable()	2022-04-28 23:16:06 -07:00
debug_page_ref.c
debug_vm_pgtable.c	mm/debug_vm_pgtable: remove pte entry from the page table	2022-02-04 09:25:04 -08:00
debug.c	mm: unexport page_init_poison	2022-03-24 19:06:45 -07:00
dmapool.c	mm/dmapool.c: revert "make dma pool to use kmalloc_node"	2022-01-15 16:30:28 +02:00
early_ioremap.c	mm/early_ioremap: declare early_memremap_pgprot_adjust()	2022-03-22 15:57:11 -07:00
fadvise.c	remove inode_congested()	2022-03-22 15:57:01 -07:00
failslab.c
filemap.c	tmpfs: fix regressions from wider use of ZERO_PAGE	2022-04-15 14:49:54 -07:00
folio-compat.c	mm/rmap: Convert rmap_walk() to take a folio	2022-03-21 13:01:35 -04:00
frontswap.c	frontswap: remove support for multiple ops	2022-01-22 08:33:38 +02:00
gup_test.c
gup_test.h
gup.c	mm/munlock: add lru_add_drain() to fix memcg_stat_test	2022-04-01 11:46:09 -07:00
highmem.c	highmem: fix checks in __kmap_local_sched_{in,out}	2022-04-08 14:20:36 -10:00
hmm.c	mm/hmm.c: remove unneeded local variable ret	2022-03-22 15:57:12 -07:00
huge_memory.c	mm/huge_memory: Avoid calling pmd_page() on a non-leaf PMD	2022-04-07 09:43:41 -04:00
hugetlb_cgroup.c	hugetlb: add hugetlb.*.numa_stat file	2022-01-15 16:30:29 +02:00
hugetlb_vmemmap.c	mm: hugetlb: replace hugetlb_free_vmemmap_enabled with a static_key	2022-03-22 15:57:08 -07:00
hugetlb_vmemmap.h
hugetlb.c	hugetlb: remove use of list iterator variable after loop	2022-04-28 23:16:03 -07:00
hwpoison-inject.c	mm/hwpoison: avoid the impact of hwpoison_filter() return value on mce handler	2022-03-22 15:57:07 -07:00
init-mm.c	kernel/fork: Initialize mm's PASID	2022-02-14 19:51:47 +01:00
internal.h	mm: rmap: introduce pfn_mkclean_range() to cleans PTEs	2022-04-28 23:16:10 -07:00
interval_tree.c
io-mapping.c
ioremap.c	mm: move ioremap_page_range to vmalloc.c	2021-09-08 11:50:24 -07:00
Kconfig	mm: generalize ARCH_HAS_FILTER_PGPROT	2022-03-24 19:06:51 -07:00
Kconfig.debug	mm: page table check	2022-01-15 16:30:28 +02:00
khugepaged.c	mm/khugepaged: remove reuse_swap_page() usage	2022-03-24 19:06:51 -07:00
kmemleak.c	mm: kmemleak: take a full lowmem check in kmemleak_*_phys()	2022-04-15 14:49:56 -07:00
ksm.c	Folio changes for 5.18	2022-03-22 17:03:12 -07:00
list_lru.c	mm/list_lru.c: revert "mm/list_lru: optimize memcg_reparent_list_lru_node()"	2022-04-08 14:20:36 -10:00
maccess.c	asm-generic updates for 5.18	2022-03-23 18:03:08 -07:00
madvise.c	mm/madvise: fix potential pte_unmap_unlock pte error	2022-04-28 23:16:09 -07:00
Makefile	mm: move the migrate_vma_* device migration code into its own file	2022-03-03 12:47:33 -05:00
mapping_dirty_helpers.c	mm: move tlb_flush_pending inline helpers to mm_inline.h	2022-01-15 16:30:27 +02:00
memblock.c	memblock: test suite and a small cleanup	2022-03-27 13:36:06 -07:00
memcontrol.c	mm/memcontrol.c: remove unused private flag of memory.oom_control	2022-04-28 23:16:00 -07:00
memfd.c	memfd: fix F_SEAL_WRITE after shmem huge page allocated	2022-03-05 11:08:32 -08:00
memory_hotplug.c	Folio changes for 5.18	2022-03-22 17:03:12 -07:00
memory-failure.c	mm, hugetlb, hwpoison: separate branch for free and in-use hugepage	2022-04-28 23:16:02 -07:00
memory.c	mm: simplify follow_invalidate_pte()	2022-04-28 23:16:10 -07:00
mempolicy.c	mm/mempolicy: clean up the code logic in queue_pages_pte_range	2022-04-28 23:16:06 -07:00
mempool.c	mm: remove spurious blkdev.h includes	2021-10-18 06:17:01 -06:00
memremap.c	mm: delete __ClearPageWaiters()	2022-03-24 19:06:45 -07:00
memtest.c
migrate_device.c	mm/migrate: Convert remove_migration_ptes() to folios	2022-03-21 13:01:35 -04:00
migrate.c	mm: untangle config dependencies for demote-on-reclaim	2022-04-28 23:16:09 -07:00
mincore.c
mlock.c	mm/munlock: protect the per-CPU pagevec by a local_lock_t	2022-04-01 11:46:09 -07:00
mm_init.c
mmap_lock.c
mmap.c	mm/mmap.c: use mmap_assert_write_locked() instead of open coding it	2022-04-28 23:16:11 -07:00
mmu_gather.c	mm/mmu_gather: limit free batch count and add schedule point in tlb_batch_pages_flush	2022-04-28 23:16:12 -07:00
mmu_notifier.c	mm/mmu_notifier.c: fix race in mmu_interval_notifier_remove()	2022-04-21 20:01:10 -07:00
mmzone.c	Folio changes for 5.18	2022-03-22 17:03:12 -07:00
mprotect.c	memory tiering: skip to scan fast memory	2022-03-22 15:57:09 -07:00
mremap.c	mmmremap.c: avoid pointless invalidate_range_start/end on mremap(old_size=0)	2022-04-08 14:20:36 -10:00
msync.c
nommu.c	no-MMU: expose vmalloc_huge() for alloc_large_system_hash()	2022-04-25 10:11:49 -07:00
oom_kill.c	oom_kill.c: futex: delay the OOM reaper to allow time for proper futex cleanup	2022-04-21 20:01:10 -07:00
page_alloc.c	mm/vmscan: make sure wakeup_kswapd with managed zone	2022-04-28 23:16:03 -07:00
page_counter.c	mm/page_counter: remove an incorrect call to propagate_protected_usage()	2022-01-15 16:30:27 +02:00
page_ext.c	mm: make some vars and functions static or __init	2022-01-15 16:30:31 +02:00
page_idle.c	mm/rmap: Constify the rmap_walk_control argument	2022-03-21 13:01:35 -04:00
page_io.c	mm: fix unexpected zeroed page mapping with zram swap	2022-04-15 14:49:55 -07:00
page_isolation.c	mm: wrap __find_buddy_pfn() with a necessary buddy page validation	2022-04-28 23:16:01 -07:00
page_owner.c	mm/page_owner.c: record tgid	2022-03-24 19:06:44 -07:00
page_poison.c
page_reporting.c
page_reporting.h
page_table_check.c	mm/page_table_check.c: use strtobool for param parsing	2022-03-22 15:57:11 -07:00
page_vma_mapped.c	mm: pvmw: add support for walking devmap pages	2022-04-28 23:16:10 -07:00
page-writeback.c	mm: rework calculation of bdi_min_ratio in bdi_set_min_ratio	2022-04-28 23:15:57 -07:00
pagewalk.c
percpu-internal.h	mm: memcg/percpu: account extra objcg space to memory cgroups	2022-01-15 16:30:31 +02:00
percpu-km.c
percpu-stats.c	mm: use vmalloc_array and vcalloc for array allocations	2022-03-08 09:30:46 -05:00
percpu-vm.c
percpu.c	bitmap patches for 5.17-rc1	2022-01-23 06:20:44 +02:00
pgalloc-track.h
pgtable-generic.c	mm: move tlb_flush_pending inline helpers to mm_inline.h	2022-01-15 16:30:27 +02:00
process_vm_access.c
ptdump.c	mm: sparsemem: use page table lock to protect kernel pmd operations	2022-03-22 15:57:08 -07:00
readahead.c	readahead: Update comments	2022-04-01 14:40:42 -04:00
rmap.c	mm: rmap: introduce pfn_mkclean_range() to cleans PTEs	2022-04-28 23:16:10 -07:00
rodata_test.c
secretmem.c	mm/secretmem: fix panic when growing a memfd_secret	2022-04-15 14:49:54 -07:00
shmem.c	mm: shmem: make shmem_init return void	2022-04-28 23:15:58 -07:00
shuffle.c
shuffle.h
slab_common.c	mm, kfence: support kmem_dump_obj() for KFENCE objects	2022-04-15 14:49:55 -07:00
slab.c	mm, kfence: support kmem_dump_obj() for KFENCE objects	2022-04-15 14:49:55 -07:00
slab.h	mm, kfence: support kmem_dump_obj() for KFENCE objects	2022-04-15 14:49:55 -07:00
slob.c	mm, kfence: support kmem_dump_obj() for KFENCE objects	2022-04-15 14:49:55 -07:00
slub.c	mm, kfence: support kmem_dump_obj() for KFENCE objects	2022-04-15 14:49:55 -07:00
sparse-vmemmap.c	mm: sparsemem: move vmemmap related to HugeTLB to CONFIG_HUGETLB_PAGE_FREE_VMEMMAP	2022-03-22 15:57:08 -07:00
sparse.c	mm/sparse: make mminit_validate_memmodel_limits() static	2022-03-22 15:57:05 -07:00
swap_cgroup.c	mm: use vmalloc_array and vcalloc for array allocations	2022-03-08 09:30:46 -05:00
swap_slots.c	treewide: Add missing includes masked by cgroup -> bpf dependency	2021-12-03 10:58:13 -08:00
swap_state.c	Filesystem folio changes for 5.18	2022-03-22 18:26:56 -07:00
swap.c	mm/munlock: protect the per-CPU pagevec by a local_lock_t	2022-04-01 11:46:09 -07:00
swapfile.c	mm/swapfile: remove stale reuse_swap_page()	2022-03-24 19:06:51 -07:00
truncate.c	Filesystem folio changes for 5.18	2022-03-22 18:26:56 -07:00
usercopy.c	Merge branch 'akpm' (patches from Andrew)	2022-03-22 16:11:53 -07:00
userfaultfd.c	userfaultfd: mark uffd_wp regardless of VM_WRITE flag	2022-04-21 20:01:09 -07:00
util.c	kvmalloc: use vmalloc_huge for vmalloc allocations	2022-04-24 10:05:38 -07:00
vmacache.c
vmalloc.c	vmap(): don't allow invalid pages	2022-04-28 23:16:00 -07:00
vmpressure.c	mm/vmpressure: fix data-race with memcg->socket_pressure	2021-11-06 13:30:40 -07:00
vmscan.c	mm/vmscan: fix comment for isolate_lru_pages	2022-04-28 23:16:04 -07:00
vmstat.c	mm: untangle config dependencies for demote-on-reclaim	2022-04-28 23:16:09 -07:00
workingset.c	memcg: sync flush only if periodic flush is delayed	2022-04-21 20:01:09 -07:00
z3fold.c	mm/z3fold: remove unneeded PAGE_HEADLESS check in free_handle()	2022-04-28 23:16:06 -07:00
zbud.c
zpool.c	zpool: remove the list of pools_head	2022-01-15 16:30:31 +02:00
zsmalloc.c	zsmalloc: replace get_cpu_var with local_lock	2022-01-22 08:33:37 +02:00
zswap.c	mm/zswap.c: allow handling just same-value filled pages	2022-03-22 15:57:11 -07:00