Chen Wandun c00b6b9610 mm/vmalloc: introduce alloc_pages_bulk_array_mempolicy to accelerate memory allocation ... Commit ffb29b1c25 ("mm/vmalloc: fix numa spreading for large hash tables") can cause significant performance regressions in some situations as Andrew mentioned in [1]. The main situation is vmalloc, vmalloc will allocate pages with NUMA_NO_NODE by default, that will result in alloc page one by one; In order to solve this, __alloc_pages_bulk and mempolicy should be considered at the same time. 1) If node is specified in memory allocation request, it will alloc all pages by __alloc_pages_bulk. 2) If interleaving allocate memory, it will cauculate how many pages should be allocated in each node, and use __alloc_pages_bulk to alloc pages in each node. [1]: https://lore.kernel.org/lkml/CALvZod4G3SzP3kWxQYn0fj+VgG-G3yWXz=gz17+3N57ru1iajw@mail.gmail.com/t/#m750c8e3231206134293b089feaa090590afa0f60 [akpm@linux-foundation.org: coding style fixes] [akpm@linux-foundation.org: make two functions static] [akpm@linux-foundation.org: fix CONFIG_NUMA=n build] Link: https://lkml.kernel.org/r/20211021080744.874701-3-chenwandun@huawei.com Signed-off-by: Chen Wandun <chenwandun@huawei.com> Reviewed-by: Uladzislau Rezki (Sony) <urezki@gmail.com> Cc: Eric Dumazet <edumazet@google.com> Cc: Shakeel Butt <shakeelb@google.com> Cc: Nicholas Piggin <npiggin@gmail.com> Cc: Kefeng Wang <wangkefeng.wang@huawei.com> Cc: Hanjun Guo <guohanjun@huawei.com> Signed-off-by: Andrew Morton <akpm@linux-foundation.org> Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>		2021-11-06 13:30:37 -07:00
..
acpi	ACPI: tools: fix compilation error	2021-10-07 19:18:19 +02:00
asm-generic	asm-generic: build fixes for v5.15	2021-10-08 11:57:54 -07:00
clocksource
crypto	Merge branch 'linus' of git://git.kernel.org/pub/scm/linux/kernel/git/herbert/crypto-2.6	2021-08-30 12:57:10 -07:00
drm
dt-bindings	linux-watchdog 5.15-rc1 tag	2021-09-07 13:52:46 -07:00
keys
kunit	kunit: fix kernel-doc warnings due to mismatched arg names	2021-10-06 17:54:07 -06:00
kvm	KVM: arm64: Fix PMU probe ordering	2021-09-20 12:43:34 +01:00
linux	mm/vmalloc: introduce alloc_pages_bulk_array_mempolicy to accelerate memory allocation	2021-11-06 13:30:37 -07:00
math-emu
media
memory
misc
net	mptcp: fix corrupt receiver key in MPC + data + checksum	2021-10-28 08:19:06 -07:00
pcmcia
ras
rdma	Merge branch 'sg_nents' into rdma.git for-next	2021-08-30 09:49:59 -03:00
scsi	scsi: core: Remove 'current_tag'	2021-09-22 00:13:38 -04:00
soc	net: dsa: tag_ocelot_8021q: break circular dependency with ocelot switch lib	2021-10-12 17:35:18 -07:00
sound	ALSA: hda: intel: Allow repeatedly probing on codec configuration errors	2021-10-07 09:15:22 +02:00
target
trace	mm: mmap_lock: use DECLARE_EVENT_CLASS and DEFINE_EVENT_FN	2021-11-06 13:30:36 -07:00
uapi	Networking fixes for 5.15-rc7, including fixes from netfilter, and can.	2021-10-21 15:36:50 -10:00
vdso
video
xen	xen/privcmd: drop "pages" parameter from xen_remap_pfn()	2021-10-05 08:20:27 +02:00