Vladimir Davydov c4159a75b6 mm: memcontrol: only mark charged pages with PageKmemcg ... To distinguish non-slab pages charged to kmemcg we mark them PageKmemcg, which sets page->_mapcount to -512. Currently, we set/clear PageKmemcg in __alloc_pages_nodemask()/free_pages_prepare() for any page allocated with __GFP_ACCOUNT, including those that aren't actually charged to any cgroup, i.e. allocated from the root cgroup context. To avoid overhead in case cgroups are not used, we only do that if memcg_kmem_enabled() is true. The latter is set iff there are kmem-enabled memory cgroups (online or offline). The root cgroup is not considered kmem-enabled. As a result, if a page is allocated with __GFP_ACCOUNT for the root cgroup when there are kmem-enabled memory cgroups and is freed after all kmem-enabled memory cgroups were removed, e.g. # no memory cgroups has been created yet, create one mkdir /sys/fs/cgroup/memory/test # run something allocating pages with __GFP_ACCOUNT, e.g. # a program using pipe dmesg | tail # remove the memory cgroup rmdir /sys/fs/cgroup/memory/test we'll get bad page state bug complaining about page->_mapcount != -1: BUG: Bad page state in process swapper/0 pfn:1fd945c page:ffffea007f651700 count:0 mapcount:-511 mapping: (null) index:0x0 flags: 0x1000000000000000() To avoid that, let's mark with PageKmemcg only those pages that are actually charged to and hence pin a non-root memory cgroup. Fixes: 4949148ad4 ("mm: charge/uncharge kmemcg from generic page allocator paths") Reported-and-tested-by: Eric Dumazet <eric.dumazet@gmail.com> Signed-off-by: Vladimir Davydov <vdavydov@virtuozzo.com> Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>		2016-08-09 10:14:10 -07:00
..
kasan	kasan: avoid overflowing quarantine size on low memory systems	2016-08-02 17:31:41 -04:00
backing-dev.c	block: fix bdi vs gendisk lifetime mismatch	2016-08-04 14:19:16 -06:00
balloon_compaction.c	mm: balloon: use general non-lru movable page feature	2016-07-26 16:19:19 -07:00
bootmem.c	mm: convert printk(KERN_<LEVEL> to pr_<level>	2016-03-17 15:09:34 -07:00
cleancache.c	cleancache: constify cleancache_ops structure	2016-01-27 09:09:57 -05:00
cma_debug.c	mm/cma_debug: correct size input to bitmap function	2015-07-17 16:39:54 -07:00
cma.c	mm/cma: silence warnings due to max() usage	2016-05-27 14:49:37 -07:00
cma.h	mm: cma: mark cma_bitmap_maxno() inline in header	2015-08-14 15:56:32 -07:00
compaction.c	mm, compaction: simplify contended compaction handling	2016-07-28 16:07:41 -07:00
debug_page_ref.c	mm/page_ref: add tracepoint to track down page reference manipulation	2016-03-17 15:09:34 -07:00
debug.c	mm: introduce page reference manipulation functions	2016-03-17 15:09:34 -07:00
dmapool.c	mm: convert printk(KERN_<LEVEL> to pr_<level>	2016-03-17 15:09:34 -07:00
early_ioremap.c	mm/early_ioremap: use offset_in_page macro	2015-11-05 19:34:48 -08:00
fadvise.c	mm/fadvise.c: do not discard partial pages with POSIX_FADV_DONTNEED	2016-06-09 14:23:11 -07:00
failslab.c	mm: fault-inject take over bootstrap kmem_cache check	2016-03-15 16:55:16 -07:00
filemap.c	block/mm: make bdev_ops->rw_page() take a bool for read/write	2016-08-07 14:41:02 -06:00
frame_vector.c	mm/gup: Switch all callers of get_user_pages() to not pass tsk/mm	2016-02-16 10:11:12 +01:00
frontswap.c	mm, frontswap: convert frontswap_enabled to static key	2016-07-26 16:19:19 -07:00
gup.c	- ARM: GICv3 ITS emulation and various fixes. Removal of the old	2016-08-02 16:11:27 -04:00
highmem.c	mm/highmem: make nr_free_highpages() handles all highmem zones by itself	2016-05-19 19:12:14 -07:00
huge_memory.c	mm, thp: remove __GFP_NORETRY from khugepaged and madvised allocations	2016-07-28 16:07:41 -07:00
hugetlb_cgroup.c	mm, hugetlb_cgroup: round limit_in_bytes down to hugepage size	2016-05-20 17:58:30 -07:00
hugetlb.c	powerpc updates for 4.8 #2	2016-08-05 09:00:54 -04:00
hwpoison-inject.c	hwpoison: use page_cgroup_ino for filtering by memcg	2015-09-10 13:29:01 -07:00
init-mm.c
internal.h	mm, compaction: simplify contended compaction handling	2016-07-28 16:07:41 -07:00
interval_tree.c
Kconfig	mm: disable CONFIG_MEMORY_HOTPLUG when KASAN is enabled	2016-08-04 20:02:09 -04:00
Kconfig.debug	mm/page_ref: add tracepoint to track down page reference manipulation	2016-03-17 15:09:34 -07:00
khugepaged.c	mm, thp: remove __GFP_NORETRY from khugepaged and madvised allocations	2016-07-28 16:07:41 -07:00
kmemcheck.c	mm: convert printk(KERN_<LEVEL> to pr_<level>	2016-03-17 15:09:34 -07:00
kmemleak-test.c	mm: convert printk(KERN_<LEVEL> to pr_<level>	2016-03-17 15:09:34 -07:00
kmemleak.c	kmemleak: don't hang if user disables scanning early	2016-07-28 16:07:41 -07:00
ksm.c	mm: do not pass mm_struct into handle_mm_fault	2016-07-26 16:19:19 -07:00
list_lru.c	mm: memcontrol: move kmem accounting code to CONFIG_MEMCG	2016-01-20 17:09:18 -08:00
maccess.c	x86: remove more uaccess_32.h complexity	2016-05-22 17:21:27 -07:00
madvise.c	mm: make mmap_sem for write waits killable for mm syscalls	2016-05-23 17:04:14 -07:00
Makefile	Implements HARDENED_USERCOPY verification of copy_to_user/copy_from_user	2016-08-08 14:48:14 -07:00
memblock.c	mm/memblock.c: fix NULL dereference error	2016-08-04 20:02:09 -04:00
memcontrol.c	mm: memcontrol: only mark charged pages with PageKmemcg	2016-08-09 10:14:10 -07:00
memory_hotplug.c	mem-hotplug: alloc new page from a nearest neighbor node when mem-offline	2016-07-28 16:07:41 -07:00
memory-failure.c	mm: hwpoison: remove incorrect comments	2016-07-28 16:07:41 -07:00
memory.c	mm: move swap-in anonymous page into active list	2016-08-02 17:31:41 -04:00
mempolicy.c	mm, vmscan: move LRU lists to node	2016-07-28 16:07:41 -07:00
mempool.c	Revert "mm, mempool: only set __GFP_NOMEMALLOC if there are free elements"	2016-07-28 16:07:41 -07:00
memtest.c	memtest: remove unused header files	2015-09-08 15:35:28 -07:00
migrate.c	mm, thp: remove __GFP_NORETRY from khugepaged and madvised allocations	2016-07-28 16:07:41 -07:00
mincore.c	mm, fs: remove remaining PAGE_CACHE_* and page_cache_{get,release} usage	2016-04-04 10:41:08 -07:00
mlock.c	mm, vmscan: move LRU lists to node	2016-07-28 16:07:41 -07:00
mm_init.c	mm: convert printk(KERN_<LEVEL> to pr_<level>	2016-03-17 15:09:34 -07:00
mmap.c	mm: refuse wrapped vm_brk requests	2016-08-02 19:35:15 -04:00
mmu_context.c	mm/mmu_context, sched/core: Fix mmu_context.h assumption	2016-04-28 11:44:19 +02:00
mmu_notifier.c	fix Christoph's email addresses	2016-03-17 15:09:34 -07:00
mmzone.c	mm, page_alloc: inline the fast path of the zonelist iterator	2016-05-19 19:12:14 -07:00
mprotect.c	mm: thp: check pmd_trans_unstable() after split_huge_pmd()	2016-07-26 16:19:19 -07:00
mremap.c	mm: thp: check pmd_trans_unstable() after split_huge_pmd()	2016-07-26 16:19:19 -07:00
msync.c	mm/msync: use offset_in_page macro	2015-11-05 19:34:48 -08:00
nobootmem.c	mm: convert printk(KERN_<LEVEL> to pr_<level>	2016-03-17 15:09:34 -07:00
nommu.c	mm: introduce fault_env	2016-07-26 16:19:19 -07:00
oom_kill.c	mm, oom: tighten task_will_free_mem() locking	2016-07-28 16:07:41 -07:00
page_alloc.c	mm: memcontrol: only mark charged pages with PageKmemcg	2016-08-09 10:14:10 -07:00
page_counter.c	mm: page_counter: let page_counter_try_charge() return bool	2015-11-05 19:34:48 -08:00
page_ext.c	mm: use early_pfn_to_nid in page_ext_init	2016-05-27 14:49:37 -07:00
page_idle.c	mm, vmscan: move lru_lock to the node	2016-07-28 16:07:41 -07:00
page_io.c	mm: make __swap_writepage() use bio_set_op_attrs()	2016-08-07 14:41:02 -06:00
page_isolation.c	mm/page_isolation: clean up confused code	2016-07-26 16:19:19 -07:00
page_owner.c	mm/page_owner: use stackdepot to store stacktrace	2016-07-26 16:19:19 -07:00
page_poison.c	mm: check the return value of lookup_page_ext for all call sites	2016-06-03 15:06:22 -07:00
page-writeback.c	mm: remove reclaim and compaction retry approximations	2016-07-28 16:07:41 -07:00
pagewalk.c	thp: rename split_huge_page_pmd() to split_huge_pmd()	2016-01-15 17:56:32 -08:00
percpu-km.c	mm: percpu: use pr_fmt to prefix output	2016-03-17 15:09:34 -07:00
percpu-vm.c
percpu.c	percpu: fix synchronization between synchronous map extension and chunk destruction	2016-05-25 11:48:25 -04:00
pgtable-generic.c	mm/thp/migration: switch from flush_tlb_range to flush_pmd_tlb_range	2016-03-17 15:09:34 -07:00
process_vm_access.c	mm/gup: Introduce get_user_pages_remote()	2016-02-16 10:04:09 +01:00
quicklist.c	fix Christoph's email addresses	2016-03-17 15:09:34 -07:00
readahead.c	mm, memcg: use consistent gfp flags during readahead	2016-07-26 16:19:19 -07:00
rmap.c	mm: move most file-based accounting to the node	2016-07-28 16:07:41 -07:00
shmem.c	shmem: Fix link error if huge pages support is disabled	2016-08-03 18:20:12 -04:00
slab_common.c	mm: charge/uncharge kmemcg from generic page allocator paths	2016-07-26 16:19:19 -07:00
slab.c	Implements HARDENED_USERCOPY verification of copy_to_user/copy_from_user	2016-08-08 14:48:14 -07:00
slab.h	mm, kasan: switch SLUB to stackdepot, enable memory quarantine for SLUB	2016-07-28 16:07:41 -07:00
slob.c	mm: slab: free kmem_cache_node after destroy sysfs file	2016-02-18 16:23:24 -08:00
slub.c	Implements HARDENED_USERCOPY verification of copy_to_user/copy_from_user	2016-08-08 14:48:14 -07:00
sparse-vmemmap.c	treewide: replace obsolete _refok by __ref	2016-08-02 17:31:41 -04:00
sparse.c	treewide: replace obsolete _refok by __ref	2016-08-02 17:31:41 -04:00
swap_cgroup.c	mm: convert printk(KERN_<LEVEL> to pr_<level>	2016-03-17 15:09:34 -07:00
swap_state.c	mm: move most file-based accounting to the node	2016-07-28 16:07:41 -07:00
swap.c	mm, pagevec: release/reacquire lru_lock on pgdat change	2016-07-28 16:07:41 -07:00
swapfile.c	mm, frontswap: convert frontswap_enabled to static key	2016-07-26 16:19:19 -07:00
truncate.c	truncate: handle file thp	2016-07-26 16:19:19 -07:00
usercopy.c	mm: Hardened usercopy	2016-07-26 14:41:47 -07:00
userfaultfd.c	mm, fs: get rid of PAGE_CACHE_* and page_cache_{get,release} macros	2016-04-04 10:41:08 -07:00
util.c	mm: move most file-based accounting to the node	2016-07-28 16:07:41 -07:00
vmacache.c	mm/vmacache: inline vmacache_valid_mm()	2015-11-05 19:34:48 -08:00
vmalloc.c	mm: charge/uncharge kmemcg from generic page allocator paths	2016-07-26 16:19:19 -07:00
vmpressure.c	mm/vmpressure.c: fix subtree pressure detection	2016-02-03 08:28:43 -08:00
vmscan.c	mm: vmscan: fix memcg-aware shrinkers not called on global reclaim	2016-08-02 17:31:41 -04:00
vmstat.c	mm: remove reclaim and compaction retry approximations	2016-07-28 16:07:41 -07:00
workingset.c	mm, workingset: make working set detection node-aware	2016-07-28 16:07:41 -07:00
z3fold.c	mm/z3fold.c: avoid modifying HEADLESS page and minor cleanup	2016-06-03 16:02:55 -07:00
zbud.c	mm/zbud.c: use list_last_entry() instead of list_tail_entry()	2016-01-15 11:40:52 -08:00
zpool.c	mm: zsmalloc: constify struct zs_pool name	2015-11-06 17:50:42 -08:00
zsmalloc.c	zsmalloc: Delete an unnecessary check before the function call "iput"	2016-07-28 16:07:41 -07:00
zswap.c	mm/zswap: use workqueue to destroy pool	2016-05-20 17:58:30 -07:00