Peter Zijlstra 2a2f5d4e44 sched/fair: Rewrite cfs_rq->removed_*avg ... Since on wakeup migration we don't hold the rq->lock for the old CPU we cannot update its state. Instead we add the removed 'load' to an atomic variable and have the next update on that CPU collect and process it. Currently we have 2 atomic variables; which already have the issue that they can be read out-of-sync. Also, two atomic ops on a single cacheline is already more expensive than an uncontended lock. Since we want to add more, convert the thing over to an explicit cacheline with a lock in. Signed-off-by: Peter Zijlstra (Intel) <peterz@infradead.org> Cc: Linus Torvalds <torvalds@linux-foundation.org> Cc: Peter Zijlstra <peterz@infradead.org> Cc: Thomas Gleixner <tglx@linutronix.de> Cc: linux-kernel@vger.kernel.org Signed-off-by: Ingo Molnar <mingo@kernel.org>		2017-09-29 19:35:14 +02:00
..
autogroup.c	sched/autogroup: Fix error reporting printk text in autogroup_create()	2017-08-10 17:06:03 +02:00
autogroup.h	sched/headers: Prepare for new header dependencies before moving code to <linux/sched/autogroup.h>	2017-03-02 08:42:28 +01:00
clock.c	sched/clock: Fix early boot preempt assumption in __set_sched_clock_stable()	2017-05-24 09:10:00 +02:00
completion.c	Merge branch 'locking-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip	2017-09-04 11:52:29 -07:00
core.c	sched/fair: Use reweight_entity() for set_user_nice()	2017-09-29 19:35:14 +02:00
cpuacct.c	sched/cputime: Convert kcpustat to nsecs	2017-02-01 09:13:47 +01:00
cpuacct.h	sched/cpuacct: Simplify the cpuacct code	2016-03-21 11:00:28 +01:00
cpudeadline.c	sched/deadline: Change return value of cpudl_find()	2017-08-10 12:18:17 +02:00
cpudeadline.h	sched/deadline: Split cpudl_set() into cpudl_set() and cpudl_clear()	2016-09-05 13:29:43 +02:00
cpufreq_schedutil.c	Merge branch 'pm-cpufreq-sched'	2017-09-04 00:05:22 +02:00
cpufreq.c	cpufreq / sched: Pass flags to cpufreq_update_util()	2016-08-16 22:14:55 +02:00
cpupri.c	sched/cpupri: Don't re-initialize 'struct cpupri'	2017-08-10 12:18:14 +02:00
cpupri.h	sched/cpupri: Remove unnecessary definitions in cpupri.h	2014-11-16 10:58:59 +01:00
cputime.c	sched/cputime: Don't use smp_processor_id() in preemptible context	2017-07-14 10:27:15 +02:00
deadline.c	sched/deadline: replace earliest dl and rq leftmost caching	2017-09-08 18:26:49 -07:00
debug.c	sched/fair: Rewrite cfs_rq->removed_*avg	2017-09-29 19:35:14 +02:00
fair.c	sched/fair: Rewrite cfs_rq->removed_*avg	2017-09-29 19:35:14 +02:00
features.h	sched/core: Implement new approach to scale select_idle_cpu()	2017-06-08 10:25:17 +02:00
idle_task.c	sched/core: Add wrappers for lockdep_(un)pin_lock()	2017-01-14 11:29:30 +01:00
idle.c	PM / s2idle: Rename ->enter_freeze to ->enter_s2idle	2017-08-11 01:29:56 +02:00
loadavg.c	sched/loadavg: Generalize "_idle" naming to "_nohz"	2017-06-22 11:30:01 +02:00
Makefile	membarrier: Provide expedited private command	2017-08-17 07:28:05 -07:00
membarrier.c	membarrier: Provide expedited private command	2017-08-17 07:28:05 -07:00
rt.c	sched: cpufreq: Allow remote cpufreq callbacks	2017-08-01 14:24:53 +02:00
sched-pelt.h	sched/fair: Move the PELT constants into a generated header	2017-04-14 10:26:37 +02:00
sched.h	sched/fair: Rewrite cfs_rq->removed_*avg	2017-09-29 19:35:14 +02:00
stats.c	sched: use %*pb[l] to print bitmaps including cpumasks and nodemasks	2015-02-13 21:21:37 -08:00
stats.h	sched/headers: Move cputime functionality from <linux/sched.h> and <linux/cputime.h> into <linux/sched/cputime.h>	2017-03-03 01:45:22 +01:00
stop_task.c	sched/core: Add wrappers for lockdep_(un)pin_lock()	2017-01-14 11:29:30 +01:00
swait.c	sched/wait: Remove the lockless swait_active() check in swake_up*()	2017-08-10 12:28:53 +02:00
topology.c	Merge branch 'sched-urgent-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip	2017-09-13 12:22:32 -07:00
wait_bit.c	sched/wait: Disambiguate wq_entry->task_list and wq_head->task_list naming	2017-06-20 12:19:14 +02:00
wait.c	sched/wait: Introduce wakeup boomark in wake_up_page_bit	2017-09-14 09:56:18 -07:00