Vincent Donnefort d05b43059d sched/fair: Provide u64 read for 32-bits arch helper ... Introducing macro helpers u64_u32_{store,load}() to factorize lockless accesses to u64 variables for 32-bits architectures. Users are for now cfs_rq.min_vruntime and sched_avg.last_update_time. To accommodate the later where the copy lies outside of the structure (cfs_rq.last_udpate_time_copy instead of sched_avg.last_update_time_copy), use the _copy() version of those helpers. Those new helpers encapsulate smp_rmb() and smp_wmb() synchronization and therefore, have a small penalty for 32-bits machines in set_task_rq_fair() and init_cfs_rq(). Signed-off-by: Vincent Donnefort <vincent.donnefort@arm.com> Signed-off-by: Vincent Donnefort <vdonnefort@google.com> Signed-off-by: Peter Zijlstra (Intel) <peterz@infradead.org> Reviewed-by: Dietmar Eggemann <dietmar.eggemann@arm.com> Tested-by: Lukasz Luba <lukasz.luba@arm.com> Link: https://lkml.kernel.org/r/20220621090414.433602-2-vdonnefort@google.com		2022-06-28 09:17:46 +02:00
..
autogroup.c	sched/autogroup: Fix sysctl move	2022-05-30 12:36:36 +02:00
autogroup.h	sched/headers: Add header guard to kernel/sched/stats.h and kernel/sched/autogroup.h	2022-02-23 08:22:00 +01:00
build_policy.c	sched: Fix missing prototype warnings	2022-05-01 10:03:43 +02:00
build_utility.c	sched: Fix missing prototype warnings	2022-05-01 10:03:43 +02:00
clock.c	sched/clock: Use try_cmpxchg64 in sched_clock_{local,remote}	2022-05-19 23:46:09 +02:00
completion.c	sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there	2022-02-23 10:58:33 +01:00
core_sched.c	sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there	2022-02-23 10:58:33 +01:00
core.c	sched: only perform capability check on privileged operation	2022-06-28 09:08:29 +02:00
cpuacct.c	Merge branch 'sched/fast-headers' into sched/core	2022-03-15 09:05:05 +01:00
cpudeadline.c	sched/headers: Introduce kernel/sched/build_policy.c and build multiple .c files there	2022-02-23 10:58:33 +01:00
cpudeadline.h	sched/headers: Simplify and clean up header usage in the scheduler	2018-03-04 12:39:29 +01:00
cpufreq_schedutil.c	Changes in this cycle were:	2022-03-22 14:39:12 -07:00
cpufreq.c	sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there	2022-02-23 10:58:33 +01:00
cpupri.c	sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there	2022-02-23 10:58:33 +01:00
cpupri.h	sched/cpupri: Add CPUPRI_HIGHER	2020-10-29 11:00:30 +01:00
cputime.c	sched/headers: Introduce kernel/sched/build_policy.c and build multiple .c files there	2022-02-23 10:58:33 +01:00
deadline.c	sched/deadline: Use proc_douintvec_minmax() limit minimum value	2022-06-13 10:30:00 +02:00
debug.c	sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there	2022-02-23 10:58:33 +01:00
fair.c	sched/fair: Provide u64 read for 32-bits arch helper	2022-06-28 09:17:46 +02:00
features.h	sched/fair: Introduce SIS_UTIL to search idle CPU based on sum of util_avg	2022-06-28 09:08:30 +02:00
idle.c	Scheduler changes in this cycle were:	2022-05-24 11:11:13 -07:00
isolation.c	sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there	2022-02-23 10:58:33 +01:00
loadavg.c	sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there	2022-02-23 10:58:33 +01:00
Makefile	sched/headers: Introduce kernel/sched/build_policy.c and build multiple .c files there	2022-02-23 10:58:33 +01:00
membarrier.c	sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there	2022-02-23 10:58:33 +01:00
pelt.c	sched/headers: Introduce kernel/sched/build_policy.c and build multiple .c files there	2022-02-23 10:58:33 +01:00
pelt.h	sched/fair: Fix cfs_rq_clock_pelt() for throttled cfs_rq	2022-04-22 12:14:07 +02:00
psi.c	sched/psi: report zeroes for CPU full at the system level	2022-04-22 12:14:08 +02:00
rt.c	sysctl changes for v5.19-rc1	2022-05-26 16:57:20 -07:00
sched-pelt.h	sched/fair: Fix "runnable_avg_yN_inv" not used warnings	2019-06-17 12:15:58 +02:00
sched.h	sched/fair: Provide u64 read for 32-bits arch helper	2022-06-28 09:17:46 +02:00
smp.h	smp: Rename flush_smp_call_function_from_idle()	2022-05-01 10:03:43 +02:00
stats.c	sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there	2022-02-23 10:58:33 +01:00
stats.h	sched/headers: Reorganize, clean up and optimize kernel/sched/sched.h dependencies	2022-02-23 10:58:34 +01:00
stop_task.c	sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there	2022-02-23 10:58:33 +01:00
swait.c	sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there	2022-02-23 10:58:33 +01:00
topology.c	sched/numa: Adjust imb_numa_nr to a better approximation of memory channels	2022-06-13 10:30:00 +02:00
wait_bit.c	sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there	2022-02-23 10:58:33 +01:00
wait.c	sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there	2022-02-23 10:58:33 +01:00