kernel_optimize_test/scripts/atomic/fallbacks
Peter Zijlstra 37f8173dd8 locking/atomics: Flip fallbacks and instrumentation
Currently instrumentation of atomic primitives is done at the architecture
level, while composites or fallbacks are provided at the generic level.

The result is that there are no uninstrumented variants of the
fallbacks. Since there is now need of such variants to isolate text poke
from any form of instrumentation invert this ordering.

Doing this means moving the instrumentation into the generic code as
well as having (for now) two variants of the fallbacks.

Notes:

 - the various *cond_read* primitives are not proper fallbacks
   and got moved into linux/atomic.c. No arch_ variants are
   generated because the base primitives smp_cond_load*()
   are instrumented.

 - once all architectures are moved over to arch_atomic_ one of the
   fallback variants can be removed and some 2300 lines reclaimed.

 - atomic_{read,set}*() are no longer double-instrumented

Reported-by: Thomas Gleixner <tglx@linutronix.de>
Signed-off-by: Peter Zijlstra (Intel) <peterz@infradead.org>
Signed-off-by: Thomas Gleixner <tglx@linutronix.de>
Acked-by: Mark Rutland <mark.rutland@arm.com>
Link: https://lkml.kernel.org/r/20200505134058.769149955@linutronix.de
2020-06-11 08:03:24 +02:00
..
acquire locking/atomics: Flip fallbacks and instrumentation 2020-06-11 08:03:24 +02:00
add_negative locking/atomics: Flip fallbacks and instrumentation 2020-06-11 08:03:24 +02:00
add_unless locking/atomics: Flip fallbacks and instrumentation 2020-06-11 08:03:24 +02:00
andnot locking/atomics: Flip fallbacks and instrumentation 2020-06-11 08:03:24 +02:00
dec locking/atomics: Flip fallbacks and instrumentation 2020-06-11 08:03:24 +02:00
dec_and_test locking/atomics: Flip fallbacks and instrumentation 2020-06-11 08:03:24 +02:00
dec_if_positive locking/atomics: Flip fallbacks and instrumentation 2020-06-11 08:03:24 +02:00
dec_unless_positive locking/atomics: Flip fallbacks and instrumentation 2020-06-11 08:03:24 +02:00
fence locking/atomics: Flip fallbacks and instrumentation 2020-06-11 08:03:24 +02:00
fetch_add_unless locking/atomics: Flip fallbacks and instrumentation 2020-06-11 08:03:24 +02:00
inc locking/atomics: Flip fallbacks and instrumentation 2020-06-11 08:03:24 +02:00
inc_and_test locking/atomics: Flip fallbacks and instrumentation 2020-06-11 08:03:24 +02:00
inc_not_zero locking/atomics: Flip fallbacks and instrumentation 2020-06-11 08:03:24 +02:00
inc_unless_negative locking/atomics: Flip fallbacks and instrumentation 2020-06-11 08:03:24 +02:00
read_acquire locking/atomics: Flip fallbacks and instrumentation 2020-06-11 08:03:24 +02:00
release locking/atomics: Flip fallbacks and instrumentation 2020-06-11 08:03:24 +02:00
set_release locking/atomics: Flip fallbacks and instrumentation 2020-06-11 08:03:24 +02:00
sub_and_test locking/atomics: Flip fallbacks and instrumentation 2020-06-11 08:03:24 +02:00
try_cmpxchg locking/atomics: Flip fallbacks and instrumentation 2020-06-11 08:03:24 +02:00