Skip to content

Commit 400c47d

Browse files
chleroympe
authored andcommitted
powerpc32: memset: only use dcbz once cache is enabled
memset() uses instruction dcbz to speed up clearing by not wasting time loading cache line with data that will be overwritten. Some platform like mpc52xx do no have cache active at startup and can therefore not use memset(). Allthough no part of the code explicitly uses memset(), GCC may make calls to it. This patch modifies memset() such that at startup, memset() unconditionally skip the optimised bloc that uses dcbz instruction. Once the initial MMU is set up, in machine_init() we patch memset() by replacing this inconditional jump by a NOP Tested-by: Thomas Gleixner <tglx@linutronix.de> Signed-off-by: Christophe Leroy <christophe.leroy@c-s.fr> Signed-off-by: Michael Ellerman <mpe@ellerman.id.au>
1 parent 1cd0389 commit 400c47d

File tree

2 files changed

+9
-0
lines changed

2 files changed

+9
-0
lines changed

arch/powerpc/kernel/setup_32.c

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -110,6 +110,8 @@ notrace unsigned long __init early_init(unsigned long dt_ptr)
110110
* This is called very early on the boot process, after a minimal
111111
* MMU environment has been set up but before MMU_init is called.
112112
*/
113+
extern unsigned int memset_nocache_branch; /* Insn to be replaced by NOP */
114+
113115
notrace void __init machine_init(u64 dt_ptr)
114116
{
115117
lockdep_init();
@@ -118,6 +120,7 @@ notrace void __init machine_init(u64 dt_ptr)
118120
udbg_early_init();
119121

120122
patch_instruction((unsigned int *)&memcpy, PPC_INST_NOP);
123+
patch_instruction(&memset_nocache_branch, PPC_INST_NOP);
121124

122125
/* Do some early initialization based on the flat device tree */
123126
early_init_devtree(__va(dt_ptr));

arch/powerpc/lib/copy_32.S

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -73,6 +73,10 @@ CACHELINE_MASK = (L1_CACHE_BYTES-1)
7373
* Use dcbz on the complete cache lines in the destination
7474
* to set them to zero. This requires that the destination
7575
* area is cacheable. -- paulus
76+
*
77+
* During early init, cache might not be active yet, so dcbz cannot be used.
78+
* We therefore skip the optimised bloc that uses dcbz. This jump is
79+
* replaced by a nop once cache is active. This is done in machine_init()
7680
*/
7781
_GLOBAL(memset)
7882
rlwimi r4,r4,8,16,23
@@ -88,6 +92,8 @@ _GLOBAL(memset)
8892
subf r6,r0,r6
8993
cmplwi 0,r4,0
9094
bne 2f /* Use normal procedure if r4 is not zero */
95+
_GLOBAL(memset_nocache_branch)
96+
b 2f /* Skip optimised bloc until cache is enabled */
9197

9298
clrlwi r7,r6,32-LG_CACHELINE_BYTES
9399
add r8,r7,r5

0 commit comments

Comments
 (0)