question about notation of micro kernel's arguments

[chunseoklee]

I have look into micro kernel implementation for personal study.

Due to the lack of documentation, I am little confused about notation.

For example, xnn_qu8_gemm_ukernel_function benchmark in

XNNPACK/bench/qu8-gemm.cc

Lines 36 to 39 in 15c0036

	static void GEMMBenchmark(benchmark::State& state,
	xnn_qu8_gemm_ukernel_function gemm,
	size_t mr, size_t nr, size_t kr, size_t sr,
	benchmark::utils::IsaCheckFunction isa_check = nullptr)

takes mr, nr, kr as arguments.

My question is which is the dimension for fully-connected operation's kernel(weight) ? I think nr*kr is the size of FC's kernel and mr*kr is the size of FC's input. Please let me know if this is incorrect.

Thank you.

[Maratyszcza]

mr*nr are the dimensions of the output tile produced in one invocation of the inner loop of GEMM/IGEMM microkernel call. kr and sr are internal weight packing parameters.

I suggest you read this classical paper of matrix-matrix multiplication to better understand how the GEMM microkernels are organized.