Xiao Wang a43fe27d65 riscv: Optimize crc32 with Zbc extension ... As suggested by the B-ext spec, the Zbc (carry-less multiplication) instructions can be used to accelerate CRC calculations. Currently, the crc32 is the most widely used crc function inside kernel, so this patch focuses on the optimization of just the crc32 APIs. Compared with the current table-lookup based optimization, Zbc based optimization can also achieve large stride during CRC calculation loop, meantime, it avoids the memory access latency of the table-lookup based implementation and it reduces memory footprint. If Zbc feature is not supported in a runtime environment, then the table-lookup based implementation would serve as fallback via alternative mechanism. By inspecting the vmlinux built by gcc v12.2.0 with default optimization level (-O2), we can see below instruction count change for each 8-byte stride in the CRC32 loop: rv64: crc32_be (54->31), crc32_le (54->13), __crc32c_le (54->13) rv32: crc32_be (50->32), crc32_le (50->16), __crc32c_le (50->16) The compile target CPU is little endian, extra effort is needed for byte swapping for the crc32_be API, thus, the instruction count change is not as significant as that in the *_le cases. This patch is tested on QEMU VM with the kernel CRC32 selftest for both rv64 and rv32. Running the CRC32 selftest on a real hardware (SpacemiT K1) with Zbc extension shows 65% and 125% performance improvement respectively on crc32_test() and crc32c_test(). Signed-off-by: Xiao Wang <xiao.w.wang@intel.com> Reviewed-by: Charlie Jenkins <charlie@rivosinc.com> Link: https://lore.kernel.org/r/20240621054707.1847548-1-xiao.w.wang@intel.com Signed-off-by: Palmer Dabbelt <palmer@rivosinc.com>		2024-07-10 13:19:50 -07:00
..
clear_page.S	use linux/export.h rather than asm-generic/export.h	2024-01-09 20:10:40 -08:00
crc32.c	riscv: Optimize crc32 with Zbc extension	2024-07-10 13:19:50 -07:00
csum.c	RISC-V Patches for the 6.9 Merge Window	2024-03-22 10:41:13 -07:00
delay.c	include/linux/delay.h: replace kernel.h with the necessary inclusions	2021-11-09 10:02:49 -08:00
error-inject.c	riscv: Add support for function error injection	2021-01-14 15:09:09 -08:00
Makefile	riscv: Optimize crc32 with Zbc extension	2024-07-10 13:19:50 -07:00
memcpy.S	riscv: Use SYM_*() assembly macros instead of deprecated ones	2023-11-06 09:42:47 -08:00
memmove.S	riscv: Use SYM_*() assembly macros instead of deprecated ones	2023-11-06 09:42:47 -08:00
memset.S	riscv: Use SYM_*() assembly macros instead of deprecated ones	2023-11-06 09:42:47 -08:00
riscv_v_helpers.c	riscv: lib: vectorize copy_to_user/copy_from_user	2024-01-16 07:13:57 -08:00
strcmp.S	riscv: lib: Include hwcap.h directly	2023-03-14 20:51:24 -07:00
strlen.S	riscv: Allow to downgrade paging mode from the command line	2023-04-26 07:30:52 -07:00
strncmp.S	riscv: lib: Include hwcap.h directly	2023-03-14 20:51:24 -07:00
tishift.S	use linux/export.h rather than asm-generic/export.h	2024-01-09 20:10:40 -08:00
uaccess_vector.S	riscv: remove unneeded #include <asm-generic/export.h>	2024-01-21 16:36:29 -08:00
uaccess.S	riscv: vector: adjust minimum Vector requirement to ZVE32X	2024-05-30 14:33:10 -07:00
xor.S	riscv: Add vector extension XOR implementation	2024-01-16 07:13:55 -08:00