Ard Biesheuvel bd2ad885e3 crypto: arm64/aes-ce-ccm - move kernel mode neon en/disable into loop ... When kernel mode NEON was first introduced on arm64, the preserve and restore of the userland NEON state was completely unoptimized, and involved saving all registers on each call to kernel_neon_begin(), and restoring them on each call to kernel_neon_end(). For this reason, the NEON crypto code that was introduced at the time keeps the NEON enabled throughout the execution of the crypto API methods, which may include calls back into the crypto API that could result in memory allocation or other actions that we should avoid when running with preemption disabled. Since then, we have optimized the kernel mode NEON handling, which now restores lazily (upon return to userland), and so the preserve action is only costly the first time it is called after entering the kernel. So let's put the kernel_neon_begin() and kernel_neon_end() calls around the actual invocations of the NEON crypto code, and run the remainder of the code with kernel mode NEON disabled (and preemption enabled) Signed-off-by: Ard Biesheuvel <ard.biesheuvel@linaro.org> Signed-off-by: Herbert Xu <herbert@gondor.apana.org.au>		2018-03-16 23:35:54 +08:00
..
.gitignore	crypto: arm64/sha2 - add generated .S files to .gitignore	2016-11-29 16:06:56 +08:00
aes-ce-ccm-core.S	crypto: arm64/aes-ce-cipher - match round key endianness with generic code	2017-08-04 09:27:19 +08:00
aes-ce-ccm-glue.c	crypto: arm64/aes-ce-ccm - move kernel mode neon en/disable into loop	2018-03-16 23:35:54 +08:00
aes-ce-core.S	crypto: arm64/aes-ce-cipher - move assembler code to .S file	2017-11-29 17:33:30 +11:00
aes-ce-glue.c	crypto: arm64/aes-ce-cipher - move assembler code to .S file	2017-11-29 17:33:30 +11:00
aes-ce-setkey.h	License cleanup: add SPDX GPL-2.0 license identifier to files with no license	2017-11-02 11:10:55 +01:00
aes-ce.S	crypto: arm64/aes-ce-cipher - match round key endianness with generic code	2017-08-04 09:27:19 +08:00
aes-cipher-core.S	crypto: arm64/aes-cipher - move S-box to .rodata section	2018-01-18 23:00:30 +11:00
aes-cipher-glue.c	crypto: arm64/aes - add scalar implementation	2017-01-13 00:26:49 +08:00
aes-ctr-fallback.h	crypto: arm64/aes-blk - add a non-SIMD fallback for synchronous CTR	2017-08-04 09:27:21 +08:00
aes-glue.c	crypto: arm64/aes - do not call crypto_unregister_skcipher twice on error	2017-11-29 17:33:34 +11:00
aes-modes.S	crypto: arm64/aes - add NEON/Crypto Extensions CBCMAC/CMAC/XCBC driver	2017-02-11 17:50:45 +08:00
aes-neon.S	crypto: arm64/aes-neon - move literal data to .rodata section	2018-01-18 23:00:30 +11:00
aes-neonbs-core.S	crypto: arm64/aes - don't use IV buffer to return final keystream block	2017-02-03 18:16:20 +08:00
aes-neonbs-glue.c	crypto: arm64/aes-bs - implement non-SIMD fallback for AES-CTR	2017-08-04 09:27:22 +08:00
chacha20-neon-core.S	crypto: arm64/chacha20 - implement NEON version based on SSE3 code	2017-01-13 00:26:48 +08:00
chacha20-neon-glue.c	crypto: arm64/chacha20 - take may_use_simd() into account	2017-08-04 09:27:22 +08:00
crc32-ce-core.S	crypto: arm64/crc32 - move literal data to .rodata section	2018-01-18 23:00:31 +11:00
crc32-ce-glue.c	crypto: hash - annotate algorithms taking optional key	2018-01-12 23:03:35 +11:00
crct10dif-ce-core.S	crypto: arm64/crct10dif - move literal data to .rodata section	2018-01-18 23:00:31 +11:00
crct10dif-ce-glue.c	crypto: arm64/crct10dif - add non-SIMD generic fallback	2017-08-04 09:27:16 +08:00
ghash-ce-core.S	crypto: arm64/ghash - add NEON accelerated fallback for 64-bit PMULL	2017-08-04 09:27:25 +08:00
ghash-ce-glue.c	crypto: arm64/ghash - add NEON accelerated fallback for 64-bit PMULL	2017-08-04 09:27:25 +08:00
Kconfig	crypto: arm64/speck - add NEON-accelerated implementation of Speck-XTS	2018-03-16 23:35:41 +08:00
Makefile	crypto: arm64/speck - add NEON-accelerated implementation of Speck-XTS	2018-03-16 23:35:41 +08:00
sha1-ce-core.S	crypto: arm64/sha1-ce - get rid of literal pool	2018-01-18 23:00:33 +11:00
sha1-ce-glue.c	crypto: arm64/sha1-ce - add non-SIMD generic fallback	2017-08-04 09:27:18 +08:00
sha2-ce-core.S	crypto: arm64/sha2-ce - move the round constant table to .rodata section	2018-01-18 23:00:32 +11:00
sha2-ce-glue.c	crypto: arm64/sha2-ce - add non-SIMD scalar fallback	2017-08-04 09:27:19 +08:00
sha3-ce-core.S	crypto: arm64/sha3 - new v8.2 Crypto Extensions implementation	2018-01-26 01:10:35 +11:00
sha3-ce-glue.c	crypto: arm64/sha3 - new v8.2 Crypto Extensions implementation	2018-01-26 01:10:35 +11:00
sha256-core.S_shipped	crypto: arm64/sha2 - integrate OpenSSL implementations of SHA256/SHA512	2016-11-28 19:58:05 +08:00
sha256-glue.c	crypto: arm64/sha2-ce - add non-SIMD scalar fallback	2017-08-04 09:27:19 +08:00
sha512-armv8.pl	crypto: arm64/sha2 - integrate OpenSSL implementations of SHA256/SHA512	2016-11-28 19:58:05 +08:00
sha512-ce-core.S	crypto: arm64/sha512 - fix/improve new v8.2 Crypto Extensions code	2018-01-26 01:10:36 +11:00
sha512-ce-glue.c	crypto: arm64 - implement SHA-512 using special instructions	2018-01-18 22:52:24 +11:00
sha512-core.S_shipped	crypto: arm64/sha2 - integrate OpenSSL implementations of SHA256/SHA512	2016-11-28 19:58:05 +08:00
sha512-glue.c	crypto: arm64/sha512 - fix/improve new v8.2 Crypto Extensions code	2018-01-26 01:10:36 +11:00
sm3-ce-core.S	crypto: arm64/sm3 - new v8.2 Crypto Extensions implementation	2018-01-26 01:10:35 +11:00
sm3-ce-glue.c	crypto: arm64/sm3 - new v8.2 Crypto Extensions implementation	2018-01-26 01:10:35 +11:00
speck-neon-core.S	crypto: arm64/speck - add NEON-accelerated implementation of Speck-XTS	2018-03-16 23:35:41 +08:00
speck-neon-glue.c	crypto: arm64/speck - add NEON-accelerated implementation of Speck-XTS	2018-03-16 23:35:41 +08:00