linux/crypto
Eric Dumazet 1abe267f17 net: add sk_wake_async_rcu() helper
While looking at UDP receive performance, I saw sk_wake_async()
was no longer inlined.

This matters at least on AMD Zen1-4 platforms (see SRSO)

This might be because rcu_read_lock() and rcu_read_unlock()
are no longer nops in recent kernels ?

Add sk_wake_async_rcu() variant, which must be called from
contexts already holding rcu lock.

As SOCK_FASYNC is deprecated in modern days, use unlikely()
to give a hint to the compiler.

sk_wake_async_rcu() is properly inlined from
__udp_enqueue_schedule_skb() and sock_def_readable().

Signed-off-by: Eric Dumazet <edumazet@google.com>
Link: https://lore.kernel.org/r/20240328144032.1864988-5-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
2024-03-29 15:03:11 -07:00
..
asymmetric_keys Revert "crypto: pkcs7 - remove sha1 support" 2024-03-22 19:42:20 +08:00
async_tx
842.c
Kconfig RISC-V Patches for the 6.9 Merge Window 2024-03-22 10:41:13 -07:00
Makefile Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
acompress.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
adiantum.c
aead.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
aegis-neon.h
aegis.h
aegis128-core.c
aegis128-neon-inner.c
aegis128-neon.c
aes_generic.c
aes_ti.c
af_alg.c net: add sk_wake_async_rcu() helper 2024-03-29 15:03:11 -07:00
ahash.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
akcipher.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
algapi.c crypto: api - Disallow identical driver names 2023-12-15 17:52:53 +08:00
algboss.c
algif_aead.c
algif_hash.c crypto: algif_hash - Remove bogus SGL free on zero-length error path 2024-02-02 18:08:12 +08:00
algif_rng.c
algif_skcipher.c crypto: algif_skcipher - Fix stream cipher chaining 2023-12-08 11:59:46 +08:00
ansi_cprng.c
anubis.c
api.c
arc4.c crypto: arc4 - Add internal state 2023-12-08 11:59:46 +08:00
aria_generic.c
authenc.c
authencesn.c
blake2b_generic.c treewide: update LLVM Bugzilla links 2024-02-22 15:38:51 -08:00
blowfish_common.c
blowfish_generic.c
camellia_generic.c
cast5_generic.c
cast6_generic.c
cast_common.c
cbc.c crypto: cbc - Ensure statesize is zero 2024-02-02 18:08:12 +08:00
ccm.c
chacha20poly1305.c
chacha_generic.c
cipher.c
cmac.c
compress.c
compress.h Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
crc32_generic.c
crc32c_generic.c
crc64_rocksoft_generic.c
crct10dif_common.c
crct10dif_generic.c
cryptd.c
crypto_engine.c
crypto_null.c
crypto_user_base.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
crypto_user_stat.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
ctr.c
cts.c
curve25519-generic.c
deflate.c
des_generic.c
dh.c crypto: dh - Make public key test FIPS-only 2024-03-01 18:35:40 +08:00
dh_helper.c
drbg.c crypto: drbg - Remove SHA1 from drbg 2023-11-17 19:16:29 +08:00
ecb.c crypto: skcipher - Add internal state support 2023-12-08 11:59:46 +08:00
ecc.c
ecc_curve_defs.h
ecdh.c
ecdh_helper.c
ecdsa.c
ecdsasignature.asn1
echainiv.c
ecrdsa.c
ecrdsa_defs.h
ecrdsa_params.asn1
ecrdsa_pub_key.asn1
essiv.c
fcrypt.c
fips.c
gcm.c
geniv.c
ghash-generic.c
hash.h Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
hash_info.c
hctr2.c
hmac.c
internal.h
jitterentropy-kcapi.c
jitterentropy-testing.c
jitterentropy.c
jitterentropy.h
kdf_sp800108.c
keywrap.c
khazad.c
kpp.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
lrw.c
lskcipher.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
lz4.c
lz4hc.c
lzo-rle.c
lzo.c
md4.c
md5.c
michael_mic.c
nhpoly1305.c
pcbc.c crypto: pcbc - remove redundant assignment to nbytes 2024-01-26 16:39:32 +08:00
pcrypt.c
poly1305_generic.c
polyval-generic.c
proc.c
ripemd.h
rmd160.c
rng.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
rsa-pkcs1pad.c
rsa.c crypto: rsa - restrict plaintext/ciphertext values more 2024-02-09 12:57:18 +08:00
rsa_helper.c
rsaprivkey.asn1
rsapubkey.asn1
scatterwalk.c
scompress.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
seed.c
seqiv.c
serpent_generic.c
sha1_generic.c
sha3_generic.c
sha256_generic.c
sha512_generic.c
shash.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
sig.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
simd.c
skcipher.c Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
skcipher.h Revert "crypto: remove CONFIG_CRYPTO_STATS" 2024-03-13 09:49:37 +08:00
sm2.c
sm2signature.asn1
sm3.c
sm3_generic.c
sm4.c
sm4_generic.c
streebog_generic.c
tcrypt.c crypto: tcrypt - add ffdhe2048(dh) test 2024-03-08 19:23:25 +08:00
tcrypt.h
tea.c
testmgr.c crypto: testmgr - remove unused xts4096 and xts512 algorithms from testmgr.c 2024-01-26 16:39:33 +08:00
testmgr.h Revert "crypto: pkcs7 - remove sha1 support" 2024-03-22 19:42:20 +08:00
twofish_common.c
twofish_generic.c
vmac.c
wp512.c
xcbc.c
xctr.c
xor.c
xts.c
xxhash_generic.c
zstd.c