Pavel Begunkov 13bfa6f15d io_uring: remove extra tw trylocks ... Before cond_resched()'ing in handle_tw_list() we also drop the current ring context, and so the next loop iteration will need to pick/pin a new context and do trylock. The chunk removed by this patch was intended to be an optimisation covering exactly this case, i.e. retaking the lock after reschedule, but in reality it's skipped for the first iteration after resched as described and will keep hammering the lock if it's contended. Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> Link: https://lore.kernel.org/r/1ecec9483d58696e248d1bfd52cf62b04442df1d.1679931367.git.asml.silence@gmail.com Signed-off-by: Jens Axboe <axboe@kernel.dk>		2023-04-03 07:16:15 -06:00
..
advise.c	io_uring: always go async for unsupported fadvise flags	2023-01-29 15:18:26 -07:00
advise.h
alloc_cache.h	io_uring: Add KASAN support for alloc_caches	2023-04-03 07:16:14 -06:00
cancel.c	io_uring/cancel: re-grab ctx mutex after finishing wait	2022-12-21 13:31:40 -07:00
cancel.h
epoll.c	io_uring: make io_kiocb_to_cmd() typesafe	2022-08-12 17:01:00 -06:00
epoll.h
fdinfo.c	capability: just use a 'u64' instead of a 'u32[2]' array	2023-03-01 10:01:22 -08:00
fdinfo.h
filetable.c	io_uring/rsrc: fix null-ptr-deref in io_file_bitmap_get()	2023-03-22 11:04:55 -06:00
filetable.h	io_uring: kill hot path fixed file bitmap debug checks	2022-10-16 17:07:53 -06:00
fs.c	io_uring: for requests that require async, force it	2023-01-29 15:18:26 -07:00
fs.h
io_uring.c	io_uring: remove extra tw trylocks	2023-04-03 07:16:15 -06:00
io_uring.h	io_uring: mark task TASK_RUNNING before handling resume/task work	2023-02-06 08:23:21 -07:00
io-wq.c	io_uring/io-wq: drop outdated comment	2023-04-03 07:16:15 -06:00
io-wq.h
kbuf.c	io_uring/kbuf: disallow mapping a badly aligned provided ring buffer	2023-04-03 07:16:14 -06:00
kbuf.h	io_uring: add support for user mapped provided buffer ring	2023-04-03 07:14:21 -06:00
Makefile
msg_ring.c	io_uring/msg_ring: let target know allocated index	2023-03-16 07:16:56 -06:00
msg_ring.h	io_uring: get rid of double locking	2022-12-07 06:47:13 -07:00
net.c	io_uring/net: avoid sending -ECONNABORTED on repeated connection requests	2023-03-20 20:44:45 -06:00
net.h	io_uring: Add KASAN support for alloc_caches	2023-04-03 07:16:14 -06:00
nop.c
nop.h
notif.c	io_uring: refactor req allocation	2023-01-29 15:17:41 -07:00
notif.h	io_uring: move zc reporting from the hot path	2022-11-21 07:38:31 -07:00
opdef.c	io_uring,audit: don't log IORING_OP_MADVISE	2023-02-10 16:00:30 -07:00
opdef.h	io_uring: Split io_issue_def struct	2023-01-29 15:17:41 -07:00
openclose.c	io_uring: always go async for unsupported open flags	2023-01-29 15:18:26 -07:00
openclose.h
poll.c	io_uring/poll: clear single/double poll flags on poll arming	2023-03-28 07:09:01 -06:00
poll.h	io_uring/poll: allow some retries for poll triggering spuriously	2023-02-25 20:10:13 -07:00
refs.h
rsrc.c	io_uring/rsrc: fix null-ptr-deref in io_file_bitmap_get()	2023-03-22 11:04:55 -06:00
rsrc.h	io_uring/rsrc: fix rogue rsrc node grabbing	2023-03-29 09:23:46 -06:00
rw.c	for-6.3/iter-ubuf-2023-02-16	2023-02-20 14:03:57 -08:00
rw.h	io_uring/rw: don't lose partial IO result on fail	2022-09-21 13:15:02 -06:00
slist.h	io_uring: silence variable ‘prev’ set but not used warning	2023-03-09 10:10:58 -07:00
splice.c	io_uring: for requests that require async, force it	2023-01-29 15:18:26 -07:00
splice.h
sqpoll.c	io_uring/sqpoll: Do not set PF_NO_SETAFFINITY on sqpoll threads	2023-03-15 06:50:59 -06:00
sqpoll.h	io_uring: make io_sqpoll_wait_sq return void	2023-01-29 15:17:40 -07:00
statx.c	io_uring: for requests that require async, force it	2023-01-29 15:18:26 -07:00
statx.h
sync.c	io_uring: for requests that require async, force it	2023-01-29 15:18:26 -07:00
sync.h
tctx.c	io_uring: rename 'in_idle' to 'in_cancel'	2023-02-22 09:57:23 -07:00
tctx.h	io_uring: simplify __io_uring_add_tctx_node	2022-10-07 12:25:30 -06:00
timeout.c	io_uring: ease timeout flush locking requirements	2022-12-14 08:53:35 -07:00
timeout.h	io_uring: remove unused return from io_disarm_next	2022-09-21 13:15:01 -06:00
uring_cmd.c	block-6.3-2023-03-24	2023-03-24 14:10:39 -07:00
uring_cmd.h
xattr.c	io_uring: for requests that require async, force it	2023-01-29 15:18:26 -07:00
xattr.h