Go to file
Changlong Xie 9bc9732fae nbd: Use CoQueue for free_sema instead of CoMutex
NBD is using the CoMutex in a way that wasn't anticipated. For example, if there are
N(N=26, MAX_NBD_REQUESTS=16) nbd write requests, so we will invoke nbd_client_co_pwritev
N times.
----------------------------------------------------------------------------------------
time request Actions
1    1       in_flight=1, Coroutine=C1
2    2       in_flight=2, Coroutine=C2
...
15   15      in_flight=15, Coroutine=C15
16   16      in_flight=16, Coroutine=C16, free_sema->holder=C16, mutex->locked=true
17   17      in_flight=16, Coroutine=C17, queue C17 into free_sema->queue
18   18      in_flight=16, Coroutine=C18, queue C18 into free_sema->queue
...
26   N       in_flight=16, Coroutine=C26, queue C26 into free_sema->queue
----------------------------------------------------------------------------------------

Once nbd client recieves request No.16' reply, we will re-enter C16. It's ok, because
it's equal to 'free_sema->holder'.
----------------------------------------------------------------------------------------
time request Actions
27   16      in_flight=15, Coroutine=C16, free_sema->holder=C16, mutex->locked=false
----------------------------------------------------------------------------------------

Then nbd_coroutine_end invokes qemu_co_mutex_unlock what will pop coroutines from
free_sema->queue's head and enter C17. More free_sema->holder is C17 now.
----------------------------------------------------------------------------------------
time request Actions
28   17      in_flight=16, Coroutine=C17, free_sema->holder=C17, mutex->locked=true
----------------------------------------------------------------------------------------

In above scenario, we only recieves request No.16' reply. As time goes by, nbd client will
almostly recieves replies from requests 1 to 15 rather than request 17 who owns C17. In this
case, we will encounter assert "mutex->holder == self" failed since Kevin's commit 0e438cdc
"coroutine: Let CoMutex remember who holds it". For example, if nbd client recieves request
No.15' reply, qemu will stop unexpectedly:
----------------------------------------------------------------------------------------
time request       Actions
29   15(most case) in_flight=15, Coroutine=C15, free_sema->holder=C17, mutex->locked=false
----------------------------------------------------------------------------------------

Per Paolo's suggestion "The simplest fix is to change it to CoQueue, which is like a condition
variable", this patch replaces CoMutex with CoQueue.

Cc: Wen Congyang <wency@cn.fujitsu.com>
Reported-by: zhanghailiang <zhang.zhanghailiang@huawei.com>
Suggested-by: Paolo Bonzini <pbonzini@redhat.com>
Signed-off-by: Changlong Xie <xiecl.fnst@cn.fujitsu.com>
Message-Id: <1476267508-19499-1-git-send-email-xiecl.fnst@cn.fujitsu.com>
Signed-off-by: Paolo Bonzini <pbonzini@redhat.com>
2016-11-01 16:06:57 +01:00
audio trace-events: fix first line comment in trace-events 2016-08-12 10:36:01 +01:00
backends Defer BrlAPI tty acquisition to when guest starts using device 2016-10-28 11:19:38 +02:00
block nbd: Use CoQueue for free_sema instead of CoMutex 2016-11-01 16:06:57 +01:00
bsd-user translate-all: add DEBUG_LOCKING asserts 2016-10-31 10:24:45 +01:00
contrib Clean up ill-advised or unusual header guards 2016-07-12 16:20:46 +02:00
crypto crypto: fix initialization of gcrypt threading 2016-10-20 12:19:35 +01:00
default-configs ppc/pnv: add skeleton PowerNV platform 2016-10-28 09:38:24 +11:00
disas disas/arm.c: Remove unused macro definitions 2016-09-22 18:13:09 +01:00
docs block: Add 'base-node' parameter to the 'block-stream' command 2016-10-31 16:52:39 +01:00
dtc@65cc4d2748 dtc: Update dtc / libfdt submodule to version 1.4.0 2015-06-03 23:56:49 +02:00
fpu fpu: add mechanism to check for invalid long double formats 2016-09-15 12:43:18 +01:00
fsdev 9pfs: fsdev: drop useless extern annotation for functions 2016-10-17 14:13:58 +02:00
gdb-xml target-ppc: gdbstub: Add VSX support 2016-01-30 23:37:38 +11:00
hw 9pfs: drop excessive error message from virtfs_reset() 2016-11-01 12:03:03 +01:00
include VFIO updates 2016-10-31 2016-10-31 18:19:06 +00:00
io io: add ability to set a name for IO channels 2016-10-27 09:13:10 +02:00
libdecnumber libdecnumber: Clean up includes 2016-02-16 14:29:27 +00:00
linux-headers linux-headers: update 2016-10-13 12:58:06 +11:00
linux-user linux-user/elfload: ensure mmap_lock() held while setting up 2016-10-31 10:51:16 +01:00
migration migration: fix compiler warning on uninitialized variable 2016-11-01 09:31:53 +00:00
nbd nbd: set name for all I/O channels created 2016-10-27 09:13:10 +02:00
net trivial patches for 2016-10-28 2016-10-31 11:58:30 +00:00
pc-bios Update OpenBIOS images to 1dc4f16 built from submodule. 2016-10-31 20:01:25 +00:00
pixman@87eea99e44 pixman: update internal copy to pixman-0.32.6 2014-09-15 08:14:19 +02:00
po rules.mak: quiet-command: Split command name and args to print 2016-10-06 12:11:51 +01:00
qapi qapi: allow blockdev-add for NFS 2016-10-31 16:52:39 +01:00
qga qga: add vsock-listen method 2016-10-31 19:49:33 -05:00
qobject qdict: implement a qdict_crumple method for un-flattening a dict 2016-10-25 17:56:14 +02:00
qom qapi: rename QmpOutputVisitor to QObjectOutputVisitor 2016-10-25 16:25:54 +02:00
replay replay: allow replay stopping and restarting 2016-09-27 11:57:30 +02:00
roms Update OpenBIOS images to 1dc4f16 built from submodule. 2016-10-31 20:01:25 +00:00
scripts checkpatch: tweak "struct should normally be const" warning 2016-11-01 16:06:57 +01:00
slirp hw: replace most use of qemu_chr_fe_write with qemu_chr_fe_write_all 2016-09-13 19:09:42 +02:00
stubs Migration bits from the COLO project 2016-10-31 13:06:38 +00:00
target-alpha target-alpha: Emulate LL/SC using cmpxchg helpers 2016-10-26 08:29:02 -07:00
target-arm Base patches for MTTCG enablement. 2016-10-31 15:29:12 +00:00
target-cris exec: move cpu_exec_init() calls to realize functions 2016-10-24 17:29:16 -02:00
target-i386 target-i386: Print warning when mixing [+-]foo and foo=(on|off) 2016-10-31 16:20:59 -02:00
target-lm32 target-lm32: rewrite gen_compare() 2016-10-28 18:17:23 +03:00
target-m68k target-m68k: immediate ops manage word and byte operands 2016-10-28 10:38:48 +02:00
target-microblaze exec: move cpu_exec_init() calls to realize functions 2016-10-24 17:29:16 -02:00
target-mips clean-up: removed duplicate #includes 2016-10-28 18:17:24 +03:00
target-moxie exec: move cpu_exec_init() calls to realize functions 2016-10-24 17:29:16 -02:00
target-openrisc exec: move cpu_exec_init() calls to realize functions 2016-10-24 17:29:16 -02:00
target-ppc trivial patches for 2016-10-28 2016-10-31 11:58:30 +00:00
target-s390x *_run_on_cpu: introduce run_on_cpu_data type 2016-10-31 15:00:25 +01:00
target-sh4 exec: move cpu_exec_init() calls to realize functions 2016-10-24 17:29:16 -02:00
target-sparc target-sparc updates for atomics and alignment 2016-11-01 11:21:02 +00:00
target-tilegx exec: move cpu_exec_init() calls to realize functions 2016-10-24 17:29:16 -02:00
target-tricore exec: move cpu_exec_init() calls to realize functions 2016-10-24 17:29:16 -02:00
target-unicore32 exec: move cpu_exec_init() calls to realize functions 2016-10-24 17:29:16 -02:00
target-xtensa clean-up: removed duplicate #includes 2016-10-28 18:17:24 +03:00
tcg tcg: comment on which functions have to be called with tb_lock held 2016-10-31 10:51:16 +01:00
tests x86 and machine queue, 2016-10-31 2016-10-31 19:06:09 +00:00
trace trace: pass trace-events to tracetool as a positional param 2016-10-12 09:54:53 +02:00
ui braille fixes and improvements. 2016-10-28 17:59:04 +01:00
util sockets: add AF_VSOCK support 2016-10-31 19:49:33 -05:00
.dir-locals.el Add .dir-locals.el file to configure emacs coding style 2015-10-08 19:46:01 +03:00
.exrc qemu: add .exrc 2012-09-07 09:02:44 +03:00
.gitignore trivial patches for 2016-10-08 2016-10-10 13:01:43 +01:00
.gitmodules ppc: add skiboot firmware for the pnv platform 2016-10-28 09:36:58 +11:00
.mailmap Update mailmap 2013-09-05 09:40:31 -05:00
.travis.yml .travis.yml: add gcc sanitizer build 2016-10-04 10:00:26 +02:00
accel.c clean-up: removed duplicate #includes 2016-10-28 18:17:24 +03:00
aio-posix.c aio-posix: avoid unnecessary aio_epoll_enabled() calls 2016-09-28 11:21:46 +01:00
aio-win32.c aio-posix: remove useless parameter 2016-07-18 15:10:52 +01:00
arch_init.c util: Add UUID API 2016-09-23 11:42:52 +08:00
async.c aio: convert from RFifoLock to QemuRecMutex 2016-10-28 21:50:18 +08:00
atomic_template.h tcg: Add atomic128 helpers 2016-10-26 08:29:01 -07:00
balloon.c all: Clean up includes 2016-02-04 17:41:30 +00:00
block.c block: Support streaming to an intermediate layer 2016-10-31 16:52:38 +01:00
blockdev-nbd.c nbd: set name for all I/O channels created 2016-10-27 09:13:10 +02:00
blockdev.c block: Add 'base-node' parameter to the 'block-stream' command 2016-10-31 16:52:39 +01:00
blockjob.c block: Add block_job_add_bdrv() 2016-10-31 16:52:38 +01:00
bootdevice.c error: Remove NULL checks on error_propagate() calls 2016-06-20 16:38:13 +02:00
bt-host.c all: Clean up includes 2016-02-04 17:41:30 +00:00
bt-vhci.c all: Clean up includes 2016-02-04 17:41:30 +00:00
Changelog Use qemu-project.org domain name 2013-10-11 09:34:56 -07:00
CODING_STYLE CODING_STYLE: Fix a typo ("have" vs. "has") 2016-10-08 11:25:29 +03:00
configure sockets: add AF_VSOCK support 2016-10-31 19:49:33 -05:00
COPYING
COPYING.LIB
cpu-exec-common.c tcg: Add EXCP_ATOMIC 2016-10-26 08:29:00 -07:00
cpu-exec.c Base patches for MTTCG enablement. 2016-10-31 15:29:12 +00:00
cpus-common.c *_run_on_cpu: introduce run_on_cpu_data type 2016-10-31 15:00:25 +01:00
cpus.c *_run_on_cpu: introduce run_on_cpu_data type 2016-10-31 15:00:25 +01:00
cputlb.c clean-up: removed duplicate #includes 2016-10-28 18:17:24 +03:00
device_tree.c qemu-common: stop including qemu/bswap.h from qemu-common.h 2016-05-19 16:42:28 +02:00
device-hotplug.c blockdev: Split monitor reference from BB creation 2016-03-17 15:47:56 +01:00
disas.c Remove remainders of HPPA backend 2016-09-15 15:32:22 +03:00
dma-helpers.c dma-helpers: explicitly pass alignment into DMA helpers 2016-10-27 16:29:13 -04:00
dump.c error: Remove NULL checks on error_propagate() calls 2016-06-20 16:38:13 +02:00
exec.c tcg: move locking for tb_invalidate_phys_page_range up 2016-10-31 15:00:25 +01:00
gdbstub.c clean-up: removed duplicate #includes 2016-10-28 18:17:24 +03:00
HACKING Disable warn about left shifts of negative values 2016-08-09 22:57:36 +02:00
hmp-commands-info.hx intc: make HMP 'info irq' and 'info pic' commands available on all targets 2016-10-04 10:00:25 +02:00
hmp-commands.hx COLO: Add 'x-colo-lost-heartbeat' command to trigger failover 2016-10-30 15:17:39 +05:30
hmp.c block: Add 'base-node' parameter to the 'block-stream' command 2016-10-31 16:52:39 +01:00
hmp.h COLO: Add 'x-colo-lost-heartbeat' command to trigger failover 2016-10-30 15:17:39 +05:30
iohandler.c iohandler: Introduce iohandler_get_aio_context 2016-04-22 16:43:42 +02:00
ioport.c hw: remove pio_addr_t 2016-05-19 16:42:30 +02:00
iothread.c iothread: release AioContext around aio_poll 2016-10-28 21:50:18 +08:00
kvm-all.c *_run_on_cpu: introduce run_on_cpu_data type 2016-10-31 15:00:25 +01:00
kvm-stub.c kvm-all: Pass requester ID to MSI routing functions 2016-10-04 13:28:09 +01:00
LICENSE vfio: move hw/misc/vfio.c to hw/vfio/pci.c Move vfio.h into include/hw/vfio 2014-12-19 15:24:06 -07:00
main-loop.c main: set names for main loop sources created 2016-10-27 09:13:11 +02:00
MAINTAINERS Migration bits from the COLO project 2016-10-31 13:06:38 +00:00
Makefile trivial patches for 2016-10-28 2016-10-31 11:58:30 +00:00
Makefile.objs tcg: Add atomic helpers 2016-10-26 08:29:01 -07:00
Makefile.target tcg: Add atomic helpers 2016-10-26 08:29:01 -07:00
memory_mapping.c memory: Replace skip_dump flag with "ram_device" 2016-10-31 09:53:03 -06:00
memory.c memory: Don't use memcpy for ram_device regions 2016-10-31 09:53:03 -06:00
module-common.c all: Clean up includes 2016-02-04 17:41:30 +00:00
monitor.c clean-up: removed duplicate #includes 2016-10-28 18:17:24 +03:00
numa.c numa: reduce code duplication by adding helper numa_get_node_for_cpu() 2016-10-10 01:16:57 +03:00
os-posix.c use g_path_get_dirname instead of dirname 2016-07-17 09:59:21 +02:00
os-win32.c all: Clean up includes 2016-02-04 17:41:30 +00:00
page_cache.c coccinelle: Remove unnecessary variables for function return value 2016-06-20 16:38:13 +02:00
qapi-schema.json sockets: add AF_VSOCK support 2016-10-31 19:49:33 -05:00
qdev-monitor.c qdev-monitor: Add blk_by_qdev_id() 2016-09-23 13:36:10 +02:00
qdict-test-data.txt
qemu-bridge-helper.c all: Remove unnecessary glib.h includes 2016-06-07 18:19:24 +03:00
qemu-char.c Merge qio 2016/10/27 v1 2016-10-28 15:30:55 +01:00
qemu-doc.texi qemu-doc: merge qemu-tech and qemu-doc 2016-10-07 10:05:54 +02:00
qemu-ga.texi qemu-ga: Remove stray 'q' in documentation 2016-10-28 18:17:23 +03:00
qemu-img-cmds.hx qemu-img: add skip option to dd 2016-09-20 22:10:57 +02:00
qemu-img.c qemu-img: call aio_context_acquire/release around block job 2016-10-28 21:50:18 +08:00
qemu-img.texi qemu-img: add skip option to dd 2016-09-20 22:10:57 +02:00
qemu-io-cmds.c trivial patches for 2016-10-28 2016-10-31 11:58:30 +00:00
qemu-io.c trace: provide mechanism for registering trace events 2016-10-12 09:52:50 +02:00
qemu-nbd.c qemu-nbd: Add --fork option 2016-10-24 17:54:03 +02:00
qemu-nbd.texi qemu-nbd: Add --fork option 2016-10-24 17:54:03 +02:00
qemu-option-trace.texi doc: move text describing --trace to specific .texi file 2016-06-28 21:14:12 +01:00
qemu-options-wrapper.h vl.c: In qemu -h output, only print options for the arch we are running as 2011-12-19 10:27:33 -06:00
qemu-options.h Clean up ill-advised or unusual header guards 2016-07-12 16:20:46 +02:00
qemu-options.hx monitor: deprecate 'default' option 2016-10-28 18:17:23 +03:00
qemu-seccomp.c seccomp: adding getrusage to the whitelist 2016-09-21 11:26:02 +02:00
qemu-tech.texi qemu-doc: merge qemu-tech and qemu-doc 2016-10-07 10:05:54 +02:00
qemu-timer.c timer: set vm_clock disabled default 2016-08-09 22:57:36 +02:00
qemu.nsi qemu-doc: merge qemu-tech and qemu-doc 2016-10-07 10:05:54 +02:00
qemu.sasl sasl: Avoid 'Could not find keytab file' in syslog 2014-03-15 13:54:18 +04:00
qmp.c clean-up: removed duplicate #includes 2016-10-28 18:17:24 +03:00
qtest.c char: remove explicit_fe_open, use a set_handlers argument 2016-10-24 15:46:10 +02:00
README qemu-doc: drop installation and compilation notes 2016-10-07 10:05:15 +02:00
replication.c replication: Introduce new APIs to do replication operation 2016-09-13 11:00:56 +01:00
replication.h replication: Introduce new APIs to do replication operation 2016-09-13 11:00:56 +01:00
rules.mak build-sys: fix find-in-path 2016-10-08 11:25:29 +03:00
softmmu_template.h cputlb: Tidy some macros 2016-10-26 08:29:00 -07:00
spice-qemu-char.c char: remove explicit_be_open from CharDriverState 2016-10-24 15:46:11 +02:00
tcg-runtime.c tcg: Add CONFIG_ATOMIC64 2016-10-26 08:29:01 -07:00
tci.c tcg/tci: Add support for fence 2016-09-16 08:12:12 -07:00
thread-pool.c coroutine: move entry argument to qemu_coroutine_create 2016-07-13 13:26:02 +02:00
thunk.c thunk: Rename args and fields in host-target bitmask conversion code 2016-06-07 18:19:24 +03:00
tpm.c qapi: Don't special-case simple union wrappers 2016-03-18 10:29:26 +01:00
trace-events memory: Don't use memcpy for ram_device regions 2016-10-31 09:53:03 -06:00
translate-all.c tcg: move locking for tb_invalidate_phys_page_range up 2016-10-31 15:00:25 +01:00
translate-all.h trace: Add per-vCPU tracing states for events with the 'vcpu' property 2016-07-18 18:23:12 +01:00
translate-common.c include: move CPU-related definitions out of qemu-common.h 2016-05-19 13:08:04 +02:00
user-exec.c tcg: Merge GETPC and GETRA 2016-09-16 08:12:11 -07:00
VERSION Open 2.8 development tree 2016-09-05 11:38:54 +01:00
version.rc Use qemu-project.org domain name 2013-10-11 09:34:56 -07:00
vl.c Migration bits from the COLO project 2016-10-31 13:06:38 +00:00
xen-common-stub.c xen: Clean up includes 2016-01-29 15:07:23 +00:00
xen-common.c xen: Rename xen_be_printf to xen_pv_printf 2016-10-28 17:53:50 -07:00
xen-hvm-stub.c fix MSI injection on Xen 2016-02-06 20:44:10 +02:00
xen-hvm.c xen: handle inbound migration of VMs without ioreq server pages 2016-08-12 16:38:30 -07:00
xen-mapcache.c os-posix: include sys/mman.h 2016-06-16 18:39:03 +02:00

         QEMU README
         ===========

QEMU is a generic and open source machine & userspace emulator and
virtualizer.

QEMU is capable of emulating a complete machine in software without any
need for hardware virtualization support. By using dynamic translation,
it achieves very good performance. QEMU can also integrate with the Xen
and KVM hypervisors to provide emulated hardware while allowing the
hypervisor to manage the CPU. With hypervisor support, QEMU can achieve
near native performance for CPUs. When QEMU emulates CPUs directly it is
capable of running operating systems made for one machine (e.g. an ARMv7
board) on a different machine (e.g. an x86_64 PC board).

QEMU is also capable of providing userspace API virtualization for Linux
and BSD kernel interfaces. This allows binaries compiled against one
architecture ABI (e.g. the Linux PPC64 ABI) to be run on a host using a
different architecture ABI (e.g. the Linux x86_64 ABI). This does not
involve any hardware emulation, simply CPU and syscall emulation.

QEMU aims to fit into a variety of use cases. It can be invoked directly
by users wishing to have full control over its behaviour and settings.
It also aims to facilitate integration into higher level management
layers, by providing a stable command line interface and monitor API.
It is commonly invoked indirectly via the libvirt library when using
open source applications such as oVirt, OpenStack and virt-manager.

QEMU as a whole is released under the GNU General Public License,
version 2. For full licensing details, consult the LICENSE file.


Building
========

QEMU is multi-platform software intended to be buildable on all modern
Linux platforms, OS-X, Win32 (via the Mingw64 toolchain) and a variety
of other UNIX targets. The simple steps to build QEMU are:

  mkdir build
  cd build
  ../configure
  make

Additional information can also be found online via the QEMU website:

  http://qemu-project.org/Hosts/Linux
  http://qemu-project.org/Hosts/W32


Submitting patches
==================

The QEMU source code is maintained under the GIT version control system.

   git clone git://git.qemu-project.org/qemu.git

When submitting patches, the preferred approach is to use 'git
format-patch' and/or 'git send-email' to format & send the mail to the
qemu-devel@nongnu.org mailing list. All patches submitted must contain
a 'Signed-off-by' line from the author. Patches should follow the
guidelines set out in the HACKING and CODING_STYLE files.

Additional information on submitting patches can be found online via
the QEMU website

  http://qemu-project.org/Contribute/SubmitAPatch
  http://qemu-project.org/Contribute/TrivialPatches


Bug reporting
=============

The QEMU project uses Launchpad as its primary upstream bug tracker. Bugs
found when running code built from QEMU git or upstream released sources
should be reported via:

  https://bugs.launchpad.net/qemu/

If using QEMU via an operating system vendor pre-built binary package, it
is preferable to report bugs to the vendor's own bug tracker first. If
the bug is also known to affect latest upstream code, it can also be
reported via launchpad.

For additional information on bug reporting consult:

  http://qemu-project.org/Contribute/ReportABug


Contact
=======

The QEMU community can be contacted in a number of ways, with the two
main methods being email and IRC

 - qemu-devel@nongnu.org
   http://lists.nongnu.org/mailman/listinfo/qemu-devel
 - #qemu on irc.oftc.net

Information on additional methods of contacting the community can be
found online via the QEMU website:

  http://qemu-project.org/Contribute/StartHere

-- End