Go to file
Avihai Horon 745c42912a vfio/migration: Add support for switchover ack capability
Loading of a VFIO device's data can take a substantial amount of time as
the device may need to allocate resources, prepare internal data
structures, etc. This can increase migration downtime, especially for
VFIO devices with a lot of resources.

To solve this, VFIO migration uAPI defines "initial bytes" as part of
its precopy data stream. Initial bytes can be used in various ways to
improve VFIO migration performance. For example, it can be used to
transfer device metadata to pre-allocate resources in the destination.
However, for this to work we need to make sure that all initial bytes
are sent and loaded in the destination before the source VM is stopped.

Use migration switchover ack capability to make sure a VFIO device's
initial bytes are sent and loaded in the destination before the source
stops the VM and attempts to complete the migration.
This can significantly reduce migration downtime for some devices.

Signed-off-by: Avihai Horon <avihaih@nvidia.com>
Reviewed-by: Cédric Le Goater <clg@redhat.com>
Tested-by: YangHang Liu <yanghliu@redhat.com>
Acked-by: Alex Williamson <alex.williamson@redhat.com>
Signed-off-by: Cédric Le Goater <clg@redhat.com>
2023-06-30 06:02:51 +02:00
.github/workflows github: fix config mistake preventing repo lockdown commenting 2022-04-26 16:12:26 +01:00
.gitlab/issue_templates .gitlab/issue_templates: Move suggestions into comments 2022-12-15 15:19:24 +01:00
.gitlab-ci.d gitlab-ci: add msys2 meson test to junit report 2023-06-26 08:58:02 +02:00
accel exec/memory: Add symbol for the min value of memory listener priority 2023-06-28 14:27:59 +02:00
audio ui/dbus: win32 support 2023-06-27 17:08:56 +02:00
authz error: Drop superfluous #include "qapi/qmp/qerror.h" 2023-02-23 13:56:14 +01:00
backends cryptodev: fix memory leak during stats query 2023-06-23 03:09:45 -04:00
block Block layer patches 2023-06-28 17:29:53 +02:00
bsd-user target/i386: implement SYSCALL/SYSRET in 32-bit emulators 2023-06-26 10:23:56 +02:00
chardev chardev/char-win-stdio: Support VT sequences on Windows 11 host 2023-06-27 17:08:56 +02:00
common-user common-user/host/ppc: Implement safe-syscall.inc.S 2023-01-23 14:39:48 -10:00
configs arm/Kconfig: Keep Kconfig default entries in default.mak as documentation 2023-05-30 15:50:17 +01:00
contrib vhost-user: fully use new backend/frontend naming 2023-06-26 09:50:00 -04:00
crypto win32: replace closesocket() with close() wrapper 2023-03-13 15:39:31 +04:00
disas meson: Replace softmmu_ss -> system_ss 2023-06-20 10:01:30 +02:00
docs vfio/migration: Add support for switchover ack capability 2023-06-30 06:02:51 +02:00
dump meson: Replace softmmu_ss -> system_ss 2023-06-20 10:01:30 +02:00
ebpf meson: Replace softmmu_ss -> system_ss 2023-06-20 10:01:30 +02:00
fpu softfloat: use QEMU_FLATTEN to avoid mistaken isra inlining 2023-06-26 17:33:00 +02:00
fsdev meson: Replace softmmu_ss -> system_ss 2023-06-20 10:01:30 +02:00
gdb-xml Hexagon (gdbstub): add HVX support 2023-05-18 12:40:52 -07:00
gdbstub meson: Replace softmmu_ss -> system_ss 2023-06-20 10:01:30 +02:00
host/include host/include/x86_64: Use __m128i for "x" constraints 2023-06-20 10:01:30 +02:00
hw vfio/migration: Add support for switchover ack capability 2023-06-30 06:02:51 +02:00
include vfio/migration: Add support for switchover ack capability 2023-06-30 06:02:51 +02:00
io aio: remove aio_disable_external() API 2023-05-30 17:37:26 +02:00
libdecnumber libdecnumber/dpd/decimal64: Fix compiler warning from Clang 15 2022-11-11 09:13:52 +01:00
linux-headers Update linux headers to v6.3rc5 2023-04-28 15:55:55 +02:00
linux-user target/i386: emulate 64-bit ring 0 for linux-user if LM feature is set 2023-06-29 10:49:43 +02:00
migration migration: Enable switchover ack capability 2023-06-30 06:02:51 +02:00
monitor meson: Replace softmmu_ss -> system_ss 2023-06-20 10:01:30 +02:00
nbd bulk: Remove pointless QOM casts 2023-06-05 20:48:34 +02:00
net vhost-vdpa: do not cleanup the vdpa/vhost-net structures if peer nic is present 2023-06-26 09:50:00 -04:00
pc-bios target/hppa: Fix boot and reboot for SMP machines 2023-06-25 08:58:49 +02:00
plugins plugins: Remove unused 'exec/helper-proto.h' header 2023-06-20 10:01:30 +02:00
po po: add ukrainian translation 2022-07-05 10:15:49 +02:00
python mkvenv: always pass locally-installed packages to pip 2023-06-06 16:30:01 +02:00
qapi migration: Add switchover ack capability 2023-06-30 06:02:51 +02:00
qga spelling: information 2023-06-09 23:38:16 +03:00
qobject docs/interop: Convert qmp-spec.txt to rST 2023-05-22 10:21:01 +02:00
qom meson: Replace softmmu_ss -> system_ss 2023-06-20 10:01:30 +02:00
replay meson: Replace softmmu_ss -> system_ss 2023-06-20 10:01:30 +02:00
roms target/hppa: Update to SeaBIOS-hppa version 8 2023-06-24 13:39:48 +02:00
scripts scripts: add a XML preprocessor script 2023-06-27 17:08:56 +02:00
scsi scsi/qemu-pr-helper: Drop support for 'old' libmultipath API 2023-06-06 10:31:31 +02:00
semihosting meson: Replace CONFIG_SOFTMMU -> CONFIG_SYSTEM_ONLY 2023-06-20 10:01:30 +02:00
softmmu icount: don't adjust virtual time backwards after warp 2023-06-27 09:00:13 +02:00
stats meson: Replace softmmu_ss -> system_ss 2023-06-20 10:01:30 +02:00
storage-daemon qapi storage-daemon/qapi: Fix documentation section structure 2023-04-28 11:48:34 +02:00
stubs include/hw/xen/xen: Rename xen_piix3_set_irq() to xen_intx_set_irq() 2023-06-07 15:07:10 +01:00
subprojects vhost-user: fully use new backend/frontend naming 2023-06-26 09:50:00 -04:00
target * Make named CPU models usable for qemu-{i386,x86_64} 2023-06-29 13:16:06 +02:00
tcg accel/tcg: Renumber TLB_DISCARD_WRITE 2023-06-26 17:33:00 +02:00
tests tests: Add migration switchover ack capability test 2023-06-30 06:02:51 +02:00
tools ebpf: fix compatibility with libbpf 1.0+ 2023-03-10 17:26:47 +08:00
trace meson: Replace softmmu_ss -> system_ss 2023-06-20 10:01:30 +02:00
ui ui/dbus: use shared D3D11 Texture2D when possible 2023-06-27 17:08:56 +02:00
util console/win32: allocate shareable display surface 2023-06-27 17:08:56 +02:00
.dir-locals.el Add .dir-locals.el file to configure emacs coding style 2015-10-08 19:46:01 +03:00
.editorconfig .editorconfig: update the automatic mode setting for Emacs 2021-03-10 15:34:11 +00:00
.exrc
.gdbinit .gdbinit: load QEMU sub-commands when gdb starts 2017-06-07 14:38:45 +01:00
.git-blame-ignore-revs metadata: add .git-blame-ignore-revs 2023-04-04 15:56:44 +01:00
.gitattributes gitattributes: Cover Objective-C source files 2022-03-29 00:15:14 +02:00
.gitignore configure: rename --enable-pypi to --enable-download, control subprojects too 2023-06-06 16:30:01 +02:00
.gitlab-ci.yml docs: Document GitLab custom CI/CD variables 2021-07-29 07:56:01 +02:00
.gitmodules meson: subprojects: replace berkeley-{soft,test}float-3 with wraps 2023-06-06 16:30:01 +02:00
.gitpublish Add a git-publish configuration file 2018-03-05 09:03:17 +00:00
.mailmap MAINTAINERS: Update Roman Bolshakov email address 2023-06-28 13:55:09 +02:00
.patchew.yml scripts/checkpatch: roll diff tweaking into checkpatch itself 2021-06-25 10:08:33 +01:00
.readthedocs.yml readthedocs: build with Python 3.6 2020-10-05 16:30:45 +01:00
.travis.yml travis.yml: Add missing 'flex', 'bison' packages to 'GCC (user)' job 2023-04-20 11:24:50 +02:00
block.c block: mark another function as coroutine_fns and GRAPH_UNLOCKED 2023-06-28 09:46:25 +02:00
blockdev-nbd.c qapi block: Elide redundant has_FOO in generated C 2022-12-14 20:03:25 +01:00
blockdev.c cutils: Adjust signature of parse_uint[_full] 2023-06-02 12:27:19 -05:00
blockjob.c blockjob: Fix AioContext locking in block_job_add_bdrv() 2023-06-28 08:46:21 +02:00
configure git-submodule.sh: allow running in validate mode without previous update 2023-06-26 10:23:56 +02:00
COPYING
COPYING.LIB COPYING.LIB: Synchronize the LGPL 2.1 with the version from gnu.org 2019-01-30 11:01:22 +01:00
cpu.c cpu: Replace target_ulong with hwaddr in tb_invalidate_phys_addr() 2023-06-26 17:33:00 +02:00
cpus-common.c cpu: expose qemu_cpu_list_lock for lock-guard use 2023-05-11 09:53:41 +01:00
event-loop-base.c util/event-loop-base: Introduce options to set the thread pool size 2022-05-09 10:43:23 +01:00
gitdm.config contrib/gitdm: add group map for AMD 2023-03-22 15:08:26 +00:00
hmp-commands-info.hx accel/tcg: remove CONFIG_PROFILER 2023-06-26 17:33:00 +02:00
hmp-commands.hx build: move COLO under CONFIG_REPLICATION 2023-05-10 18:48:11 +02:00
iothread.c iothread: Remove unused IOThreadClass / IOTHREAD_CLASS 2023-02-27 13:27:05 +00:00
job-qmp.c qapi job: Elide redundant has_FOO in generated C 2022-12-14 20:04:47 +01:00
job.c block: remove bdrv_try_set_aio_context and replace it with bdrv_try_change_aio_context 2022-10-27 20:14:11 +02:00
Kconfig meson: Introduce target-specific Kconfig 2021-07-09 18:21:34 +02:00
Kconfig.host vfio-user: build library 2022-06-15 16:42:33 +01:00
LICENSE tcg/LICENSE: Remove out of date claim about TCG subdirectory licensing 2019-11-11 15:11:21 +01:00
MAINTAINERS MAINTAINERS: Update Roman Bolshakov email address 2023-06-28 13:55:09 +02:00
Makefile build: further refine build.ninja rules 2023-06-26 10:23:01 +02:00
memory_ldst.c.inc exec/memory_ldst: Use correct type sizes 2021-05-26 08:35:51 -07:00
meson_options.txt accel/tcg: remove CONFIG_PROFILER 2023-06-26 17:33:00 +02:00
meson.build accel: Re-enable WHPX cross-build on case sensitive filesystems 2023-06-28 13:55:35 +02:00
module-common.c all: Clean up includes 2016-02-04 17:41:30 +00:00
os-posix.c util/async-teardown: wire up query-command-line-options 2023-05-16 09:14:18 +02:00
os-win32.c Remove qemu-common.h include from most units 2022-04-06 14:31:55 +02:00
page-vary-common.c Remove qemu-common.h include from most units 2022-04-06 14:31:55 +02:00
page-vary.c include: move target page bits declaration to page-vary.h 2022-04-06 14:31:43 +02:00
qemu-bridge-helper.c qemu-bridge-helper: relocate path to default ACL 2020-09-30 19:11:36 +02:00
qemu-edid.c qemu-edid: Restrict input parameter -d to avoid division by zero 2022-10-12 13:38:15 +02:00
qemu-img-cmds.hx qemu-img: Unify [-b [-F]] documentation 2022-02-01 13:49:15 +01:00
qemu-img.c qemu-img: Take graph lock more selectively 2023-05-19 19:12:12 +02:00
qemu-io-cmds.c qemu-iotests: test zone append operation 2023-05-15 08:18:10 -04:00
qemu-io.c include: move qemu_*_exec_dir() to cutils 2022-05-28 11:42:56 +02:00
qemu-keymap.c qemu-keymap: Silence memory leak warning from Clang's sanitizer 2023-02-27 09:15:39 +01:00
qemu-nbd.c block: Take main AioContext lock when calling bdrv_open() 2023-05-30 17:21:23 +02:00
qemu-options.hx qcow2: add discard-no-unref option 2023-06-05 13:15:42 +02:00
qemu.nsi nsis installer: Fix mouse-over descriptions for emulators 2022-03-18 10:55:15 +00:00
qemu.sasl sasl: remove comment about obsolete kerberos versions 2021-06-14 13:28:50 +01:00
README.rst README.rst: fix link formatting 2022-08-04 13:44:21 +02:00
replication.c replication: move include out of root directory 2021-05-26 14:49:46 +02:00
trace-events trace-events: remove the remaining vcpu trace events 2023-06-01 11:05:05 -04:00
VERSION Open 8.1 development tree 2023-04-20 10:05:25 +01:00
version.rc configure: remove CONFIG_FILEVERSION and CONFIG_PRODUCTVERSION 2021-01-02 21:03:37 +01:00

===========
QEMU README
===========

QEMU is a generic and open source machine & userspace emulator and
virtualizer.

QEMU is capable of emulating a complete machine in software without any
need for hardware virtualization support. By using dynamic translation,
it achieves very good performance. QEMU can also integrate with the Xen
and KVM hypervisors to provide emulated hardware while allowing the
hypervisor to manage the CPU. With hypervisor support, QEMU can achieve
near native performance for CPUs. When QEMU emulates CPUs directly it is
capable of running operating systems made for one machine (e.g. an ARMv7
board) on a different machine (e.g. an x86_64 PC board).

QEMU is also capable of providing userspace API virtualization for Linux
and BSD kernel interfaces. This allows binaries compiled against one
architecture ABI (e.g. the Linux PPC64 ABI) to be run on a host using a
different architecture ABI (e.g. the Linux x86_64 ABI). This does not
involve any hardware emulation, simply CPU and syscall emulation.

QEMU aims to fit into a variety of use cases. It can be invoked directly
by users wishing to have full control over its behaviour and settings.
It also aims to facilitate integration into higher level management
layers, by providing a stable command line interface and monitor API.
It is commonly invoked indirectly via the libvirt library when using
open source applications such as oVirt, OpenStack and virt-manager.

QEMU as a whole is released under the GNU General Public License,
version 2. For full licensing details, consult the LICENSE file.


Documentation
=============

Documentation can be found hosted online at
`<https://www.qemu.org/documentation/>`_. The documentation for the
current development version that is available at
`<https://www.qemu.org/docs/master/>`_ is generated from the ``docs/``
folder in the source tree, and is built by `Sphinx
<https://www.sphinx-doc.org/en/master/>`_.


Building
========

QEMU is multi-platform software intended to be buildable on all modern
Linux platforms, OS-X, Win32 (via the Mingw64 toolchain) and a variety
of other UNIX targets. The simple steps to build QEMU are:


.. code-block:: shell

  mkdir build
  cd build
  ../configure
  make

Additional information can also be found online via the QEMU website:

* `<https://wiki.qemu.org/Hosts/Linux>`_
* `<https://wiki.qemu.org/Hosts/Mac>`_
* `<https://wiki.qemu.org/Hosts/W32>`_


Submitting patches
==================

The QEMU source code is maintained under the GIT version control system.

.. code-block:: shell

   git clone https://gitlab.com/qemu-project/qemu.git

When submitting patches, one common approach is to use 'git
format-patch' and/or 'git send-email' to format & send the mail to the
qemu-devel@nongnu.org mailing list. All patches submitted must contain
a 'Signed-off-by' line from the author. Patches should follow the
guidelines set out in the `style section
<https://www.qemu.org/docs/master/devel/style.html>`_ of
the Developers Guide.

Additional information on submitting patches can be found online via
the QEMU website

* `<https://wiki.qemu.org/Contribute/SubmitAPatch>`_
* `<https://wiki.qemu.org/Contribute/TrivialPatches>`_

The QEMU website is also maintained under source control.

.. code-block:: shell

  git clone https://gitlab.com/qemu-project/qemu-web.git

* `<https://www.qemu.org/2017/02/04/the-new-qemu-website-is-up/>`_

A 'git-publish' utility was created to make above process less
cumbersome, and is highly recommended for making regular contributions,
or even just for sending consecutive patch series revisions. It also
requires a working 'git send-email' setup, and by default doesn't
automate everything, so you may want to go through the above steps
manually for once.

For installation instructions, please go to

*  `<https://github.com/stefanha/git-publish>`_

The workflow with 'git-publish' is:

.. code-block:: shell

  $ git checkout master -b my-feature
  $ # work on new commits, add your 'Signed-off-by' lines to each
  $ git publish

Your patch series will be sent and tagged as my-feature-v1 if you need to refer
back to it in the future.

Sending v2:

.. code-block:: shell

  $ git checkout my-feature # same topic branch
  $ # making changes to the commits (using 'git rebase', for example)
  $ git publish

Your patch series will be sent with 'v2' tag in the subject and the git tip
will be tagged as my-feature-v2.

Bug reporting
=============

The QEMU project uses GitLab issues to track bugs. Bugs
found when running code built from QEMU git or upstream released sources
should be reported via:

* `<https://gitlab.com/qemu-project/qemu/-/issues>`_

If using QEMU via an operating system vendor pre-built binary package, it
is preferable to report bugs to the vendor's own bug tracker first. If
the bug is also known to affect latest upstream code, it can also be
reported via GitLab.

For additional information on bug reporting consult:

* `<https://wiki.qemu.org/Contribute/ReportABug>`_


ChangeLog
=========

For version history and release notes, please visit
`<https://wiki.qemu.org/ChangeLog/>`_ or look at the git history for
more detailed information.


Contact
=======

The QEMU community can be contacted in a number of ways, with the two
main methods being email and IRC

* `<mailto:qemu-devel@nongnu.org>`_
* `<https://lists.nongnu.org/mailman/listinfo/qemu-devel>`_
* #qemu on irc.oftc.net

Information on additional methods of contacting the community can be
found online via the QEMU website:

* `<https://wiki.qemu.org/Contribute/StartHere>`_