User:Paolo Bonzini/Machine init sequence: Difference between revisions

From QEMU
(Created page with "== Current machine init sequence == === Up to CHECKPOINT_INIT === * Runstate is RUN_STATE_PRECONFIG or RUN_STATE_INMIGRATE ** Xen looks at RUN_STATE_INMIGRATE to skip RAM init...")
 
 
(78 intermediate revisions by the same user not shown)
Line 1: Line 1:
== Current machine init sequence ==
== Tasks ==
=== Up to CHECKPOINT_INIT ===
# Convert -machine, -object, -accel from QemuOpts to keyval [Paolo]
* Runstate is RUN_STATE_PRECONFIG or RUN_STATE_INMIGRATE
# Deprecate x-exit-preconfig, replacing it with cont/finish-machine-init/loadvm/migrate_incoming [Paolo]
** Xen looks at RUN_STATE_INMIGRATE to skip RAM initialization.
# Replace -qtest with "-object qtest,chardev=...,log=..." [Paolo]
* Options: -sandbox, -name, -add-fd
# Replace -m, -smp, -boot, -semihosting-config, -rtc with machine properties
* current_machine is created
# Add machine-set and accel-set commands
* Options: -trace, -L
 
* Options: -smp
Independent pieces:
* Options: -mem-prealloc (requires current_machine->smp.cpus, but could look at -smp cpus directly)
* QAPIfy -display, add "-display add".
* Options: -plugin (requires -smp)
* Make more commands available in preconfig (e.g. object-add, netdev-add, blockdev-add)
* Handle default devices
 
** Default device check (needs machine_class)
== Basic phases ==
** A bunch of checks for -daemonize
;PHASE_NO_MACHINE:
** Add default devices to device_configs
:* Only backends can be created
* Create backends
:* No machines have compat props that affect the backends, so that's good
** Create displays
:QMP configuration flow starts here. machine-set command moves to the next step
** Create early objects
 
** Initialize SPICE
;PHASE_MACHINE_CREATED:
** Create chardevs
:* Backends can be connected to on-board devices (how?)
** Create fsdevs
:set-numa-options available here
** Create audiodevs
:accel-set (can only be invoked again if it fails) moves to the next step
* Machine properties set
 
* Accelerators created and properties set
;PHASE_ACCEL_CREATED:
* migration_object_init
:* vl.c sets up memory here, but that's not required
** Wants current_machine->enforce_config_section, but that part can be done later though
:* migration_object_init() can be called
* Initialize qtest server ''(QOMify)''
:* plugins can be loaded
* Parse bootorder and -machine kernel_filename/initrd_filename/kernel_cmdline
:CLI configuration flow starts here (preconfig enters the monitor here; w/o preconfig, x-exit-preconfig is invoked immediately)
* cpu_timers_init() ''(can be done earlier)''
:accel-set actually goes directly from PHASE_MACHINE_CREATED to the next step
* Create default network ''(move with other device_configs operations)''
 
* net_init_clients
;PHASE_MACHINE_INITIALIZED:
* Create late objects
:* Devices can be created (including by x-exit-preconfig)
* blk_mig_init, ram_mig_init, dirty_bitmap_mig_init ''(move to migration_object_init())''
:finish-machine-init, cont, migrate_incoming, x-exit-preconfig move to the next step
* Create monitors ''(why so late?)''
 
* Create backends for -serial/-parallel/-debugcon
;PHASE_MACHINE_READY
* get_default_vga_model, select_vgahw, select_watchdog
:* everything after qdev_machine_creation_done()
=== After CHECKPOINT_INIT ===
 
* qdev_machine_init()
== QMP configuration flow ==
** Only creates /machine/peripheral and /machine/peripheral-anon
=== Existing commands ===
* Determine ram_size
*Backend creation: netdev-add, object-add, blockdev-add, ...
* parse_numa_opts() -> set_numa_options()
*Device creation: device-add
* Preconfig monitor
*set-action (replaces -action and indirectly -watchdog-action, -no-reboot, -no-shutdown)
** set_numa_options (same as -numa but more powerful)
=== New commands ===
=== RUN_STATE_PRELAUNCH ===
*machine-set (covers -M but also -smp, -boot, -m, -semihosting-config, -acpitable, -smbios, -fw_cfg, -option-rom, -rtc, maybe -cpu)
* machine_run_board_init(current_machine)
*accel-set (-accel)
** On-board devices are created
*something to replace -incoming defer??
** Requires accelerator to be initialized
=== Non-QemuOpts options ===
* Devices cannot be realized before this point (buses don't exist)
* -k (should have replacement property in -display curses / -display vnc / -object input-barrier)
* Start VM
* -uuid (should be added to -machine)
** loadvm or incoming migration
* -qtest, -qtest-log (replaced by -object qtest)
** Otherwise, vm_start()
=== Other command line options without QMP equivalent ===
Move to "missing commands" as you see fit or remark on whether it's not needed in the QMP configuration flow:
*-display
*-fsdev
*-global
*-icount (tcg accelerator options?)
* -iscsi (obsoleted by -blockdev?)
*-mon (just use stdio)
*-msg
* -overcommit
*-plugin (plugin-add?)
*-replay
*-tpmdev


== First attempt at cleaned up sequence ==
== 6.0 cleaned up sequence ==
=== Early option parsing ===
=== Early option parsing ===
* Runstate is RUN_STATE_PRECONFIG
* Runstate is RUN_STATE_PRELAUNCH or RUN_STATE_INMIGRATE
* Options: -sandbox, -name, -add-fd, -trace, -L
* qemu_process_sugar_options: -mem-prealloc, -watchdog
* qemu_process_early_options: -pidfile, -sandbox, -name, -add-fd, -trace, -L, -incoming defer
* qemu_process_help_options
* qemu_maybe_daemonize
 
=== Early initialization ===
=== Early initialization ===
* qdev_machine_init()
* qemu_init_main_loop()
* migration_object_init()
** blk_mig_init, ram_mig_init, dirty_bitmap_mig_init
* cpu_timers_init()
* cpu_timers_init()
* Set RUN_STATE_INMIGRATE if needed
 
=== Command-line processing part one ===
=== Early command-line processing, machine creation ===
* Options: -mem-prealloc (look at -smp cpus directly)
* Options: -global, -rtc, replay_configure
* Find MachineClass
* qemu_create_machine
* Handle default devices
** set_memory_options + current_machine is created (these two could be moved after early backend creation?)
** Default device check (needs machine_class but not MS)
** Set machine compat props
** A bunch of checks for -daemonize
* Handle default devices (qemu_disable_default_devices, qemu_create_default_devices)
** Add default devices to device_configs
* Create default network
* Create default network ''(move with other device_configs operations)''
* Create early backends
* Create backends
** Create displays
** Create displays
** Create early objects
** Create early objects
** Initialize SPICE
** Options: -spice
** Create chardevs
** Create chardevs
** Create fsdevs
** Create fsdevs
** Create audiodevs
** Create audiodevs
* Initialize qtest server
* qemu_apply_machine_options
=== Machine creation ===
** -boot, smp, -semihosting-config
* current_machine is created
* Options: -smp
* Options: -plugin (requires -smp)
* Machine properties set
** set current_migration->send_configuration as in migration_object_init
** set current_migration->send_configuration as in migration_object_init
=== Accelerator creation ===
* Accelerators created and properties set
* Accelerators created and properties set
* Parse bootorder and -machine kernel_filename/initrd_filename/kernel_cmdline
* migration_object_init()
* net_init_clients
** blk_mig_init, ram_mig_init, dirty_bitmap_mig_init
** Determine ram_size
 
*** parse_numa_opts() -> set_numa_options()
=== Late creation ===
=== Late creation ===
* Create late objects
* Create late backends
* Create monitors
** qtest (needs chardev)
* Create backends for -serial/-parallel/-debugcon
** net_init_clients
* get_default_vga_model, select_vgahw, select_watchdog
** Create late objects
* Preconfig monitor
** Create monitors
=== RUN_STATE_PRELAUNCH ===
** Create backends for -serial/-parallel/-debugcon/semihosting
* Determine ram_size
** qemu_resolve_machine_memdev()
** parse_numa_opts() -> set_numa_options()
* Monitor entered here if preconfig, otherwise qemu_init invokes qmp_x_exit_preconfig
 
=== Leaving preconfig ===
* CHECKPOINT_INIT
* CHECKPOINT_INIT
* Options: -plugin (requires -smp, but must be before CPUs are created)
* machine_run_board_init(current_machine)
* machine_run_board_init(current_machine)
** On-board devices are created
** On-board devices are created
** Requires accelerator to be initialized
** Requires accelerator to be initialized
* Devices cannot be realized before this point (buses don't exist)
* Devices cannot be realized before this point (buses don't exist)
* Start VM
* cont/migrate_incoming/loadvm complete initialization of the machine
** loadvm or incoming migration
** everything starting with cpu_synchronize_all_post_init
** Otherwise, vm_start()

Latest revision as of 14:38, 7 October 2021

Tasks

  1. Convert -machine, -object, -accel from QemuOpts to keyval [Paolo]
  2. Deprecate x-exit-preconfig, replacing it with cont/finish-machine-init/loadvm/migrate_incoming [Paolo]
  3. Replace -qtest with "-object qtest,chardev=...,log=..." [Paolo]
  4. Replace -m, -smp, -boot, -semihosting-config, -rtc with machine properties
  5. Add machine-set and accel-set commands

Independent pieces:

  • QAPIfy -display, add "-display add".
  • Make more commands available in preconfig (e.g. object-add, netdev-add, blockdev-add)

Basic phases

PHASE_NO_MACHINE
  • Only backends can be created
  • No machines have compat props that affect the backends, so that's good
QMP configuration flow starts here. machine-set command moves to the next step
PHASE_MACHINE_CREATED
  • Backends can be connected to on-board devices (how?)
set-numa-options available here
accel-set (can only be invoked again if it fails) moves to the next step
PHASE_ACCEL_CREATED
  • vl.c sets up memory here, but that's not required
  • migration_object_init() can be called
  • plugins can be loaded
CLI configuration flow starts here (preconfig enters the monitor here; w/o preconfig, x-exit-preconfig is invoked immediately)
accel-set actually goes directly from PHASE_MACHINE_CREATED to the next step
PHASE_MACHINE_INITIALIZED
  • Devices can be created (including by x-exit-preconfig)
finish-machine-init, cont, migrate_incoming, x-exit-preconfig move to the next step
PHASE_MACHINE_READY
  • everything after qdev_machine_creation_done()

QMP configuration flow

Existing commands

  • Backend creation: netdev-add, object-add, blockdev-add, ...
  • Device creation: device-add
  • set-action (replaces -action and indirectly -watchdog-action, -no-reboot, -no-shutdown)

New commands

  • machine-set (covers -M but also -smp, -boot, -m, -semihosting-config, -acpitable, -smbios, -fw_cfg, -option-rom, -rtc, maybe -cpu)
  • accel-set (-accel)
  • something to replace -incoming defer??

Non-QemuOpts options

  • -k (should have replacement property in -display curses / -display vnc / -object input-barrier)
  • -uuid (should be added to -machine)
  • -qtest, -qtest-log (replaced by -object qtest)

Other command line options without QMP equivalent

Move to "missing commands" as you see fit or remark on whether it's not needed in the QMP configuration flow:

  • -display
  • -fsdev
  • -global
  • -icount (tcg accelerator options?)
  • -iscsi (obsoleted by -blockdev?)
  • -mon (just use stdio)
  • -msg
  • -overcommit
  • -plugin (plugin-add?)
  • -replay
  • -tpmdev

6.0 cleaned up sequence

Early option parsing

  • Runstate is RUN_STATE_PRELAUNCH or RUN_STATE_INMIGRATE
  • qemu_process_sugar_options: -mem-prealloc, -watchdog
  • qemu_process_early_options: -pidfile, -sandbox, -name, -add-fd, -trace, -L, -incoming defer
  • qemu_process_help_options
  • qemu_maybe_daemonize

Early initialization

  • qemu_init_main_loop()
  • cpu_timers_init()

Early command-line processing, machine creation

  • Options: -global, -rtc, replay_configure
  • qemu_create_machine
    • set_memory_options + current_machine is created (these two could be moved after early backend creation?)
    • Set machine compat props
  • Handle default devices (qemu_disable_default_devices, qemu_create_default_devices)
  • Create default network
  • Create early backends
    • Create displays
    • Create early objects
    • Options: -spice
    • Create chardevs
    • Create fsdevs
    • Create audiodevs
  • qemu_apply_machine_options
    • -boot, smp, -semihosting-config
    • set current_migration->send_configuration as in migration_object_init

Accelerator creation

  • Accelerators created and properties set
  • migration_object_init()
    • blk_mig_init, ram_mig_init, dirty_bitmap_mig_init

Late creation

  • Create late backends
    • qtest (needs chardev)
    • net_init_clients
    • Create late objects
    • Create monitors
    • Create backends for -serial/-parallel/-debugcon/semihosting
  • Determine ram_size
    • qemu_resolve_machine_memdev()
    • parse_numa_opts() -> set_numa_options()
  • Monitor entered here if preconfig, otherwise qemu_init invokes qmp_x_exit_preconfig

Leaving preconfig

  • CHECKPOINT_INIT
  • Options: -plugin (requires -smp, but must be before CPUs are created)
  • machine_run_board_init(current_machine)
    • On-board devices are created
    • Requires accelerator to be initialized
  • Devices cannot be realized before this point (buses don't exist)
  • cont/migrate_incoming/loadvm complete initialization of the machine
    • everything starting with cpu_synchronize_all_post_init
Retrieved from "https://wiki.qemu.org/index.php?title=User:Paolo_Bonzini/Machine_init_sequence&oldid=10651"