Planning/1.0/Testing: Difference between revisions

From QEMU
No edit summary
 
(68 intermediate revisions by 16 users not shown)
Line 1: Line 1:
=QEMU 1.0 Test day: Nov 7=
=QEMU 1.0 Test day: Nov 7=
== Documentation ==
<b><font color="red">rc1</font></b>
<b><font color="red">rc2</font></b>
<b><font color="red">rc3</font></b>
<b><font color="red">rc4</font></b>


== Compilation test==
== Compilation test==


{| border="1"
{| border="1"
| OS || Xen? || KVM? || Ceph? || Spice? || libfdt?
| OS || Xen? || KVM? || Ceph? || Spice? || libfdt? || libiscsi
|-
|-
| Fedora 15 || ? || ? || ? || ? || ?
| Fedora 15 || ? || ? || ? || ? || ? || ?
|-
|-
| Fedora 16 || ? || ? || ? || ? || ?
| Fedora 16 || ? || ? || ? || ? || ? || ?
|-
|-
| RHEL/CentOS 5 || ? || ? || ? || ? || ?
| RHEL/CentOS 5 || ? || ? || ? || ? || ? || ?
|-
|-
| RHEL/CentOS 6 || ? || ? || ? || ? || ?
| RHEL/CentOS 6 || ? || ? || ? || ? || ? || ?
|-
|-
| Debian 6.0 || ? || ? || ? || ? || ?
| Debian 6.0 || ? || ? || ? || ? || ? || ?
|-
|-
| Debian testing || ? || ? || ? || ? || ?
| Debian testing || ? || <b><font color="green">rc2</font></b> || <b><font color="green">rc2</font></b> || <b><font color="green">rc2</font></b> || ? || ?
|-
|-
| Ubuntu 10.04 || ? || ? || ? || ? || ?
| Ubuntu 10.04 || ? || ? || ? || ? || ? || ?
|-
|-
| Ubuntu 11.04 || ? || ? || ? || ? || ?
| Ubuntu 11.04 || ? || <b><font color="green">rc1</font></b> || <b><font color="green">rc1</font></b> || ? || ? || ?
|-
|-
| openSUSE 11.4 || ? || ? || ? || ? || ?
| SLES 10 SP4 ppc64 || ? || <b><font color="red">rc1</font></b> || ? || ? || ? || ?
|-
|-
| openSUSE 12.1 RC1 || ? || ? || ? || ? || ?
| SLES 11 SP1 s390x || ? || <b><font color="red">rc1</font></b> || ? || ? || ? || ?
|-
|-
| MinGW32 || N/A || N/A || ? || N/A || ?
| openSUSE 11.4 || ? || ? || ? || ? || ? || ?
|-
|-
| MinGW32 (cross-compile) || N/A || N/A || ? || N/A || ?
| openSUSE 12.1 RC2 x86_64 || ? || <b><font color="green">rc0</font></b> <b><font color="green">rc0-22-g932eacc</font></b> <b><font color="green">rc1</font></b> || ? || ? || <b><font color="green">rc0</font></b> <b><font color="green">rc0-22-g932eacc</font></b> <b><font color="green">rc1</font></b> || ?
|-
| MinGW32 || N/A || N/A || ? || N/A || ? || N/A
|-
| MinGW32 (cross-compile) || N/A || N/A || ? || N/A || ? || N/A
|}
|}


Line 34: Line 43:


Hints: qemu-iotests, qemu-nbd, install your favorite OS, ...
Hints: qemu-iotests, qemu-nbd, install your favorite OS, ...
=== Raw ===
* qemu-iotests <b><font color="green">rc0</font></b> [Stefan]


=== QCow2 ===
=== QCow2 ===
* qemu-iotests [Stefan]
* qemu-iotests <b><font color="orange">rc0</font></b> [Stefan]
* Windows Server 2003 install [Stefan]
** rc0 - 026 leaked cluster output is different
* Red Hat Enterprise Linux 6 install [Stefan]
* Windows Server 2003 install <b><font color="red">rc0</font>  <font color="green">rc1</font></b> [Stefan]
** rc0 - guest hangs on a black screen when the installer reboots, fixed in rc1 by https://github.com/aliguori/qemu/commit/3f8aeaa
* Red Hat Enterprise Linux 6 install <b><font color="green">rc1</font></b> [Stefan]


=== QED ===
=== QED ===
* qemu-iotests [Stefan]
* qemu-iotests <b><font color="green">rc0</font></b> [Stefan]
* Windows Server 2003 install [Stefan]
* Windows Server 2003 install <b><font color="green">rc1</font></b> [Stefan]
* Red Hat Enterprise Linux 6 install [Stefan]
* Red Hat Enterprise Linux 6 install <b><font color="green">rc1</font></b> [Stefan]
 
=== VHD ===
* Windows 7 + IE8 Internet Explorer Application Compatibility VPC Image boot <b><font color="green">rc1</font></b> [Andreas]


=== NBD ===
=== NBD ===


=== Ceph ===
=== Ceph ===
* <b><font color="green">rc0</font></b> and ceph 0.37 ok [Martin]
* <b><font color="green">rc1</font></b> and ceph 0.38 ok [Martin]


=== Sheepdog ===
=== Sheepdog ===
* qemu-iotests <b><font color="green">rc1</font></b> [Kazutaka]


=== vmdk ===
=== vmdk ===
Line 56: Line 76:


=== CD-ROM ===
=== CD-ROM ===
* Eject/insert Host CD-ROM passthrough [Benoît]
* Eject/insert Host CD-ROM passthrough [Need tester]
* Eject/insert ISO CD-ROM [Benoît]
* Eject/insert ISO CD-ROM [Need tester]
 
Ubuntu 11.10 have a broken support for cdrom tray locking.
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/854814
 
=== AHCI ===
* Install SLES 11 SP2 Beta8 x86_64 from AHCI CD-ROM <b><font color="red">rc1</font></b> [Andreas]
** rc1 - "Check Installation Media" results in: ''Checksum wrong. This CD-ROM is broken.''
 
=== iSCSI ===
libiscsi source: [http://people.redhat.com/pbonzini/qemu-test-day/libiscsi-1.0.1.tar.gz .tar.gz] - RHEL6/Fedora packages: [http://people.redhat.com/pbonzini/qemu-test-day/libiscsi-1.0.1-1.75c8fc3.el6.src.rpm src] [http://people.redhat.com/pbonzini/qemu-test-day/libiscsi-1.0.1-1.75c8fc3.el6.x86_64.rpm x86_64] [http://people.redhat.com/pbonzini/qemu-test-day/libiscsi-devel-1.0.1-1.75c8fc3.el6.x86_64.rpm x86_64-devel]


== System emulation targets ==
== System emulation targets ==
Line 65: Line 95:
=== ARM ===
=== ARM ===


* Will check that zaurus and associated machine boot [Benoît]
* Zaurus
 
keypad and touchscreen tested by cat /dev/input/event0 and /dev/input/event1 [Benoît]
 
{| class="wikitable" border="1"
|-
!  Model
!  boot
!  serial
!  Compact FLASH IDE
!  touchscreen
!  keyboard
!  ADC
|-
|  akita
|  ok
|  ok
|  none
|  ok
|  ok
|  ok
|-
|  borzoi
|  ok
|  ok
|  ok
|  ok
|  ok
|  ok
|-
|  spitz
|  ok
|  ok
|  ok
|  ok
|  ok
|  ok
|-
|  terrier
|  ok
|  ok
|  ok
|  ok
|  ok
|  ok
|-
|  tosa
|  ok
|  ok
|  ok
|  none
|  none
|  none
|}


=== PPC (BookE, pSeries, ... including KVM) ===
=== PPC (BookE, pSeries, ... including KVM) ===


=== s390 ===
* pSeries
** Booting without parameters <b><font color="red">rc1</font></b> [Andreas]
*** rc1 - immediate segfault - fixed by http://patchwork.ozlabs.org/patch/123204/
** Booting AIX
 
=== s390x ===
* Boot SLES 11 SP2 Beta8 <b><font color="red">rc1</font></b> [Andreas]
** rc1 - ''qemu-system-s390x: Guest moved used index from 0 to 47802''  - fixed by http://patchwork.ozlabs.org/patch/124768/


=== x86 (including KVM/Xen) ===
=== x86 (including KVM/Xen) ===
* win7 64bit freezes frequently in qemu-<b><font color="red">1.0-rc2</font></b> -enable-kvm and qemu itself becomes unresponsive (only kill -9 works).  Tried 32bit build of qemu (on 64bit host kernel) only so far.  This behavour didn't exist in 0.15 and in kvm.  (mjt)
=== LM32 ===
* opcode testsuite <font color="green"><b>rc2</b></font>
* Milkymist emulation <font color="orange"><b>rc2</b></font> (partly working, ac97 is broken)


== User-mode emulation targets ==
== User-mode emulation targets ==
Line 94: Line 189:


=== Virtio (including vhost-net) ===
=== Virtio (including vhost-net) ===
Networking tests [pradeep]
Installed RHEL 6.1 and ran network related autotest tests (ping, set_link, jumbo, file_transfer) with vhost=on
https://bugs.launchpad.net/qemu/+bug/888016


=== Xen ===
=== Xen ===
Line 102: Line 203:


=== Libvirt ===
=== Libvirt ===
* Hotadd of disks/nics/cpu/memory
* Hotadd of disks/nics/cpu/memory [Supriya]


=== Xen ===
=== Xen ===


=== HMP/QMP/QAPI ===
=== HMP/QMP/QAPI ===
* Comprehensive libvirt testing [LuizCapitulino]
* Run kvm-autotest under QMP [LuizCapitulino]


=== Migration ===
=== Migration ===


=== Ganeti ===
=== Ganeti ===
Tested qemu 1.0rc0 under Ganeti 2.5.0-rc4, with the KVM backend (x86_64) on Debian Wheezy.
No problems found during instance creation, live migration and deletion. For these activities, Ganeti sends commands to QEMU both via the monitor protocol and via the QMP protocol.
Had problems connecting via SPICE to an instance that does not use QXL drivers (blank screen), but this seems to be a [http://lists.freedesktop.org/archives/spice-devel/2011-November/005931.html known issue].


=== Tracing ===
=== Tracing ===
Line 116: Line 226:
Hints: link to sample systemtap scripts!
Hints: link to sample systemtap scripts!


* Simpletrace memory allocation tracing [Stefan]
* Simpletrace memory allocation tracing <b><font color="green">rc1</font></b> [Stefan]
* SystemTap clean build [Stefan]
* SystemTap clean build <b><font color="green">rc1</font></b> [Stefan]
 
== Virtfs (9P Server) ==
 
 
* Tested all 9p file system ( security models, features like mmap, locking, posixacl, zerocopy) using the basic fs tests, I/O and stress tests on qemu 1.0rc0 with fs driver as local. No Issues found. [Madhuri]
 
{| border="1"
| Qemu release info || fs driver name || passthrough security model || mapped security model || features tested || Tests ran to cover these features
|-
| rc0 || local || All pass || All pass ||  basic fsops like open/create/read/write/close/rename/link/unlink/readdir/readlink/statfs/lookup/delete/truncate, acl, mmap, zerocopy,locking, xattr,sync,fragmentation ||  dbench, tuxera_posix, connecthon, fsstress, fsx, fs_mark, acl,synctest,mmap,LTP, xfs, disktest, tiobench,postmark
|-
| rc0 || handle || All pass || All pass  ||  basic fsops like open/create/read/write/close/rename/link/unlink/readdir/readlink/statfs/lookup/delete/truncate, acl, mmap, zerocopy,locking, xattr,sync,fragmentation ||  dbench, tuxera_posix, connecthon, fsstress, fsx fs_mark, acl,synctest,mmap,LTP, xfs, disktest, tiobench
|}

Latest revision as of 16:41, 29 November 2011

QEMU 1.0 Test day: Nov 7

Documentation

rc1 rc2 rc3 rc4

Compilation test

OS Xen? KVM? Ceph? Spice? libfdt? libiscsi
Fedora 15 ? ? ? ? ? ?
Fedora 16 ? ? ? ? ? ?
RHEL/CentOS 5 ? ? ? ? ? ?
RHEL/CentOS 6 ? ? ? ? ? ?
Debian 6.0 ? ? ? ? ? ?
Debian testing ? rc2 rc2 rc2 ? ?
Ubuntu 10.04 ? ? ? ? ? ?
Ubuntu 11.04 ? rc1 rc1 ? ? ?
SLES 10 SP4 ppc64 ? rc1 ? ? ? ?
SLES 11 SP1 s390x ? rc1 ? ? ? ?
openSUSE 11.4 ? ? ? ? ? ?
openSUSE 12.1 RC2 x86_64 ? rc0 rc0-22-g932eacc rc1 ? ? rc0 rc0-22-g932eacc rc1 ?
MinGW32 N/A N/A ? N/A ? N/A
MinGW32 (cross-compile) N/A N/A ? N/A ? N/A

Block subsystem

Hints: qemu-iotests, qemu-nbd, install your favorite OS, ...

Raw

  • qemu-iotests rc0 [Stefan]

QCow2

  • qemu-iotests rc0 [Stefan]
    • rc0 - 026 leaked cluster output is different
  • Windows Server 2003 install rc0 rc1 [Stefan]
  • Red Hat Enterprise Linux 6 install rc1 [Stefan]

QED

  • qemu-iotests rc0 [Stefan]
  • Windows Server 2003 install rc1 [Stefan]
  • Red Hat Enterprise Linux 6 install rc1 [Stefan]

VHD

  • Windows 7 + IE8 Internet Explorer Application Compatibility VPC Image boot rc1 [Andreas]

NBD

Ceph

  • rc0 and ceph 0.37 ok [Martin]
  • rc1 and ceph 0.38 ok [Martin]

Sheepdog

  • qemu-iotests rc1 [Kazutaka]

vmdk

qemu-nbd

CD-ROM

  • Eject/insert Host CD-ROM passthrough [Need tester]
  • Eject/insert ISO CD-ROM [Need tester]

Ubuntu 11.10 have a broken support for cdrom tray locking. https://bugs.launchpad.net/ubuntu/+source/linux/+bug/854814

AHCI

  • Install SLES 11 SP2 Beta8 x86_64 from AHCI CD-ROM rc1 [Andreas]
    • rc1 - "Check Installation Media" results in: Checksum wrong. This CD-ROM is broken.

iSCSI

libiscsi source: .tar.gz - RHEL6/Fedora packages: src x86_64 x86_64-devel

System emulation targets

Hints: install your favorite OS, try different hardware configurations

ARM

  • Zaurus

keypad and touchscreen tested by cat /dev/input/event0 and /dev/input/event1 [Benoît]

Model boot serial Compact FLASH IDE touchscreen keyboard ADC
akita ok ok none ok ok ok
borzoi ok ok ok ok ok ok
spitz ok ok ok ok ok ok
terrier ok ok ok ok ok ok
tosa ok ok ok none none none

PPC (BookE, pSeries, ... including KVM)

s390x

x86 (including KVM/Xen)

  • win7 64bit freezes frequently in qemu-1.0-rc2 -enable-kvm and qemu itself becomes unresponsive (only kill -9 works). Tried 32bit build of qemu (on 64bit host kernel) only so far. This behavour didn't exist in 0.15 and in kvm. (mjt)

LM32

  • opcode testsuite rc2
  • Milkymist emulation rc2 (partly working, ac97 is broken)

User-mode emulation targets

ARM

PPC

s390

x86

Emulated hardware

Hints: install your favorite OS, run your favorite benchmarks

SCSI

Spice

USB

Virtio (including vhost-net)

Networking tests [pradeep]

Installed RHEL 6.1 and ran network related autotest tests (ping, set_link, jumbo, file_transfer) with vhost=on

https://bugs.launchpad.net/qemu/+bug/888016

Xen

Management

Hints: install your favorite OS, try weird configurations!

Libvirt

  • Hotadd of disks/nics/cpu/memory [Supriya]

Xen

HMP/QMP/QAPI

  • Comprehensive libvirt testing [LuizCapitulino]
  • Run kvm-autotest under QMP [LuizCapitulino]

Migration

Ganeti

Tested qemu 1.0rc0 under Ganeti 2.5.0-rc4, with the KVM backend (x86_64) on Debian Wheezy.

No problems found during instance creation, live migration and deletion. For these activities, Ganeti sends commands to QEMU both via the monitor protocol and via the QMP protocol.

Had problems connecting via SPICE to an instance that does not use QXL drivers (blank screen), but this seems to be a known issue.

Tracing

Hints: link to sample systemtap scripts!

  • Simpletrace memory allocation tracing rc1 [Stefan]
  • SystemTap clean build rc1 [Stefan]

Virtfs (9P Server)

  • Tested all 9p file system ( security models, features like mmap, locking, posixacl, zerocopy) using the basic fs tests, I/O and stress tests on qemu 1.0rc0 with fs driver as local. No Issues found. [Madhuri]
Qemu release info fs driver name passthrough security model mapped security model features tested Tests ran to cover these features
rc0 local All pass All pass basic fsops like open/create/read/write/close/rename/link/unlink/readdir/readlink/statfs/lookup/delete/truncate, acl, mmap, zerocopy,locking, xattr,sync,fragmentation dbench, tuxera_posix, connecthon, fsstress, fsx, fs_mark, acl,synctest,mmap,LTP, xfs, disktest, tiobench,postmark
rc0 handle All pass All pass basic fsops like open/create/read/write/close/rename/link/unlink/readdir/readlink/statfs/lookup/delete/truncate, acl, mmap, zerocopy,locking, xattr,sync,fragmentation dbench, tuxera_posix, connecthon, fsstress, fsx fs_mark, acl,synctest,mmap,LTP, xfs, disktest, tiobench
Retrieved from "https://wiki.qemu.org/index.php?title=Planning/1.0/Testing&oldid=2150"