Spec JVM Benchmarks

Spec JVM Benchmarks

The test compare two guest OS:

  1. Out of the box (OOTB) Linux
  2. OSv

Test goal is comparing OS guests ‘as is’. No tuning is done on either Linux or OSv for this particular test .

Motivation

Compare OSv guest to a Linux guest in a computation- and memory-oriented applications (not IO-intensive).

Latest Benchmark

  • Test Date: Feb 16, 2014
  • OSv version: 0.05, commit a21e78cd382dc656d288a9de69ba3237ffc45003
  • Linux version: Fedora release 20 (Heisenbug), 3.12.8-300.fc20.x86_64
  • HW: 4x Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz

Results

Test Fedora OSv Ratio
compiler.compiler 386 370 0.96
compiler.sunflow 149 139 0.93
compress 104 107 1.03
crypto.aes 56 56.7 1.01
crypto.rsa 279 290 1.04
crypto.signverify 277 280 1.01
derby 176 181 1.03
mpegaudio 98.7 100 1.01
fft.large 31.5 36.8 1.17
lu.large 12 12 1.00
sor.large 27.1 27.5 1.01
sparse.large 28.1 29 1.03
fft.small 114 140 1.23
lu.small 249 219 0.88
sor.small 121 122 1.01
sparse.small 160 157 0.98
monte-carlo 150 159 1.06
serial 108 108 1.00
sunflow 55.8 53.8 0.96
xml.transform 245 249 1.02
xml.validation 468 477 1.02

Analysts

Although OSv shines a IO intensive workload, it out performed Fedora in most tests.

All Benchmarks

Test Bed

  • Benchmarks runs with two benchmark threads, and given 2 vCPUs and 2GB of memory.
  • qemu options:
    qemu-kvm -nographic -m 2G -smp 2 -device virtio-blk-pci,id=blk0,bootindex=0,drive=hd0,scsi=off -drive file=fedora.img,if=none,id=hd0,aio=native,cache=none -enable-kvm -cpu host,+x2apic
  • Java options: Xmx=1400m Xms=1400m
  • SPECjvm2008 benchmark, version 1.01, is a free Java benchmark aims to measure Java’s performance on a system
  • We ran all of SPECjvm2008’s sub-benchmarks except the “start.*” ones which measure process startup performance (as OSV does not support processes).
  • Each sub-benchmark warmed up for 120 seconds, and then measured for 240 additional sections.
  • Each measurement was repeated at least 3 times and averaged

footerCloudIcon