latest benchmarks
Stephen Weeks
MLton@sourcelight.com
Tue, 3 Jul 2001 22:51:28 -0700
I just finished rerunning all the benchmarks -- there are a few new ones that
weren't there last time. In the absence of any problems, these are the numbers
going on the web page.
compile time
benchmark ML Kit MLton Moscow ML SML/NJ
barnes-hut 8.1 2.5 0.8 1.7
checksum * 0.7 * 0.2
count-graphs 2.6 1.7 0.2 1.1
fft 2.1 1.5 0.2 0.9
fib 1.0 0.6 0.1 0.2
hamlet * 53.3 43.1 90.8
knuth-bendix 5.3 2.4 0.3 2.1
lexgen 10.1 5.8 0.8 4.8
life 2.8 1.4 0.2 0.7
logic 6.7 7.4 0.4 2.0
mandelbrot 1.1 0.7 0.1 0.2
matrix-multiply 1.2 0.7 0.1 0.3
md5 * 2.3 * 2.1
merge 1.0 0.7 0.1 0.2
mlyacc 60.1 19.6 7.4 24.0
mpuz 1.4 0.9 0.1 0.4
nucleic 27.9 4.3 2.1 2.9
peek 1.2 1.1 0.1 0.2
psdes-random 1.1 0.7 * 0.3
ratio-regions 5.3 3.1 0.4 2.1
ray 3.7 3.6 0.3 1.1
raytrace * 10.3 * 6.7
simple 14.6 7.5 0.9 4.5
smith-normal-form * 8.2 * 3.4
tak 1.0 0.6 0.1 0.2
tensor * 3.1 * 3.5
tsp 2.7 1.8 0.3 0.7
vector-concat 1.0 0.7 0.1 0.2
vector-rev 1.0 0.7 0.1 0.2
vliw 37.2 12.5 3.0 18.1
wc-input1 1.1 1.7 0.1 0.3
wc-scanStream 1.1 1.8 0.1 0.3
zebra 2.9 4.8 0.2 0.8
run time ratio
benchmark ML Kit Moscow ML SML/NJ
barnes-hut 3.5 12.2 0.8
checksum * * 3.0
count-graphs 6.6 21.6 1.5
fft * 25.4 1.0
fib 1.0 4.7 1.1
hamlet * 9.0 1.5
knuth-bendix 4.7 12.2 2.1
lexgen 2.4 5.5 1.5
life 7.0 20.1 0.9
logic * 3.5 0.6
mandelbrot 4.4 33.0 1.4
matrix-multiply 10.1 36.6 3.2
md5 * * 3.2
merge * * 10.6
mlyacc * 7.6 1.7
mpuz 8.4 47.7 3.0
nucleic * 15.6 0.7
peek 6.9 31.8 2.1
psdes-random 8.4 * 2.3
ratio-regions 12.0 45.8 5.2
ray 4.4 11.4 0.8
raytrace * * 2.2
simple 2.3 12.7 1.3
smith-normal-form * * 95.1
tak 1.6 7.7 1.4
tensor * * 5.8
tsp 2.4 14.5 1.6
vector-concat 9.5 17.0 5.9
vector-rev 10.1 32.2 20.0
vliw 2.6 7.7 1.2
wc-input1 * * 6.8
wc-scanStream * * 1.5
zebra 12.2 23.4 7.0
size
benchmark ML Kit MLton Moscow ML SML/NJ
barnes-hut 179,964 41,194 94,990 331,768
checksum * 18,121 * 332,504
count-graphs 109,996 37,305 84,575 355,376
fft 107,348 31,921 84,095 332,808
fib 68,700 17,905 79,878 310,968
hamlet * 973,616 277,168 1,263,816
knuth-bendix 115,348 56,410 88,439 321,504
lexgen 227,444 128,601 104,883 390,136
life 100,380 34,593 83,390 305,120
logic 136,180 145,577 87,252 331,744
mandelbrot 101,660 17,753 81,341 311,992
matrix-multiply 118,380 18,673 81,879 338,632
md5 * 31,434 * 331,792
merge 68,908 19,033 80,091 307,904
mlyacc 525,580 421,737 148,286 700,456
mpuz 89,564 22,961 82,383 320,184
nucleic 234,188 55,033 207,154 354,288
peek 77,500 26,074 81,618 311,016
psdes-random 84,636 19,065 * 313,016
ratio-regions 111,356 54,425 87,485 335,856
ray 123,420 70,808 89,860 384,072
raytrace * 178,237 * 510,056
simple 194,092 166,265 94,397 641,056
smith-normal-form * 139,153 * 483,400
tak 68,468 17,817 79,928 306,872
tensor * 50,521 * 342,048
tsp 115,732 34,394 86,140 322,552
vector-concat 77,756 18,569 80,191 317,128
vector-rev 77,956 18,713 80,073 317,128
vliw 418,268 260,745 135,386 618,576
wc-input1 144,636 38,330 86,900 311,992
wc-scanStream 145,084 40,882 87,076 313,016
zebra 85,516 106,234 83,419 310,256