[MLton] benchmarks for 20040227
Stephen Weeks
MLton@mlton.org
Sat, 28 Feb 2004 17:26:03 -0800
Here are the benchmarks, which I just posted on the web. I didn't see
anything too surprising.
run time ratio
benchmark MLton0 ML-Kit Moscow-ML Poly/ML SML/NJ
barnes-hut 1.00 * * * 1.01
boyer 1.00 * 10.43 2.65 3.48
checksum 1.00 * * * *
count-graphs 1.00 6.13 36.08 6.32 2.34
DLXSimulator 1.00 * * * *
fft 1.00 2.77 * 47.90 1.04
fib 1.00 1.27 5.28 0.87 1.28
hamlet 1.00 * * * 2.29
imp-for 1.00 4.92 76.60 12.39 6.90
knuth-bendix 1.00 * 18.42 8.47 3.57
lexgen 1.00 1.73 4.83 1.66 1.30
life 1.00 2.31 21.70 8.54 1.26
logic 1.00 * 6.39 1.44 1.04
mandelbrot 1.00 13.09 42.66 66.97 1.45
matrix-multiply 1.00 3.86 36.14 11.62 3.78
md5 1.00 * * * *
merge 1.00 * * 1.52 5.65
mlyacc 1.00 * 7.11 1.50 1.66
model-elimination 1.00 * * * 1.79
mpuz 1.00 2.70 57.82 5.91 3.71
nucleic 1.00 * * 23.69 0.67
output1 1.00 15.45 24.56 2.29 5.29
peek 1.00 24.96 147.60 24.19 17.93
psdes-random 1.00 7.44 * * 3.31
ratio-regions 1.00 2.16 25.29 2.77 4.66
ray 1.00 * 21.96 35.11 1.17
raytrace 1.00 * * * 2.83
simple 1.00 1.87 14.50 7.40 1.61
tailfib 1.00 1.51 42.29 2.82 2.83
tak 1.00 2.45 9.83 0.86 1.62
tensor 1.00 * * * 15.39
tsp 1.00 2.80 21.53 * 46.75
tyan 1.00 * 14.07 1.63 0.95
vector-concat 1.00 1.53 14.97 1.57 8.88
vector-rev 1.00 2.04 21.94 2.90 74.24
vliw 1.00 * * * 1.24
wc-input1 1.00 14.90 * 6.66 8.31
wc-scanStream 1.00 23.14 * 380.71 10.17
zebra 1.00 5.76 25.15 5.98 7.27
zern 1.00 * * * 2.72
compile time
benchmark MLton0 ML-Kit Moscow-ML Poly/ML SML/NJ
barnes-hut 6.11 * * * 1.12
boyer 8.15 9.31 0.39 0.15 3.16
checksum 4.70 * * * *
count-graphs 5.39 2.07 0.12 0.07 0.68
DLXSimulator 7.14 * * * *
fft 5.20 1.53 0.12 0.06 0.59
fib 4.69 0.87 0.04 0.02 0.16
hamlet 45.69 * * * 52.63
imp-for 4.72 0.99 0.04 0.02 0.19
knuth-bendix 5.76 4.21 0.18 0.15 1.34
lexgen 8.15 6.47 0.38 0.32 3.24
life 5.21 2.44 0.09 0.06 0.52
logic 6.20 4.82 0.21 0.13 1.66
mandelbrot 4.66 0.98 0.05 0.02 0.23
matrix-multiply 4.81 1.03 0.06 0.03 0.25
md5 5.10 * * * *
merge 4.69 0.92 0.05 0.02 0.22
mlyacc 22.94 37.03 3.64 1.45 14.72
model-elimination 20.91 * * * 25.68
mpuz 4.80 1.25 0.06 0.03 0.33
nucleic 61.94 31.14 * 0.49 2.54
output1 4.99 0.91 0.04 0.02 0.17
peek 4.83 0.97 0.04 0.03 0.19
psdes-random 4.70 1.00 * * 65.89
ratio-regions 5.83 3.79 0.19 0.13 1.39
ray 7.35 3.23 0.13 0.09 0.78
raytrace 11.24 * * * 4.67
simple 9.27 11.72 0.43 0.26 3.32
tailfib 4.63 0.92 0.04 0.03 0.17
tak 4.64 0.88 0.04 0.02 0.17
tensor 6.50 * * * 2.08
tsp 5.17 2.39 0.14 * 0.53
tyan 6.94 5.84 0.27 0.20 1.89
vector-concat 4.73 0.91 0.05 0.03 0.18
vector-rev 4.68 0.93 0.05 0.03 0.18
vliw 14.76 * * * 12.13
wc-input1 5.52 0.93 0.05 0.02 0.20
wc-scanStream 5.62 0.97 0.04 0.03 0.22
zebra 6.82 2.54 0.09 0.07 0.62
zern 5.24 * * * 0.56
size
benchmark MLton0 ML-Kit Moscow-ML Poly/ML SML/NJ
barnes-hut 143,701 * * * 408,640
boyer 226,477 156,737 116,300 122,880 497,704
checksum 116,365 * * * *
count-graphs 133,901 88,601 84,613 98,304 436,344
DLXSimulator 176,853 * * * *
fft 134,777 85,433 84,046 65,536 409,680
fib 114,701 16,101 79,892 49,152 386,816
hamlet 1,339,351 * * * 1,395,984
imp-for 114,685 16,869 80,040 57,344 371,752
knuth-bendix 152,549 97,177 88,439 180,224 402,472
lexgen 235,930 215,729 104,883 196,608 473,152
life 134,149 79,253 83,390 65,536 386,088
logic 174,485 115,217 87,251 114,688 411,688
mandelbrot 114,785 77,905 81,340 57,344 375,848
matrix-multiply 117,357 96,137 82,417 57,344 404,536
md5 123,529 * * * *
merge 116,117 25,601 80,090 49,152 387,848
mlyacc 552,670 502,081 148,286 2,850,816 782,448
model-elimination 671,086 * * * 1,010,936
mpuz 118,877 75,925 82,382 81,920 384,040
nucleic 265,193 268,237 * 221,184 462,904
output1 133,271 61,465 80,187 49,152 386,816
peek 124,857 60,829 81,621 57,344 374,872
psdes-random 115,101 25,529 * * 393,272
ratio-regions 142,969 98,489 87,482 73,728 414,776
ray 222,819 112,309 89,859 147,456 469,136
raytrace 325,759 * * * 588,976
simple 283,637 202,561 94,396 475,136 728,168
tailfib 114,813 16,301 79,943 57,344 386,816
tak 114,753 16,093 79,908 57,344 382,720
tensor 145,996 * * * 422,000
tsp 125,313 99,497 86,146 * 400,448
tyan 182,665 146,101 91,586 196,608 448,600
vector-concat 116,417 24,517 80,194 49,152 398,096
vector-rev 115,765 24,697 80,078 57,344 398,096
vliw 433,564 * * * 712,872
wc-input1 152,353 132,765 85,771 49,152 375,848
wc-scanStream 150,925 133,261 85,947 49,152 376,872
zebra 184,609 44,741 83,422 90,112 391,224
zern 148,770 * * * 448,664