img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 108.84597% | 111.49114% | 0.91141% |
ghc-7.2.1 | 114.69775% | 112.71587% | 0.93544% |
ghc-7.4.1 | 121.80481% | 127.99318% | 1.12135% |
ghc-7.6.1 | 119.07032% | 117.79956% | 0.90433% |
ghc-7.8.1 | 108.35991% | 107.34372% | 0.99952% |
ghc-7.10.1 | 105.40945% | 105.90776% | 1.07531% |
ghc-8.0.1 | 106.41657% | 106.24436% | 1.09746% |
csv
Summary for input no. 0
Mean score per implementation. Excludes all categories with less than 3 inputs.
The plot shows the distribution of mean scores per category per implementation for
input no. 0.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 109.99521% | 110.12824% | 1.47017% |
ghc-7.2.1 | 113.64300% | 111.18250% | 1.38880% |
ghc-7.4.1 | 117.83062% | 123.20764% | 1.71795% |
ghc-7.6.1 | 120.74727% | 119.99786% | 1.56344% |
ghc-7.8.1 | 109.04785% | 107.13430% | 1.69922% |
ghc-7.10.1 | 104.00065% | 104.11138% | 2.28550% |
ghc-8.0.1 | 105.16447% | 105.76530% | 1.82490% |
csv
Summary for input no. 1
Mean score per implementation. Excludes all categories with less than 3 inputs.
The plot shows the distribution of mean scores per category per implementation for
input no. 1.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 108.57339% | 111.63292% | 0.94625% |
ghc-7.2.1 | 116.12635% | 112.67131% | 1.08108% |
ghc-7.4.1 | 124.70473% | 128.65927% | 1.13759% |
ghc-7.6.1 | 117.87471% | 115.08536% | 0.69092% |
ghc-7.8.1 | 106.83129% | 106.77179% | 1.14609% |
ghc-7.10.1 | 105.09967% | 104.85115% | 0.79287% |
ghc-8.0.1 | 106.65574% | 105.34999% | 1.10219% |
csv
Summary for input no. 2
Mean score per implementation. Excludes all categories with less than 3 inputs.
The plot shows the distribution of mean scores per category per implementation for
input no. 2.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 107.27264% | 113.14794% | 0.40362% |
ghc-7.2.1 | 115.00026% | 114.84053% | 0.42588% |
ghc-7.4.1 | 125.56140% | 133.45027% | 0.55262% |
ghc-7.6.1 | 117.57541% | 116.35714% | 0.48626% |
ghc-7.8.1 | 108.78589% | 107.99217% | 0.36801% |
ghc-7.10.1 | 108.05711% | 108.15271% | 0.42832% |
ghc-8.0.1 | 108.23984% | 107.29417% | 0.47823% |
csv
Seperated by entropy
The following shows the summary including only the lower or the upper half of programs
(per category),
regarding the entropy of their files. This entropy is measured by taking the length of the
gnu zipped program code length. Programs with lower entropy should be simpler than programs
with higher entropy.
If the number of programs is uneven in a category, then one program belongs to the upper and
the lower half.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 109.93962% | 112.19943% | 0.87677% |
ghc-7.2.1 | 116.12446% | 113.54280% | 0.86994% |
ghc-7.4.1 | 125.83594% | 129.55381% | 1.14674% |
ghc-7.6.1 | 120.35124% | 118.79780% | 0.82262% |
ghc-7.8.1 | 107.75473% | 107.63214% | 1.01932% |
ghc-7.10.1 | 105.23367% | 106.20069% | 1.14307% |
ghc-8.0.1 | 106.04428% | 106.35833% | 1.11062% |
csv
Summary for input no. 0
Mean score per implementation. Excludes all categories with less than 3 inputs.
The plot shows the distribution of mean scores per category per implementation for
input no. 0.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 111.12206% | 111.04640% | 1.51365% |
ghc-7.2.1 | 115.50437% | 112.06519% | 1.52241% |
ghc-7.4.1 | 121.64433% | 125.46189% | 1.95921% |
ghc-7.6.1 | 122.45417% | 121.41178% | 1.66892% |
ghc-7.8.1 | 109.14373% | 107.65795% | 1.94657% |
ghc-7.10.1 | 104.06950% | 104.21445% | 2.66142% |
ghc-8.0.1 | 105.16605% | 105.97577% | 2.16869% |
csv
Summary for input no. 1
Mean score per implementation. Excludes all categories with less than 3 inputs.
The plot shows the distribution of mean scores per category per implementation for
input no. 1.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 109.85674% | 111.94655% | 0.85932% |
ghc-7.2.1 | 116.68129% | 113.52209% | 0.95908% |
ghc-7.4.1 | 128.46872% | 129.16628% | 1.07136% |
ghc-7.6.1 | 118.77238% | 116.02835% | 0.55141% |
ghc-7.8.1 | 105.74993% | 106.59477% | 1.15773% |
ghc-7.10.1 | 104.47541% | 104.89156% | 0.86235% |
ghc-8.0.1 | 105.64967% | 105.00561% | 0.99915% |
csv
Summary for input no. 2
Mean score per implementation. Excludes all categories with less than 3 inputs.
The plot shows the distribution of mean scores per category per implementation for
input no. 2.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 108.35390% | 113.76585% | 0.41005% |
ghc-7.2.1 | 116.45765% | 115.43945% | 0.35475% |
ghc-7.4.1 | 129.36901% | 134.53907% | 0.57106% |
ghc-7.6.1 | 118.97030% | 117.17299% | 0.44670% |
ghc-7.8.1 | 107.80683% | 108.12511% | 0.35615% |
ghc-7.10.1 | 107.69540% | 108.68101% | 0.45302% |
ghc-8.0.1 | 107.71244% | 107.67921% | 0.47458% |
csv
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 106.53693% | 111.30730% | 1.17340% |
ghc-7.2.1 | 111.07174% | 110.26730% | 1.20541% |
ghc-7.4.1 | 119.35655% | 129.18992% | 1.46590% |
ghc-7.6.1 | 114.21292% | 113.38500% | 1.07598% |
ghc-7.8.1 | 107.14739% | 106.80111% | 1.24860% |
ghc-7.10.1 | 106.16506% | 106.23250% | 1.28252% |
ghc-8.0.1 | 107.67563% | 106.19523% | 1.44109% |
csv
Summary for input no. 0
Mean score per implementation. Excludes all categories with less than 3 inputs.
The plot shows the distribution of mean scores per category per implementation for
input no. 0.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 106.50750% | 108.98639% | 2.20830% |
ghc-7.2.1 | 109.80256% | 108.73915% | 2.03457% |
ghc-7.4.1 | 116.21543% | 124.40442% | 2.43171% |
ghc-7.6.1 | 115.99328% | 116.16368% | 2.10490% |
ghc-7.8.1 | 107.89294% | 105.99445% | 2.40560% |
ghc-7.10.1 | 104.80959% | 104.33250% | 3.14374% |
ghc-8.0.1 | 106.45957% | 106.00749% | 2.47376% |
csv
Summary for input no. 1
Mean score per implementation. Excludes all categories with less than 3 inputs.
The plot shows the distribution of mean scores per category per implementation for
input no. 1.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 107.20286% | 111.85383% | 1.22096% |
ghc-7.2.1 | 112.53595% | 109.58405% | 1.39081% |
ghc-7.4.1 | 121.14358% | 129.25678% | 1.45590% |
ghc-7.6.1 | 113.02876% | 109.63590% | 0.83324% |
ghc-7.8.1 | 105.43856% | 106.12061% | 1.44434% |
ghc-7.10.1 | 105.42545% | 105.11450% | 0.90662% |
ghc-8.0.1 | 107.64206% | 105.04922% | 1.55340% |
csv
Summary for input no. 2
Mean score per implementation. Excludes all categories with less than 3 inputs.
The plot shows the distribution of mean scores per category per implementation for
input no. 2.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 105.91694% | 113.54859% | 0.45697% |
ghc-7.2.1 | 111.44124% | 112.54945% | 0.49457% |
ghc-7.4.1 | 122.16267% | 134.79141% | 0.71625% |
ghc-7.6.1 | 112.88725% | 112.06903% | 0.53274% |
ghc-7.8.1 | 107.81065% | 108.12865% | 0.42298% |
ghc-7.10.1 | 108.89053% | 108.42821% | 0.50401% |
ghc-8.0.1 | 109.47113% | 107.05011% | 0.61782% |
csv
binarytrees
Program: '1'
The following plot shows the rel means (means / min means) per input distribution for every implementation.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 102.93271% | 103.22854% | 1.68299% |
ghc-7.2.1 | 107.48103% | 103.18824% | 1.67860% |
ghc-7.4.1 | 106.70664% | 104.89441% | 2.97218% |
ghc-7.6.1 | 106.56646% | 105.61383% | 1.20134% |
ghc-7.8.1 | 104.57288% | 103.55173% | 2.11023% |
ghc-7.10.1 | 110.49075% | 106.12813% | 2.77859% |
ghc-8.0.1 | 109.94970% | 103.42827% | 1.96983% |
csv
Input: '12'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 35.58488 | 101.36534% | 100.00000% | 9.32676% | 9.45410% | 9.32676% | 34.26758 |
ghc-7.2.1 | 20 | 36.99127 | 105.37152% | 103.95222% | 7.77222% | 8.18971% | 8.07940% | 35.19761 |
ghc-7.4.1 | 20 | 35.90469 | 102.27634% | 100.89873% | 11.82767% | 12.09691% | 11.93397% | 35.61000 |
ghc-7.6.1 | 20 | 35.10557 | 100.00000% | 98.65305% | 7.74059% | 7.74059% | 7.63633% | 34.08987 |
ghc-7.8.1 | 20 | 36.86751 | 105.01897% | 103.60442% | 6.97816% | 7.32839% | 7.22968% | 36.88943 |
ghc-7.10.1 | 20 | 37.97593 | 108.17637% | 106.71929% | 10.79466% | 11.67727% | 11.51998% | 36.61204 |
ghc-8.0.1 | 20 | 39.46879 | 112.42887% | 110.91451% | 8.53589% | 9.59680% | 9.46754% | 39.38057 |
csv
Input: '16'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 1160.27345 | 107.58972% | 100.00000% | 1.41761% | 1.52521% | 1.41761% | 1155.18420 |
ghc-7.2.1 | 20 | 1211.60769 | 112.34983% | 104.42432% | 1.15898% | 1.30212% | 1.21026% | 1207.04450 |
ghc-7.4.1 | 20 | 1230.20803 | 114.07460% | 106.02742% | 1.90480% | 2.17290% | 2.01961% | 1233.32402 |
ghc-7.6.1 | 20 | 1232.27620 | 114.26638% | 106.20567% | 0.53489% | 0.61120% | 0.56808% | 1233.36989 |
ghc-7.8.1 | 20 | 1078.42412 | 100.00000% | 92.94569% | 2.33894% | 2.33894% | 2.17395% | 1065.17774 |
ghc-7.10.1 | 20 | 1122.26322 | 104.06511% | 96.72403% | 2.41977% | 2.51814% | 2.34050% | 1119.25540 |
ghc-8.0.1 | 20 | 1130.56275 | 104.83471% | 97.43934% | 1.04156% | 1.09192% | 1.01489% | 1130.61332 |
csv
Input: '20'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 33325.22206 | 100.00000% | 100.00000% | 0.36054% | 0.36054% | 0.36054% | 33322.55649 |
ghc-7.2.1 | 20 | 34952.06696 | 104.88172% | 104.88172% | 0.52507% | 0.55070% | 0.55070% | 34939.80545 |
ghc-7.4.1 | 20 | 34704.29598 | 104.13823% | 104.13823% | 1.16541% | 1.21363% | 1.21363% | 34613.03562 |
ghc-7.6.1 | 20 | 35295.24995 | 105.91152% | 105.91152% | 0.41876% | 0.44351% | 0.44351% | 35272.26885 |
ghc-7.8.1 | 20 | 36287.96056 | 108.89038% | 108.89038% | 0.57575% | 0.62693% | 0.62693% | 36235.93834 |
ghc-7.10.1 | 20 | 39931.27951 | 119.82300% | 119.82300% | 0.82127% | 0.98408% | 0.98408% | 39912.47192 |
ghc-8.0.1 | 20 | 37581.34251 | 112.77147% | 112.77147% | 0.85971% | 0.96951% | 0.96951% | 37576.24591 |
csv
fannkuchredux
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 108.92013% | 108.94826% | 0.51452% |
ghc-7.2.1 | 125.58951% | 115.04661% | 0.60178% |
ghc-7.4.1 | 124.70097% | 122.11361% | 0.46758% |
ghc-7.6.1 | 132.28822% | 119.31155% | 0.83025% |
ghc-7.8.1 | 115.81784% | 101.35085% | 0.45521% |
ghc-7.10.1 | 106.22628% | 103.36328% | 0.44580% |
ghc-8.0.1 | 106.23325% | 106.25654% | 0.44734% |
csv
Mean scores per input
Mean scores for input '10'
The plot shows the distribution of mean scores per program for each implementation.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 109.54090% | 109.54090% | 1.01369% |
ghc-7.2.1 | 126.50159% | 114.52707% | 0.66927% |
ghc-7.4.1 | 125.23615% | 121.28720% | 0.86913% |
ghc-7.6.1 | 133.85183% | 118.65013% | 1.52375% |
ghc-7.8.1 | 115.66826% | 102.09793% | 0.75559% |
ghc-7.10.1 | 106.08937% | 102.83432% | 1.20377% |
ghc-8.0.1 | 106.11207% | 106.11207% | 0.95519% |
csv
Mean scores for input '11'
The plot shows the distribution of mean scores per program for each implementation.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 108.93594% | 108.93594% | 0.54330% |
ghc-7.2.1 | 127.47426% | 113.49712% | 0.68066% |
ghc-7.4.1 | 124.37159% | 122.81162% | 0.59178% |
ghc-7.6.1 | 132.95339% | 118.94406% | 0.78994% |
ghc-7.8.1 | 115.90692% | 101.03740% | 0.49237% |
ghc-7.10.1 | 106.15796% | 103.21904% | 0.36958% |
ghc-8.0.1 | 106.75752% | 106.75752% | 0.46756% |
csv
Mean scores for input '12'
The plot shows the distribution of mean scores per program for each implementation.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 108.28716% | 108.28716% | 0.24733% |
ghc-7.2.1 | 122.84052% | 116.66142% | 0.47840% |
ghc-7.4.1 | 124.49691% | 122.21405% | 0.19875% |
ghc-7.6.1 | 130.08878% | 120.16498% | 0.47546% |
ghc-7.8.1 | 115.87847% | 100.01241% | 0.25355% |
ghc-7.10.1 | 106.43181% | 103.93822% | 0.19915% |
ghc-8.0.1 | 105.83227% | 105.83227% | 0.20044% |
csv
Program: '1'
The following plot shows the rel means (means / min means) per input distribution for every implementation.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 118.63595% | 100.94457% | 0.19912% |
ghc-7.2.1 | 144.28686% | 100.48603% | 0.19461% |
ghc-7.4.1 | 152.26322% | 100.23311% | 0.15765% |
ghc-7.6.1 | 157.75537% | 100.67105% | 0.29305% |
ghc-7.8.1 | 117.01921% | 100.78351% | 0.21002% |
ghc-7.10.1 | 102.80342% | 100.30630% | 0.27388% |
ghc-8.0.1 | 100.00000% | 100.00000% | 0.14643% |
csv
Input: '10'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 2431.27055 | 119.99210% | 100.00000% | 0.29348% | 0.35215% | 0.29348% | 2432.94804 |
ghc-7.2.1 | 20 | 2935.51816 | 144.87856% | 120.74009% | 0.26594% | 0.38530% | 0.32110% | 2936.21690 |
ghc-7.4.1 | 20 | 3077.69317 | 151.89542% | 126.58785% | 0.21535% | 0.32711% | 0.27261% | 3076.00295 |
ghc-7.6.1 | 20 | 3217.90461 | 158.81536% | 132.35486% | 0.52653% | 0.83620% | 0.69688% | 3216.76569 |
ghc-7.8.1 | 20 | 2392.82962 | 118.09490% | 98.41890% | 0.29377% | 0.34693% | 0.28912% | 2391.99346 |
ghc-7.10.1 | 20 | 2090.32813 | 103.16534% | 85.97678% | 0.48306% | 0.49835% | 0.41532% | 2089.02167 |
ghc-8.0.1 | 20 | 2026.19225 | 100.00000% | 83.33882% | 0.39517% | 0.39517% | 0.32933% | 2024.08741 |
csv
Input: '11'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 29801.21325 | 118.67040% | 100.00000% | 0.15890% | 0.18857% | 0.15890% | 29793.11429 |
ghc-7.2.1 | 20 | 36332.79839 | 144.67960% | 121.91718% | 0.18534% | 0.26815% | 0.22596% | 36332.88632 |
ghc-7.4.1 | 20 | 38357.66737 | 152.74277% | 128.71176% | 0.20229% | 0.30899% | 0.26037% | 38343.23472 |
ghc-7.6.1 | 20 | 39713.09308 | 158.14016% | 133.25999% | 0.18623% | 0.29451% | 0.24818% | 39720.60724 |
ghc-7.8.1 | 15 | 29409.19100 | 117.10934% | 98.68454% | 0.22703% | 0.26587% | 0.22404% | 29407.80424 |
ghc-7.10.1 | 20 | 25827.61369 | 102.84726% | 86.66632% | 0.31018% | 0.31901% | 0.26882% | 25805.31750 |
ghc-8.0.1 | 20 | 25112.59181 | 100.00000% | 84.26701% | 0.09978% | 0.09978% | 0.08408% | 25117.14842 |
csv
Input: '12'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 15 | 399917.26345 | 117.26108% | 100.00000% | 0.16929% | 0.19851% | 0.16929% | 399884.28386 |
ghc-7.2.1 | 15 | 488748.19064 | 143.30749% | 122.21233% | 0.14953% | 0.21428% | 0.18274% | 488425.17276 |
ghc-7.4.1 | 15 | 518914.68921 | 152.15271% | 129.75551% | 0.08995% | 0.13685% | 0.11671% | 518772.51667 |
ghc-7.6.1 | 15 | 533131.07801 | 156.32115% | 133.31034% | 0.25666% | 0.40121% | 0.34215% | 533391.37097 |
ghc-7.8.1 | 15 | 395152.86357 | 115.86409% | 98.80865% | 0.13889% | 0.16093% | 0.13724% | 395130.88882 |
ghc-7.10.1 | 15 | 349230.71670 | 102.39911% | 87.32574% | 0.13711% | 0.14040% | 0.11973% | 349329.50207 |
ghc-8.0.1 | 15 | 341048.59152 | 100.00000% | 85.27979% | 0.07962% | 0.07962% | 0.06790% | 341066.42369 |
csv
Program: '3'
The following plot shows the rel means (means / min means) per input distribution for every implementation.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 100.00000% | 100.00000% | 1.32954% |
ghc-7.2.1 | 109.31505% | 102.77233% | 1.86087% |
ghc-7.4.1 | 102.12795% | 100.81628% | 1.38677% |
ghc-7.6.1 | 110.93235% | 101.78143% | 2.35218% |
ghc-7.8.1 | 114.62879% | 100.93272% | 0.98667% |
ghc-7.10.1 | 109.76309% | 100.58194% | 0.72565% |
ghc-8.0.1 | 112.85503% | 100.73149% | 1.36661% |
csv
Input: '10'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 315.36318 | 100.00000% | 100.00000% | 3.50129% | 3.50129% | 3.50129% | 312.16577 |
ghc-7.2.1 | 20 | 348.33637 | 110.45562% | 110.45562% | 1.68427% | 1.86038% | 1.86038% | 349.48573 |
ghc-7.4.1 | 20 | 325.63097 | 103.25586% | 103.25586% | 3.50774% | 3.62195% | 3.62195% | 328.15997 |
ghc-7.6.1 | 20 | 355.76816 | 112.81221% | 112.81221% | 4.40967% | 4.97465% | 4.97465% | 353.80273 |
ghc-7.8.1 | 20 | 357.27963 | 113.29148% | 113.29148% | 1.94342% | 2.20173% | 2.20173% | 354.73545 |
ghc-7.10.1 | 20 | 344.04950 | 109.09628% | 109.09628% | 2.99975% | 3.27262% | 3.27262% | 340.89525 |
ghc-8.0.1 | 20 | 355.09170 | 112.59771% | 112.59771% | 2.30885% | 2.59972% | 2.59972% | 356.89238 |
csv
Input: '11'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 3768.54381 | 100.00000% | 100.00000% | 1.85759% | 1.85759% | 1.85759% | 3744.06282 |
ghc-7.2.1 | 20 | 4232.63905 | 112.31498% | 112.31498% | 2.49967% | 2.80750% | 2.80750% | 4283.73190 |
ghc-7.4.1 | 20 | 3816.41247 | 101.27022% | 101.27022% | 1.73118% | 1.75317% | 1.75317% | 3794.96577 |
ghc-7.6.1 | 20 | 4212.40594 | 111.77808% | 111.77808% | 3.35063% | 3.74526% | 3.74526% | 4223.68652 |
ghc-7.8.1 | 20 | 4323.15482 | 114.71685% | 114.71685% | 1.06785% | 1.22500% | 1.22500% | 4307.54278 |
ghc-7.10.1 | 20 | 4129.39012 | 109.57522% | 109.57522% | 0.44036% | 0.48253% | 0.48253% | 4124.00906 |
ghc-8.0.1 | 20 | 4295.07310 | 113.97169% | 113.97169% | 2.19088% | 2.49698% | 2.49698% | 4349.05943 |
csv
Input: '12'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 50597.63303 | 100.00000% | 100.00000% | 0.36135% | 0.36135% | 0.36135% | 50553.75893 |
ghc-7.2.1 | 20 | 53277.59509 | 105.29662% | 105.29662% | 1.53058% | 1.61165% | 1.61165% | 52895.89321 |
ghc-7.4.1 | 20 | 51542.75317 | 101.86791% | 101.86791% | 0.43918% | 0.44739% | 0.44739% | 51534.79956 |
ghc-7.6.1 | 20 | 54776.22787 | 108.25848% | 108.25848% | 0.88080% | 0.95355% | 0.95355% | 54675.61769 |
ghc-7.8.1 | 20 | 58639.03768 | 115.89285% | 115.89285% | 0.46285% | 0.53641% | 0.53641% | 58611.32413 |
ghc-7.10.1 | 20 | 55972.78503 | 110.62333% | 110.62333% | 0.28926% | 0.31999% | 0.31999% | 55968.64536 |
ghc-8.0.1 | 20 | 56671.72519 | 112.00470% | 112.00470% | 0.50457% | 0.56514% | 0.56514% | 56663.55054 |
csv
fasta
Program: '1'
The following plot shows the rel means (means / min means) per input distribution for every implementation.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 100.00000% | 100.00000% | 0.54658% |
ghc-7.2.1 | 108.77260% | 100.35953% | 0.65921% |
ghc-7.4.1 | 108.31284% | 100.62274% | 0.94715% |
ghc-7.6.1 | 109.05580% | 100.31796% | 0.73660% |
ghc-7.8.1 | 104.48686% | 100.71980% | 0.86472% |
ghc-7.10.1 | 106.76054% | 100.19318% | 0.86389% |
ghc-8.0.1 | 106.32172% | 100.06521% | 0.87779% |
csv
Input: '250000'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 91.58449 | 100.00000% | 100.00000% | 2.29352% | 2.29352% | 2.29352% | 90.95912 |
ghc-7.2.1 | 20 | 99.22039 | 108.33754% | 108.33754% | 2.37905% | 2.57740% | 2.57740% | 99.57854 |
ghc-7.4.1 | 20 | 98.67861 | 107.74598% | 107.74598% | 3.79691% | 4.09101% | 4.09101% | 97.08773 |
ghc-7.6.1 | 20 | 99.45951 | 108.59863% | 108.59863% | 2.63441% | 2.86093% | 2.86093% | 99.15499 |
ghc-7.8.1 | 20 | 96.66559 | 105.54798% | 105.54798% | 3.43436% | 3.62490% | 3.62490% | 97.36682 |
ghc-7.10.1 | 20 | 97.95568 | 106.95662% | 106.95662% | 3.35585% | 3.58930% | 3.58930% | 97.99731 |
ghc-8.0.1 | 20 | 97.40551 | 106.35589% | 106.35589% | 4.20620% | 4.47354% | 4.47354% | 95.64652 |
csv
Input: '2500000'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 858.13469 | 100.00000% | 100.00000% | 0.41239% | 0.41239% | 0.41239% | 858.16156 |
ghc-7.2.1 | 20 | 932.76868 | 108.69724% | 108.69724% | 0.62045% | 0.67442% | 0.67442% | 931.40360 |
ghc-7.4.1 | 20 | 937.61006 | 109.26141% | 109.26141% | 1.10705% | 1.20958% | 1.20958% | 934.21447 |
ghc-7.6.1 | 20 | 936.52815 | 109.13533% | 109.13533% | 0.53262% | 0.58127% | 0.58127% | 936.66202 |
ghc-7.8.1 | 20 | 891.43519 | 103.88057% | 103.88057% | 0.65011% | 0.67534% | 0.67534% | 890.36709 |
ghc-7.10.1 | 20 | 913.70888 | 106.47616% | 106.47616% | 0.51705% | 0.55053% | 0.55053% | 914.66606 |
ghc-8.0.1 | 20 | 911.55450 | 106.22511% | 106.22511% | 0.58894% | 0.62560% | 0.62560% | 910.40225 |
csv
Input: '25000000'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 8475.04354 | 100.00000% | 100.00000% | 0.17264% | 0.17264% | 0.17264% | 8473.06848 |
ghc-7.2.1 | 20 | 9261.96105 | 109.28511% | 109.28511% | 0.19407% | 0.21209% | 0.21209% | 9260.86345 |
ghc-7.4.1 | 20 | 9147.74124 | 107.93740% | 107.93740% | 0.20215% | 0.21819% | 0.21819% | 9146.41668 |
ghc-7.6.1 | 20 | 9274.67219 | 109.43510% | 109.43510% | 0.28483% | 0.31171% | 0.31171% | 9265.62100 |
ghc-7.8.1 | 20 | 8817.44514 | 104.04012% | 104.04012% | 0.28959% | 0.30129% | 0.30129% | 8813.83238 |
ghc-7.10.1 | 20 | 9055.53682 | 106.84944% | 106.84944% | 0.37158% | 0.39703% | 0.39703% | 9057.64455 |
ghc-8.0.1 | 20 | 9016.10850 | 106.38421% | 106.38421% | 0.27303% | 0.29046% | 0.29046% | 9006.45216 |
csv
mandelbrot
Program: '2'
The following plot shows the rel means (means / min means) per input distribution for every implementation.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 103.50558% | 103.08648% | 1.92342% |
ghc-7.2.1 | 103.71926% | 102.90718% | 2.26406% |
ghc-7.4.1 | 102.16165% | 100.19496% | 1.42170% |
ghc-7.6.1 | 102.70680% | 100.05700% | 0.57072% |
ghc-7.8.1 | 100.60881% | 100.70844% | 1.38261% |
ghc-7.10.1 | 100.40521% | 100.57353% | 0.78464% |
ghc-8.0.1 | 100.68730% | 100.52208% | 1.15590% |
csv
Input: '1000'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 159.75269 | 100.00000% | 100.00000% | 1.67908% | 1.67908% | 1.67908% | 160.15171 |
ghc-7.2.1 | 20 | 161.94860 | 101.37457% | 101.37457% | 1.85232% | 1.87778% | 1.87778% | 162.45140 |
ghc-7.4.1 | 20 | 162.77066 | 101.88915% | 101.88915% | 2.09404% | 2.13360% | 2.13360% | 162.88280 |
ghc-7.6.1 | 20 | 164.03177 | 102.67857% | 102.67857% | 1.60892% | 1.65202% | 1.65202% | 164.65697 |
ghc-7.8.1 | 20 | 159.92122 | 100.10550% | 100.10550% | 2.00733% | 2.00945% | 2.00945% | 159.30069 |
ghc-7.10.1 | 20 | 161.70255 | 101.22055% | 101.22055% | 6.05486% | 6.12877% | 6.12877% | 159.72087 |
ghc-8.0.1 | 20 | 159.89625 | 100.08987% | 100.08987% | 1.73788% | 1.73944% | 1.73944% | 160.33271 |
csv
Input: '4000'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 2615.22732 | 107.67497% | 100.00000% | 5.13554% | 5.52969% | 5.13554% | 2583.86733 |
ghc-7.2.1 | 20 | 2623.03610 | 107.99648% | 100.29859% | 6.21729% | 6.71445% | 6.23585% | 2622.74467 |
ghc-7.4.1 | 20 | 2483.18607 | 102.23853% | 94.95106% | 2.00638% | 2.05129% | 1.90508% | 2477.44161 |
ghc-7.6.1 | 20 | 2496.53979 | 102.78833% | 95.46167% | 0.23764% | 0.24426% | 0.22685% | 2495.97555 |
ghc-7.8.1 | 20 | 2468.12111 | 101.61827% | 94.37501% | 3.75606% | 3.81685% | 3.54478% | 2437.55969 |
ghc-7.10.1 | 20 | 2428.81629 | 100.00000% | 92.87209% | 0.15627% | 0.15627% | 0.14513% | 2429.67457 |
ghc-8.0.1 | 20 | 2462.02784 | 101.36740% | 94.14202% | 3.03969% | 3.08126% | 2.86163% | 2446.25796 |
csv
Input: '16000'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 39920.97715 | 102.98561% | 100.00000% | 0.82521% | 0.84984% | 0.82521% | 39966.87073 |
ghc-7.2.1 | 20 | 39506.10113 | 101.91534% | 98.96076% | 1.00774% | 1.02704% | 0.99727% | 39360.17624 |
ghc-7.4.1 | 20 | 39677.63702 | 102.35785% | 99.39045% | 0.68395% | 0.70008% | 0.67978% | 39586.76082 |
ghc-7.6.1 | 20 | 39792.25711 | 102.65354% | 99.67756% | 0.48620% | 0.49910% | 0.48463% | 39760.54546 |
ghc-7.8.1 | 20 | 38806.36010 | 100.11019% | 97.20794% | 0.35055% | 0.35094% | 0.34076% | 38795.52100 |
ghc-7.10.1 | 20 | 38763.64690 | 100.00000% | 97.10095% | 0.51055% | 0.51055% | 0.49575% | 38686.48520 |
ghc-8.0.1 | 20 | 38999.61644 | 100.60874% | 97.69204% | 0.29236% | 0.29414% | 0.28561% | 38963.47326 |
csv
meteor
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 116.46942% | 106.01064% | 0.59917% |
ghc-7.2.1 | 113.31993% | 106.23309% | 0.62142% |
ghc-7.4.1 | 110.67379% | 107.71272% | 0.76150% |
ghc-7.6.1 | 128.62935% | 122.95118% | 0.64821% |
ghc-7.8.1 | 110.59127% | 108.51369% | 0.77799% |
ghc-7.10.1 | 101.00570% | 100.94884% | 1.05876% |
ghc-8.0.1 | 101.22610% | 101.02489% | 0.83403% |
csv
Program: '1'
The following plot shows the rel means (means / min means) per input distribution for every implementation.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 112.20272% | 100.00000% | 0.75380% |
ghc-7.2.1 | 111.06987% | 100.00000% | 0.54394% |
ghc-7.4.1 | 113.75138% | 100.00000% | 0.44849% |
ghc-7.6.1 | 135.61677% | 100.00000% | 0.54015% |
ghc-7.8.1 | 111.81972% | 100.00000% | 0.57710% |
ghc-7.10.1 | 100.00000% | 100.00000% | 0.64774% |
ghc-8.0.1 | 100.74801% | 100.00000% | 0.62928% |
csv
Input: '2098'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 780.85071 | 112.20272% | 100.00000% | 0.75380% | 0.84579% | 0.75380% | 780.59416 |
ghc-7.2.1 | 20 | 772.96688 | 111.06987% | 98.99035% | 0.54394% | 0.60416% | 0.53845% | 772.82466 |
ghc-7.4.1 | 20 | 791.62828 | 113.75138% | 101.38023% | 0.44849% | 0.51016% | 0.45468% | 790.22039 |
ghc-7.6.1 | 20 | 943.79578 | 135.61677% | 120.86763% | 0.54015% | 0.73254% | 0.65287% | 944.38132 |
ghc-7.8.1 | 20 | 778.18528 | 111.81972% | 99.65865% | 0.57710% | 0.64531% | 0.57513% | 777.64230 |
ghc-7.10.1 | 20 | 695.92850 | 100.00000% | 89.12440% | 0.64774% | 0.64774% | 0.57729% | 694.97022 |
ghc-8.0.1 | 20 | 701.13414 | 100.74801% | 89.79106% | 0.62928% | 0.63399% | 0.56504% | 700.97944 |
csv
Program: '2'
The following plot shows the rel means (means / min means) per input distribution for every implementation.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 116.49272% | 100.00000% | 0.61491% |
ghc-7.2.1 | 115.80379% | 100.00000% | 0.65995% |
ghc-7.4.1 | 116.55427% | 100.00000% | 0.90399% |
ghc-7.6.1 | 156.74819% | 100.00000% | 0.68390% |
ghc-7.8.1 | 119.37297% | 100.00000% | 0.85097% |
ghc-7.10.1 | 101.71395% | 100.00000% | 1.50369% |
ghc-8.0.1 | 100.00000% | 100.00000% | 1.17327% |
csv
Input: '2098'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 560.64048 | 116.49272% | 100.00000% | 0.61491% | 0.71633% | 0.61491% | 560.26343 |
ghc-7.2.1 | 20 | 557.32488 | 115.80379% | 99.40860% | 0.65995% | 0.76424% | 0.65604% | 557.80003 |
ghc-7.4.1 | 20 | 560.93671 | 116.55427% | 100.05284% | 0.90399% | 1.05363% | 0.90446% | 559.74270 |
ghc-7.6.1 | 20 | 754.37661 | 156.74819% | 134.55621% | 0.68390% | 1.07200% | 0.92023% | 753.28482 |
ghc-7.8.1 | 20 | 574.50216 | 119.37297% | 102.47247% | 0.85097% | 1.01583% | 0.87201% | 573.45458 |
ghc-7.10.1 | 20 | 489.51523 | 101.71395% | 87.31357% | 1.50369% | 1.52946% | 1.31292% | 486.37003 |
ghc-8.0.1 | 20 | 481.26654 | 100.00000% | 85.84227% | 1.17327% | 1.17327% | 1.00716% | 479.90835 |
csv
Program: '3'
The following plot shows the rel means (means / min means) per input distribution for every implementation.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 126.95749% | 100.00000% | 0.59211% |
ghc-7.2.1 | 119.49844% | 100.00000% | 0.81707% |
ghc-7.4.1 | 121.69200% | 100.00000% | 1.34284% |
ghc-7.6.1 | 162.40440% | 100.00000% | 0.64232% |
ghc-7.8.1 | 122.14086% | 100.00000% | 1.11370% |
ghc-7.10.1 | 100.00000% | 100.00000% | 1.68579% |
ghc-8.0.1 | 100.48506% | 100.00000% | 0.99905% |
csv
Input: '2098'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 500.82414 | 126.95749% | 100.00000% | 0.59211% | 0.75173% | 0.59211% | 500.39205 |
ghc-7.2.1 | 20 | 471.39956 | 119.49844% | 94.12477% | 0.81707% | 0.97638% | 0.76906% | 472.25430 |
ghc-7.4.1 | 20 | 480.05273 | 121.69200% | 95.85255% | 1.34284% | 1.63412% | 1.28714% | 478.32268 |
ghc-7.6.1 | 20 | 640.65573 | 162.40440% | 127.92030% | 0.64232% | 1.04316% | 0.82166% | 639.92574 |
ghc-7.8.1 | 20 | 481.82342 | 122.14086% | 96.20611% | 1.11370% | 1.36028% | 1.07145% | 479.75312 |
ghc-7.10.1 | 20 | 394.48176 | 100.00000% | 78.76652% | 1.68579% | 1.68579% | 1.32784% | 393.52752 |
ghc-8.0.1 | 20 | 396.39521 | 100.48506% | 79.14858% | 0.99905% | 1.00390% | 0.79074% | 396.69033 |
csv
Program: '4'
The following plot shows the rel means (means / min means) per input distribution for every implementation.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 120.57194% | 100.00000% | 0.31278% |
ghc-7.2.1 | 119.55388% | 100.00000% | 0.27074% |
ghc-7.4.1 | 101.60412% | 100.00000% | 0.54307% |
ghc-7.6.1 | 101.99681% | 100.00000% | 0.57750% |
ghc-7.8.1 | 100.00000% | 100.00000% | 0.46370% |
ghc-7.10.1 | 100.90782% | 100.00000% | 0.60463% |
ghc-8.0.1 | 102.41152% | 100.00000% | 0.73481% |
csv
Input: '2098'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 1592.66937 | 120.57194% | 100.00000% | 0.31278% | 0.37712% | 0.31278% | 1592.71279 |
ghc-7.2.1 | 20 | 1579.22163 | 119.55388% | 99.15565% | 0.27074% | 0.32368% | 0.26845% | 1580.43887 |
ghc-7.4.1 | 20 | 1342.11799 | 101.60412% | 84.26846% | 0.54307% | 0.55178% | 0.45764% | 1340.88953 |
ghc-7.6.1 | 20 | 1347.30520 | 101.99681% | 84.59416% | 0.57750% | 0.58903% | 0.48853% | 1346.43679 |
ghc-7.8.1 | 20 | 1320.92874 | 100.00000% | 82.93804% | 0.46370% | 0.46370% | 0.38458% | 1320.47545 |
ghc-7.10.1 | 20 | 1332.92042 | 100.90782% | 83.69097% | 0.60463% | 0.61012% | 0.50602% | 1331.92911 |
ghc-8.0.1 | 20 | 1352.78319 | 102.41152% | 84.93811% | 0.73481% | 0.75253% | 0.62414% | 1355.52882 |
csv
Program: '5'
The following plot shows the rel means (means / min means) per input distribution for every implementation.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 107.11563% | 100.00000% | 0.89959% |
ghc-7.2.1 | 101.69192% | 100.00000% | 1.16695% |
ghc-7.4.1 | 101.28981% | 100.00000% | 0.86606% |
ghc-7.6.1 | 100.00000% | 100.00000% | 0.83514% |
ghc-7.8.1 | 101.46560% | 100.00000% | 1.12386% |
ghc-7.10.1 | 102.42929% | 100.00000% | 1.34010% |
ghc-8.0.1 | 102.51226% | 100.00000% | 0.74458% |
csv
Input: '2098'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 491.26064 | 107.11563% | 100.00000% | 0.89959% | 0.96360% | 0.89959% | 492.14202 |
ghc-7.2.1 | 20 | 466.38605 | 101.69192% | 94.93658% | 1.16695% | 1.18669% | 1.10786% | 464.87271 |
ghc-7.4.1 | 20 | 464.54187 | 101.28981% | 94.56118% | 0.86606% | 0.87723% | 0.81895% | 464.12722 |
ghc-7.6.1 | 20 | 458.62647 | 100.00000% | 93.35706% | 0.83514% | 0.83514% | 0.77966% | 459.20778 |
ghc-7.8.1 | 20 | 465.34809 | 101.46560% | 94.72530% | 1.12386% | 1.14034% | 1.06458% | 464.62867 |
ghc-7.10.1 | 20 | 469.76782 | 102.42929% | 95.62497% | 1.34010% | 1.37266% | 1.28147% | 468.22075 |
ghc-8.0.1 | 20 | 470.14838 | 102.51226% | 95.70243% | 0.74458% | 0.76328% | 0.71258% | 469.24550 |
csv
nbody
Program: '2'
The following plot shows the rel means (means / min means) per input distribution for every implementation.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 138.14381% | 104.18918% | 5.62064% |
ghc-7.2.1 | 139.40074% | 102.41255% | 5.37932% |
ghc-7.4.1 | 136.81056% | 103.64907% | 6.45534% |
ghc-7.6.1 | 136.21414% | 100.99787% | 4.06000% |
ghc-7.8.1 | 105.03926% | 103.22124% | 4.84274% |
ghc-7.10.1 | 100.00000% | 100.00000% | 6.77481% |
ghc-8.0.1 | 111.79445% | 102.73758% | 14.19526% |
csv
Input: '500000'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 230.46101 | 130.82430% | 100.00000% | 5.61270% | 7.34278% | 5.61270% | 225.80699 |
ghc-7.2.1 | 20 | 239.97532 | 136.22522% | 104.12838% | 6.05435% | 8.24755% | 6.30429% | 248.69692 |
ghc-7.4.1 | 20 | 232.04463 | 131.72326% | 100.68715% | 6.09682% | 8.03092% | 6.13871% | 224.72262 |
ghc-7.6.1 | 20 | 240.59158 | 136.57505% | 104.39578% | 4.37306% | 5.97250% | 4.56529% | 243.66861 |
ghc-7.8.1 | 20 | 193.52271 | 109.85577% | 83.97200% | 14.99345% | 16.47117% | 12.59030% | 174.59754 |
ghc-7.10.1 | 20 | 176.16071 | 100.00000% | 76.43840% | 12.10915% | 12.10915% | 9.25604% | 167.63824 |
ghc-8.0.1 | 20 | 204.56904 | 116.12637% | 88.76514% | 15.69572% | 18.22687% | 13.93233% | 224.69804 |
csv
Input: '5000000'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 2305.81689 | 139.50450% | 100.00000% | 5.79157% | 8.07950% | 5.79157% | 2276.94280 |
ghc-7.2.1 | 20 | 2281.65331 | 138.04258% | 98.95206% | 5.86817% | 8.10057% | 5.80667% | 2188.85445 |
ghc-7.4.1 | 20 | 2238.32931 | 135.42143% | 97.07316% | 5.24638% | 7.10473% | 5.09283% | 2168.04751 |
ghc-7.6.1 | 20 | 2221.76175 | 134.41907% | 96.35465% | 5.47605% | 7.36086% | 5.27643% | 2179.34841 |
ghc-7.8.1 | 20 | 1696.94019 | 102.66678% | 73.59388% | 7.15235% | 7.34309% | 5.26369% | 1638.83791 |
ghc-7.10.1 | 20 | 1652.86202 | 100.00000% | 71.68228% | 14.46762% | 14.46762% | 10.37072% | 1540.63845 |
ghc-8.0.1 | 20 | 1818.80262 | 110.03959% | 78.87888% | 16.33200% | 17.97167% | 12.88250% | 1581.20341 |
csv
Input: '50000000'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 22357.84453 | 144.45003% | 100.00000% | 5.46247% | 7.89054% | 5.46247% | 21656.01308 |
ghc-7.2.1 | 20 | 22296.51302 | 144.05377% | 99.72568% | 4.38140% | 6.31157% | 4.36938% | 21803.90840 |
ghc-7.4.1 | 20 | 22218.83512 | 143.55191% | 99.37825% | 8.40995% | 12.07264% | 8.35766% | 21268.43523 |
ghc-7.6.1 | 20 | 21308.19414 | 137.66842% | 95.30523% | 2.79465% | 3.84735% | 2.66344% | 21139.30827 |
ghc-7.8.1 | 20 | 15904.29624 | 102.75481% | 71.13519% | 1.05906% | 1.08824% | 0.75337% | 15808.89890 |
ghc-7.10.1 | 20 | 15477.90975 | 100.00000% | 69.22809% | 1.77493% | 1.77493% | 1.22875% | 15318.80374 |
ghc-8.0.1 | 20 | 16923.61668 | 109.34045% | 75.69431% | 11.15859% | 12.20086% | 8.44642% | 15821.52174 |
csv
pidigits
Program: '4'
The following plot shows the rel means (means / min means) per input distribution for every implementation.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 100.79398% | 100.27468% | 0.97400% |
ghc-7.2.1 | 100.52810% | 100.54452% | 0.91473% |
ghc-7.4.1 | 101.32356% | 100.77533% | 0.79315% |
ghc-7.6.1 | 100.87121% | 100.38429% | 0.80794% |
ghc-7.8.1 | 100.03442% | 100.04868% | 1.05638% |
ghc-7.10.1 | 103.45012% | 100.98635% | 1.03350% |
ghc-8.0.1 | 101.56874% | 100.40439% | 0.87040% |
csv
Input: '2000'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 76.46476 | 101.17405% | 100.00000% | 4.60022% | 4.65423% | 4.60022% | 74.75978 |
ghc-7.2.1 | 20 | 76.54653 | 101.28224% | 100.10694% | 3.80506% | 3.85385% | 3.80913% | 76.91825 |
ghc-7.4.1 | 20 | 77.40649 | 102.42010% | 101.23159% | 4.56160% | 4.67200% | 4.61778% | 76.41395 |
ghc-7.6.1 | 20 | 76.64645 | 101.41445% | 100.23761% | 4.32173% | 4.38286% | 4.33200% | 75.19810 |
ghc-7.8.1 | 20 | 75.57745 | 100.00000% | 98.83958% | 4.32152% | 4.32152% | 4.27138% | 75.24086 |
ghc-7.10.1 | 20 | 79.27531 | 104.89282% | 103.67562% | 4.95526% | 5.19771% | 5.13739% | 79.03151 |
ghc-8.0.1 | 20 | 76.32640 | 100.99097% | 99.81905% | 3.88822% | 3.92675% | 3.88118% | 75.39838 |
csv
Input: '6000'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 624.27332 | 100.68642% | 100.00000% | 0.64951% | 0.65397% | 0.64951% | 622.63870 |
ghc-7.2.1 | 20 | 620.01738 | 100.00000% | 99.31826% | 0.76404% | 0.76404% | 0.75883% | 619.23738 |
ghc-7.4.1 | 15 | 625.85601 | 100.94169% | 100.25352% | 0.49573% | 0.50040% | 0.49699% | 626.68672 |
ghc-7.6.1 | 15 | 624.15153 | 100.66678% | 99.98049% | 0.53404% | 0.53760% | 0.53393% | 624.24838 |
ghc-7.8.1 | 20 | 620.65782 | 100.10329% | 99.42085% | 0.68047% | 0.68117% | 0.67653% | 621.09769 |
ghc-7.10.1 | 20 | 636.46868 | 102.65336% | 101.95353% | 0.62557% | 0.64216% | 0.63779% | 636.79603 |
ghc-8.0.1 | 20 | 631.64025 | 101.87460% | 101.18008% | 0.85888% | 0.87498% | 0.86901% | 630.64804 |
csv
Input: '10000'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 1755.92499 | 100.52261% | 100.00000% | 0.30925% | 0.31087% | 0.30925% | 1755.66508 |
ghc-7.2.1 | 20 | 1752.15023 | 100.30652% | 99.78503% | 0.26327% | 0.26408% | 0.26270% | 1751.92720 |
ghc-7.4.1 | 20 | 1757.59085 | 100.61798% | 100.09487% | 0.22065% | 0.22202% | 0.22086% | 1757.46961 |
ghc-7.6.1 | 20 | 1756.13481 | 100.53462% | 100.01195% | 0.22852% | 0.22974% | 0.22854% | 1755.79998 |
ghc-7.8.1 | 15 | 1746.79601 | 100.00000% | 99.48010% | 0.40088% | 0.40088% | 0.39880% | 1745.75631 |
ghc-7.10.1 | 15 | 1796.04101 | 102.81916% | 102.28461% | 0.35612% | 0.36616% | 0.36426% | 1794.14956 |
ghc-8.0.1 | 15 | 1778.99156 | 101.84312% | 101.31364% | 0.19746% | 0.20110% | 0.20005% | 1779.31469 |
csv
spectralnorm
Program: '2'
The following plot shows the rel means (means / min means) per input distribution for every implementation.
img
tex
tex_standalone
| mean score (gmean(mean / best mean)) | mean score std (gmean std(mean / best mean)) | mean rel std (gmean(std / mean)) |
ghc-7.0.1 | 100.00000% | 100.00000% | 0.37354% |
ghc-7.2.1 | 114.02938% | 103.77211% | 0.25968% |
ghc-7.4.1 | 223.33285% | 105.21157% | 1.06356% |
ghc-7.6.1 | 123.77520% | 104.21321% | 0.68232% |
ghc-7.8.1 | 118.58418% | 104.07235% | 0.56549% |
ghc-7.10.1 | 118.36898% | 103.76838% | 0.69992% |
ghc-8.0.1 | 118.51593% | 103.96683% | 0.67283% |
csv
Input: '500'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 151.12996 | 100.00000% | 100.00000% | 2.03693% | 2.03693% | 2.03693% | 150.88186 |
ghc-7.2.1 | 20 | 166.90141 | 110.43569% | 110.43569% | 2.18330% | 2.41114% | 2.41114% | 165.51166 |
ghc-7.4.1 | 15 | 323.34887 | 213.95418% | 213.95418% | 2.24441% | 4.80200% | 4.80200% | 321.54607 |
ghc-7.6.1 | 20 | 179.90016 | 119.03673% | 119.03673% | 2.02401% | 2.40932% | 2.40932% | 178.02147 |
ghc-7.8.1 | 20 | 172.71968 | 114.28553% | 114.28553% | 1.94108% | 2.21838% | 2.21838% | 172.13319 |
ghc-7.10.1 | 20 | 173.13771 | 114.56214% | 114.56214% | 1.82974% | 2.09619% | 2.09619% | 173.19726 |
ghc-8.0.1 | 20 | 173.14620 | 114.56775% | 114.56775% | 1.77555% | 2.03421% | 2.03421% | 173.69433 |
csv
Input: '3000'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 20 | 5171.83138 | 100.00000% | 100.00000% | 0.19281% | 0.19281% | 0.19281% | 5170.01140 |
ghc-7.2.1 | 20 | 5781.38730 | 111.78607% | 111.78607% | 0.20091% | 0.22458% | 0.22458% | 5778.23770 |
ghc-7.4.1 | 15 | 11226.31249 | 217.06648% | 217.06648% | 0.72786% | 1.57993% | 1.57993% | 11190.70875 |
ghc-7.6.1 | 20 | 6286.88847 | 121.56020% | 121.56020% | 0.42035% | 0.51098% | 0.51098% | 6278.34404 |
ghc-7.8.1 | 20 | 6020.45120 | 116.40850% | 116.40850% | 0.44175% | 0.51424% | 0.51424% | 6010.37609 |
ghc-7.10.1 | 20 | 6006.47182 | 116.13820% | 116.13820% | 0.64616% | 0.75044% | 0.75044% | 5999.60791 |
ghc-8.0.1 | 20 | 6004.48577 | 116.09980% | 116.09980% | 0.38090% | 0.44223% | 0.44223% | 5996.49143 |
csv
Input: '5500'
The following plot shows the actual distribution of the measurements for each implementation.
img
tex
tex_standalone
| n | mean | mean / best mean | mean / mean of first impl | std / mean | std / best mean | std / mean of first impl | median |
ghc-7.0.1 | 15 | 16102.61935 | 100.00000% | 100.00000% | 0.13271% | 0.13271% | 0.13271% | 16102.86637 |
ghc-7.2.1 | 15 | 19339.69597 | 120.10280% | 120.10280% | 0.03992% | 0.04795% | 0.04795% | 19340.99120 |
ghc-7.4.1 | 15 | 38622.53472 | 239.85250% | 239.85250% | 0.73645% | 1.76639% | 1.76639% | 38496.27640 |
ghc-7.6.1 | 20 | 21102.06737 | 131.04742% | 131.04742% | 0.37336% | 0.48928% | 0.48928% | 21076.15467 |
ghc-7.8.1 | 20 | 20183.70374 | 125.34423% | 125.34423% | 0.21089% | 0.26434% | 0.26434% | 20158.28584 |
ghc-7.10.1 | 15 | 20072.15654 | 124.65150% | 124.65150% | 0.29001% | 0.36150% | 0.36150% | 20039.32409 |
ghc-8.0.1 | 20 | 20152.68039 | 125.15157% | 125.15157% | 0.45036% | 0.56363% | 0.56363% | 20111.10169 |
csv