img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O128.01180%132.21870%1.13648%
ghc-7.0.1-O2109.77168%113.01207%0.87452%
ghc-7.0.1-Odph109.24063%111.79036%0.91141%
ghc-7.2.1-O130.62360%133.25495%1.33332%
ghc-7.2.1-O2114.81631%112.89803%0.93486%
ghc-7.2.1-Odph115.11363%112.76839%0.93544%
ghc-7.4.1-O131.85977%141.24651%1.24388%
ghc-7.4.1-O2122.08595%128.29490%1.08181%
ghc-7.4.1-Odph122.24646%127.93397%1.12135%
ghc-7.6.1-O129.55298%129.09570%1.10312%
ghc-7.6.1-O2119.66532%118.12750%1.06743%
ghc-7.6.1-Odph119.50206%118.35681%0.90433%
ghc-7.8.1-O118.04147%122.52850%1.01702%
ghc-7.8.1-O2109.12880%107.92006%1.04548%
ghc-7.8.1-Odph108.75281%107.79817%0.99952%
ghc-7.10.1-O116.14593%123.64133%0.94031%
ghc-7.10.1-O2106.09789%105.72288%0.97867%
ghc-7.10.1-Odph105.79165%105.76091%1.07531%
ghc-8.0.1-O116.71994%123.73935%1.07722%
ghc-8.0.1-O2106.80523%105.82073%1.08023%
ghc-8.0.1-Odph106.80243%106.01105%1.09746%
csv

Summary for input no. 0

Mean score per implementation. Excludes all categories with less than 3 inputs. The plot shows the distribution of mean scores per category per implementation for input no. 0.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O127.10398%127.35396%2.55426%
ghc-7.0.1-O2111.67688%112.34893%1.46929%
ghc-7.0.1-Odph110.77978%110.80310%1.47017%
ghc-7.2.1-O128.60782%127.97231%2.77180%
ghc-7.2.1-O2114.09740%111.86788%1.61221%
ghc-7.2.1-Odph114.45359%111.40968%1.38880%
ghc-7.4.1-O127.79712%134.29518%2.50891%
ghc-7.4.1-O2118.64085%124.16874%1.77459%
ghc-7.4.1-Odph118.67107%123.24929%1.71795%
ghc-7.6.1-O130.99667%125.06743%2.69626%
ghc-7.6.1-O2121.95843%120.45528%1.73699%
ghc-7.6.1-Odph121.60853%121.09468%1.56344%
ghc-7.8.1-O116.40501%118.20750%2.71779%
ghc-7.8.1-O2110.33617%108.38206%1.76990%
ghc-7.8.1-Odph109.82566%108.10635%1.69922%
ghc-7.10.1-O113.70856%119.76080%2.54086%
ghc-7.10.1-O2105.32090%104.18944%1.87762%
ghc-7.10.1-Odph104.74246%103.86030%2.28550%
ghc-8.0.1-O113.26455%120.02879%2.56406%
ghc-8.0.1-O2105.96460%104.93146%1.90795%
ghc-8.0.1-Odph105.91458%105.32673%1.82490%
csv

Summary for input no. 1

Mean score per implementation. Excludes all categories with less than 3 inputs. The plot shows the distribution of mean scores per category per implementation for input no. 1.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O129.23778%133.78353%1.18458%
ghc-7.0.1-O2108.94121%112.91024%0.94026%
ghc-7.0.1-Odph108.69525%111.61136%0.94625%
ghc-7.2.1-O132.78341%134.66768%1.32923%
ghc-7.2.1-O2115.82657%112.62304%0.82559%
ghc-7.2.1-Odph116.25670%112.63631%1.08108%
ghc-7.4.1-O135.66665%143.39243%1.18970%
ghc-7.4.1-O2124.63403%128.84521%0.93969%
ghc-7.4.1-Odph124.84470%128.59608%1.13759%
ghc-7.6.1-O128.45201%130.06001%0.79516%
ghc-7.6.1-O2117.94576%115.32364%1.01027%
ghc-7.6.1-Odph118.00701%115.05163%0.69092%
ghc-7.8.1-O119.03319%123.57918%0.80937%
ghc-7.8.1-O2107.52191%106.65492%1.27978%
ghc-7.8.1-Odph106.95120%106.69605%1.14609%
ghc-7.10.1-O117.54342%124.70404%0.69522%
ghc-7.10.1-O2105.28259%104.58523%0.64754%
ghc-7.10.1-Odph105.21764%104.84964%0.79287%
ghc-8.0.1-O119.31474%124.41485%0.95576%
ghc-8.0.1-O2106.99162%105.34699%0.96345%
ghc-8.0.1-Odph106.77546%105.34369%1.10219%
csv

Summary for input no. 2

Mean score per implementation. Excludes all categories with less than 3 inputs. The plot shows the distribution of mean scores per category per implementation for input no. 2.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O128.27237%137.81090%0.29244%
ghc-7.0.1-O2107.55854%113.71235%0.35004%
ghc-7.0.1-Odph107.32078%113.12319%0.40362%
ghc-7.2.1-O131.78780%139.45402%0.40719%
ghc-7.2.1-O2114.98250%114.62774%0.43664%
ghc-7.2.1-Odph115.05187%114.80578%0.42588%
ghc-7.4.1-O134.84576%148.84898%0.41588%
ghc-7.4.1-O2125.28409%133.21210%0.55722%
ghc-7.4.1-Odph125.61775%133.41345%0.55262%
ghc-7.6.1-O128.33143%134.00583%0.35815%
ghc-7.6.1-O2117.72225%116.35053%0.51124%
ghc-7.6.1-Odph117.62817%116.32538%0.48626%
ghc-7.8.1-O119.74389%127.43027%0.25871%
ghc-7.8.1-O2108.79695%108.02188%0.36305%
ghc-7.8.1-Odph108.83471%108.00501%0.36801%
ghc-7.10.1-O118.78930%127.83116%0.25287%
ghc-7.10.1-O2108.20424%108.01620%0.51307%
ghc-7.10.1-Odph108.10561%108.15045%0.42832%
ghc-8.0.1-O119.89577%127.73525%0.29665%
ghc-8.0.1-O2107.99705%107.24837%0.48056%
ghc-8.0.1-Odph108.28842%107.29743%0.47823%
csv

Seperated by entropy

The following shows the summary including only the lower or the upper half of programs (per category), regarding the entropy of their files. This entropy is measured by taking the length of the gnu zipped program code length. Programs with lower entropy should be simpler than programs with higher entropy. If the number of programs is uneven in a category, then one program belongs to the upper and the lower half.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O133.68273%133.40124%1.11835%
ghc-7.0.1-O2111.23895%113.80208%0.86294%
ghc-7.0.1-Odph110.36903%112.50919%0.87677%
ghc-7.2.1-O136.55796%134.51822%1.24481%
ghc-7.2.1-O2116.33515%113.71688%0.78929%
ghc-7.2.1-Odph116.57802%113.57829%0.86994%
ghc-7.4.1-O138.47180%143.42526%1.21967%
ghc-7.4.1-O2126.17237%129.86534%1.12023%
ghc-7.4.1-Odph126.32743%129.44685%1.14674%
ghc-7.6.1-O133.35315%130.78272%1.03932%
ghc-7.6.1-O2121.12150%119.06320%1.01947%
ghc-7.6.1-Odph120.82132%119.39880%0.82262%
ghc-7.8.1-O120.14609%124.40461%1.02643%
ghc-7.8.1-O2108.60323%108.31954%1.05193%
ghc-7.8.1-Odph108.17560%108.16473%1.01932%
ghc-7.10.1-O118.30753%125.67550%0.97945%
ghc-7.10.1-O2106.06522%106.01224%1.08684%
ghc-7.10.1-Odph105.64470%106.05770%1.14307%
ghc-8.0.1-O118.60486%125.81269%1.17083%
ghc-8.0.1-O2106.36641%105.86328%1.03369%
ghc-8.0.1-Odph106.45847%106.11746%1.11062%
csv

Summary for input no. 0

Mean score per implementation. Excludes all categories with less than 3 inputs. The plot shows the distribution of mean scores per category per implementation for input no. 0.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O134.06405%128.62818%2.78646%
ghc-7.0.1-O2113.77632%113.28930%1.54176%
ghc-7.0.1-Odph112.06789%111.75346%1.51365%
ghc-7.2.1-O135.77679%129.30033%2.98573%
ghc-7.2.1-O2116.16481%112.76665%1.53464%
ghc-7.2.1-Odph116.48751%112.22354%1.52241%
ghc-7.4.1-O135.29939%136.91123%2.85182%
ghc-7.4.1-O2122.73710%126.45164%1.97510%
ghc-7.4.1-Odph122.67973%125.37768%1.95921%
ghc-7.6.1-O135.95740%126.40597%3.00624%
ghc-7.6.1-O2124.01318%121.76729%1.87989%
ghc-7.6.1-Odph123.49646%122.64374%1.66892%
ghc-7.8.1-O119.75061%119.72074%3.16609%
ghc-7.8.1-O2110.71190%109.10431%1.99619%
ghc-7.8.1-Odph110.07272%108.79961%1.94657%
ghc-7.10.1-O116.68360%121.87251%2.97454%
ghc-7.10.1-O2105.82630%104.27954%2.23983%
ghc-7.10.1-Odph104.95530%103.94093%2.66142%
ghc-8.0.1-O115.72119%122.24086%2.94158%
ghc-8.0.1-O2105.95967%104.94595%2.21876%
ghc-8.0.1-Odph106.06118%105.47174%2.16869%
csv

Summary for input no. 1

Mean score per implementation. Excludes all categories with less than 3 inputs. The plot shows the distribution of mean scores per category per implementation for input no. 1.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O133.90682%134.24704%1.13062%
ghc-7.0.1-O2110.28219%113.32726%0.88099%
ghc-7.0.1-Odph109.97517%111.92659%0.85932%
ghc-7.2.1-O137.62170%135.21001%1.21495%
ghc-7.2.1-O2116.57735%113.40136%0.67429%
ghc-7.2.1-Odph116.80707%113.48569%0.95908%
ghc-7.4.1-O141.21860%144.51611%1.12614%
ghc-7.4.1-O2128.35718%129.41213%0.96026%
ghc-7.4.1-Odph128.60721%129.10022%1.07136%
ghc-7.6.1-O131.52445%131.37721%0.68985%
ghc-7.6.1-O2119.11606%116.16436%0.84445%
ghc-7.6.1-Odph118.90042%115.99371%0.55141%
ghc-7.8.1-O120.10075%125.22178%0.78261%
ghc-7.8.1-O2106.44100%106.46738%1.21625%
ghc-7.8.1-Odph105.86393%106.49989%1.15773%
ghc-7.10.1-O118.82686%126.36560%0.77541%
ghc-7.10.1-O2104.65518%104.58678%0.72870%
ghc-7.10.1-Odph104.58803%104.88517%0.86235%
ghc-8.0.1-O120.43104%126.11755%1.02237%
ghc-8.0.1-O2106.00967%105.04324%0.86965%
ghc-8.0.1-Odph105.76356%104.99068%0.99915%
csv

Summary for input no. 2

Mean score per implementation. Excludes all categories with less than 3 inputs. The plot shows the distribution of mean scores per category per implementation for input no. 2.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O132.91706%138.78602%0.30022%
ghc-7.0.1-O2108.64646%114.38420%0.36892%
ghc-7.0.1-Odph108.37339%113.75740%0.41005%
ghc-7.2.1-O136.61751%140.58474%0.36548%
ghc-7.2.1-O2116.33673%115.27362%0.35736%
ghc-7.2.1-Odph116.47860%115.42254%0.35475%
ghc-7.4.1-O140.34923%150.66622%0.39258%
ghc-7.4.1-O2129.01336%134.33057%0.58128%
ghc-7.4.1-Odph129.39229%134.52682%0.57106%
ghc-7.6.1-O131.52269%135.67791%0.34338%
ghc-7.6.1-O2119.07873%117.18889%0.51347%
ghc-7.6.1-Odph118.99171%117.15661%0.44670%
ghc-7.8.1-O120.75888%129.43822%0.26932%
ghc-7.8.1-O2107.80669%108.14822%0.36433%
ghc-7.8.1-Odph107.82623%108.11226%0.35615%
ghc-7.10.1-O120.13936%129.76307%0.25307%
ghc-7.10.1-O2107.84110%108.53309%0.57695%
ghc-7.10.1-Odph107.71478%108.66877%0.45302%
ghc-8.0.1-O120.98666%129.74932%0.35960%
ghc-8.0.1-O2107.31007%107.52989%0.41262%
ghc-8.0.1-Odph107.73182%107.66706%0.47458%
csv

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O127.99940%135.67630%1.45588%
ghc-7.0.1-O2107.19240%112.73093%1.13169%
ghc-7.0.1-Odph106.85390%111.49747%1.17340%
ghc-7.2.1-O128.18773%136.44983%1.72403%
ghc-7.2.1-O2111.06833%110.45089%1.24419%
ghc-7.2.1-Odph111.40219%110.36319%1.20541%
ghc-7.4.1-O129.04838%145.03786%1.61155%
ghc-7.4.1-O2119.50906%129.52061%1.39061%
ghc-7.4.1-Odph119.71166%129.14128%1.46590%
ghc-7.6.1-O126.22353%130.98102%1.36534%
ghc-7.6.1-O2114.76081%113.68596%1.30159%
ghc-7.6.1-Odph114.55272%113.93180%1.07598%
ghc-7.8.1-O118.11079%125.00857%1.20639%
ghc-7.8.1-O2107.90298%107.35700%1.31348%
ghc-7.8.1-Odph107.46617%107.14695%1.24860%
ghc-7.10.1-O118.43181%125.42277%1.15817%
ghc-7.10.1-O2106.89223%106.00652%1.21093%
ghc-7.10.1-Odph106.48092%106.12178%1.28252%
ghc-8.0.1-O119.45341%125.32350%1.34271%
ghc-8.0.1-O2107.85574%105.89932%1.38497%
ghc-8.0.1-Odph107.99599%105.95678%1.44109%
csv

Summary for input no. 0

Mean score per implementation. Excludes all categories with less than 3 inputs. The plot shows the distribution of mean scores per category per implementation for input no. 0.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O125.49847%131.12416%3.60884%
ghc-7.0.1-O2107.56464%111.09369%2.08254%
ghc-7.0.1-Odph107.13491%109.54847%2.20830%
ghc-7.2.1-O125.57570%131.47111%3.96981%
ghc-7.2.1-O2110.03625%109.67678%2.41303%
ghc-7.2.1-Odph110.44938%109.09080%2.03457%
ghc-7.4.1-O125.14206%138.63213%3.63466%
ghc-7.4.1-O2116.83635%125.49607%2.50284%
ghc-7.4.1-Odph116.90003%124.41765%2.43171%
ghc-7.6.1-O127.38690%126.99097%3.76917%
ghc-7.6.1-O2117.15334%116.42731%2.40396%
ghc-7.6.1-Odph116.67657%117.22742%2.10490%
ghc-7.8.1-O115.96535%120.95696%3.68896%
ghc-7.8.1-O2109.14328%107.30821%2.45377%
ghc-7.8.1-Odph108.52851%106.85266%2.40560%
ghc-7.10.1-O115.49983%121.94282%3.50971%
ghc-7.10.1-O2106.28925%104.32024%2.73954%
ghc-7.10.1-Odph105.42700%104.13847%3.14374%
ghc-8.0.1-O115.46886%122.17012%3.43081%
ghc-8.0.1-O2107.05177%105.14398%2.64914%
ghc-8.0.1-Odph107.08670%105.53368%2.47376%
csv

Summary for input no. 1

Mean score per implementation. Excludes all categories with less than 3 inputs. The plot shows the distribution of mean scores per category per implementation for input no. 1.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O130.26450%136.38923%1.61359%
ghc-7.0.1-O2107.61601%113.32682%1.27496%
ghc-7.0.1-Odph107.34039%111.84575%1.22096%
ghc-7.2.1-O130.51543%136.94884%1.72341%
ghc-7.2.1-O2112.20361%109.39989%1.11048%
ghc-7.2.1-Odph112.68032%109.58149%1.39081%
ghc-7.4.1-O132.26448%146.01575%1.58157%
ghc-7.4.1-O2121.05454%129.44678%1.18188%
ghc-7.4.1-Odph121.29899%129.20421%1.45590%
ghc-7.6.1-O125.34548%131.29892%1.10912%
ghc-7.6.1-O2113.11165%110.07799%1.22320%
ghc-7.6.1-Odph113.17376%109.64388%0.83324%
ghc-7.8.1-O119.10732%125.39802%1.01565%
ghc-7.8.1-O2106.23471%106.16913%1.64998%
ghc-7.8.1-Odph105.57383%106.05576%1.44434%
ghc-7.10.1-O119.80887%125.82943%0.91068%
ghc-7.10.1-O2105.64385%104.80571%0.80938%
ghc-7.10.1-Odph105.56069%105.10426%0.90662%
ghc-8.0.1-O122.04588%125.18091%1.31576%
ghc-8.0.1-O2107.86568%105.20160%1.21510%
ghc-8.0.1-Odph107.78015%105.01614%1.55340%
csv

Summary for input no. 2

Mean score per implementation. Excludes all categories with less than 3 inputs. The plot shows the distribution of mean scores per category per implementation for input no. 2.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O129.36950%140.77723%0.35914%
ghc-7.0.1-O2106.24301%114.21260%0.42032%
ghc-7.0.1-Odph105.97126%113.52681%0.45697%
ghc-7.2.1-O129.65932%142.26640%0.52389%
ghc-7.2.1-O2111.42066%112.26212%0.54113%
ghc-7.2.1-Odph111.49840%112.51924%0.49457%
ghc-7.4.1-O131.56253%152.11568%0.51381%
ghc-7.4.1-O2121.85776%134.49682%0.70669%
ghc-7.4.1-Odph122.22532%134.75668%0.71625%
ghc-7.6.1-O125.45266%135.83533%0.39400%
ghc-7.6.1-O2113.05203%112.12646%0.57651%
ghc-7.6.1-Odph112.94515%112.04308%0.53274%
ghc-7.8.1-O120.23034%129.54806%0.29026%
ghc-7.8.1-O2107.82258%108.16297%0.42820%
ghc-7.8.1-Odph107.86595%108.14945%0.42298%
ghc-7.10.1-O121.33906%129.11432%0.30222%
ghc-7.10.1-O2109.03296%108.28110%0.56439%
ghc-7.10.1-Odph108.94638%108.42040%0.50401%
ghc-8.0.1-O122.72192%128.82160%0.35873%
ghc-8.0.1-O2109.00471%107.25567%0.62501%
ghc-8.0.1-Odph109.52728%107.04482%0.61782%
csv

binarytrees

Program: '1'

The following plot shows the rel means (means / min means) per input distribution for every implementation.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O108.32953%103.92788%1.86398%
ghc-7.0.1-O2104.02709%103.58685%1.65583%
ghc-7.0.1-Odph103.17925%103.57352%1.68299%
ghc-7.2.1-O109.93997%103.91333%1.73290%
ghc-7.2.1-O2106.45475%104.84925%1.28968%
ghc-7.2.1-Odph107.73846%103.53735%1.67860%
ghc-7.4.1-O106.45241%104.73044%2.67999%
ghc-7.4.1-O2106.67197%105.83577%2.95182%
ghc-7.4.1-Odph106.96221%105.24591%2.97218%
ghc-7.6.1-O109.06454%103.87264%1.48971%
ghc-7.6.1-O2108.35283%103.90497%1.85313%
ghc-7.6.1-Odph106.82170%105.93897%1.20134%
ghc-7.8.1-O111.45330%102.94074%2.49861%
ghc-7.8.1-O2105.42503%103.84182%2.32185%
ghc-7.8.1-Odph104.82335%103.23817%2.11023%
ghc-7.10.1-O114.22320%103.29470%2.06672%
ghc-7.10.1-O2111.59889%105.73256%2.23560%
ghc-7.10.1-Odph110.75538%105.87791%2.77859%
ghc-8.0.1-O112.56381%102.35245%2.52598%
ghc-8.0.1-O2108.15815%103.31591%1.92705%
ghc-8.0.1-Odph110.21304%103.07921%1.96983%
csv

Input: '12'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 20 38.35232109.24855%100.00000%9.86243%10.77456%9.86243%37.63287
ghc-7.0.1-O2 20 36.20066103.11943%94.38975%10.03459%10.34761%9.47162%34.85335
ghc-7.0.1-Odph 20 35.58488101.36534%92.78415%9.32676%9.45410%8.65375%34.26758
ghc-7.2.1-O 20 38.39031109.35675%100.09904%10.70472%11.70634%10.71533%36.75450
ghc-7.2.1-O2 20 35.61208101.44284%92.85509%4.53638%4.60183%4.21226%35.46328
ghc-7.2.1-Odph 20 36.99127105.37152%96.45119%7.77222%8.18971%7.49640%35.19761
ghc-7.4.1-O 20 35.87514102.19216%93.54098%13.34123%13.63369%12.47952%34.24283
ghc-7.4.1-O2 20 35.39184100.81545%92.28082%12.59612%12.69884%11.62381%33.96606
ghc-7.4.1-Odph 20 35.90469102.27634%93.61803%11.82767%12.09691%11.07283%35.61000
ghc-7.6.1-O 20 37.30969106.27854%97.28142%11.51040%12.23309%11.19748%35.62532
ghc-7.6.1-O2 20 36.87765105.04786%96.15493%10.44987%10.97737%10.04807%36.31278
ghc-7.6.1-Odph 20 35.10557100.00000%91.53440%7.74059%7.74059%7.08530%34.08987
ghc-7.8.1-O 20 40.07256114.14873%104.48535%13.85139%15.81118%14.47267%38.47585
ghc-7.8.1-O2 20 37.76556107.57712%98.47007%9.24146%9.94170%9.10008%36.27919
ghc-7.8.1-Odph 20 36.86751105.01897%96.12848%6.97816%7.32839%6.70800%36.88943
ghc-7.10.1-O 20 41.76646118.97388%108.90202%11.66053%13.87298%12.69855%41.43228
ghc-7.10.1-O2 20 39.07529111.30794%101.88506%8.35636%9.30129%8.51388%39.49754
ghc-7.10.1-Odph 20 37.97593108.17637%99.01859%10.79466%11.67727%10.68872%36.61204
ghc-8.0.1-O 20 39.02290111.15871%101.74846%12.31435%13.68847%12.52966%39.63483
ghc-8.0.1-O2 20 37.26539106.15237%97.16593%7.80938%8.28985%7.58806%37.27534
ghc-8.0.1-Odph 20 39.46879112.42887%102.91109%8.53589%9.59680%8.78437%39.38057
csv

Input: '16'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 201210.12421113.02049%100.00000%1.41043%1.59408%1.41043%1210.99402
ghc-7.0.1-O2 201167.27827109.01886%96.45938%1.57979%1.72227%1.52386%1161.52058
ghc-7.0.1-Odph 201160.27345108.36464%95.88053%1.41761%1.53619%1.35921%1155.18420
ghc-7.2.1-O 201236.81074115.51290%102.20527%1.00798%1.16434%1.03020%1235.23638
ghc-7.2.1-O2 201215.58678113.53067%100.45141%0.94060%1.06786%0.94484%1216.41146
ghc-7.2.1-Odph 201211.60769113.15904%100.12259%1.15898%1.31150%1.16040%1207.04450
ghc-7.4.1-O 201215.88141113.55818%100.47575%1.84523%2.09541%1.85401%1215.90072
ghc-7.4.1-O2 201234.27302115.27588%101.99556%1.82849%2.10781%1.86498%1236.54016
ghc-7.4.1-Odph 201230.20803114.89623%101.65965%1.90480%2.18855%1.93642%1233.32402
ghc-7.6.1-O 201232.21727115.08388%101.82569%1.25198%1.44083%1.27484%1234.12319
ghc-7.6.1-O2 201224.48991114.36218%101.18713%0.94036%1.07541%0.95152%1226.54413
ghc-7.6.1-Odph 201232.27620115.08939%101.83055%0.53489%0.61560%0.54468%1233.36989
ghc-7.8.1-O 201213.67346113.35197%100.29330%1.99850%2.26534%2.00436%1213.17293
ghc-7.8.1-O2 201070.71227100.00000%88.47953%1.95901%1.95901%1.73332%1062.86615
ghc-7.8.1-Odph 201078.42412100.72025%89.11681%2.33894%2.35579%2.08439%1065.17774
ghc-7.10.1-O 201220.32985113.97365%100.84335%1.69499%1.93185%1.70929%1224.70957
ghc-7.10.1-O2 201117.54812104.37427%92.34987%1.42076%1.48291%1.31207%1114.32825
ghc-7.10.1-Odph 201122.26322104.81464%92.73951%2.41977%2.53628%2.24409%1119.25540
ghc-8.0.1-O 201245.17123116.29373%102.89615%1.60939%1.87162%1.65600%1244.92030
ghc-8.0.1-O2 201127.03694105.26049%93.13399%1.35905%1.43055%1.26574%1130.47068
ghc-8.0.1-Odph 201130.56275105.58978%93.42535%1.04156%1.09979%0.97309%1130.61332
csv

Input: '20'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 2034311.58701102.95982%100.00000%0.46557%0.47935%0.46557%34262.24397
ghc-7.0.1-O2 2033371.08566100.13762%97.25894%0.28638%0.28678%0.27853%33354.01282
ghc-7.0.1-Odph 2033325.22206100.00000%97.12527%0.36054%0.36054%0.35018%33322.55649
ghc-7.2.1-O 2035056.12200105.19396%102.16992%0.48228%0.50733%0.49274%35022.52316
ghc-7.2.1-O2 2034908.69846104.75159%101.74026%0.50273%0.52662%0.51148%34893.77406
ghc-7.2.1-Odph 2034952.06696104.88172%101.86666%0.52507%0.55070%0.53487%34939.80545
ghc-7.4.1-O 2034642.04753103.95144%100.96312%0.78191%0.81280%0.78944%34583.01815
ghc-7.4.1-O2 2034806.35150104.44447%101.44197%1.11671%1.16634%1.13281%34751.99800
ghc-7.4.1-Odph 2034704.29598104.13823%101.14454%1.16541%1.21363%1.17874%34613.03562
ghc-7.6.1-O 2035347.90708106.06953%103.02032%0.22941%0.24334%0.23634%35342.40829
ghc-7.6.1-O2 2035287.76572105.88906%102.84504%0.64761%0.68575%0.66603%35266.02503
ghc-7.6.1-Odph 2035295.24995105.91152%102.86685%0.41876%0.44351%0.43076%35272.26885
ghc-7.8.1-O 2035657.57070106.99875%103.92283%0.56351%0.60295%0.58561%35595.31812
ghc-7.8.1-O2 2036298.13930108.92092%105.78974%0.69140%0.75307%0.73143%36336.50885
ghc-7.8.1-Odph 2036287.96056108.89038%105.76008%0.57575%0.62693%0.60891%36235.93834
ghc-7.10.1-O 2036625.19177109.90232%106.74293%0.44664%0.49087%0.47676%36605.66050
ghc-7.10.1-O2 2039868.79516119.63550%116.19630%0.94112%1.12591%1.09354%39772.87905
ghc-7.10.1-Odph 2039931.27951119.82300%116.37841%0.82127%0.98408%0.95579%39912.47192
ghc-8.0.1-O 2036767.96484110.33074%107.15903%0.81324%0.89725%0.87146%36823.40996
ghc-8.0.1-O2 2037735.98821113.23552%109.98031%0.67425%0.76349%0.74154%37769.74465
ghc-8.0.1-Odph 2037581.34251112.77147%109.52960%0.85971%0.96951%0.94164%37576.24591
csv

fannkuchredux

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O111.06330%110.08835%0.44010%
ghc-7.0.1-O2108.99107%108.87390%0.40694%
ghc-7.0.1-Odph108.98846%108.88046%0.51452%
ghc-7.2.1-O124.49619%119.96642%0.61537%
ghc-7.2.1-O2125.16703%115.34823%0.62384%
ghc-7.2.1-Odph125.66829%114.96873%0.60178%
ghc-7.4.1-O128.69780%125.63127%0.52492%
ghc-7.4.1-O2124.89731%122.10337%0.47789%
ghc-7.4.1-Odph124.77919%122.03539%0.46758%
ghc-7.6.1-O129.07694%118.00277%0.57356%
ghc-7.6.1-O2131.86786%119.60030%0.74099%
ghc-7.6.1-Odph132.37121%119.23194%0.83025%
ghc-7.8.1-O115.27451%102.83323%0.41882%
ghc-7.8.1-O2116.02309%101.21197%0.49040%
ghc-7.8.1-Odph115.89049%101.33870%0.45521%
ghc-7.10.1-O105.78391%102.88317%0.28162%
ghc-7.10.1-O2106.22767%103.33657%0.35163%
ghc-7.10.1-Odph106.29291%103.43624%0.44580%
ghc-8.0.1-O107.18980%105.33105%0.27724%
ghc-8.0.1-O2107.09102%105.94595%0.54564%
ghc-8.0.1-Odph106.29989%106.32234%0.44734%
csv

Mean scores per input

Mean scores for input '10'

The plot shows the distribution of mean scores per program for each implementation.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O112.24726%110.07499%1.38729%
ghc-7.0.1-O2109.62752%109.45091%1.07902%
ghc-7.0.1-Odph109.54090%109.54090%1.01369%
ghc-7.2.1-O126.07300%119.32155%1.29091%
ghc-7.2.1-O2125.75144%115.20037%0.98354%
ghc-7.2.1-Odph126.50159%114.52707%0.66927%
ghc-7.4.1-O129.44967%125.70843%1.11930%
ghc-7.4.1-O2125.60617%121.42095%1.33633%
ghc-7.4.1-Odph125.23615%121.28720%0.86913%
ghc-7.6.1-O130.93007%117.54635%1.55604%
ghc-7.6.1-O2133.39990%118.91673%1.26997%
ghc-7.6.1-Odph133.85183%118.65013%1.52375%
ghc-7.8.1-O116.08842%103.49040%1.18855%
ghc-7.8.1-O2115.95286%101.98400%0.93230%
ghc-7.8.1-Odph115.66826%102.09793%0.75559%
ghc-7.10.1-O105.50352%101.94968%0.89645%
ghc-7.10.1-O2105.85736%102.57088%0.90927%
ghc-7.10.1-Odph106.08937%102.83432%1.20377%
ghc-8.0.1-O107.82031%105.98393%1.11083%
ghc-8.0.1-O2106.97116%105.91099%0.81280%
ghc-8.0.1-Odph106.11207%106.11207%0.95519%
csv

Mean scores for input '11'

The plot shows the distribution of mean scores per program for each implementation.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O111.02357%110.13316%0.47275%
ghc-7.0.1-O2108.94311%108.94311%0.40678%
ghc-7.0.1-Odph109.01400%108.85795%0.54330%
ghc-7.2.1-O124.43137%120.38927%0.73365%
ghc-7.2.1-O2126.55874%114.32093%0.59406%
ghc-7.2.1-Odph127.56559%113.41585%0.68066%
ghc-7.4.1-O128.85814%125.76804%0.53226%
ghc-7.4.1-O2124.50552%122.75430%0.39040%
ghc-7.4.1-Odph124.46070%122.72369%0.59178%
ghc-7.6.1-O128.83214%118.34297%0.40794%
ghc-7.6.1-O2131.91281%119.84515%0.96879%
ghc-7.6.1-Odph133.04865%118.85890%0.78994%
ghc-7.8.1-O115.11983%102.94981%0.41131%
ghc-7.8.1-O2116.18818%100.68131%0.62852%
ghc-7.8.1-Odph115.98997%100.96506%0.49237%
ghc-7.10.1-O105.84592%102.92246%0.18443%
ghc-7.10.1-O2106.22703%103.34564%0.19620%
ghc-7.10.1-Odph106.23402%103.29299%0.36958%
ghc-8.0.1-O106.69338%104.77229%0.24662%
ghc-8.0.1-O2107.39831%106.26305%0.61206%
ghc-8.0.1-Odph106.83402%106.83402%0.46756%
csv

Mean scores for input '12'

The plot shows the distribution of mean scores per program for each implementation.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O109.93116%109.93116%0.12997%
ghc-7.0.1-O2108.40602%108.14421%0.15353%
ghc-7.0.1-Odph108.41339%108.16107%0.24733%
ghc-7.2.1-O123.00315%120.07680%0.24606%
ghc-7.2.1-O2123.21534%116.31318%0.41553%
ghc-7.2.1-Odph122.98372%116.52558%0.47840%
ghc-7.4.1-O127.79108%125.39272%0.24277%
ghc-7.4.1-O2124.58327%122.10552%0.20920%
ghc-7.4.1-Odph124.64204%122.07175%0.19875%
ghc-7.6.1-O127.49183%117.98391%0.29724%
ghc-7.6.1-O2130.30900%119.93487%0.33069%
ghc-7.6.1-Odph130.24043%120.02506%0.47546%
ghc-7.8.1-O114.62012%101.54711%0.15028%
ghc-7.8.1-O2115.92840%100.05160%0.20126%
ghc-7.8.1-Odph116.01355%100.12900%0.25355%
ghc-7.10.1-O106.00291%103.53892%0.13509%
ghc-7.10.1-O2106.59991%103.92192%0.24371%
ghc-7.10.1-Odph106.55588%104.05938%0.19915%
ghc-8.0.1-O107.05879%105.11055%0.07778%
ghc-8.0.1-O2106.90426%105.63715%0.32654%
ghc-8.0.1-Odph105.95564%105.95564%0.20044%
csv

Program: '1'

The following plot shows the rel means (means / min means) per input distribution for every implementation.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O122.22117%100.90919%0.17221%
ghc-7.0.1-O2118.63105%100.95284%0.15795%
ghc-7.0.1-Odph118.63595%100.94457%0.19912%
ghc-7.2.1-O149.30625%100.78771%0.17663%
ghc-7.2.1-O2144.28664%100.48139%0.14917%
ghc-7.2.1-Odph144.28686%100.48603%0.19461%
ghc-7.4.1-O161.67398%100.65371%0.17627%
ghc-7.4.1-O2152.49010%100.19131%0.21292%
ghc-7.4.1-Odph152.26322%100.23311%0.15765%
ghc-7.6.1-O152.25567%100.94411%0.19249%
ghc-7.6.1-O2157.66741%100.63992%0.27550%
ghc-7.6.1-Odph157.75537%100.67105%0.29305%
ghc-7.8.1-O118.33985%101.30624%0.22747%
ghc-7.8.1-O2117.02987%100.83573%0.22233%
ghc-7.8.1-Odph117.01921%100.78351%0.21002%
ghc-7.10.1-O102.90103%100.44165%0.15586%
ghc-7.10.1-O2102.85606%100.25352%0.24926%
ghc-7.10.1-Odph102.80342%100.30630%0.27388%
ghc-8.0.1-O101.80659%100.05197%0.16462%
ghc-8.0.1-O2101.08958%100.08155%0.17294%
ghc-8.0.1-Odph100.00000%100.00000%0.14643%
csv

Input: '10'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 202503.48546123.55617%100.00000%0.54045%0.66776%0.54045%2501.15517
ghc-7.0.1-O2 202431.19386119.98831%97.11236%0.36315%0.43574%0.35267%2429.00734
ghc-7.0.1-Odph 202431.27055119.99210%97.11543%0.29348%0.35215%0.28502%2432.94804
ghc-7.2.1-O 203048.04678150.43226%121.75213%0.36594%0.55049%0.44554%3050.36551
ghc-7.2.1-O2 202935.26611144.86612%117.24718%0.32929%0.47703%0.38609%2931.91303
ghc-7.2.1-Odph 202935.51816144.87856%117.25725%0.26594%0.38530%0.31184%2936.21690
ghc-7.4.1-O 203297.20528162.72914%131.70459%0.35686%0.58072%0.47000%3295.55016
ghc-7.4.1-O2 203090.19043152.51220%123.43553%0.48438%0.73874%0.59790%3091.51116
ghc-7.4.1-Odph 203077.69317151.89542%122.93633%0.21535%0.32711%0.26474%3076.00295
ghc-7.6.1-O 203118.38125153.90352%124.56159%0.50150%0.77183%0.62468%3116.16849
ghc-7.6.1-O2 203214.24606158.63480%128.39084%0.35808%0.56805%0.45975%3213.10787
ghc-7.6.1-Odph 203217.90461158.81536%128.53698%0.52653%0.83620%0.67678%3216.76569
ghc-7.8.1-O 202434.27482120.14037%97.23543%0.61619%0.74029%0.59915%2437.20936
ghc-7.8.1-O2 202396.04050118.25336%95.70819%0.44463%0.52579%0.42555%2394.41023
ghc-7.8.1-Odph 202392.82962118.09490%95.57993%0.29377%0.34693%0.28078%2391.99346
ghc-7.10.1-O 202096.82289103.48588%83.75614%0.49655%0.51386%0.41589%2095.63720
ghc-7.10.1-O2 202091.11370103.20411%83.52809%0.43305%0.44692%0.36171%2088.34470
ghc-7.10.1-Odph 202090.32813103.16534%83.49672%0.48306%0.49835%0.40334%2089.02167
ghc-8.0.1-O 202061.29991101.73269%82.33720%0.55767%0.56733%0.45917%2059.58895
ghc-8.0.1-O2 202046.47444101.00100%81.74501%0.35694%0.36051%0.29178%2045.87104
ghc-8.0.1-Odph 202026.19225100.00000%80.93485%0.39517%0.39517%0.31983%2024.08741
csv

Input: '11'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 1530706.11241122.27377%100.00000%0.13613%0.16645%0.13613%30706.25548
ghc-7.0.1-O2 2029805.13260118.68601%97.06580%0.11156%0.13241%0.10829%29791.61672
ghc-7.0.1-Odph 2029801.21325118.67040%97.05303%0.15890%0.18857%0.15422%29793.11429
ghc-7.2.1-O 1537619.17004149.80202%122.51362%0.21582%0.32330%0.26440%37609.17131
ghc-7.2.1-O2 1536333.68188144.68312%118.32720%0.10364%0.14994%0.12263%36329.16055
ghc-7.2.1-Odph 2036332.79839144.67960%118.32432%0.18534%0.26815%0.21930%36332.88632
ghc-7.4.1-O 1540698.05928162.06236%132.54058%0.16214%0.26277%0.21490%40701.51532
ghc-7.4.1-O2 2038381.04998152.83588%124.99482%0.18874%0.28846%0.23591%38351.20630
ghc-7.4.1-Odph 2038357.66737152.74277%124.91867%0.20229%0.30899%0.25270%38343.23472
ghc-7.6.1-O 1538287.60742152.46378%124.69051%0.07741%0.11803%0.09653%38285.10192
ghc-7.6.1-O2 2039700.77472158.09111%129.29274%0.26485%0.41870%0.34243%39705.12273
ghc-7.6.1-Odph 2039713.09308158.14016%129.33286%0.18623%0.29451%0.24086%39720.60724
ghc-7.8.1-O 1529762.34885118.51564%96.92646%0.16519%0.19577%0.16011%29762.19396
ghc-7.8.1-O2 2029376.65639116.97979%95.67039%0.21614%0.25283%0.20678%29377.21130
ghc-7.8.1-Odph 1529409.19100117.10934%95.77634%0.22703%0.26587%0.21744%29407.80424
ghc-7.10.1-O 1525825.90066102.84044%84.10671%0.10505%0.10804%0.08836%25815.44647
ghc-7.10.1-O2 2025812.76009102.78812%84.06391%0.13585%0.13964%0.11420%25808.17040
ghc-7.10.1-Odph 2025827.61369102.84726%84.11229%0.31018%0.31901%0.26090%25805.31750
ghc-8.0.1-O 1525573.05292101.83359%83.28326%0.10198%0.10385%0.08494%25565.27857
ghc-8.0.1-O2 2025380.88166101.06835%82.65742%0.18982%0.19185%0.15690%25371.96889
ghc-8.0.1-Odph 2025112.59181100.00000%81.78369%0.09978%0.09978%0.08161%25117.14842
csv

Input: '12'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 15412152.43840120.84860%100.00000%0.06942%0.08389%0.06942%412163.40982
ghc-7.0.1-O2 15399827.75930117.23484%97.00968%0.09726%0.11403%0.09435%400001.73880
ghc-7.0.1-Odph 15399917.26345117.26108%97.03140%0.16929%0.19851%0.16426%399884.28386
ghc-7.2.1-O 15503722.80348147.69825%122.21760%0.06978%0.10306%0.08528%503760.91091
ghc-7.2.1-O2 15488776.09017143.31567%118.59110%0.09726%0.13938%0.11534%488895.68591
ghc-7.2.1-Odph 15488748.19064143.30749%118.58433%0.14953%0.21428%0.17731%488425.17276
ghc-7.4.1-O 15546498.71142160.24072%132.59626%0.09465%0.15167%0.12550%546681.87645
ghc-7.4.1-O2 15518813.50208152.12304%125.87903%0.10559%0.16063%0.13292%518701.84984
ghc-7.4.1-Odph 15518914.68921152.15271%125.90358%0.08995%0.13685%0.11324%518772.51667
ghc-7.6.1-O 15513004.76650150.41985%124.46967%0.18370%0.27632%0.22865%512838.21907
ghc-7.6.1-O2 15533010.96260156.28593%129.32374%0.22050%0.34461%0.28515%532818.53136
ghc-7.6.1-Odph 15533131.07801156.32115%129.35289%0.25666%0.40121%0.33199%533391.37097
ghc-7.8.1-O 15396958.11528116.39342%96.31342%0.11563%0.13459%0.11137%396804.24874
ghc-7.8.1-O2 15395168.27336115.86861%95.87915%0.11435%0.13250%0.10964%395139.82475
ghc-7.8.1-Odph 15395152.86357115.86409%95.87542%0.13889%0.16093%0.13317%395130.88882
ghc-7.10.1-O 15349164.75066102.37977%84.71738%0.07258%0.07431%0.06149%349111.22867
ghc-7.10.1-O2 15349837.17797102.57693%84.88053%0.26323%0.27001%0.22343%349601.14388
ghc-7.10.1-Odph 15349230.71670102.39911%84.73339%0.13711%0.14040%0.11618%349329.50207
ghc-8.0.1-O 15347370.00173101.85352%84.28192%0.07845%0.07990%0.06612%347399.15443
ghc-8.0.1-O2 15345139.43447101.19949%83.74072%0.07634%0.07725%0.06392%345088.61839
ghc-8.0.1-Odph 15341048.59152100.00000%82.74817%0.07962%0.07962%0.06589%341066.42369
csv

Program: '3'

The following plot shows the rel means (means / min means) per input distribution for every implementation.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O100.92406%100.80514%1.12469%
ghc-7.0.1-O2100.13444%100.10058%1.04844%
ghc-7.0.1-Odph100.12550%100.09600%1.32954%
ghc-7.2.1-O103.80880%101.30947%2.14393%
ghc-7.2.1-O2108.58098%101.85405%2.60903%
ghc-7.2.1-Odph109.45224%102.71270%1.86087%
ghc-7.4.1-O102.44768%100.42474%1.56317%
ghc-7.4.1-O2102.29739%100.82972%1.07260%
ghc-7.4.1-Odph102.25612%100.74435%1.38677%
ghc-7.6.1-O109.42684%101.29914%1.70905%
ghc-7.6.1-O2110.28997%101.32141%1.99297%
ghc-7.6.1-Odph111.07157%101.69365%2.35218%
ghc-7.8.1-O112.28857%100.39008%0.77115%
ghc-7.8.1-O2115.02497%100.85030%1.08169%
ghc-7.8.1-Odph114.77265%101.02938%0.98667%
ghc-7.10.1-O108.74756%100.83711%0.50884%
ghc-7.10.1-O2109.70980%100.82426%0.49605%
ghc-7.10.1-Odph109.90084%100.67369%0.72565%
ghc-8.0.1-O112.85766%100.92583%0.46688%
ghc-8.0.1-O2113.44875%100.44106%1.72154%
ghc-8.0.1-Odph112.99666%100.72158%1.36661%
csv

Input: '10'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 20 321.58670101.97344%100.00000%3.56109%3.63136%3.56109%319.53677
ghc-7.0.1-O2 20 315.87206100.16136%98.22299%3.20601%3.21119%3.14904%312.19359
ghc-7.0.1-Odph 20 315.36318100.00000%98.06475%3.50129%3.50129%3.43353%312.16577
ghc-7.2.1-O 20 333.20707105.65820%103.61345%4.55385%4.81152%4.71840%336.62854
ghc-7.2.1-O2 20 344.24692109.15888%107.04638%2.93765%3.20671%3.14465%345.62014
ghc-7.2.1-Odph 20 348.33637110.45562%108.31803%1.68427%1.86038%1.82437%349.48573
ghc-7.4.1-O 20 324.74879102.97613%100.98328%3.51070%3.61518%3.54522%323.59020
ghc-7.4.1-O2 20 326.23332103.44686%101.44490%3.68673%3.81381%3.74000%327.84209
ghc-7.4.1-Odph 20 325.63097103.25586%101.25760%3.50774%3.62195%3.55185%328.15997
ghc-7.6.1-O 20 351.27013111.38590%109.23030%4.82798%5.37769%5.27361%345.39428
ghc-7.6.1-O2 20 353.77208112.17926%110.00831%4.50402%5.05258%4.95480%354.27927
ghc-7.6.1-Odph 20 355.76816112.81221%110.62900%4.40967%4.97465%4.87837%353.80273
ghc-7.8.1-O 20 353.75273112.17312%110.00229%2.29258%2.57166%2.52189%351.11784
ghc-7.8.1-O2 20 358.55880113.69710%111.49678%1.95482%2.22257%2.17956%358.58763
ghc-7.8.1-Odph 20 357.27963113.29148%111.09901%1.94342%2.20173%2.15913%354.73545
ghc-7.10.1-O 20 339.20621107.56050%105.47893%1.61839%1.74075%1.70706%337.95770
ghc-7.10.1-O2 20 342.41763108.57882%106.47755%1.90921%2.07300%2.03288%341.22556
ghc-7.10.1-Odph 20 344.04950109.09628%106.98499%2.99975%3.27262%3.20929%340.89525
ghc-8.0.1-O 20 360.37244114.27220%112.06074%2.21270%2.52850%2.47956%360.51566
ghc-8.0.1-O2 20 357.28824113.29422%111.10169%1.85088%2.09694%2.05635%359.27518
ghc-8.0.1-Odph 20 355.09170112.59771%110.41865%2.30885%2.59972%2.54940%356.89238
csv

Input: '11'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 203793.57391100.80849%100.00000%1.64173%1.65500%1.64173%3791.08808
ghc-7.0.1-O2 203763.14932100.00000%99.19800%1.48320%1.48320%1.47130%3742.51215
ghc-7.0.1-Odph 203768.54381100.14335%99.34020%1.85759%1.86025%1.84533%3744.06282
ghc-7.2.1-O 203889.49820103.35753%102.52860%2.49398%2.57771%2.55704%3864.02972
ghc-7.2.1-O2 204165.98633110.70478%109.81693%3.40526%3.76978%3.73955%4226.04824
ghc-7.2.1-Odph 204232.63905112.47598%111.57392%2.49967%2.81153%2.78898%4283.73190
ghc-7.4.1-O 203855.60924102.45698%101.63527%1.74728%1.79021%1.77585%3821.35717
ghc-7.4.1-O2 203816.83482101.42661%100.61317%0.80754%0.81906%0.81249%3811.72234
ghc-7.4.1-Odph 203816.41247101.41539%100.60203%1.73118%1.75568%1.74160%3794.96577
ghc-7.6.1-O 204096.69101108.86337%107.99028%2.14966%2.34019%2.32143%4068.30002
ghc-7.6.1-O2 204142.07500110.06938%109.18662%3.54372%3.90055%3.86927%4056.44997
ghc-7.6.1-Odph 204212.40594111.93832%111.04057%3.35063%3.75063%3.72055%4223.68652
ghc-7.8.1-O 204208.00304111.82131%110.92450%1.02417%1.14524%1.13606%4209.26865
ghc-7.8.1-O2 204342.74690115.40193%114.47640%1.82775%2.10926%2.09235%4310.89535
ghc-7.8.1-Odph 204323.15482114.88130%113.95995%1.06785%1.22676%1.21692%4307.54278
ghc-7.10.1-O 204099.54584108.93923%108.06553%0.32377%0.35271%0.34989%4096.71620
ghc-7.10.1-O2 204131.22300109.78100%108.90055%0.28334%0.31106%0.30856%4130.81925
ghc-7.10.1-Odph 204129.39012109.73230%108.85224%0.44036%0.48322%0.47934%4124.00906
ghc-8.0.1-O 204206.64025111.78510%110.88858%0.59637%0.66666%0.66131%4199.07843
ghc-8.0.1-O2 204294.68336114.12471%113.20943%1.97349%2.25224%2.23418%4337.93303
ghc-8.0.1-Odph 204295.07310114.13507%113.21970%2.19088%2.50056%2.48050%4349.05943
csv

Input: '12'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 2050479.87221100.00000%100.00000%0.24334%0.24334%0.24334%50448.76199
ghc-7.0.1-O2 2050602.08287100.24210%100.24210%0.24236%0.24295%0.24295%50572.65383
ghc-7.0.1-Odph 2050597.63303100.23328%100.23328%0.36135%0.36219%0.36219%50553.75893
ghc-7.2.1-O 2051710.09792102.43706%102.43706%0.86768%0.88883%0.88883%51514.31738
ghc-7.2.1-O2 2053475.40772105.93412%105.93412%1.77535%1.88071%1.88071%52961.15168
ghc-7.2.1-Odph 2053277.59509105.54225%105.54225%1.53058%1.61541%1.61541%52895.89321
ghc-7.4.1-O 2051445.39025101.91268%101.91268%0.62268%0.63459%0.63459%51359.65878
ghc-7.4.1-O2 2051504.20308102.02919%102.02919%0.41449%0.42290%0.42290%51489.50040
ghc-7.4.1-Odph 2051542.75317102.10555%102.10555%0.43918%0.44843%0.44843%51534.79956
ghc-7.6.1-O 2054547.87184108.05866%108.05866%0.48098%0.51974%0.51974%54465.82117
ghc-7.6.1-O2 2054846.28520108.64981%108.64981%0.49595%0.53885%0.53885%54791.00900
ghc-7.6.1-Odph 2054776.22787108.51103%108.51103%0.88080%0.95577%0.95577%54675.61769
ghc-7.8.1-O 2056978.56685112.87383%112.87383%0.19530%0.22045%0.22045%56991.26216
ghc-7.8.1-O2 2058550.70589115.98822%115.98822%0.35423%0.41086%0.41086%58597.60080
ghc-7.8.1-Odph 2058639.03768116.16321%116.16321%0.46285%0.53766%0.53766%58611.32413
ghc-7.10.1-O 2055403.81611109.75427%109.75427%0.25144%0.27596%0.27596%55379.15549
ghc-7.10.1-O2 2055921.94299110.78067%110.78067%0.22563%0.24996%0.24996%55909.98706
ghc-7.10.1-Odph 2055972.78503110.88139%110.88139%0.28926%0.32074%0.32074%55968.64536
ghc-8.0.1-O 2056805.04342112.53009%112.53009%0.07712%0.08678%0.08678%56806.86937
ghc-8.0.1-O2 2057007.23171112.93062%112.93062%1.39682%1.57744%1.57744%56607.78377
ghc-8.0.1-Odph 2056671.72519112.26598%112.26598%0.50457%0.56646%0.56646%56663.55054
csv

fasta

Program: '1'

The following plot shows the rel means (means / min means) per input distribution for every implementation.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O119.41526%100.77263%1.34126%
ghc-7.0.1-O2100.08562%100.07653%0.67866%
ghc-7.0.1-Odph100.11189%100.15827%0.54658%
ghc-7.2.1-O111.49896%100.58148%1.26468%
ghc-7.2.1-O2109.53225%100.69342%0.72067%
ghc-7.2.1-Odph108.89430%100.25365%0.65921%
ghc-7.4.1-O111.56197%101.74362%0.96803%
ghc-7.4.1-O2108.18583%100.57903%0.70814%
ghc-7.4.1-Odph108.43403%100.54282%0.94715%
ghc-7.6.1-O112.70099%102.25946%0.94498%
ghc-7.6.1-O2109.60220%100.17351%1.41708%
ghc-7.6.1-Odph109.17782%100.17858%0.73660%
ghc-7.8.1-O106.28621%101.90854%1.11499%
ghc-7.8.1-O2103.75904%100.15065%0.71040%
ghc-7.8.1-Odph104.60377%100.87871%0.86472%
ghc-7.10.1-O106.59530%100.59320%0.91719%
ghc-7.10.1-O2106.96560%100.48192%0.96417%
ghc-7.10.1-Odph106.87999%100.32191%0.86389%
ghc-8.0.1-O109.08325%100.64798%0.98656%
ghc-8.0.1-O2106.82889%100.67721%0.70379%
ghc-8.0.1-Odph106.44068%100.19109%0.87779%
csv

Input: '250000'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 20 110.18863120.71793%100.00000%7.47960%9.02922%7.47960%107.25109
ghc-7.0.1-O2 20 91.27777100.00000%82.83774%2.01324%2.01324%1.66772%91.57420
ghc-7.0.1-Odph 20 91.58449100.33603%83.11610%2.29352%2.30123%1.90629%90.95912
ghc-7.2.1-O 20 102.59331112.39682%93.10698%6.41522%7.21050%5.97302%98.42570
ghc-7.2.1-O2 20 100.93530110.58038%91.60228%3.30667%3.65653%3.02898%101.04386
ghc-7.2.1-Odph 20 99.22039108.70159%90.04594%2.37905%2.58606%2.14224%99.57854
ghc-7.4.1-O 20 103.76467113.68011%94.17003%5.77550%6.56560%5.43879%99.96251
ghc-7.4.1-O2 20 98.21063107.59535%89.12955%3.12203%3.35916%2.78265%96.80112
ghc-7.4.1-Odph 20 98.67861108.10805%89.55426%3.79691%4.10476%3.40029%97.08773
ghc-7.6.1-O 20 106.16939116.31462%96.35240%8.46724%9.84864%8.15839%104.30498
ghc-7.6.1-O2 20 99.97244109.52551%90.72845%3.44869%3.77719%3.12894%98.90641
ghc-7.6.1-Odph 20 99.45951108.96356%90.26295%2.63441%2.87055%2.37790%99.15499
ghc-7.8.1-O 20 99.61858109.13783%90.40731%6.06827%6.62278%5.48616%100.32330
ghc-7.8.1-O2 20 94.52937103.56231%85.78868%3.28755%3.40466%2.82034%95.03523
ghc-7.8.1-Odph 20 96.66559105.90266%87.72737%3.43436%3.63708%3.01287%97.36682
ghc-7.10.1-O 20 98.11498107.49056%89.04275%4.53635%4.87615%4.03929%96.70019
ghc-7.10.1-O2 20 98.23191107.61865%89.14886%4.32257%4.65189%3.85352%98.11557
ghc-7.10.1-Odph 20 97.95568107.31603%88.89817%3.35585%3.60136%2.98329%97.99731
ghc-8.0.1-O 20 100.47685110.07812%91.18622%5.15477%5.67427%4.70044%100.04431
ghc-8.0.1-O2 20 98.44565107.85283%89.34284%3.79052%4.08818%3.38656%98.23122
ghc-8.0.1-Odph 20 97.40551106.71329%88.39887%4.20620%4.48857%3.71823%95.64652
csv

Input: '2500000'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 201019.96911118.85886%100.00000%1.09440%1.30079%1.09440%1017.01817
ghc-7.0.1-O2 20 859.72972100.18587%84.28978%0.78522%0.78667%0.66186%859.99299
ghc-7.0.1-Odph 20 858.13469100.00000%84.13340%0.41239%0.41239%0.34696%858.16156
ghc-7.2.1-O 20 954.39027111.21684%93.57051%1.51464%1.68454%1.41726%950.51772
ghc-7.2.1-O2 20 933.69500108.80518%91.54150%0.53409%0.58111%0.48891%935.11088
ghc-7.2.1-Odph 20 932.76868108.69724%91.45068%0.62045%0.67442%0.56741%931.40360
ghc-7.4.1-O 20 961.30399112.02251%94.24834%0.83057%0.93042%0.78280%959.97220
ghc-7.4.1-O2 20 935.82205109.05305%91.75004%0.69230%0.75497%0.63518%933.99837
ghc-7.4.1-Odph 20 937.61006109.26141%91.92534%1.10705%1.20958%1.01766%934.21447
ghc-7.6.1-O 20 950.71838110.78895%93.21051%0.51296%0.56830%0.47813%949.96928
ghc-7.6.1-O2 20 942.78015109.86389%92.43223%3.17333%3.48634%2.93318%934.48460
ghc-7.6.1-Odph 20 936.52815109.13533%91.81927%0.53262%0.58127%0.48904%936.66202
ghc-7.8.1-O 20 902.99088105.22717%88.53120%1.64703%1.73313%1.45814%898.51654
ghc-7.8.1-O2 20 890.49351103.77083%87.30593%0.53651%0.55674%0.46840%889.02159
ghc-7.8.1-Odph 20 891.43519103.88057%87.39825%0.65011%0.67534%0.56819%890.36709
ghc-7.10.1-O 20 911.00156106.16067%89.31658%1.07320%1.13932%0.95854%908.48066
ghc-7.10.1-O2 20 912.72182106.36114%89.48524%0.51762%0.55055%0.46320%912.94257
ghc-7.10.1-Odph 20 913.70888106.47616%89.58202%0.51705%0.55053%0.46318%914.66606
ghc-8.0.1-O 20 932.65157108.68359%91.43920%0.99971%1.08653%0.91413%933.30467
ghc-8.0.1-O2 20 912.11080106.28993%89.42534%0.64093%0.68125%0.57315%909.68639
ghc-8.0.1-Odph 20 911.55450106.22511%89.37080%0.58894%0.62560%0.52634%910.40225
csv

Input: '25000000'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 2010058.14882118.67961%100.00000%0.29477%0.34984%0.29477%10061.89841
ghc-7.0.1-O2 208481.06676100.07107%84.32035%0.19773%0.19787%0.16673%8479.72851
ghc-7.0.1-Odph 208475.04354100.00000%84.26047%0.17264%0.17264%0.14547%8473.06848
ghc-7.2.1-O 209397.87916110.88886%93.43548%0.20817%0.23084%0.19451%9397.40480
ghc-7.2.1-O2 209256.36307109.21906%92.02850%0.21194%0.23147%0.19504%9259.46861
ghc-7.2.1-Odph 209261.96105109.28511%92.08415%0.19407%0.21209%0.17871%9260.86345
ghc-7.4.1-O 209240.61020109.03319%91.87188%0.18911%0.20619%0.17374%9236.88142
ghc-7.4.1-O2 209145.80105107.91450%90.92927%0.16429%0.17730%0.14939%9146.63034
ghc-7.4.1-Odph 209147.74124107.93740%90.94856%0.20215%0.21819%0.18385%9146.41668
ghc-7.6.1-O 209414.43857111.08425%93.60011%0.19429%0.21582%0.18185%9415.93525
ghc-7.6.1-O2 209273.19641109.41768%92.19586%0.26003%0.28451%0.23973%9273.33791
ghc-7.6.1-Odph 209274.67219109.43510%92.21053%0.28483%0.31171%0.26265%9265.62100
ghc-7.8.1-O 208860.73001104.55085%88.09504%0.13869%0.14500%0.12218%8860.59964
ghc-7.8.1-O2 208809.32814103.94434%87.58399%0.20326%0.21128%0.17803%8800.69561
ghc-7.8.1-Odph 208817.44514104.04012%87.66469%0.28959%0.30129%0.25387%8813.83238
ghc-7.10.1-O 208995.43468106.14028%89.43430%0.15849%0.16822%0.14174%8991.31078
ghc-7.10.1-O2 159061.57847106.92073%90.09191%0.40059%0.42832%0.36090%9051.57530
ghc-7.10.1-Odph 209055.53682106.84944%90.03184%0.37158%0.39703%0.33454%9057.64455
ghc-8.0.1-O 209194.98762108.49487%91.41829%0.18633%0.20216%0.17034%9189.88698
ghc-8.0.1-O2 209013.31309106.35123%89.61205%0.14349%0.15260%0.12858%9013.75720
ghc-8.0.1-Odph 209016.10850106.38421%89.63984%0.27303%0.29046%0.24474%9006.45216
csv

mandelbrot

Program: '2'

The following plot shows the rel means (means / min means) per input distribution for every implementation.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O105.15281%101.23959%2.37173%
ghc-7.0.1-O2102.82121%101.80931%2.01078%
ghc-7.0.1-Odph103.59442%103.04769%1.92342%
ghc-7.2.1-O109.20901%104.52164%3.12423%
ghc-7.2.1-O2103.56905%102.29185%2.05825%
ghc-7.2.1-Odph103.80827%102.86539%2.26406%
ghc-7.4.1-O105.25405%101.81612%3.07766%
ghc-7.4.1-O2101.37577%100.99401%1.04959%
ghc-7.4.1-Odph102.24933%100.18716%1.42170%
ghc-7.6.1-O105.44979%101.03862%1.21961%
ghc-7.6.1-O2102.89144%100.19563%0.61937%
ghc-7.6.1-Odph102.79495%100.01882%0.57072%
ghc-7.8.1-O101.94320%100.74326%1.07621%
ghc-7.8.1-O2100.75576%100.76730%1.50605%
ghc-7.8.1-Odph100.69515%100.66749%1.38261%
ghc-7.10.1-O102.32875%101.75637%1.04886%
ghc-7.10.1-O2100.12762%100.18053%0.64275%
ghc-7.10.1-Odph100.49138%100.59571%0.78464%
ghc-8.0.1-O102.45098%100.57242%1.41264%
ghc-8.0.1-O2100.57807%100.32832%0.64143%
ghc-8.0.1-Odph100.77372%100.48464%1.15590%
csv

Input: '1000'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 20 167.74479105.12418%100.00000%4.22982%4.44657%4.22982%164.87336
ghc-7.0.1-O2 20 160.42612100.53764%95.63702%1.75470%1.76413%1.67814%160.79570
ghc-7.0.1-Odph 20 159.75269100.11560%95.23556%1.67908%1.68102%1.59908%160.15171
ghc-7.2.1-O 20 184.72573115.76599%110.12308%11.30530%13.08770%12.44975%174.65467
ghc-7.2.1-O2 20 162.42034101.78739%96.82586%1.67803%1.70802%1.62477%163.14165
ghc-7.2.1-Odph 20 161.94860101.49176%96.54464%1.85232%1.87995%1.78831%162.45140
ghc-7.4.1-O 20 171.93583107.75067%102.49846%12.99776%14.00517%13.32250%163.59584
ghc-7.4.1-O2 20 159.56823100.00000%95.12559%1.89012%1.89012%1.79799%158.90612
ghc-7.4.1-Odph 20 162.77066102.00694%97.03470%2.09404%2.13607%2.03194%162.88280
ghc-7.6.1-O 20 170.57432106.89742%101.68681%5.19471%5.55301%5.28233%167.73297
ghc-7.6.1-O2 20 164.59941103.15300%98.12490%2.39831%2.47392%2.35334%163.04342
ghc-7.6.1-Odph 20 164.03177102.79727%97.78651%1.60892%1.65393%1.57331%164.65697
ghc-7.8.1-O 20 164.32584102.98156%97.96182%5.12799%5.28088%5.02347%161.91270
ghc-7.8.1-O2 20 160.13111100.35275%95.46115%1.61399%1.61969%1.54074%159.70962
ghc-7.8.1-Odph 20 159.92122100.22122%95.33603%2.00733%2.01177%1.91371%159.30069
ghc-7.10.1-O 20 167.35323104.87880%99.76658%7.03733%7.38067%7.02091%163.12538
ghc-7.10.1-O2 20 160.17993100.38335%95.49026%1.86841%1.87558%1.78415%159.44228
ghc-7.10.1-Odph 20 161.70255101.33756%96.39796%6.05486%6.13585%5.83677%159.72087
ghc-8.0.1-O 20 163.62490102.54228%97.54395%3.12818%3.20770%3.05135%163.90855
ghc-8.0.1-O2 20 159.79206100.14027%95.25903%1.89539%1.89805%1.80553%159.27346
ghc-8.0.1-Odph 20 159.89625100.20557%95.32114%1.73788%1.74145%1.65656%160.33271
csv

Input: '4000'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 202592.41145106.76578%100.00000%4.47867%4.78168%4.47867%2539.18195
ghc-7.0.1-O2 202550.70415105.04810%98.39118%4.47875%4.70484%4.40669%2479.32123
ghc-7.0.1-Odph 202615.22732107.70542%100.88010%5.13554%5.53125%5.18073%2583.86733
ghc-7.2.1-O 202626.50185108.16975%101.31501%4.19026%4.53260%4.24537%2571.86304
ghc-7.2.1-O2 202596.58612106.93770%100.16103%5.31514%5.68389%5.32370%2560.36736
ghc-7.2.1-Odph 202623.03610108.02702%101.18132%6.21729%6.71635%6.29073%2622.74467
ghc-7.4.1-O 202547.70524104.92460%98.27550%3.48029%3.65168%3.42027%2513.26784
ghc-7.4.1-O2 202471.99218101.80643%95.35493%0.80919%0.82381%0.77160%2464.50646
ghc-7.4.1-Odph 202483.18607102.26744%95.78673%2.00638%2.05187%1.92184%2477.44161
ghc-7.6.1-O 202554.66172105.21109%98.54384%0.78030%0.82097%0.76894%2554.96271
ghc-7.6.1-O2 202497.53006102.85818%96.34003%0.19427%0.19982%0.18716%2496.10362
ghc-7.6.1-Odph 202496.53979102.81740%96.30183%0.23764%0.24433%0.22885%2495.97555
ghc-7.8.1-O 202468.44033101.66015%95.21792%0.68288%0.69422%0.65023%2468.92198
ghc-7.8.1-O2 202472.79424101.83946%95.38587%4.90941%4.99972%4.68288%2434.95444
ghc-7.8.1-Odph 202468.12111101.64701%95.20561%3.75606%3.81792%3.57598%2437.55969
ghc-7.10.1-O 202455.66328101.13394%94.72506%0.44440%0.44944%0.42096%2459.36265
ghc-7.10.1-O2 202428.12966100.00000%93.66297%0.34502%0.34502%0.32316%2429.03788
ghc-7.10.1-Odph 202428.81629100.02828%93.68946%0.15627%0.15631%0.14641%2429.67457
ghc-8.0.1-O 202503.87165103.11935%96.58465%2.89329%2.98355%2.79448%2486.35923
ghc-8.0.1-O2 202450.82369100.93463%94.53838%0.69584%0.70234%0.65784%2447.96004
ghc-8.0.1-Odph 202462.02784101.39606%94.97057%3.03969%3.08213%2.88681%2446.25796
csv

Input: '16000'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 2040110.62745103.59242%100.00000%0.70424%0.72954%0.70424%40053.32028
ghc-7.0.1-O2 2039853.15825102.92747%99.35810%1.03451%1.06480%1.02787%39897.39195
ghc-7.0.1-Odph 2039920.97715103.10262%99.52718%0.82521%0.85081%0.82130%39966.87073
ghc-7.2.1-O 2040273.56469104.01324%100.40622%0.64373%0.66957%0.64635%40320.61008
ghc-7.2.1-O2 2039518.14966102.06225%98.52289%0.97764%0.99781%0.96320%39376.17946
ghc-7.2.1-Odph 2039506.10113102.03113%98.49285%1.00774%1.02821%0.99255%39360.17624
ghc-7.4.1-O 2039934.72323103.13812%99.56145%0.64443%0.66466%0.64161%39842.33462
ghc-7.4.1-O2 2039624.03961102.33573%98.78689%0.75600%0.77365%0.74683%39554.91924
ghc-7.4.1-Odph 2039677.63702102.47415%98.92051%0.68395%0.70087%0.67657%39586.76082
ghc-7.6.1-O 2040368.24173104.25776%100.64226%0.44755%0.46661%0.45042%40393.71248
ghc-7.6.1-O2 2039751.03939102.66373%99.10351%0.50995%0.52354%0.50538%39752.85069
ghc-7.6.1-Odph 2039792.25711102.77018%99.20627%0.48620%0.49966%0.48234%39760.54546
ghc-7.8.1-O 2039182.84981101.19628%97.68695%0.35595%0.36021%0.34772%39134.96325
ghc-7.8.1-O2 2038752.13844100.08390%96.61314%0.43111%0.43147%0.41651%38725.08843
ghc-7.8.1-Odph 2038806.36010100.22393%96.74832%0.35055%0.35134%0.33915%38795.52100
ghc-7.10.1-O 2039114.68558101.02024%97.51701%0.36895%0.37272%0.35979%39074.84667
ghc-7.10.1-O2 2038719.65351100.00000%96.53216%0.41191%0.41191%0.39763%38702.94552
ghc-7.10.1-Odph 2038763.64690100.11362%96.64184%0.51055%0.51113%0.49340%38686.48520
ghc-8.0.1-O 2039376.45986101.69631%98.16964%0.31146%0.31675%0.30576%39358.26855
ghc-8.0.1-O2 2038975.56582100.66094%97.17017%0.20009%0.20142%0.19443%38993.90852
ghc-8.0.1-Odph 2038999.61644100.72305%97.23013%0.29236%0.29447%0.28426%38963.47326
csv

meteor

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O121.89222%112.23690%1.25398%
ghc-7.0.1-O2118.63700%109.25244%0.61942%
ghc-7.0.1-Odph118.45143%107.15276%0.59917%
ghc-7.2.1-O119.78756%111.31271%1.35038%
ghc-7.2.1-O2115.26549%107.38828%0.85065%
ghc-7.2.1-Odph115.24833%107.32059%0.62142%
ghc-7.4.1-O116.98478%107.87262%1.09529%
ghc-7.4.1-O2112.27695%109.53612%0.65276%
ghc-7.4.1-Odph112.55717%109.40363%0.76150%
ghc-7.6.1-O133.18142%117.91837%1.11013%
ghc-7.6.1-O2130.78312%124.95568%0.72862%
ghc-7.6.1-Odph130.81828%124.96531%0.64821%
ghc-7.8.1-O109.89223%105.94326%1.34814%
ghc-7.8.1-O2112.62247%110.49959%0.82353%
ghc-7.8.1-Odph112.47324%110.33357%0.77799%
ghc-7.10.1-O105.27847%107.23142%1.33831%
ghc-7.10.1-O2102.44941%102.14125%0.78100%
ghc-7.10.1-Odph102.72456%101.94647%1.05876%
ghc-8.0.1-O103.86117%106.57839%1.45092%
ghc-8.0.1-O2103.20192%101.10946%0.96624%
ghc-8.0.1-Odph102.94871%101.03926%0.83403%
csv

Program: '1'

The following plot shows the rel means (means / min means) per input distribution for every implementation.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O110.21621%100.00000%1.30817%
ghc-7.0.1-O2111.10896%100.00000%0.57403%
ghc-7.0.1-Odph113.01530%100.00000%0.75380%
ghc-7.2.1-O112.17588%100.00000%1.08851%
ghc-7.2.1-O2111.98866%100.00000%2.66817%
ghc-7.2.1-Odph111.87425%100.00000%0.54394%
ghc-7.4.1-O109.83633%100.00000%1.29852%
ghc-7.4.1-O2114.03974%100.00000%0.60866%
ghc-7.4.1-Odph114.57518%100.00000%0.44849%
ghc-7.6.1-O135.71366%100.00000%0.83240%
ghc-7.6.1-O2136.82414%100.00000%0.60423%
ghc-7.6.1-Odph136.59892%100.00000%0.54015%
ghc-7.8.1-O103.29817%100.00000%1.18933%
ghc-7.8.1-O2112.47322%100.00000%0.70272%
ghc-7.8.1-Odph112.62952%100.00000%0.57710%
ghc-7.10.1-O100.30742%100.00000%1.30089%
ghc-7.10.1-O2100.52571%100.00000%0.67073%
ghc-7.10.1-Odph100.72421%100.00000%0.64774%
ghc-8.0.1-O100.00000%100.00000%1.28063%
ghc-8.0.1-O2101.65136%100.00000%0.70734%
ghc-8.0.1-Odph101.47764%100.00000%0.62928%
csv

Input: '2098'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 20 761.51110110.21621%100.00000%1.30817%1.44181%1.30817%759.70832
ghc-7.0.1-O2 20 767.67932111.10896%100.81000%0.57403%0.63779%0.57868%767.44429
ghc-7.0.1-Odph 20 780.85071113.01530%102.53964%0.75380%0.85191%0.77295%780.59416
ghc-7.2.1-O 20 775.05095112.17588%101.77802%1.08851%1.22105%1.10787%771.83809
ghc-7.2.1-O2 20 773.75738111.98866%101.60816%2.66817%2.98805%2.71108%770.24378
ghc-7.2.1-Odph 20 772.96688111.87425%101.50435%0.54394%0.60853%0.55213%772.82466
ghc-7.4.1-O 20 758.88642109.83633%99.65533%1.29852%1.42625%1.29405%762.25197
ghc-7.4.1-O2 20 787.92885114.03974%103.46912%0.60866%0.69411%0.62978%787.40665
ghc-7.4.1-Odph 20 791.62828114.57518%103.95492%0.44849%0.51386%0.46623%790.22039
ghc-7.6.1-O 20 937.67929135.71366%123.13403%0.83240%1.12968%1.02497%938.73615
ghc-7.6.1-O2 20 945.35185136.82414%124.14157%0.60423%0.82673%0.75010%945.93377
ghc-7.6.1-Odph 20 943.79578136.59892%123.93723%0.54015%0.73784%0.66945%944.38132
ghc-7.8.1-O 20 713.71268103.29817%93.72321%1.18933%1.22856%1.11468%712.71044
ghc-7.8.1-O2 20 777.10534112.47322%102.04780%0.70272%0.79037%0.71711%775.23167
ghc-7.8.1-Odph 20 778.18528112.62952%102.18962%0.57710%0.64998%0.58973%777.64230
ghc-7.10.1-O 20 693.04884100.30742%91.00968%1.30089%1.30489%1.18394%691.67955
ghc-7.10.1-O2 20 694.55701100.52571%91.20773%0.67073%0.67425%0.61175%692.46854
ghc-7.10.1-Odph 20 695.92850100.72421%91.38783%0.64774%0.65243%0.59195%694.97022
ghc-8.0.1-O 20 690.92477100.00000%90.73076%1.28063%1.28063%1.16192%692.38374
ghc-8.0.1-O2 20 702.33445101.65136%92.22905%0.70734%0.71902%0.65237%701.74705
ghc-8.0.1-Odph 20 701.13414101.47764%92.07143%0.62928%0.63858%0.57939%700.97944
csv

Program: '2'

The following plot shows the rel means (means / min means) per input distribution for every implementation.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O120.67064%100.00000%1.62597%
ghc-7.0.1-O2120.53386%100.00000%0.55880%
ghc-7.0.1-Odph121.61949%100.00000%0.61491%
ghc-7.2.1-O117.39847%100.00000%1.26021%
ghc-7.2.1-O2121.46643%100.00000%0.84532%
ghc-7.2.1-Odph120.90023%100.00000%0.65995%
ghc-7.4.1-O120.86271%100.00000%1.16078%
ghc-7.4.1-O2121.59707%100.00000%0.61556%
ghc-7.4.1-Odph121.68375%100.00000%0.90399%
ghc-7.6.1-O155.88585%100.00000%0.89910%
ghc-7.6.1-O2163.60149%100.00000%0.68540%
ghc-7.6.1-Odph163.64658%100.00000%0.68390%
ghc-7.8.1-O110.97085%100.00000%1.52535%
ghc-7.8.1-O2125.29558%100.00000%0.93585%
ghc-7.8.1-Odph124.62649%100.00000%0.85097%
ghc-7.10.1-O100.81412%100.00000%1.56762%
ghc-7.10.1-O2106.52223%100.00000%1.39884%
ghc-7.10.1-Odph106.19032%100.00000%1.50369%
ghc-8.0.1-O100.00000%100.00000%2.02833%
ghc-8.0.1-O2104.74576%100.00000%1.38922%
ghc-8.0.1-Odph104.40093%100.00000%1.17327%
csv

Input: '2098'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 20 556.26650120.67064%100.00000%1.62597%1.96207%1.62597%553.77396
ghc-7.0.1-O2 20 555.63597120.53386%99.88665%0.55880%0.67355%0.55817%554.70634
ghc-7.0.1-Odph 20 560.64048121.61949%100.78631%0.61491%0.74785%0.61975%560.26343
ghc-7.2.1-O 20 541.18246117.39847%97.28834%1.26021%1.47947%1.22604%540.46302
ghc-7.2.1-O2 20 559.93494121.46643%100.65948%0.84532%1.02678%0.85090%559.87327
ghc-7.2.1-Odph 20 557.32488120.90023%100.19026%0.65995%0.79788%0.66120%557.80003
ghc-7.4.1-O 20 557.15189120.86271%100.15917%1.16078%1.40295%1.16262%554.36827
ghc-7.4.1-O2 20 560.53717121.59707%100.76774%0.61556%0.74850%0.62029%560.37564
ghc-7.4.1-Odph 20 560.93671121.68375%100.83956%0.90399%1.10000%0.91157%559.74270
ghc-7.6.1-O 20 718.60129155.88585%129.18292%0.89910%1.40157%1.16149%719.00965
ghc-7.6.1-O2 20 754.16878163.60149%135.57688%0.68540%1.12133%0.92925%754.94005
ghc-7.6.1-Odph 20 754.37661163.64658%135.61424%0.68390%1.11918%0.92747%753.28482
ghc-7.8.1-O 20 511.55247110.97085%91.96176%1.52535%1.69269%1.40274%508.94619
ghc-7.8.1-O2 20 577.58653125.29558%103.83270%0.93585%1.17258%0.97172%576.46288
ghc-7.8.1-Odph 20 574.50216124.62649%103.27822%0.85097%1.06054%0.87887%573.45458
ghc-7.10.1-O 20 464.73207100.81412%83.54486%1.56762%1.58039%1.30967%463.76079
ghc-7.10.1-O2 20 491.04528106.52223%88.27518%1.39884%1.49007%1.23482%490.82792
ghc-7.10.1-Odph 20 489.51523106.19032%88.00013%1.50369%1.59677%1.32325%486.37003
ghc-8.0.1-O 20 460.97916100.00000%82.87020%2.02833%2.02833%1.68088%460.24932
ghc-8.0.1-O2 20 482.85614104.74576%86.80302%1.38922%1.45515%1.20589%482.17158
ghc-8.0.1-Odph 20 481.26654104.40093%86.51726%1.17327%1.22490%1.01508%479.90835
csv

Program: '3'

The following plot shows the rel means (means / min means) per input distribution for every implementation.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O127.42525%100.00000%1.88735%
ghc-7.0.1-O2131.63716%100.00000%0.82635%
ghc-7.0.1-Odph131.30390%100.00000%0.59211%
ghc-7.2.1-O125.49652%100.00000%2.31612%
ghc-7.2.1-O2123.10248%100.00000%0.76505%
ghc-7.2.1-Odph123.58949%100.00000%0.81707%
ghc-7.4.1-O125.84600%100.00000%1.86536%
ghc-7.4.1-O2125.82213%100.00000%1.11886%
ghc-7.4.1-Odph125.85814%100.00000%1.34284%
ghc-7.6.1-O159.72385%100.00000%1.55439%
ghc-7.6.1-O2167.70111%100.00000%0.90364%
ghc-7.6.1-Odph167.96433%100.00000%0.64232%
ghc-7.8.1-O114.81563%100.00000%1.23062%
ghc-7.8.1-O2126.58990%100.00000%1.16807%
ghc-7.8.1-Odph126.32237%100.00000%1.11370%
ghc-7.10.1-O100.82103%100.00000%1.55248%
ghc-7.10.1-O2102.71172%100.00000%1.07386%
ghc-7.10.1-Odph103.42351%100.00000%1.68579%
ghc-8.0.1-O100.00000%100.00000%1.66598%
ghc-8.0.1-O2104.05101%100.00000%1.24197%
ghc-8.0.1-Odph103.92517%100.00000%0.99905%
csv

Input: '2098'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 20 486.03006127.42525%100.00000%1.88735%2.40497%1.88735%485.90328
ghc-7.0.1-O2 20 502.09530131.63716%103.30540%0.82635%1.08778%0.85366%500.91612
ghc-7.0.1-Odph 20 500.82414131.30390%103.04386%0.59211%0.77746%0.61013%500.39205
ghc-7.2.1-O 20 478.67343125.49652%98.48638%2.31612%2.90665%2.28106%477.08146
ghc-7.2.1-O2 20 469.54202123.10248%96.60761%0.76505%0.94179%0.73909%468.79844
ghc-7.2.1-Odph 20 471.39956123.58949%96.98980%0.81707%1.00981%0.79247%472.25430
ghc-7.4.1-O 20 480.00644125.84600%98.76065%1.86536%2.34748%1.84224%479.21236
ghc-7.4.1-O2 20 479.91539125.82213%98.74192%1.11886%1.40778%1.10479%479.72938
ghc-7.4.1-Odph 20 480.05273125.85814%98.77017%1.34284%1.69007%1.32632%478.32268
ghc-7.6.1-O 20 609.22456159.72385%125.34710%1.55439%2.48273%1.94838%608.63004
ghc-7.6.1-O2 20 639.65173167.70111%131.60744%0.90364%1.51541%1.18925%637.95827
ghc-7.6.1-Odph 20 640.65573167.96433%131.81401%0.64232%1.07887%0.84667%639.92574
ghc-7.8.1-O 20 437.93399114.81563%90.10430%1.23062%1.41295%1.10885%437.14018
ghc-7.8.1-O2 20 482.84384126.58990%99.34444%1.16807%1.47866%1.16041%481.15285
ghc-7.8.1-Odph 20 481.82342126.32237%99.13449%1.11370%1.40685%1.10406%479.75312
ghc-7.10.1-O 20 384.55528100.82103%79.12171%1.55248%1.56523%1.22835%385.27346
ghc-7.10.1-O2 20 391.76683102.71172%80.60547%1.07386%1.10298%0.86559%391.17030
ghc-7.10.1-Odph 20 394.48176103.42351%81.16407%1.68579%1.74350%1.36825%393.52752
ghc-8.0.1-O 20 381.42368100.00000%78.47738%1.66598%1.66598%1.30742%383.36252
ghc-8.0.1-O2 20 396.87517104.05101%81.65651%1.24197%1.29228%1.01415%397.05996
ghc-8.0.1-Odph 20 396.39521103.92517%81.55776%0.99905%1.03827%0.81481%396.69033
csv

Program: '4'

The following plot shows the rel means (means / min means) per input distribution for every implementation.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O148.10322%100.00000%0.51542%
ghc-7.0.1-O2128.32454%100.00000%0.32302%
ghc-7.0.1-Odph120.57194%100.00000%0.31278%
ghc-7.2.1-O143.03660%100.00000%0.69191%
ghc-7.2.1-O2119.67226%100.00000%0.29485%
ghc-7.2.1-Odph119.55388%100.00000%0.27074%
ghc-7.4.1-O125.72916%100.00000%0.58267%
ghc-7.4.1-O2101.43869%100.00000%0.33112%
ghc-7.4.1-Odph101.60412%100.00000%0.54307%
ghc-7.6.1-O120.92531%100.00000%0.88229%
ghc-7.6.1-O2101.92308%100.00000%0.62823%
ghc-7.6.1-Odph101.99681%100.00000%0.57750%
ghc-7.8.1-O118.75707%100.00000%1.24719%
ghc-7.8.1-O2100.03457%100.00000%0.40693%
ghc-7.8.1-Odph100.00000%100.00000%0.46370%
ghc-7.10.1-O120.52175%100.00000%0.84149%
ghc-7.10.1-O2100.57245%100.00000%0.32556%
ghc-7.10.1-Odph100.90782%100.00000%0.60463%
ghc-8.0.1-O117.79125%100.00000%0.98643%
ghc-8.0.1-O2102.23033%100.00000%0.58835%
ghc-8.0.1-Odph102.41152%100.00000%0.73481%
csv

Input: '2098'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 201956.33802148.10322%100.00000%0.51542%0.76335%0.51542%1956.25254
ghc-7.0.1-O2 201695.07577128.32454%86.64534%0.32302%0.41451%0.27988%1694.03506
ghc-7.0.1-Odph 201592.66937120.57194%81.41075%0.31278%0.37712%0.25463%1592.71279
ghc-7.2.1-O 201889.41159143.03660%96.57899%0.69191%0.98968%0.66823%1886.21970
ghc-7.2.1-O2 201580.78524119.67226%80.80328%0.29485%0.35286%0.23825%1581.02647
ghc-7.2.1-Odph 201579.22163119.55388%80.72335%0.27074%0.32368%0.21855%1580.43887
ghc-7.4.1-O 201660.79263125.72916%84.89293%0.58267%0.73259%0.49465%1661.67235
ghc-7.4.1-O2 201339.93280101.43869%68.49189%0.33112%0.33589%0.22679%1339.31531
ghc-7.4.1-Odph 201342.11799101.60412%68.60358%0.54307%0.55178%0.37257%1340.88953
ghc-7.6.1-O 201597.33720120.92531%81.64935%0.88229%1.06691%0.72038%1594.51293
ghc-7.6.1-O2 201346.33129101.92308%68.81895%0.62823%0.64031%0.43234%1343.57807
ghc-7.6.1-Odph 201347.30520101.99681%68.86873%0.57750%0.58903%0.39772%1346.43679
ghc-7.8.1-O 201568.69627118.75707%80.18534%1.24719%1.48112%1.00006%1566.36844
ghc-7.8.1-O2 201321.38538100.03457%67.54382%0.40693%0.40707%0.27485%1320.88545
ghc-7.8.1-Odph 201320.92874100.00000%67.52048%0.46370%0.46370%0.31309%1320.47545
ghc-7.10.1-O 201592.00639120.52175%81.37686%0.84149%1.01418%0.68478%1591.93319
ghc-7.10.1-O2 201328.49034100.57245%67.90699%0.32556%0.32743%0.22108%1328.43755
ghc-7.10.1-Odph 201332.92042100.90782%68.13344%0.60463%0.61012%0.41195%1331.92911
ghc-8.0.1-O 201555.93850117.79125%79.53321%0.98643%1.16193%0.78454%1554.14858
ghc-8.0.1-O2 201350.38979102.23033%69.02640%0.58835%0.60148%0.40612%1350.11800
ghc-8.0.1-Odph 201352.78319102.41152%69.14875%0.73481%0.75253%0.50811%1355.52882
csv

Program: '5'

The following plot shows the rel means (means / min means) per input distribution for every implementation.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O107.20448%100.00000%1.49854%
ghc-7.0.1-O2103.88539%100.00000%1.06499%
ghc-7.0.1-Odph107.16111%100.00000%0.89959%
ghc-7.2.1-O104.33207%100.00000%2.04263%
ghc-7.2.1-O2101.53269%100.00000%0.87543%
ghc-7.2.1-Odph101.73509%100.00000%1.16695%
ghc-7.4.1-O104.31170%100.00000%0.96217%
ghc-7.4.1-O2100.81219%100.00000%0.85382%
ghc-7.4.1-Odph101.33281%100.00000%0.86606%
ghc-7.6.1-O102.54179%100.00000%1.64270%
ghc-7.6.1-O2100.00000%100.00000%0.87347%
ghc-7.6.1-Odph100.04246%100.00000%0.83514%
ghc-7.8.1-O102.53516%100.00000%1.59937%
ghc-7.8.1-O2101.52923%100.00000%1.21176%
ghc-7.8.1-Odph101.50868%100.00000%1.12386%
ghc-7.10.1-O105.25116%100.00000%1.61150%
ghc-7.10.1-O2102.03071%100.00000%0.88583%
ghc-7.10.1-Odph102.47277%100.00000%1.34010%
ghc-8.0.1-O102.60131%100.00000%1.50635%
ghc-8.0.1-O2103.36256%100.00000%1.17296%
ghc-8.0.1-Odph102.55579%100.00000%0.74458%
csv

Input: '2098'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 20 491.45945107.20448%100.00000%1.49854%1.60650%1.49854%491.99374
ghc-7.0.1-O2 20 476.24369103.88539%96.90396%1.06499%1.10637%1.03202%475.12693
ghc-7.0.1-Odph 20 491.26064107.16111%99.95955%0.89959%0.96401%0.89923%492.14202
ghc-7.2.1-O 20 478.29140104.33207%97.32062%2.04263%2.13111%1.98790%475.71853
ghc-7.2.1-O2 20 465.45818101.53269%94.70938%0.87543%0.88885%0.82912%464.16712
ghc-7.2.1-Odph 20 466.38605101.73509%94.89817%1.16695%1.18719%1.10741%464.87271
ghc-7.4.1-O 20 478.19802104.31170%97.30162%0.96217%1.00366%0.93621%476.60458
ghc-7.4.1-O2 20 462.15516100.81219%94.03729%0.85382%0.86075%0.80291%461.00225
ghc-7.4.1-Odph 20 464.54187101.33281%94.52293%0.86606%0.87760%0.81862%464.12722
ghc-7.6.1-O 20 470.08423102.54179%95.65066%1.64270%1.68446%1.57126%467.46246
ghc-7.6.1-O2 20 458.43183100.00000%93.27969%0.87347%0.87347%0.81477%457.45233
ghc-7.6.1-Odph 20 458.62647100.04246%93.31929%0.83514%0.83549%0.77935%459.20778
ghc-7.8.1-O 20 470.05381102.53516%95.64448%1.59937%1.63991%1.52971%466.92835
ghc-7.8.1-O2 20 465.44232101.52923%94.70615%1.21176%1.23029%1.14761%464.83213
ghc-7.8.1-Odph 20 465.34809101.50868%94.68698%1.12386%1.14082%1.06415%464.62867
ghc-7.10.1-O 20 482.50483105.25116%98.17795%1.61150%1.69612%1.58214%479.71388
ghc-7.10.1-O2 20 467.74124102.03071%95.17392%0.88583%0.90382%0.84308%467.67641
ghc-7.10.1-Odph 20 469.76782102.47277%95.58628%1.34010%1.37324%1.28095%468.22075
ghc-8.0.1-O 20 470.35709102.60131%95.70618%1.50635%1.54554%1.44167%470.23685
ghc-8.0.1-O2 20 473.84685103.36256%96.41627%1.17296%1.21240%1.13092%473.38042
ghc-8.0.1-Odph 20 470.14838102.55579%95.66372%0.74458%0.76361%0.71229%469.24550
csv

nbody

Program: '2'

The following plot shows the rel means (means / min means) per input distribution for every implementation.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O182.22167%101.90840%2.11800%
ghc-7.0.1-O2144.04793%101.94691%4.89582%
ghc-7.0.1-Odph138.14381%104.18918%5.62064%
ghc-7.2.1-O182.77547%101.31228%3.61963%
ghc-7.2.1-O2138.93932%102.08416%4.73024%
ghc-7.2.1-Odph139.40074%102.41255%5.37932%
ghc-7.4.1-O165.70556%101.04039%4.09327%
ghc-7.4.1-O2136.21152%102.21556%6.53814%
ghc-7.4.1-Odph136.81056%103.64907%6.45534%
ghc-7.6.1-O141.33969%101.48161%3.48570%
ghc-7.6.1-O2136.09966%101.26326%4.53373%
ghc-7.6.1-Odph136.21414%100.99787%4.06000%
ghc-7.8.1-O125.83736%101.95419%2.69422%
ghc-7.8.1-O2108.39722%104.95349%5.73485%
ghc-7.8.1-Odph105.03926%103.22124%4.84274%
ghc-7.10.1-O127.98183%102.34756%2.75954%
ghc-7.10.1-O2102.85067%102.41790%9.33225%
ghc-7.10.1-Odph100.00000%100.00000%6.77481%
ghc-8.0.1-O133.31102%100.93763%4.93499%
ghc-8.0.1-O2110.92294%104.53644%13.43539%
ghc-8.0.1-Odph111.79445%102.73758%14.19526%
csv

Input: '500000'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 20 315.94924179.35284%100.00000%4.75023%8.51967%4.75023%315.05588
ghc-7.0.1-O2 20 247.26146140.36130%78.25987%4.28697%6.01725%3.35498%250.14663
ghc-7.0.1-Odph 20 230.46101130.82430%72.94242%5.61270%7.34278%4.09404%225.80699
ghc-7.2.1-O 20 322.08117182.83371%101.94079%6.32944%11.57236%6.45229%316.31996
ghc-7.2.1-O2 20 241.18585136.91240%76.33690%6.12874%8.39101%4.67849%249.92065
ghc-7.2.1-Odph 20 239.97532136.22522%75.95376%6.05435%8.24755%4.59850%248.69692
ghc-7.4.1-O 20 293.26112166.47362%92.81906%6.61504%11.01231%6.14002%295.88597
ghc-7.4.1-O2 20 237.66459134.91350%75.22240%10.40079%14.03207%7.82373%227.30083
ghc-7.4.1-Odph 20 232.04463131.72326%73.44364%6.09682%8.03092%4.47772%224.72262
ghc-7.6.1-O 20 252.18536143.15642%79.81832%10.23230%14.64820%8.16725%239.48244
ghc-7.6.1-O2 20 236.01201133.97540%74.69934%5.58017%7.47606%4.16835%242.55714
ghc-7.6.1-Odph 20 240.59158136.57505%76.14881%4.37306%5.97250%3.33003%243.66861
ghc-7.8.1-O 20 222.08167126.06765%70.29030%9.53521%12.02081%6.70233%213.78585
ghc-7.8.1-O2 20 203.33869115.42794%64.35802%13.93456%16.08437%8.96800%224.46873
ghc-7.8.1-Odph 20 193.52271109.85577%61.25120%14.99345%16.47117%9.18367%174.59754
ghc-7.10.1-O 20 224.36681127.36484%71.01356%9.30492%11.85119%6.60775%215.96249
ghc-7.10.1-O2 20 187.35506106.35462%59.29910%16.23312%17.26468%9.62610%168.81993
ghc-7.10.1-Odph 20 176.16071100.00000%55.75602%12.10915%12.10915%6.75158%167.63824
ghc-8.0.1-O 20 234.76313133.26645%74.30407%8.08572%10.77555%6.00802%226.35309
ghc-8.0.1-O2 20 205.60613116.71509%65.07568%14.91921%17.41297%9.70878%225.91291
ghc-8.0.1-Odph 20 204.56904116.12637%64.74744%15.69572%18.22687%10.16258%224.69804
csv

Input: '5000000'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 202979.82190180.28256%100.00000%4.61471%8.31951%4.61471%2909.28541
ghc-7.0.1-O2 202394.39002144.86327%80.35346%5.25409%7.61124%4.22184%2466.69975
ghc-7.0.1-Odph 202305.81689139.50450%77.38103%5.79157%8.07950%4.48158%2276.94280
ghc-7.2.1-O 202972.70456179.85195%99.76115%4.53032%8.14787%4.51950%2948.62822
ghc-7.2.1-O2 202263.47254136.94262%75.95999%5.16181%7.06872%3.92091%2193.75928
ghc-7.2.1-Odph 202281.65331138.04258%76.57012%5.86817%8.10057%4.49326%2188.85445
ghc-7.4.1-O 202699.89096163.34642%90.60578%5.72972%9.35929%5.19145%2644.19287
ghc-7.4.1-O2 202205.17985133.41585%74.00375%6.89397%9.19765%5.10180%2140.60477
ghc-7.4.1-Odph 202238.32931135.42143%75.11621%5.24638%7.10473%3.94088%2168.04751
ghc-7.6.1-O 202288.51091138.45747%76.80026%4.48989%6.21659%3.44825%2238.89082
ghc-7.6.1-O2 202251.20393136.20035%75.54827%6.04626%8.23503%4.56785%2199.34902
ghc-7.6.1-Odph 202221.76175134.41907%74.56022%5.47605%7.36086%4.08296%2179.34841
ghc-7.8.1-O 202029.44880122.78392%68.10638%3.23000%3.96592%2.19983%2001.91780
ghc-7.8.1-O2 201777.21077107.52324%59.64151%14.49399%15.58441%8.64444%1607.52109
ghc-7.8.1-Odph 201696.94019102.66678%56.94770%7.15235%7.34309%4.07310%1638.83791
ghc-7.10.1-O 202061.70487124.73545%69.18886%2.91486%3.63586%2.01676%2036.77132
ghc-7.10.1-O2 201678.11175101.52764%56.31584%12.05750%12.24170%6.79028%1551.09309
ghc-7.10.1-Odph 201652.86202100.00000%55.46848%14.46762%14.46762%8.02497%1540.63845
ghc-8.0.1-O 202178.77726131.81846%73.11770%8.63628%11.38421%6.31465%2082.94856
ghc-8.0.1-O2 201845.02728111.62621%61.91737%17.38712%19.40858%10.76565%1576.66104
ghc-8.0.1-Odph 201818.80262110.03959%61.03729%16.33200%17.97167%9.96861%1581.20341
csv

Input: '50000000'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 2028963.45773187.12771%100.00000%0.43343%0.81107%0.43343%28978.99009
ghc-7.0.1-O2 2022752.42366146.99933%78.55562%5.20988%7.65848%4.09265%22285.94547
ghc-7.0.1-Odph 2022357.84453144.45003%77.19329%5.46247%7.89054%4.21666%21656.01308
ghc-7.2.1-O 2028740.52126185.68736%99.23028%1.65385%3.07099%1.64112%28552.32061
ghc-7.2.1-O2 2022141.46612143.05204%76.44621%3.34562%4.78597%2.55760%21810.65860
ghc-7.2.1-Odph 2022296.51302144.05377%76.98153%4.38140%6.31157%3.37287%21803.90840
ghc-7.4.1-O 2025898.13637167.32322%89.41659%1.80944%3.02762%1.61794%25745.26650
ghc-7.4.1-O2 2021731.56439140.40374%75.03097%3.89786%5.47275%2.92460%21260.97830
ghc-7.4.1-Odph 2022218.83512143.55191%76.71334%8.40995%12.07264%6.45155%21268.43523
ghc-7.6.1-O 2022048.42252142.45091%76.12497%0.92185%1.31318%0.70176%21978.41017
ghc-7.6.1-O2 2021383.56522138.15538%73.82946%2.76205%3.81593%2.03921%21165.50254
ghc-7.6.1-Odph 2021308.19414137.66842%73.56923%2.79465%3.84735%2.05600%21139.30827
ghc-7.8.1-O 2019924.89223128.73116%68.79321%0.63499%0.81743%0.43683%19882.29380
ghc-7.8.1-O2 2015883.76295102.62214%54.84070%0.93387%0.95835%0.51214%15806.43472
ghc-7.8.1-Odph 2015904.29624102.75481%54.91159%1.05906%1.08824%0.58155%15808.89890
ghc-7.10.1-O 2020422.91656131.94880%70.51270%0.77478%1.02231%0.54632%20396.78589
ghc-7.10.1-O2 2015595.27691100.75829%53.84467%4.15240%4.18389%2.23585%15344.47656
ghc-7.10.1-Odph 2015477.90975100.00000%53.43944%1.77493%1.77493%0.94851%15318.80374
ghc-8.0.1-O 2020874.37002134.86556%72.07140%1.72113%2.32121%1.24044%20715.88275
ghc-8.0.1-O2 2016213.74289104.75409%55.98000%9.34927%9.79374%5.23372%15637.57100
ghc-8.0.1-Odph 2016923.61668109.34045%58.43093%11.15859%12.20086%6.52007%15821.52174
csv

pidigits

Program: '4'

The following plot shows the rel means (means / min means) per input distribution for every implementation.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O104.05886%103.52369%2.08132%
ghc-7.0.1-O2101.09837%100.80459%0.79061%
ghc-7.0.1-Odph100.89769%100.41255%0.97400%
ghc-7.2.1-O102.52961%101.54459%1.63977%
ghc-7.2.1-O2100.26510%100.19027%0.82340%
ghc-7.2.1-Odph100.63154%100.68136%0.91473%
ghc-7.4.1-O102.59618%101.16502%1.90963%
ghc-7.4.1-O2101.42887%101.00725%1.06782%
ghc-7.4.1-Odph101.42781%100.91488%0.79315%
ghc-7.6.1-O103.78756%102.38659%1.56007%
ghc-7.6.1-O2101.25189%100.86650%0.97733%
ghc-7.6.1-Odph100.97500%100.52388%0.80794%
ghc-7.8.1-O101.54824%101.40120%1.66701%
ghc-7.8.1-O2100.04855%100.06867%1.00831%
ghc-7.8.1-Odph100.13735%100.12401%1.05638%
ghc-7.10.1-O104.64943%101.65774%1.78565%
ghc-7.10.1-O2103.48419%101.03976%1.10791%
ghc-7.10.1-Odph103.55656%101.12696%1.03350%
ghc-8.0.1-O104.43428%102.03362%1.86458%
ghc-8.0.1-O2102.48520%100.73976%1.00302%
ghc-8.0.1-Odph101.67324%100.26461%0.87040%
csv

Input: '2000'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 20 82.34128109.27718%100.00000%9.03866%9.87720%9.03866%83.05856
ghc-7.0.1-O2 20 77.04672102.25063%93.56998%4.25092%4.34659%3.97758%76.03899
ghc-7.0.1-Odph 20 76.46476101.47830%92.86321%4.60022%4.66823%4.27192%74.75978
ghc-7.2.1-O 20 78.91149104.72542%95.83466%6.07145%6.35835%5.81855%78.91800
ghc-7.2.1-O2 20 75.71761100.48674%91.95583%3.83679%3.85546%3.52815%74.64561
ghc-7.2.1-Odph 20 76.54653101.58682%92.96252%3.80506%3.86544%3.53728%76.91825
ghc-7.4.1-O 20 78.48239104.15594%95.31354%6.16628%6.42255%5.87730%76.07850
ghc-7.4.1-O2 20 77.51842102.87663%94.14283%3.82396%3.93396%3.59998%77.70187
ghc-7.4.1-Odph 20 77.40649102.72809%94.00691%4.56160%4.68605%4.28822%76.41395
ghc-7.6.1-O 20 80.84804107.29545%98.18651%6.76273%7.25611%6.64009%80.34261
ghc-7.6.1-O2 20 77.22228102.48362%93.78319%4.43682%4.54701%4.16099%75.17787
ghc-7.6.1-Odph 20 76.64645101.71942%93.08386%4.32173%4.39604%4.02283%75.19810
ghc-7.8.1-O 20 78.02723103.55189%94.76076%6.75507%6.99500%6.40116%78.11925
ghc-7.8.1-O2 20 75.35085100.00000%91.51042%4.44502%4.44502%4.06766%75.50679
ghc-7.8.1-Odph 20 75.57745100.30072%91.78561%4.32152%4.33452%3.96654%75.24086
ghc-7.10.1-O 20 80.70261107.10244%98.00989%6.69768%7.17338%6.56439%81.68970
ghc-7.10.1-O2 20 79.11616104.99704%96.08323%5.54540%5.82251%5.32820%78.19914
ghc-7.10.1-Odph 20 79.27531105.20825%96.27651%4.95526%5.21334%4.77075%79.03151
ghc-8.0.1-O 20 80.95793107.44129%98.31997%8.36037%8.98249%8.21991%80.07200
ghc-8.0.1-O2 20 78.03062103.55639%94.76488%4.60960%4.77354%4.36828%77.72996
ghc-8.0.1-Odph 20 76.32640101.29467%92.69518%3.88822%3.93856%3.60419%75.39838
csv

Input: '6000'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 20 630.66846101.72626%100.00000%1.34035%1.36349%1.34035%627.69463
ghc-7.0.1-O2 15 623.21033100.52327%98.81742%0.54151%0.54434%0.53510%623.55578
ghc-7.0.1-Odph 20 624.27332100.69473%98.98597%0.64951%0.65403%0.64293%622.63870
ghc-7.2.1-O 20 631.44269101.85114%100.12276%1.30231%1.32641%1.30391%629.92145
ghc-7.2.1-O2 20 620.09988100.02155%98.32423%0.63412%0.63426%0.62350%618.83594
ghc-7.2.1-Odph 20 620.01738100.00825%98.31114%0.76404%0.76410%0.75113%619.23738
ghc-7.4.1-O 20 634.77679102.38893%100.65142%1.82255%1.86609%1.83442%632.55678
ghc-7.4.1-O2 20 624.31356100.70122%98.99235%0.65636%0.66096%0.64974%624.05662
ghc-7.4.1-Odph 15 625.85601100.95001%99.23693%0.49573%0.50044%0.49195%626.68672
ghc-7.6.1-O 20 634.35963102.32164%100.58528%1.05680%1.08133%1.06298%633.09057
ghc-7.6.1-O2 20 623.06223100.49938%98.79394%0.55549%0.55827%0.54879%622.69254
ghc-7.6.1-Odph 15 624.15153100.67508%98.96666%0.53404%0.53764%0.52852%624.24838
ghc-7.8.1-O 20 624.70871100.76495%99.05501%1.34576%1.35606%1.33304%623.26926
ghc-7.8.1-O2 20 619.96625100.00000%98.30304%0.66065%0.66065%0.64944%618.83870
ghc-7.8.1-Odph 20 620.65782100.11155%98.41269%0.68047%0.68123%0.66967%621.09769
ghc-7.10.1-O 20 642.40298103.61902%101.86065%1.46196%1.51487%1.48916%639.42276
ghc-7.10.1-O2 15 635.91847102.57308%100.83245%0.69032%0.70809%0.69607%634.93058
ghc-7.10.1-Odph 20 636.46868102.66183%100.91969%0.62557%0.64222%0.63132%636.79603
ghc-8.0.1-O 20 637.12106102.76706%101.02314%1.11121%1.14196%1.12258%637.16974
ghc-8.0.1-O2 15 631.68133101.88963%100.16060%0.53708%0.54723%0.53794%631.44371
ghc-8.0.1-Odph 20 631.64025101.88301%100.15409%0.85888%0.87505%0.86020%630.64804
csv

Input: '10000'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 201770.58549101.36189%100.00000%0.74421%0.75435%0.74421%1766.62487
ghc-7.0.1-O2 201756.07096100.53097%99.18024%0.21468%0.21582%0.21292%1755.45402
ghc-7.0.1-Odph 201755.92499100.52261%99.17200%0.30925%0.31087%0.30669%1755.66508
ghc-7.2.1-O 201765.11167101.04853%99.69085%0.55763%0.56347%0.55590%1761.98785
ghc-7.2.1-O2 151751.81910100.28756%98.94010%0.22946%0.23011%0.22702%1751.14757
ghc-7.2.1-Odph 201752.15023100.30652%98.95880%0.26327%0.26408%0.26053%1751.92720
ghc-7.4.1-O 201768.88113101.26432%99.90374%0.61965%0.62748%0.61905%1767.44872
ghc-7.4.1-O2 151759.44414100.72408%99.37075%0.48512%0.48863%0.48206%1755.85387
ghc-7.4.1-Odph 201757.59085100.61798%99.26608%0.22065%0.22202%0.21903%1757.46961
ghc-7.6.1-O 201778.80892101.83266%100.46445%0.53128%0.54102%0.53375%1780.45505
ghc-7.6.1-O2 151760.49095100.78400%99.42988%0.37877%0.38174%0.37661%1758.15429
ghc-7.6.1-Odph 201756.13481100.53462%99.18385%0.22852%0.22974%0.22665%1755.79998
ghc-7.8.1-O 151753.04038100.35748%99.00908%0.50959%0.51141%0.50454%1749.35109
ghc-7.8.1-O2 151749.34169100.14573%98.80018%0.34909%0.34960%0.34490%1747.26031
ghc-7.8.1-Odph 151746.79601100.00000%98.65641%0.40088%0.40088%0.39550%1745.75631
ghc-7.10.1-O 201803.90624103.26943%101.88191%0.58147%0.60048%0.59241%1801.76206
ghc-7.10.1-O2 151797.43728102.89910%101.51655%0.35524%0.36554%0.36063%1796.48684
ghc-7.10.1-Odph 151796.04101102.81916%101.43769%0.35612%0.36616%0.36124%1794.14956
ghc-8.0.1-O 201801.96490103.15829%101.77226%0.69779%0.71983%0.71016%1799.59760
ghc-8.0.1-O2 151782.04526102.01794%100.64723%0.40759%0.41582%0.41023%1780.77134
ghc-8.0.1-Odph 151778.99156101.84312%100.47476%0.19746%0.20110%0.19839%1779.31469
csv

spectralnorm

Program: '2'

The following plot shows the rel means (means / min means) per input distribution for every implementation.

img tex tex_standalone

mean score (gmean(mean / best mean))mean score std (gmean std(mean / best mean))mean rel std (gmean(std / mean))
ghc-7.0.1-O245.92842%102.11286%0.46653%
ghc-7.0.1-O2100.01665%100.02355%0.41970%
ghc-7.0.1-Odph100.02122%100.02186%0.37354%
ghc-7.2.1-O251.82116%103.45179%0.63541%
ghc-7.2.1-O2113.84413%103.94095%0.23547%
ghc-7.2.1-Odph114.05358%103.76282%0.25968%
ghc-7.4.1-O316.96827%104.69649%0.41197%
ghc-7.4.1-O2225.06829%104.56930%1.24459%
ghc-7.4.1-Odph223.38024%105.20251%1.06356%
ghc-7.6.1-O239.23338%104.43558%0.70645%
ghc-7.6.1-O2123.84085%104.24641%0.80491%
ghc-7.6.1-Odph123.80146%104.20235%0.68232%
ghc-7.8.1-O207.09968%104.42429%0.30292%
ghc-7.8.1-O2118.61736%104.10727%0.61499%
ghc-7.8.1-Odph118.60935%104.06190%0.56549%
ghc-7.10.1-O208.89350%103.73416%0.43679%
ghc-7.10.1-O2118.56827%103.62354%0.69206%
ghc-7.10.1-Odph118.39410%103.75874%0.69992%
ghc-8.0.1-O207.94941%104.15313%0.44331%
ghc-8.0.1-O2118.34274%103.97720%0.63974%
ghc-8.0.1-Odph118.54108%103.95741%0.67283%
csv

Input: '500'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 20 370.54190245.30675%100.00000%2.46399%6.04434%2.46399%367.90456
ghc-7.0.1-O2 20 151.05247100.00000%40.76529%2.16871%2.16871%0.88408%150.44508
ghc-7.0.1-Odph 20 151.12996100.05130%40.78620%2.03693%2.03797%0.83078%150.88186
ghc-7.2.1-O 20 372.40203246.53820%100.50200%2.55341%6.29513%2.56623%371.79499
ghc-7.2.1-O2 20 165.97599109.87970%44.79277%1.94951%2.14211%0.87324%164.43145
ghc-7.2.1-Odph 20 166.90141110.49234%45.04252%2.18330%2.41238%0.98341%165.51166
ghc-7.4.1-O 20 459.72849304.35020%124.06923%1.93453%5.88776%2.40016%456.40333
ghc-7.4.1-O2 15 328.85562217.70953%88.74992%2.76650%6.02293%2.45526%327.06099
ghc-7.4.1-Odph 15 323.34887214.06394%87.26378%2.24441%4.80447%1.95855%321.54607
ghc-7.6.1-O 20 346.55717229.42834%93.52712%2.78290%6.38476%2.60277%345.52699
ghc-7.6.1-O2 15 179.78282119.02012%48.51889%1.84879%2.20044%0.89701%179.28403
ghc-7.6.1-Odph 20 179.90016119.09780%48.55056%2.02401%2.41056%0.98267%178.02147
ghc-7.8.1-O 20 300.87038199.18270%81.19740%2.52711%5.03356%2.05195%299.49466
ghc-7.8.1-O2 20 172.58790114.25692%46.57716%1.67243%1.91087%0.77897%171.57760
ghc-7.8.1-Odph 20 172.71968114.34416%46.61273%1.94108%2.21951%0.90479%172.13319
ghc-7.10.1-O 20 304.68313201.70682%82.22636%2.29852%4.63627%1.88999%303.79164
ghc-7.10.1-O2 20 174.50940115.52900%47.09573%2.46996%2.85352%1.16324%174.41953
ghc-7.10.1-Odph 20 173.13771114.62091%46.72554%1.82974%2.09726%0.85496%173.19726
ghc-8.0.1-O 20 302.16451200.03944%81.54665%1.94401%3.88878%1.58527%300.13998
ghc-8.0.1-O2 15 172.81121114.40476%46.63743%2.06806%2.36596%0.96449%172.80909
ghc-8.0.1-Odph 20 173.14620114.62653%46.72783%1.77555%2.03525%0.82968%173.69433
csv

Input: '3000'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 2012414.30163240.03686%100.00000%0.40570%0.97384%0.40570%12402.24871
ghc-7.0.1-O2 205174.41491100.04995%41.68108%0.23358%0.23369%0.09736%5171.07341
ghc-7.0.1-Odph 205171.83138100.00000%41.66027%0.19281%0.19281%0.08032%5170.01140
ghc-7.2.1-O 2012680.81880245.19010%102.14686%0.47972%1.17621%0.49001%12687.64511
ghc-7.2.1-O2 155780.95850111.77778%46.56692%0.06997%0.07821%0.03258%5782.47796
ghc-7.2.1-Odph 205781.38730111.78607%46.57038%0.20091%0.22458%0.09356%5778.23770
ghc-7.4.1-O 2016011.86179309.59752%128.97916%0.25433%0.78741%0.32804%16007.53888
ghc-7.4.1-O2 1511297.08810218.43497%91.00059%0.86061%1.87988%0.78316%11270.54340
ghc-7.4.1-Odph 1511226.31249217.06648%90.43048%0.72786%1.57993%0.65820%11190.70875
ghc-7.6.1-O 2012152.53511234.97547%97.89141%0.40392%0.94912%0.39541%12150.19512
ghc-7.6.1-O2 156292.32803121.66537%50.68612%0.59380%0.72245%0.30098%6274.78677
ghc-7.6.1-Odph 206286.88847121.56020%50.64230%0.42035%0.51098%0.21288%6278.34404
ghc-7.8.1-O 1510484.07371202.71492%84.45158%0.11140%0.22583%0.09408%10481.87485
ghc-7.8.1-O2 156022.85608116.45500%48.51546%0.36866%0.42932%0.17886%6014.53037
ghc-7.8.1-Odph 206020.45120116.40850%48.49609%0.44175%0.51424%0.21423%6010.37609
ghc-7.10.1-O 2010636.24398205.65721%85.67734%0.46573%0.95781%0.39903%10657.01215
ghc-7.10.1-O2 205984.56424115.71460%48.20701%0.38025%0.44000%0.18331%5974.17594
ghc-7.10.1-Odph 206006.47182116.13820%48.38349%0.64616%0.75044%0.31264%5999.60791
ghc-8.0.1-O 1510568.94531204.35595%85.13524%0.25626%0.52367%0.21816%10572.73348
ghc-8.0.1-O2 205994.51166115.90694%48.28714%0.35014%0.40583%0.16907%5986.98572
ghc-8.0.1-Odph 206004.48577116.09980%48.36749%0.38090%0.44223%0.18423%5996.49143
csv

Input: '5500'

The following plot shows the actual distribution of the measurements for each implementation.

img tex tex_standalone

nmeanmean / best meanmean / mean of first implstd / meanstd / best meanstd / mean of first implmedian
ghc-7.0.1-O 2040670.68900252.60313%100.00000%0.10157%0.25658%0.10157%40687.36732
ghc-7.0.1-O2 1516100.62758100.00000%39.58779%0.14594%0.14594%0.05778%16094.96154
ghc-7.0.1-Odph 1516102.61935100.01237%39.59269%0.13271%0.13273%0.05254%16102.86637
ghc-7.2.1-O 2042533.61581264.17365%104.58051%0.20944%0.55328%0.21903%42521.24431
ghc-7.2.1-O2 2019342.01767120.13207%47.55763%0.09570%0.11497%0.04551%19335.72481
ghc-7.2.1-Odph 1519339.69597120.11765%47.55193%0.03992%0.04795%0.01898%19340.99120
ghc-7.4.1-O 1554415.05652337.96854%133.79428%0.14210%0.48027%0.19013%54398.64822
ghc-7.4.1-O2 1538599.89397239.74155%94.90838%0.80973%1.94126%0.76850%38530.39270
ghc-7.4.1-Odph 1538622.53472239.88217%94.96405%0.73645%1.76661%0.69936%38496.27640
ghc-7.6.1-O 2040892.01815253.97779%100.54420%0.31365%0.79660%0.31536%40897.17312
ghc-7.6.1-O2 2021117.72998131.16091%51.92371%0.47503%0.62305%0.24665%21075.62582
ghc-7.6.1-Odph 2021102.06737131.06363%51.88520%0.37336%0.48935%0.19372%21076.15467
ghc-7.8.1-O 1535419.61041219.98900%87.08879%0.09873%0.21720%0.08598%35422.41567
ghc-7.8.1-O2 1520195.14288125.43078%49.65528%0.37725%0.47319%0.18733%20153.55308
ghc-7.8.1-Odph 2020183.70374125.35973%49.62715%0.21089%0.26437%0.10466%20158.28584
ghc-7.10.1-O 1535379.61456219.74059%86.99045%0.07785%0.17106%0.06772%35381.73301
ghc-7.10.1-O2 2020075.62455124.68846%49.36141%0.35292%0.44005%0.17421%20044.68894
ghc-7.10.1-Odph 1520072.15654124.66692%49.35288%0.29001%0.36154%0.14313%20039.32409
ghc-8.0.1-O 1535417.09438219.97338%87.08260%0.17488%0.38470%0.15229%35407.89545
ghc-8.0.1-O2 1520123.99384124.98888%49.48034%0.36159%0.45195%0.17892%20078.72571
ghc-8.0.1-Odph 2020152.68039125.16705%49.55087%0.45036%0.56370%0.22316%20111.10169
csv