benchmark_runner

• The console utility benchmark_runner now supports [Glob][Glob] syntax when entering a path.
• Added asyncGroup, a dedicated asynchronous benchmark group that can be awaited.
• Eliminated the use of FutureOr.
• Fixed bug in measureAsync.
• Requires Dart 3.13 (uses primary constructor syntax).

• Updated dependencies.
• Applied suggested lints.

• Simplified methods measure and measureAsync.
• Added README.md to folder gnuplot.

Breaking changes:

• The functions benchmark and asyncBenchmark are not longer generic and now have the optional parameters: warmUpDuration, sampleSize, customEmitter.
• The classes Benchmark and AsyncBenchmark were renamed ScoreGenerator and AsyncScoreGenerator,respectively, They no longer inherit from BenchmarkBase and AsyncBenchmarkBase and are now solely responsible for generating benchmark scores. As such, the constructor parameters description and emitter have been removed.
• Generating the benchmark reports is delegated to ScoreEmitter.
• The function sampleSize now returns an object of type SampleSize instead of a record.
• The default score emitter is now StatsEmitter. To emit a report that is similar to that printed by benchmark_harness use MeanEmitter.

Breaking changes:

• The command benchmark_runner now has subcommands report and export.
• The functions benchmark and asyncBenchmark are now generic and accept the optional parameters:
  • E extents ColorPrintEmitter emitter,
  • report(instance, emitter){}, where instance is an instance of Benchmark or AsyncBenchmark, respectively. The callback can be can be used to pass benchmark scores to the emitter.

• Changed default encoding of standard output of benchmark processes to Utf8Codec(). This enables the correct output of histograms in windows terminals with utf8 support.

• Updated docs.
• Amended error reporting.
• Formatted executable.

• Fixed bug in function blockHistogram that surfaced when the inter-quartile-range iqr of the score sample is zero.
• Made benchmark report more compact.

• Format.
• Amended link in docs.

• Made [BenchmarkHelper.sampleSize][sampleSize] a variable assignable with a user defined function. This allows changing the score sample generation customizing the relation between the single score estimate and the score sample size.

• Fixed bugs in runner (results were listed twice, exit code was always 0).

• Added progress indicator to output generated by benchmark_runner.
• Results are now printed as soon as the individual process returns.

• Amended all links referencing the API documentation. (/doc/api -> /latest).

• Added extension BenchmarkHelper.
• Improved calculation of sample size.
• Extended docs, added image.
• Added class Score.

• Added tests for class Stats.
• ColorEmitter now scales benchmark score stats (that are larger than 1000 us).
• Added class Score.

• Updated dependencies.

• Updated dependencies.
• Amended README.md.

• Amended package description.
• Formated files.
• Amended tags.

• Initial version