github.com/c-bata/goptuna

Changelog

CHANGES

Minor improvements

• Add options to skip an initial portion of Sobol' sequence (#208)

Minor bug fixes

• Fix less comparator of DataGrid component on Web Dashboard (#225).

API Changes (not breaking changes)

• Rename options for Asynchronous Successive Halving Pruner (56bbce2)

CHANGES

Support a new sampler based on Sobol's Quasi-random Sequence

Goptuna now supports Sobol based sampler. See the paper S. Joe and F. Y. Kuo, Remark on Algorithm 659: Implementing Sobol's quasirandom sequence generator, ACM Trans. Math. Softw. 29, 49-57 (2003). for details.

Usage is like this:

import (
	"github.com/c-bata/goptuna"
	"github.com/c-bata/goptuna/sobol"
)

func main() {
	study, err := goptuna.CreateStudy(
		"goptuna-example",
		goptuna.StudyOptionRelativeSampler(sobol.NewSampler()),  // Set Sobol based sampler.
	)
	...
}

Add github.com/c-bata/gorm/rdb.v2

Add rdb.v2 package built on gorm v2.
So github.com/c-bata/goptuna/rdb package is now deprecated.

• Use gorm v2 package (#124).
• Fix duplicate trial numbers are assigned on parallel execution (#130).
• Add CASCADE ON DELETE constraints (#170).
• Drop schema compatibility with Optuna (#166).

Dashboard

• Add datetime_start column on top page of Dashboard (#169).
• Put select box to change the reload interval time on AppBar (#176).

Minor compatibility changes

• Include the upper bound of uniform/loguniform distributions (#205)

New features

Dashboard: filtering trials by state

You can now walk through trials by filtering and sorting.

Dashboard: Add button to delete a study

You can delete a study from dashboard.

New feature

Built-in Web Dashboard (#157)

You can download standalone binaries (JavaScript files are also embedded in these binaries) via GitHub release, then you can open Web dashboard like following command.

$ goptuna --version
goptuna version 0.7.0 (rev: e8db5dc)
$ goptuna dashboard --storage sqlite:///example.db --host 127.0.0.1 --port 8000

Goptuna's RDB storage backend is compatible with Optuna. So this CLI is able to visualize Optuna's optimization results.

Improvements

• Faster TPE categorical sampling (#152)

Bug fixes

• Fix log message of pruned trials (#150)
• Calculate logLikeLihoodsAbove from samplesBelow (#151)

New feature

• Support IPOP-CMA-ES and BI-POP-CMA-ES algorithm (#131, #135, #136, #141)
  • Please check the benchmark results on two-dimensional Rastrigin function at #141.
  • Auger, A., Hansen, N.: A restart CMA evolution strategy with increasing population size. In: Proceedings of the 2005 IEEE Congress on Evolutionary Computation (CEC’2005), pp. 1769–1776 (2005a)
  • Hansen N. Benchmarking a BI-Population CMA-ES on the BBOB-2009 Function Testbed. In the workshop Proceedings of the Genetic and Evolutionary Computation Conference, GECCO, pages 2389–2395. ACM, 2009.
• Add BlackHoleStorage towards 100k+ evaluations (#105)
• Add TPE sampler options (#127)

API changes

Pruning (Early-stopping) APIs are changed without backward compatibility.

While I added an example which uses successive halving pruner at #120, I found a lot of issues. I'm sure that nobody uses pruning functionalities (I also confirmed that Kubeflow/Katib and sile/kurobako-go does not use pruning functionalities). So I fixes those issues. And I merge it without backward compatibility.

• Fix typo of OptionSetReductionFactor
• Alter the argument of trial.ShouldPrune() and remove trial.Report().

Some APIs are renamed without breaking changes.

These changes are added with backward compatibilities. Older functions are deprecated.

• Rename RandomSearchSampler to RandomSampler (#137).
• Rename StudyOptionSetDirection to StudyOptionDirection (#138).
• Rename StudyOptionSetTrialNotifyChannel to StudyOptionTrialNotifyChannel (#138).

Minor bug fixes

• Fix IntUniformDistribution.ToExternalRepr() (#102)
• Fix IntUniformDistributions.Contains() (#103)
• Fix a bug when set attrs multiple times (#121)
• CMA-ES: fix numerical overflow errors (#126)
• Fix a bug of successive halving pruner (#120)

Example

• Add an example of Gorgonia hyperparameter optimization with early stopping (ASHA) (#118, #119 and #120)

In this release, some internal methods made public for Kubeflow/Katib.

New feature

• Add study option to define search space (#99)

For Developers

• Public API to call relative sampler for Kubeflow/Katib (#100)

Others

• Generate stringer code for trial state (#101)

From this release, new suggest API SuggestStepInt for step-interval integer parameter is available.
SuggestUniform, SuggestLogUniform and SuggestDiscreteUniform are deprecated. These APIs are renamed to Suggest...Float API.

New feature

• Suggest int parameter with step (#98)

API changes

• Rename SuggestUniform to SuggestFloat (#96)

This release supports CMA-ES sampler and compatible with the RDB schema of Optuna v1.3.0.

New feature

• CMA-ES sampler (#93)

Internal chages

• Make StudyAttrs/UserAttrs more readable (#89)
• Add number field in trials table (#88)

Bug fixes

• Fix concurrency problems of EnqueuTrial (#92)

Compatibility with Optuna RDB storage

This release has compatibility with Optuna v1.3.0.

This release supports enqueue_trial and has compatibility with the RDB schema of Optuna v1.2.0.

New feature

• Experimental support of EnqueueTrial (#86)

Bug fixes

• Fix trial number on RDB storage (#87)

Compatibility with Optuna RDB storage

This release has compatibility with Optuna v1.2.0.