Skip to content

Use Optuna directly instead of via Ray Tune for tuning #1026

@mdekstrand

Description

@mdekstrand

It will be easier to integrate with sensible reporting if we just use Optuna directly, instead of via Ray Tune, to tune hyperparameters.

We can still support using Ray for that parallelism, and possibly even keep a simple version of Ray Tune support around, but a lot of the support code is fussing around to get Ray to play nicely with logging, progress, etc., which will be simpler in the common case with Optuna.

However, Optuna does not directly support checkpoint resuming, so that may be sub-optimal.

Metadata

Metadata

Assignees

Projects

Status

Backlog

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions