Code

Add MLflow logs to evaluate job#220

Code

Merged

sfmig merged 19 commits intomainSainsburyWellcomeCentre/crabs-exploration:mainfrom smg/eval-bash-script-clusterSainsburyWellcomeCentre/crabs-exploration:smg/eval-bash-script-clusterCopy head branch name to clipboardNov 1, 2024

+148-57

Commits

Commits on Oct 29, 2024

• Define mlflow experiment and run name with reference to the trained model

  sfmig

  committed
  4ce3b8b

• First draft bash script

  sfmig

  committed
  4a72125

• add script to select best model

  sfmig

  committed
  6b68641

• Add checkpoint path to evaluation run name

  sfmig

  committed
  e110eb5

• Fix ruff

  sfmig

  committed
  b35f727

• Remove select best model empty script

  sfmig

  committed
  e6cfb6a

• Log dataset info and trained model info to mlflow

  sfmig

  committed
  c4b4b33

• Print MLflow details to screen

  sfmig

  committed
  c91c65e

• Small edits to comments

  sfmig

  committed
  43f2fe9

Commits on Oct 30, 2024

• Rename output folder for evaluationr results

  sfmig

  committed
  f255532

Commits on Oct 31, 2024

• Move run_name assignment to constructor and remove option of defining it based on training job run name

  sfmig

  committed
  6bedbab

• Add name of checkpoint file to MLflow logs

  sfmig

  committed
  0f7117f

• Remove option to define run name from train job run name from evaluate utils

  sfmig

  committed
  9bd6763

• Adapt test to generalise to other output directory names (still not fixed for batch size > 1, see PR 232

  sfmig

  committed
  3744021

• Evaluate on the validation split by default, and optionally on the test split

  sfmig

  committed
  bcd46e6

• Update readme to add --save_frames flag to evaluate section

  sfmig

  committed
  832a37b

• Simpify CLI help for experiment name

  sfmig

  committed
  ff30a86

Commits on Nov 1, 2024

• Remove bash script (see PR 236)

  sfmig

  committed
  8e41668

• Clarify CLI help

  sfmig

  committed
  1c35f52