I was curious if there’s an idiomatic Guild way to run a batch of runs that are dependent on a batch of prior runs. To be concrete, suppose I run a batch of train runs. Also suppose I have an evaluation operation called
eval_op that requires a train run (so the model checkpoint can be loaded in). It would be neat if something like this worked:
guild run eval_op train=[<run id 1>, <run id 2>, ...]
However, instead I have to type the runs out individually with each run id and also lose out on keeping it organized by batching them together. Full disclosure on context here: I did some hyperparameter optimization and I want to do some additional evaluation over each model.
Perhaps I missed something in the docs! Or if not, perhaps this could be a convenient feature?