You need to do some work for this. We’re working on streamlining the interface for this functionality, but in the meantime, this should get you what you need:
Overview
A queue is a long-running runs implemented by the built-in queue operation. A queue is used to start staged runs.
Queues can be used to:
Schedule runs
Run operations in parallel
Assign runs to GPUs
To start a queue, run:
guild run queue
Once running, a queue looks for a staged run and starts it when the all of the following are true:
If started with wait-for-running and the queue is not waiting for a run to complete
The staged run is compatible with the queue GPU affinity
A q…
Overview
Important Dask schedulers are experimental in Guild. The functionality outlined in this document is available as a pre-release in Guild 0.7.3.rc2 and later. To install the latest pre-release, run pip install --upgrade --pre guildai,
Guild 0.7.3 introduces support for running operations in parallel using Dask.distributed . Dask based scheduling is implemented by the built-in dask:scheduler operation. A Dask scheduler is similar to a Guild queues . Unlike a queue, a Dask scheduler is c…