Similarly to what has been described in this thread, running the following command results in hanging for a while before we see any results:
guild run train
The Guild file contains the following:
train: main: script
The script is simply:
I believe the hanging is related to the fact that I have a data folder which contains thousands of files each corresponding to a sample of the dataset I’m using in my experiments. This is because:
- When using the
--debugflag, Guild hangs just after copying one
.csvfile within the data folder (none of the thousands of sample files are copied to the target directory, though).
- When I remove the data folder, the hanging stops.
My questions are:
- Is this a bug? If so, how can I circumvent this issue?
- How am I supposed to make my dataset accessible by the training script, since it is run from a totally different directory and there are thousands of files it needs to access?