How to require multiple files from the same directory in guild.yml?

General
4

Thank you! This was very helpful.

For future reference, the cheatsheet has a section under Dependencies describing the resources and select directive.

I needed to add an appropriate flag under requires to point to the information under resources, so the code ended up like this.


- model: modelname
  operations:
    train:
      sourcecode:
        - exclude: '*.ipynb'
        - exclude: '*.md'
        - exclude: '.git*'
      requires: data
      main: src.modelname
      output-scalars:
        - step: 'epoch: (\step)'
        - train_loss: 'train_loss: (\value)'
        - loss: 'valid_loss: (\value)'
      flags:
         dataset = '01.npy'
  resources:
    data:
      - file: './path/to/data/'
        select:
          - '.*\.npy' # regex pattern
        target-type: link
        target-path: 'path/to/data/'
1 Like