I want to call something like data/*
under required files. Is this possible?
Basically, I have different datasets as parameters to my problem that I call via flags. Listing each dataset by name is not robust. Can I require all of them somehow? Thanks!
- model: modelname
operations:
train:
sourcecode:
- exclude: '*.ipynb'
- exclude: '*.md'
- exclude: '.git*'
requires:
- file: figs
target-type: link
- file: data/*
target-type: link
main: src.modelname
output-scalars:
- step: 'epoch: (\step)'
- train_loss: 'train_loss: (\value)'
- loss: 'valid_loss: (\value)'
flags:
dataset = '01.npy'
...