C:\Users\sarat.chinni\Codes_sequencing\biobench\sandbox\Sarat\incorp_basecalling (feature/incorp_basecalling -> origin)
(biobench-thMxqAli) λ guild tensorboard
Preparing runs for TensorBoard
ERROR: error removing C:\Users\SARAT~1.CHI\AppData\Local\Temp\guild-tensorboard-88wle55x: [WinError 3] The system cannot find the path specified: "C:\\Users\\SARAT~1.CHI\\AppData\\Local\\Temp\\guild-tensorboard-88wle55x\\d83224a9 dnn_classifier_train 2021-03-24 17_18_48 batch_size=32 dense_activation=relu dense_units='128 128' drop_out=0.0 fileName=black_and_white_1sec.pickle l2_decay=0.001 num_epochs=100 seed=42 verify_saved=no"
Traceback (most recent call last):
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.8_3.8.2288.0_x64__qbz5n2kfra8p0\lib\runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.8_3.8.2288.0_x64__qbz5n2kfra8p0\lib\runpy.py", line 87, in _run_code
exec(code, run_globals)
File "C:\Users\sarat.chinni\.virtualenvs\biobench-thMxqAli\Scripts\guild.exe\__main__.py", line 7, in <module>
File "c:\users\sarat.chinni\.virtualenvs\biobench-thmxqali\lib\site-packages\guild\main_bootstrap.py", line 40, in main
_main()
File "c:\users\sarat.chinni\.virtualenvs\biobench-thmxqali\lib\site-packages\guild\main_bootstrap.py", line 66, in _main
guild.main.main()
File "c:\users\sarat.chinni\.virtualenvs\biobench-thmxqali\lib\site-packages\guild\main.py", line 33, in main
main_cmd.main(standalone_mode=False)
File "c:\users\sarat.chinni\.virtualenvs\biobench-thmxqali\lib\site-packages\click\core.py", line 829, in __call__
return self.main(*args, **kwargs)
File "c:\users\sarat.chinni\.virtualenvs\biobench-thmxqali\lib\site-packages\click\core.py", line 782, in main
rv = self.invoke(ctx)
File "c:\users\sarat.chinni\.virtualenvs\biobench-thmxqali\lib\site-packages\click\core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "c:\users\sarat.chinni\.virtualenvs\biobench-thmxqali\lib\site-packages\click\core.py", line 1066, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "c:\users\sarat.chinni\.virtualenvs\biobench-thmxqali\lib\site-packages\click\core.py", line 610, in invoke
return callback(*args, **kwargs)
File "c:\users\sarat.chinni\.virtualenvs\biobench-thmxqali\lib\site-packages\guild\click_util.py", line 213, in fn
return fn0(*(args + (Args(**kw),)))
File "c:\users\sarat.chinni\.virtualenvs\biobench-thmxqali\lib\site-packages\guild\commands\tensorboard.py", line 108, in tensorboard
tensorboard_impl.main(args)
File "c:\users\sarat.chinni\.virtualenvs\biobench-thmxqali\lib\site-packages\guild\commands\tensorboard_impl.py", line 46, in main
_run_tensorboard(args)
File "c:\users\sarat.chinni\.virtualenvs\biobench-thmxqali\lib\site-packages\guild\commands\tensorboard_impl.py", line 94, in _run_tensorboard
monitor.run_once(exit_on_error=True)
File "c:\users\sarat.chinni\.virtualenvs\biobench-thmxqali\lib\site-packages\guild\run_util.py", line 89, in run_once
self._refresh_logdir(runs)
File "c:\users\sarat.chinni\.virtualenvs\biobench-thmxqali\lib\site-packages\guild\run_util.py", line 97, in _refresh_logdir
self.refresh_run_cb(run, path)
File "c:\users\sarat.chinni\.virtualenvs\biobench-thmxqali\lib\site-packages\guild\tensorboard.py", line 275, in f
return _refresh_run(run, run_logdir, state)
File "c:\users\sarat.chinni\.virtualenvs\biobench-thmxqali\lib\site-packages\guild\tensorboard.py", line 281, in _refresh_run
_refresh_tfevent_links(run, run_logdir, state)
File "c:\users\sarat.chinni\.virtualenvs\biobench-thmxqali\lib\site-packages\guild\tensorboard.py", line 292, in _refresh_tfevent_links
_init_tfevent_link(tfevent_path, link, run, state)
File "c:\users\sarat.chinni\.virtualenvs\biobench-thmxqali\lib\site-packages\guild\tensorboard.py", line 304, in _init_tfevent_link
util.ensure_dir(link_dir)
File "c:\users\sarat.chinni\.virtualenvs\biobench-thmxqali\lib\site-packages\guild\util.py", line 74, in ensure_dir
os.makedirs(d)
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.8_3.8.2288.0_x64__qbz5n2kfra8p0\lib\os.py", line 213, in makedirs
makedirs(head, exist_ok=exist_ok)
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.8_3.8.2288.0_x64__qbz5n2kfra8p0\lib\os.py", line 223, in makedirs
mkdir(name, mode)
FileNotFoundError: [WinError 3] The system cannot find the path specified: "C:\\Users\\sarat.chinni\\AppData\\Local\\Temp\\guild-tensorboard-88wle55x\\d83224a9 dnn_classifier_train 2021-03-24 17_18_48 batch_size=32 dense_activation=relu dense_units='128 128' drop_out=0.0 fileName=black_and_white_1sec.pickle l2_decay=0.001 num_epochs=100 seed=42 verify_saved=no"
1 Like
I have the same problem. I think the issue is that the filename created by guild ai is too long! Shortening the filename by shortening the names of the operations and hyperparameters is really unsatisfactory. Does anybody know another workaround/solution?
Try running with a label for your operation guild run OP --label MY_EXPERIMENT
1 Like
That works 
Ugh, I’m glad you’re able to work around that but that’s an awful bug in Guild. I’ll take a look at this now and see if there’s a solution that doesn’t require you to hack the filename this way!
This issue should be fixed in the forthcoming 0.7.5. There was a bug that wasn’t correctly truncating the filename.