TensorBoardLog with MPI

Created by: jwnys

Not sure this can be solved in netket, but when using TensorBoardLog with MPI, I'm getting errors.

MWE (mpitest.py):

import netket as nk
logger = nk.logging.TensorBoardLog("test_mpi_log")

When you run the above with

mpirun -np 4 python ./mpitest.py

You'll see messages like:

KeyError: 'test_mpi_log'

FileExistsError: [Errno 17] File exists: 'test_mpi_log'
Traceback (most recent call last):
  File "/usr/local/anaconda3/envs/localjw/lib/python3.8/site-packages/tensorboardX/record_writer.py", line 47, in directory_check
    factory = REGISTERED_FACTORIES[prefix]