For better visualization in tensorboard, hyper-parameter plugin could be used. There is a guide [here](https://tensorflow.google.cn/tensorboard/hyperparameter_tuning_with_hparams?hl=zh-cn).