TensorBoard is a visualization toolkit with allows the user to track and visualize metrics such as loss and accuracy, visualize the model graph, histograms, projects embeddings and much more.
Although Tensorboard was created by the TensorFlow people, it can also be used with PyTorch. This gist shows how one can do this.