wandb for tracking of training runs

[LckyLke]

we could add wandb for tracking of loss curves, hyperparameters, eval results,...

https://github.com/wandb/wandb

[alkidbaci]

Did you try this out?

[LckyLke]

Yes you just have to provide an api key and call their log function with, e.g. a loss value