feat request: resume evaluation from an output dir

[ifififa]

How to resume running from a output dir such that we can rollout a large dataset (even if some error occurring during running )

[estsauver]

I think this is already being worked on! Check out issue #579 and PR #803 (The PR looks close to merging too.)

[mikasenghaas]

indeed, #803 is merged now! let us know if this works for your usecase and if you have any problems with it!