Hi all!
Quick question/feature request:
Can I stop running a model while it's running? (aka cancel a request) Sometimes my model takes so long to process, and new information comes in that warrants me canceling and re-prompting.
Importantly, I don't want this stopping function to unload the model from memory.
Thanks!
Hi all!
Quick question/feature request:
Can I stop running a model while it's running? (aka cancel a request) Sometimes my model takes so long to process, and new information comes in that warrants me canceling and re-prompting.
Importantly, I don't want this stopping function to unload the model from memory.
Thanks!