Prerequisites
Feature Description
Adding a statisics with speed of parsing promt token, like webui has for token generation.
Ideally show:
context: xxx / max (Y%)
input: ... / xxx (Z%)
A.B t/s
Motivation
Right now webui has nice progress and speed for token generation, but when it on parsing large input, for 10k or 20k tokens... user see just Processing... for quite a while.
Possible Implementation
No response
Prerequisites
Feature Description
Adding a statisics with speed of parsing promt token, like webui has for token generation.
Ideally show:
context: xxx / max (Y%)input: ... / xxx (Z%)A.B t/sMotivation
Right now webui has nice progress and speed for token generation, but when it on parsing large input, for 10k or 20k tokens... user see just
Processing...for quite a while.Possible Implementation
No response