Add first_token_offset_in_batch to indicate the offset of the request's first token in a BatchConfig
#3392
| Job | Run time |
|---|---|
| 1s | |
| 1s |