LLM runner to expose maximum context length to user #16726
Description
🚀 The feature, motivation and pitch
User like android app can then limit the input size to users
Alternatives
No response
Additional context
No response
RFC (Optional)
No response