Problem
I recently struggled a bit with supplying —override-preset X in (turboderp-org/exllamav3#199).
I found it confusing that tabbyAPI searches for literal sampler_overrides directory in the current working directory. The documentation doesn’t preclude this behaviour, but it feels unexpected? The docs suggest adding a new override to existing sampler_overrides directory hinting that the binary would search for (dirname <binary>)/sampler_overrides.
Solution
Maybe adjust the docstring to make it clear how the search happens. Alternatively, ditch the builtin path transformation mechanism and accept a full path to override.yml file instead. That makes it clear and explicit which file will be read.
Alternatives
No response
Explanation
To make it more explicit what happens.
Examples
No response
Additional context
No response
Acknowledgements
Problem
I recently struggled a bit with supplying
—override-preset Xin (turboderp-org/exllamav3#199).I found it confusing that tabbyAPI searches for literal
sampler_overridesdirectory in the current working directory. The documentation doesn’t preclude this behaviour, but it feels unexpected? The docs suggest adding a new override to existingsampler_overridesdirectory hinting that the binary would search for(dirname <binary>)/sampler_overrides.Solution
Maybe adjust the docstring to make it clear how the search happens. Alternatively, ditch the builtin path transformation mechanism and accept a full path to override.yml file instead. That makes it clear and explicit which file will be read.
Alternatives
No response
Explanation
To make it more explicit what happens.
Examples
No response
Additional context
No response
Acknowledgements