Skip to content

readme.md

Latest commit

 

History

History
39 lines (26 loc) · 1.37 KB

readme.md

File metadata and controls

39 lines (26 loc) · 1.37 KB

oke >< (wiiiiip)

not the best, but an oke way to use llamacpp

packages

all packages are on jsr under the @oke scope. if you use pnpm or yarn (or deno obviously) they already support jsr.

universal

  • JSR @oke/grammar: dynamically generate gbnf grammars. this is the only one that isn't designed for exclusively function calling!
  • TODO [@oke/pedantic]: generate a standard schema and a gbnf at the same time
  • JSR @oke/client: llama-server api client

for deno

  • JSR @oke/manage: start and stop llama-server from within your application

for the browser

  • TODO [@oke/stores]: reactive stores for frontend stuff
  • TODO [@oke/hump]: an example frontend built on sveltekit

license

oke is licensed under BSL 1.1 with an Additional Use Grant permitting use (including commercially!) as long as your software doesn't interface with closed source models. see license.md for more info.

give me money if you find this useful or your employer hates the license