Skip to content

@doublewordai doublewordai

Change the repository type filter

All

    Repositories list

    48 repositories

    • outlet-postgres

      Public
      A plugin for the https://github.com/doublewordai/outlet middleware, for publishing requests & responses through an axum server to postgres
      Rust
      •
      MIT License
      •0•0•2•6•Updated Apr 28, 2026Apr 28, 2026

    • control-layer

      Public
      The world’s fastest AI model gateway (450x less overhead than LiteLLM). Unified access to LLMs across endpoints (openAI, self-hosted, etc.) behind a single auth…
      gatewayopenaillm
      gatewayopenaillm
      Rust
      •
      Apache License 2.0
      •9•64•19•23•Updated Apr 28, 2026Apr 28, 2026

    • onwards

      Public
      A router for openAI compatible endpoints
      routerself-hostedopenai-api
      routerself-hostedopenai-apigenerative-ai
      Rust
      •
      MIT License
      •2•1•3•14•Updated Apr 28, 2026Apr 28, 2026

    • fusillade

      Public
      Batched LLM request processing daemon with efficient request coalescing and per-model concurrency control
      Rust
      •1•1•3•9•Updated Apr 28, 2026Apr 28, 2026

    • control-layer-chart

      Public
      A Helm chart for the Doubleword control layer
      Go Template
      •
      Apache License 2.0
      •0•0•1•4•Updated Apr 28, 2026Apr 28, 2026

    • outlet

      Public
      A high-performance Axum middleware for capturing and correlating HTTP requests and responses with full streaming support.
      Rust
      •
      MIT License
      •0•2•2•6•Updated Apr 28, 2026Apr 28, 2026

    • inference-lab

      Public
      High-performance LLM inference simulator for analyzing serving systems
      Rust
      •
      MIT License
      •0•2•1•11•Updated Apr 28, 2026Apr 28, 2026

    • shenron-configs

      Public
      Public Shenron release configs
      0•0•0•0•Updated Apr 28, 2026Apr 28, 2026

    • dynamo

      Public
      A Datacenter Scale Distributed Inference Serving Framework
      Rust
      •
      Other
      •1.1k•0•0•1•Updated Apr 28, 2026Apr 28, 2026

    • sglang

      Public
      SGLang is a high-performance serving framework for large language models and multimodal models.
      Python
      •
      Apache License 2.0
      •5.6k•0•4•1•Updated Apr 28, 2026Apr 28, 2026

    • batchbench

      Public
      Rust
      •0•0•0•2•Updated Apr 27, 2026Apr 27, 2026

    • langchain-doubleword

      Public
      Langchain <> Doubleword integration
      Python
      •
      MIT License
      •0•0•0•2•Updated Apr 27, 2026Apr 27, 2026

    • llamaindex-doubleword

      Public
      Python
      •0•0•0•0•Updated Apr 27, 2026Apr 27, 2026

    • vercel-doubleword

      Public
      TypeScript
      •0•0•0•0•Updated Apr 27, 2026Apr 27, 2026

    • blog

      Public
      TypeScript
      •0•0•0•1•Updated Apr 24, 2026Apr 24, 2026

    • autobatcher

      Public
      Drop-in AsyncOpenAI replacement that transparently batches requests
      Python
      •
      MIT License
      •1•15•2•8•Updated Apr 23, 2026Apr 23, 2026

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •16k•0•0•5•Updated Apr 21, 2026Apr 21, 2026

    • torch_memory_saver

      Public
      Allow torch tensor memory to be released and resumed later
      Python
      •
      MIT License
      •50•0•0•5•Updated Apr 20, 2026Apr 20, 2026

    • documentation

      Public
      Developer documentation for DoubleWord products
      TypeScript
      •0•0•0•0•Updated Apr 20, 2026Apr 20, 2026

    • inference-lab-web

      Public
      Interactive web interface for the Inference Lab LLM simulator
      TypeScript
      •
      MIT License
      •0•0•1•10•Updated Apr 19, 2026Apr 19, 2026

    • silt

      Public
      Rust
      •
      MIT License
      •0•1•1•10•Updated Apr 19, 2026Apr 19, 2026

    • docs

      Public
      Documentation for Doubleword AI Products.
      documentationdoubleword
      documentationdoubleword
      CSS
      •1•0•1•9•Updated Apr 19, 2026Apr 19, 2026

    • arbiter

      Public
      DeBERTa inference server for sequence classification
      Rust
      •0•0•2•10•Updated Apr 19, 2026Apr 19, 2026

    • dw

      Public
      Rust
      •
      MIT License
      •0•2•0•1•Updated Apr 16, 2026Apr 16, 2026

    • criu

      Public
      CRIU v4.2 fork for warmstart experiments
      C
      •
      Other
      •1•0•0•4•Updated Apr 15, 2026Apr 15, 2026

    • doubleword-skill

      Public
      Claude Code skill for working with the Doubleword Batch API
      1•1•0•0•Updated Apr 13, 2026Apr 13, 2026

    • use-cases

      Public
      Batch API use case implementations
      Python
      •0•0•0•1•Updated Apr 8, 2026Apr 8, 2026

    • containerd

      Public
      An open and reliable container runtime
      Go
      •
      Apache License 2.0
      •3.9k•0•0•2•Updated Apr 7, 2026Apr 7, 2026

    • qlm

      Public
      QLM - Query Language for Models
      Rust
      •
      MIT License
      •0•0•1•9•Updated Mar 31, 2026Mar 31, 2026

    • dwocr

      Public
      Python
      •
      MIT License
      •0•0•0•1•Updated Mar 19, 2026Mar 19, 2026
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.