Skip to content
Change the repository type filter

All

    Repositories list

    • A plugin for the https://github.com/doublewordai/outlet middleware, for publishing requests & responses through an axum server to postgres
      Rust
      MIT License
      0026Updated Apr 28, 2026Apr 28, 2026
    • The world’s fastest AI model gateway (450x less overhead than LiteLLM). Unified access to LLMs across endpoints (openAI, self-hosted, etc.) behind a single auth…
      Rust
      Apache License 2.0
      9641923Updated Apr 28, 2026Apr 28, 2026
    • onwards

      Public
      A router for openAI compatible endpoints
      Rust
      MIT License
      21314Updated Apr 28, 2026Apr 28, 2026
    • fusillade

      Public
      Batched LLM request processing daemon with efficient request coalescing and per-model concurrency control
      Rust
      1139Updated Apr 28, 2026Apr 28, 2026
    • A Helm chart for the Doubleword control layer
      Go Template
      Apache License 2.0
      0014Updated Apr 28, 2026Apr 28, 2026
    • outlet

      Public
      A high-performance Axum middleware for capturing and correlating HTTP requests and responses with full streaming support.
      Rust
      MIT License
      0226Updated Apr 28, 2026Apr 28, 2026
    • High-performance LLM inference simulator for analyzing serving systems
      Rust
      MIT License
      02111Updated Apr 28, 2026Apr 28, 2026
    • Public Shenron release configs
      0000Updated Apr 28, 2026Apr 28, 2026
    • dynamo

      Public
      A Datacenter Scale Distributed Inference Serving Framework
      Rust
      Other
      1.1k001Updated Apr 28, 2026Apr 28, 2026
    • sglang

      Public
      SGLang is a high-performance serving framework for large language models and multimodal models.
      Python
      Apache License 2.0
      5.6k041Updated Apr 28, 2026Apr 28, 2026
    • Rust
      0002Updated Apr 27, 2026Apr 27, 2026
    • Langchain <> Doubleword integration
      Python
      MIT License
      0002Updated Apr 27, 2026Apr 27, 2026
    • Python
      0000Updated Apr 27, 2026Apr 27, 2026
    • TypeScript
      0000Updated Apr 27, 2026Apr 27, 2026
    • blog

      Public
      TypeScript
      0001Updated Apr 24, 2026Apr 24, 2026
    • Drop-in AsyncOpenAI replacement that transparently batches requests
      Python
      MIT License
      11528Updated Apr 23, 2026Apr 23, 2026
    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      Apache License 2.0
      16k005Updated Apr 21, 2026Apr 21, 2026
    • Allow torch tensor memory to be released and resumed later
      Python
      MIT License
      50005Updated Apr 20, 2026Apr 20, 2026
    • Developer documentation for DoubleWord products
      TypeScript
      0000Updated Apr 20, 2026Apr 20, 2026
    • Interactive web interface for the Inference Lab LLM simulator
      TypeScript
      MIT License
      00110Updated Apr 19, 2026Apr 19, 2026
    • silt

      Public
      Rust
      MIT License
      01110Updated Apr 19, 2026Apr 19, 2026
    • docs

      Public
      Documentation for Doubleword AI Products.
      CSS
      1019Updated Apr 19, 2026Apr 19, 2026
    • arbiter

      Public
      DeBERTa inference server for sequence classification
      Rust
      00210Updated Apr 19, 2026Apr 19, 2026
    • dw

      Public
      Rust
      MIT License
      0201Updated Apr 16, 2026Apr 16, 2026
    • criu

      Public
      CRIU v4.2 fork for warmstart experiments
      C
      Other
      1004Updated Apr 15, 2026Apr 15, 2026
    • Claude Code skill for working with the Doubleword Batch API
      1100Updated Apr 13, 2026Apr 13, 2026
    • use-cases

      Public
      Batch API use case implementations
      Python
      0001Updated Apr 8, 2026Apr 8, 2026
    • An open and reliable container runtime
      Go
      Apache License 2.0
      3.9k002Updated Apr 7, 2026Apr 7, 2026
    • qlm

      Public
      QLM - Query Language for Models
      Rust
      MIT License
      0019Updated Mar 31, 2026Mar 31, 2026
    • dwocr

      Public
      Python
      MIT License
      0001Updated Mar 19, 2026Mar 19, 2026
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.