Skip to content

Latest commit

 

History

History
27 lines (21 loc) · 753 Bytes

File metadata and controls

27 lines (21 loc) · 753 Bytes

xPyD

Meta-package for the xPyD ecosystem. Installs all components:

pip install xpyd

This installs:

  • xpyd-proxy — Lightweight Prefill-Decode proxy for disaggregated LLM serving
  • xpyd-sim — OpenAI-compatible LLM inference simulator
  • xpyd-bench — Benchmarking & PD ratio planning tool
  • xpyd-acc — PD disaggregation accuracy diagnostic tool
  • xpyd-plan — PD ratio planner for optimal node allocation

Individual packages can also be installed separately:

pip install xpyd-proxy  # proxy only
pip install xpyd-sim    # simulator only
pip install xpyd-bench  # benchmark only
pip install xpyd-acc    # accuracy diagnostic only
pip install xpyd-plan   # ratio planner only

License

Apache 2.0