Skip to content

xPyD-hub/xPyD

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 

Repository files navigation

xPyD

Meta-package for the xPyD ecosystem. Installs all components:

pip install xpyd

This installs:

  • xpyd-proxy — Lightweight Prefill-Decode proxy for disaggregated LLM serving
  • xpyd-sim — OpenAI-compatible LLM inference simulator
  • xpyd-bench — Benchmarking & PD ratio planning tool
  • xpyd-acc — PD disaggregation accuracy diagnostic tool
  • xpyd-plan — PD ratio planner for optimal node allocation

Individual packages can also be installed separately:

pip install xpyd-proxy  # proxy only
pip install xpyd-sim    # simulator only
pip install xpyd-bench  # benchmark only
pip install xpyd-acc    # accuracy diagnostic only
pip install xpyd-plan   # ratio planner only

License

Apache 2.0

About

xPyD meta-package: pip install xpyd installs xpyd-proxy + xpyd-sim

Resources

Stars

Watchers

Forks

Packages

 
 
 

Contributors