[Chore] Task list for serve/server changes

[gh0st-ryder]

Tracking follow up from the recently PR review:

• Fix hardcoded paths {hardcoded conf path}, {example_workflows path}
• logging package: unify with E2S loguru instead of logging
• worker.py: remove too many globals
• config.py: Env overrides for config values need to be controlled
• cpu_worker.py: Legacy infer request cleanup vestiges to be eliminated
• redis_client in main.py: Re-work to use app.state for FastAPI
• status response should invoke Python; status.sh script should call this python instead
• Eliminate the dual endpoint paths
• WorkflowRegistry should be a singleton.
• Trim docker image size and clean up dockerfile as needed

[JiwaniZakir]

Several of these items share a common architectural root: the server module appears to have been developed with tightly coupled, module-level state (globals in worker.py, hardcoded paths, the redis_client not scoped to app.state) rather than leveraging FastAPI's dependency injection and lifespan patterns. The WorkflowRegistry singleton and the dual endpoint paths likely stem from the same incremental growth — functionality added ad-hoc rather than through a unified routing/registry design. The status.sh → Python inversion and the loguru unification are relatively self-contained, but the globals, config overrides, and app.state refactor will need to be sequenced carefully since cpu_worker.py legacy cleanup may expose implicit dependencies on those globals before they're removed.