[Feature]: Add Quantization Support using TorchAO

[Josephrp]

Area

No response

Problem to solve

It would be nice to push quants automatically after the training pipeline

Proposed solution

• add quantization options to the ./launch script
• add quantization (scripts) to the quantization folder
• add quantized demo templates
• add quantization to the interface.py (automatically)
• add quantization configs
• add quantization aware training

Alternatives considered

No response

Estimated difficulty

expert

Priority / impact

{"priority" => "medium"}

Additional context

No response