This repository was archived by the owner on Oct 23, 2023. It is now read-only.
This repository was archived by the owner on Oct 23, 2023. It is now read-only.
Resolve fixed-point datatypes for Quant nodes #53
When querying the output datatype of
Quantnodes, the current implementation only supports identifying quantization cases the corespond to integers. Everything else is set toFLOAT32.In cases where the scale is global and is a negative power of two, we can resolve the datatype as
FIXED<>instead.See also relevant discussion: #52 (comment)_