2
$\begingroup$

I'm trying to understand the basics of quantization in Neural networks. Quantization tries to convert a neural network that uses floating point arithmetic to one that uses a lower precision integer arithmetic (mostly during inference). While searching around about it, I ran into the Gemmlow documentation that gives a good introduction to the concept.

I understood most of what they mention in that documentation except the first sentence of the Quantization as an affine map section that mentions that in order for the arithmetic to map from floating point to integer directly, only affine functions might work.

Now I understand the basics of affine function a bit, but I couldn't really understand why only affine functions make sense. Could someone explain if there's any property of affine functions that might be missing in other types of functions which make this statement true.

$\endgroup$
1
  • $\begingroup$ No precise statement here, just free-associating: Perhaps related to the fact that integer-weighted relu networks are tropical rational maps? arxiv.org/abs/1805.07091 $\endgroup$
    – Neal
    Commented Mar 18, 2022 at 15:15

0

You must log in to answer this question.

Browse other questions tagged .