<p>You can try using <a href="https://docs.nvidia.com/deeplearning/tensorrt/developer-guide/index.html#work-with-qat-networks" rel="nofollow noreferrer">TensorRT library</a>.</p>

<p>One of the features of the library is quantization.
In general mobilenets are difficult to quantize (see <a href="https://arxiv.org/pdf/2004.09602.pdf" rel="nofollow noreferrer">https://arxiv.org/pdf/2004.09602.pdf</a>) but the library should do a good work</p>
Quantization of mobilenet-ssd
<p>I wanted to quantize (change all the floats into INT8) a ssd-mobilenet model and then want to deploy it onto my raspberry-pi. So far, I have not yet found any thing which can help me with it. Any help would be highly appreciated. 
I saw tensorflow-lite but it seems it only supports android and iOS. 
Any library/framweork is acceptable.</p>

<p>Thanks in advance.</p>