Resnet50 Test Quantization
CoreMLTools 8.01b, M4 iPad Pro 16GB, iPad OS18.1 beta

8-bit
resnet50-LUT8-iOS17.mlpackage 1.08 ms
resnet50-W8A8-iOS17.mlpackage 0.81 ms
4-bit
resnet50-LUT4-iOS17.mlpackage 0.93 ms
resnet50-W4A8-iOS18.mlpackage 0.68 ms