INT8 Quantized TFLite Support Status

Only a subset of tflite ops supports INT8 data type. If your model includes an unsupported op, the quantized converter will raise an error.

You can check all INT8 ops below:

  • ADD

  • AVERAGE_POOL_2D

  • CONCATENATION

  • CONV_2D

  • DEPTHWISE_CONV_2D

  • FULLY_CONNECTED

  • L2_NORMALIZATION

  • LOGISTIC

  • MAX_POOL_2D

  • MUL

  • RESHAPE

  • RESIZE_BILINEAR

  • SOFTMAX

  • SPACE_TO_DEPTH

  • TANH

  • PAD

  • GATHER

  • BATCH_TO_SPACE_ND

  • SPACE_TO_BATCH_ND

  • TRANSPOSE

  • MEAN

  • SUB

  • SUM

  • SQUEEZE

  • LOG_SOFTMAX

  • MAXIMUM

  • ARG_MAX

  • MINIMUM

  • LESS

  • PADV2

  • GREATER

  • GREATER_EQUAL

  • LESS_EQUAL

  • SLICE

  • EQUAL

  • NOT_EQUAL

  • SHAPE

  • QUANTIZE

  • RELU

  • LEAKY_RELU

Note that CONCATENATION is in the supported op list, but we recommend that you avoid using it. CONCATENATION will bring additional quantization error and may lead to significant degradation of accuracy.