FunctionLevel Support Status¶
ONNX Support Status¶
 Note
In this document, the numbers in the header of all tables represent the version of onnx opset.
 ONNX Version
1.6.0
Import¶
✓: onnx specification defined, and supported.
X: onnx specification defined, but not support yet.
Empty: Not defined (Support status follows latest).
Total: 93/155
ONNX Operator 
1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
NNabla Func 
Description 

Abs 
✓ 
✓ 
Abs 

Acos 
✓ 
ACos 

Acosh 
✓ 
ACosh 

Add 
✓ 
✓ 
✓ 
Add2, Reshape 

And 
✓ 
✓ 
✓ 
LogicalAnd, Reshape 

ArgMax 
✓ 
✓ 
X 
✓ 
Max 

ArgMin 
✓ 
✓ 
X 
✓ 
Min 

Asin 
✓ 
ASin 

Asinh 
✓ 
ASinh 

Atan 
✓ 
ATan 

Atanh 
✓ 
ATanh 

AveragePool 
✓ 
✓ 
✓ 
X 
X 
Pad, AveragePooling 
Not all features are verified, since some features are not supported by caffe2. Those features can be verified by ONNXRuntime when opset > 6. Some feature is not supported by Nnabla such as Pad’s edge mode. if opset >= 10, the ceil_mode is not supported. 

BatchNormalization 
X 
X 
X 
✓ 
BatchNormalization 

BitShift 
X 
Not yet implemented. 

Cast 
✓ 
✓ 
X 
Log, Abs 

Ceil 
✓ 
✓ 
Ceil 

Clip 
✓ 
✓ 
✓ 
Identity, MinimumScalar, MaximumScalar 

Compress 
X 
X 
Not yet implemented. 

Concat 
✓ 
✓ 
✓ 
X 
Concatenate 

ConcatFromSequence 
X 
Not yet implemented. 

Constant 
✓ 
✓ 
X 
X 
Identity 

ConstantOfShape 
✓ 
Constant 

Conv 
✓ 
✓ 
X 
Convolution 

ConvInteger 
X 
Not yet implemented. 

ConvTranspose 
✓ 
✓ 
X 
Pad, Deconvolution 

Cos 
✓ 
Cos 

Cosh 
✓ 
Cosh 

CumSum 
X 
Not yet implemented. 

DepthToSpace 
✓ 
✓ 
✓ 
Reshape, Transpose 

DequantizeLinear 
X 
Not yet implemented. 

Det 
X 
Not yet implemented. 

Div 
✓ 
✓ 
✓ 
Reshape, Div2 

Dropout 
X 
X 
✓ 
X 
Identity 

DynamicQuantizeLinear 
X 
Not yet implemented. 

Elu 
✓ 
✓ 
ELU 

Equal 
✓ 
✓ 
✓ 
X 
Reshape, Equal 

Erf 
X 
Not yet implemented. 

Exp 
✓ 
✓ 
Exp 

Expand 
✓ 
✓ 
Reshape, Broadcast 

EyeLike 
X 
Not yet implemented. 

Flatten 
✓ 
✓ 
✓ 
✓ 
Reshape 

Floor 
✓ 
✓ 
Floor 

GRU 
X 
X 
X 
Not yet implemented. 

Gather 
✓ 
✓ 
✓ 
Concatenate, Slice 

GatherElements 
X 
Not yet implemented. 

GatherND 
X 
Not yet implemented. 

Gemm 
✓ 
✓ 
✓ 
✓ 
✓ 
BatchMatmul, Add2, MulScalar, Reshape 

GlobalAveragePool 
✓ 
✓ 
GlobalAveragePooling 

GlobalLpPool 
X 
X 
Not yet implemented. 

GlobalMaxPool 
X 
Not yet implemented. 

Greater 
✓ 
✓ 
✓ 
✓ 
Greater, Reshape 

HardSigmoid 
✓ 
✓ 
MulScalar, AddScalar, HardSigmoid, MaximumScalar, MinimumScalar 

Hardmax 
✓ 
✓ 
✓ 
Max, Reshape, OneHot 

Identity 
✓ 
✓ 
Identity 

If 
X 
Not yet implemented. 

InstanceNormalization 
✓ 
✓ 
Concatenate, BatchNormalization, Reshape, Split 

IsInf 
✓ 
IsInf 

IsNaN 
✓ 
IsNaN 

LRN 
✓ 
✓ 
MulScalar, SumPooling, Div2, AddScalar, Transpose, PowScalar 

LSTM 
X 
X 
Not yet implemented. 

LeakyRelu 
✓ 
✓ 
LeakyReLU 

Less 
✓ 
✓ 
✓ 
✓ 
Less, Reshape 

Log 
✓ 
✓ 
Log 

LogSoftmax 
✓ 
✓ 
✓ 
Log, Reshape, Sum, Add2, Max, Exp, Sub2 

Loop 
X 
X 
Not yet implemented. 

LpNormalization 
X 
Not yet implemented. 

LpPool 
X 
X 
X 
Not yet implemented. 

MatMul 
✓ 
✓ 
✓ 
BatchMatmul 

MatMulInteger 
X 
Not yet implemented. 

Max 
✓ 
✓ 
✓ 
✓ 
Maximum2 

MaxPool 
✓ 
✓ 
X 
X 
X 
Pad, MaxPooling 
Not all features are verified, since some features are not supported by caffe2. Those features can be verified by ONNXRuntime. if opset >= 10, the ceil_mode is not supported, dilations is not equal to 1 is not supported. 

MaxRoiPool 
X 
Not yet implemented. 

MaxUnpool 
X 
X 
Not yet implemented. 

Mean 
✓ 
✓ 
✓ 
✓ 
Mean, Broadcast, Stack 

MeanVarianceNormalization 
X 
Not yet implemented. 

Min 
✓ 
✓ 
✓ 
✓ 
Minimum2 

Mod 
X 
Not yet implemented. 

Mul 
✓ 
✓ 
✓ 
Reshape, Mul2 

Multinomial 
X 
Not yet implemented. 

Neg 
✓ 
✓ 
MulScalar 

NonMaxSuppression 
X 
X 
Not yet implemented. 

NonZero 
X 
Not yet implemented. 

Not 
✓ 
✓ 
LogicalNot 

OneHot 
X 
X 
Not yet implemented. 

Or 
✓ 
✓ 
✓ 
Reshape, LogicalOr 

PRelu 
✓ 
✓ 
X 
X 
PReLU 

Pad 
✓ 
✓ 
✓ 
✓ 
Pad 
Onnx required to support “edge” mode, while nnabla does not support it. 

Pow 
✓ 
✓ 
✓ 
Pow2, Reshape 

QLinearConv 
X 
Not yet implemented. 

QLinearMatMul 
X 
Not yet implemented. 

QuantizeLinear 
X 
Not yet implemented. 

RNN 
X 
X 
Not yet implemented. 

RandomNormal 
X 
Not yet implemented. 

RandomNormalLike 
X 
Not yet implemented. 

RandomUniform 
X 
Not yet implemented. 

RandomUniformLike 
X 
Not yet implemented. 

Range 
X 
Not yet implemented. 

Reciprocal 
✓ 
✓ 
RDivScalar 

ReduceL1 
X 
X 
Not yet implemented. 

ReduceL2 
X 
X 
Not yet implemented. 

ReduceLogSum 
X 
X 
Not yet implemented. 

ReduceLogSumExp 
X 
X 
Not yet implemented. 

ReduceMax 
✓ 
✓ 
✓ 
Max 

ReduceMean 
✓ 
✓ 
✓ 
Mean 

ReduceMin 
✓ 
✓ 
✓ 
Min 

ReduceProd 
✓ 
✓ 
✓ 
Prod 

ReduceSum 
✓ 
✓ 
✓ 
Sum 

ReduceSumSquare 
✓ 
✓ 
✓ 
Sum, PowScalar 

Relu 
✓ 
✓ 
ReLU 

Reshape 
✓ 
✓ 
✓ 
Reshape 

Resize 
X 
X 
Not yet implemented. 

ReverseSequence 
X 
Not yet implemented. 

RoiAlign 
X 
Not yet implemented. 

Round 
✓ 
Round 

Scan 
X 
X 
X 
Not yet implemented. 

Scatter 
X 
X 
Not yet implemented. 

ScatterElements 
X 
Not yet implemented. 

ScatterND 
X 
Not yet implemented. 

Selu 
✓ 
✓ 
SELU 

SequenceAt 
X 
Not yet implemented. 

SequenceConstruct 
X 
Not yet implemented. 

SequenceErase 
X 
Not yet implemented. 

SequenceInsert 
X 
Not yet implemented. 

SequenceLength 
X 
Not yet implemented. 

Shape 
X 
Not yet implemented. 

Shrink 
X 
Not yet implemented. 

Sigmoid 
✓ 
✓ 
Sigmoid 

Sign 
✓ 
Sign 

Sin 
✓ 
Sin 

Sinh 
✓ 
Sinh 

Size 
X 
Not yet implemented. 

Slice 
✓ 
✓ 
✓ 
X 
Slice 

Softmax 
✓ 
✓ 
✓ 
Reshape, Div2, Sum, Max, Exp, Sub2 

Softplus 
✓ 
✓ 
SoftPlus 

Softsign 
✓ 
✓ 
SoftSign 

SpaceToDepth 
✓ 
✓ 
Reshape, Transpose 

Split 
✓ 
✓ 
✓ 
✓ 
Split, Stack 

SplitToSequence 
X 
Not yet implemented. 

Sqrt 
✓ 
✓ 
PowScalar 

Squeeze 
✓ 
✓ 
✓ 
Reshape 

StringNormalizer 
X 
Not yet implemented. 

Sub 
✓ 
✓ 
✓ 
Sub2, Reshape 

Sum 
✓ 
✓ 
✓ 
✓ 
Add2 

Tan 
✓ 
Tan 

Tanh 
✓ 
✓ 
Tanh 

TfIdfVectorizer 
X 
Not yet implemented. 

ThresholdedRelu 
✓ 
GreaterScalar, Constant, Where 

Tile 
✓ 
✓ 
Tile 

TopK 
X 
X 
X 
Not yet implemented. 

Transpose 
✓ 
✓ 
Transpose 

Unique 
X 
Not yet implemented. 

Unsqueeze 
✓ 
✓ 
✓ 
Reshape 

Upsample 
✓ 
✓ 
✓ 
✓ 
X 
Unpooling 

Where 
✓ 
Where 

Xor 
✓ 
✓ 
✓ 
Reshape, LogicalXor 
Export¶
✓: Support to export this opset.
△: Partially support to export this opset (e.g. some cases cannot be supported, or not completely tested).
X: Supported, but test failed.
Empty: Not support corresponding opset version.
Total: 119/173
Neural Network Layer¶
Count 11/14
NNabla Function
6
7
9
10
11
ONNX Op
Description
Affine
✓
✓
✓
✓
✓
Reshape, Gemm
RNN
Not yet implemented.
LSTM
Not yet implemented.
GRU
Not yet implemented.
Convolution
✓
✓
✓
✓
✓
Reshape, Conv
DepthwiseConvolution
✓
✓
✓
✓
✓
Reshape, Conv
Deconvolution
✓
✓
✓
✓
✓
Reshape, ConvTranspose
Caffe2 and onnxruntime do not support dilations != 1.
DepthwiseDeconvolution
✓
✓
✓
✓
✓
Reshape, ConvTranspose
Caffe2 and onnxruntime do not support dilations != 1.
MaxPooling
✓
✓
✓
✓
X
Pad, Reshape, MaxPool
AveragePooling
△
△
△
△
X
Pad, Reshape, AveragePool
Currently only supports the cases where both ignore_border and including_pad are True.
GlobalAveragePooling
✓
✓
✓
✓
✓
GlobalAveragePool
SumPooling
X
✓
✓
✓
X
Mul, Reshape, Constant, AveragePool, Pad
Unpooling
△
✓
✓
✓
✓
Resize
The kernel only supports 2d on opset 6.
Embed
✓
✓
✓
✓
✓
Gather
Neural Network Activation Functions¶
Count 21/21
NNabla Function
6
7
9
10
11
ONNX Op
Description
Sigmoid
✓
✓
✓
✓
✓
Sigmoid
Swish
✓
✓
✓
✓
✓
Mul, Sigmoid
Tanh
✓
✓
✓
✓
✓
Tanh
ReLU
✓
✓
✓
✓
✓
Relu
LeakyReLU
✓
✓
✓
✓
✓
LeakyRelu
Softmax
△
✓
✓
✓
✓
Div, Sub, ReduceMax, ReduceSum, Exp
ONNX Add, Sub operator does not support multidirectional broadcasting on opset 6.
LogSoftmax
△
✓
✓
✓
✓
Log, Sub, ReduceMax, ReduceSum, Exp
ELU
✓
✓
✓
✓
✓
Elu
SELU
✓
✓
✓
✓
✓
Selu
CReLU
✓
✓
✓
✓
✓
Neg, Relu, Concat
CELU
✓
✓
✓
✓
✓
Elu, Neg, Concat
PReLU
✓
✓
✓
✓
✓
Reshape, PRelu
GELU
✓
✓
✓
✓
✓
Mul, Div, Add, Pow, Sqrt, Constant, Tanh
ReLU6
✓
✓
✓
✓
✓
Relu, Constant, Min
HardSigmoid
✓
✓
✓
✓
✓
HardSigmoid
HardTanh
✓
✓
✓
✓
✓
Neg, Constant, Min, Max
LogSigmoid
✓
✓
✓
✓
✓
Log, Sigmoid
SoftPlus
✓
✓
✓
✓
✓
Softplus
SoftSign
✓
✓
✓
✓
✓
Softsign
TanhShrink
✓
✓
✓
✓
✓
Sub, Tanh
Sinc
X
X
✓
✓
✓
Div, Where, Sin, Constant, Equal
Normalization¶
Count 1/6
NNabla Function
6
7
9
10
11
ONNX Op
Description
FusedBatchNormalization
X
X
X
X
X
Mul, Div, Sub, ReduceSum, BatchNormalization, Constant, ReduceMean, Relu
Not yet implemented.
BatchNormalization
✓
✓
✓
✓
✓
Mul, Div, Sub, Reshape, ReduceSum, BatchNormalization, Constant, ReduceMean
In inferring stage, caffe2 mistmatch onnx 1.4.x’s implementation, “inplace” feature cannot be applied.
SyncBatchNormalization
Not yet implemented.
MeanSubtraction
Not yet implemented.
ClipGradByValue
Not yet implemented.
ClipGradByNorm
Not yet implemented.
Reduction¶
Count 5/7
NNabla Function
6
7
9
10
11
ONNX Op
Description
Sum
✓
✓
✓
✓
✓
ReduceSum
Mean
✓
✓
✓
✓
✓
ReduceMean
Max
✓
✓
✓
✓
✓
ReduceMax
Min
✓
✓
✓
✓
✓
ReduceMin
Prod
✓
✓
✓
✓
✓
ReduceProd
ReduceSum
Not yet implemented.
ReduceMean
Not yet implemented.
Arithmetic¶
Count 11/12
NNabla Function
6
7
9
10
11
ONNX Op
Description
Add2
△
✓
✓
✓
✓
Add
ONNX Add operator does not support multidirectional broadcasting on opset 6.
BcAdd2
Not yet implemented.
Sub2
△
✓
✓
✓
✓
Sub
ONNX Sub operator does not support multidirectional broadcasting on opset 6.
Mul2
△
✓
✓
✓
✓
Mul
ONNX Mul operator does not support multidirectional broadcasting on opset 6.
Div2
△
✓
✓
✓
✓
Div
ONNX Div operator does not support multidirectional broadcasting on opset 6.
Pow2
△
✓
✓
✓
✓
Pow
ONNX Pow operator does not support multidirectional broadcasting on opset 6.
AddScalar
✓
✓
✓
✓
✓
Constant, Add
MulScalar
✓
✓
✓
✓
✓
Mul, Constant
PowScalar
✓
✓
✓
✓
✓
Constant, Pow
RSubScalar
✓
✓
✓
✓
✓
Constant, Sub
RDivScalar
✓
✓
✓
✓
✓
Div, Constant
RPowScalar
✓
✓
✓
✓
✓
Constant, Pow
Logical¶
Count 29/29
NNabla Function
6
7
9
10
11
ONNX Op
Description
Sign
X
X
✓
✓
✓
Sign
Minimum2
△
✓
✓
✓
✓
Constant, Min, Add
ONNX Add operator does not support multidirectional broadcasting on opset 6.
Maximum2
△
✓
✓
✓
✓
Max, Constant, Add
ONNX Add operator does not support multidirectional broadcasting on opset 6.
MinimumScalar
✓
✓
✓
✓
✓
Constant, Min, Add
MaximumScalar
✓
✓
✓
✓
✓
Max, Constant, Add
LogicalAnd
✓
✓
✓
✓
✓
And
LogicalOr
✓
✓
✓
✓
✓
Or
LogicalXor
✓
✓
✓
✓
✓
Xor
Equal
✓
✓
✓
✓
✓
Equal
NotEqual
✓
✓
✓
✓
✓
Not, Equal
GreaterEqual
✓
✓
✓
✓
✓
Not, Less
Greater
✓
✓
✓
✓
✓
Greater
LessEqual
✓
✓
✓
✓
✓
Not, Greater
Less
✓
✓
✓
✓
✓
Less
LogicalAndScalar
✓
✓
✓
✓
✓
And, Constant
LogicalOrScalar
✓
✓
✓
✓
✓
Or, Constant
LogicalXorScalar
✓
✓
✓
✓
✓
Constant, Xor
EqualScalar
✓
✓
✓
✓
✓
Constant, Equal
NotEqualScalar
✓
✓
✓
✓
✓
Not, Constant, Equal
GreaterEqualScalar
✓
✓
✓
✓
✓
Not, Less, Constant
GreaterScalar
✓
✓
✓
✓
✓
Constant, Greater
LessEqualScalar
✓
✓
✓
✓
✓
Not, Constant, Greater
LessScalar
✓
✓
✓
✓
✓
Less, Constant
LogicalNot
✓
✓
✓
✓
✓
Not
IsNaN
X
X
✓
✓
✓
IsNaN
IsInf
X
X
X
✓
✓
IsInf
ResetNaN
X
X
✓
✓
✓
Constant, Where, IsNaN
ResetInf
X
X
X
✓
✓
Constant, Where, IsInf
Where
X
X
✓
✓
✓
Where
Math¶
Count 22/22
NNabla Function
6
7
9
10
11
ONNX Op
Description
Constant
✓
✓
✓
✓
✓
Constant, Identity
Arange
✓
✓
✓
✓
✓
Constant, Identity
Abs
✓
✓
✓
✓
✓
Abs
Exp
✓
✓
✓
✓
✓
Exp
Log
✓
✓
✓
✓
✓
Log
Identity
✓
✓
✓
✓
✓
Identity
BatchMatmul
✓
✓
✓
✓
✓
MatMul, Reshape, Transpose
Round
X
X
X
X
✓
Round
Ceil
✓
✓
✓
✓
✓
Ceil
Floor
✓
✓
✓
✓
✓
Floor
Sin
X
✓
✓
✓
✓
Sin
Cos
X
✓
✓
✓
✓
Cos
Tan
X
✓
✓
✓
✓
Tan
Sinh
X
X
✓
✓
✓
Sinh
Cosh
X
X
✓
✓
✓
Cosh
ASin
X
✓
✓
✓
✓
Asin
ACos
X
✓
✓
✓
✓
Acos
ATan
X
✓
✓
✓
✓
Atan
ATan2
X
✓
✓
✓
✓
Div, Atan
ASinh
X
X
✓
✓
✓
Asinh
ACosh
X
X
✓
✓
✓
Acosh
ATanh
X
X
✓
✓
✓
Atanh
Array Manipulation¶
Count 12/19
NNabla Function
6
7
9
10
11
ONNX Op
Description
Concatenate
✓
✓
✓
✓
✓
Concat
Split
✓
✓
✓
✓
✓
Split, Squeeze
Stack
✓
✓
✓
✓
✓
Concat, Unsqueeze
Slice
△
△
△
△
△
Constant, Slice
ONNX slice cannot support step != 1 on opset < 10.
Pad
△
△
△
△
△
Pad, Constant
When the mode of the pad is reflect, if the size of the pad exceeds the input size, caffe2 and onnxruntime cannot handle it.
Transpose
✓
✓
✓
✓
✓
Transpose
Broadcast
X
X
✓
✓
✓
BroadcastTo
✓
✓
✓
✓
✓
Tile
✓
✓
✓
✓
✓
Constant, Reshape, Tile
OneHot
✓
✓
✓
✓
✓
Reshape, Gather, Flatten
Flip
✓
✓
✓
✓
✓
Identity, Transpose, Gather
Shift
Not yet implemented.
Sort
Not yet implemented.
Reshape
✓
✓
✓
✓
✓
Constant, Reshape
MatrixDiag
Not yet implemented.
MatrixDiagPart
Not yet implemented.
Assign
Not yet implemented.
GatherNd
Not yet implemented.
ScatterNd
Not yet implemented.
Signal Processing¶
Count 1/3
NNabla Function
6
7
9
10
11
ONNX Op
Description
Interpolate
X
X
X
△
✓
Reshape, Resize
FFT
Not yet implemented.
IFFT
Not yet implemented.
Stochasticity¶
Count 0/11
NNabla Function
6
7
9
10
11
ONNX Op
Description
Dropout
X
X
X
X
X
Dropout
The Dropout in nnabla has no test mode and contains random parameters, so the test result is not the same as onnx.
TopKData
Not yet implemented.
TopKGrad
Not yet implemented.
Rand
Not yet implemented.
Randint
Not yet implemented.
Randn
Not yet implemented.
RandomChoice
Not yet implemented.
RandomCrop
Not yet implemented.
RandomFlip
Not yet implemented.
RandomShift
Not yet implemented.
ImageAugmentation
Not yet implemented.
Loss Functions¶
Count 0/9
NNabla Function
6
7
9
10
11
ONNX Op
Description
SigmoidCrossEntropy
Not yet implemented.
BinaryCrossEntropy
Not yet implemented.
SoftmaxCrossEntropy
Not yet implemented.
CategoricalCrossEntropy
Not yet implemented.
SquaredError
Not yet implemented.
AbsoluteError
Not yet implemented.
HuberLoss
Not yet implemented.
EpsilonInsensitiveLoss
Not yet implemented.
KLMultinomial
Not yet implemented.
Quantization Neural Network Layers¶
Count 6/12
NNabla Function
6
7
9
10
11
ONNX Op
Description
BinarySigmoid
X
X
✓
✓
✓
Constant, Where, Greater
BinaryTanh
X
X
✓
✓
✓
Constant, Where, Greater
BinaryConnectAffine
✓
✓
✓
✓
✓
Reshape, Gemm
BinaryConnectConvolution
✓
✓
✓
✓
✓
Reshape, Conv
BinaryWeightAffine
✓
✓
✓
✓
✓
Mul, MatMul, Reshape, Add
BinaryWeightConvolution
✓
✓
✓
✓
✓
Mul, Add, Reshape, Conv
INQAffine
Not yet implemented.
INQConvolution
Not yet implemented.
FixedPointQuantize
Not yet implemented.
MinMaxQuantize
Not yet implemented.
Pow2Quantize
Not yet implemented.
Prune
Not yet implemented.
Validation¶
Count 0/3
NNabla Function
6
7
9
10
11
ONNX Op
Description
TopNError
Not yet implemented.
BinaryError
Not yet implemented.
ConfusionMatrix
Not yet implemented.
Unsupported, Special Use¶
Count 0/5
NNabla Function
6
7
9
10
11
ONNX Op
Description
VATNoise
Not yet implemented.
Unlink
Not yet implemented.
Sink
Not yet implemented.
NmsDetection2d
Not yet implemented.
MaxPoolingBackward
Not yet implemented.
Tensorflow Support Status¶
Import¶
✓: Supported
△: Partially supported
X: Supported, but test failed.
Empty: Not support yet.
Total: 85/120
Tensorflow Function 
Status 
NNabla Func 
Description 

Abs 
✓ 
Abs 

Acos 
✓ 
ACos 

Acosh 
✓ 
ACosh 

Add 
✓ 
Add2 

AddN 
✓ 
Add2 

All 
Not yet implemented. 

Any 
Not yet implemented. 

ArgMax 
✓ 
Max 

ArgMin 
✓ 
Min 

Asin 
✓ 
ASin 

Asinh 
✓ 
ASinh 

Atan 
✓ 
ATan 

Atan2 
Not yet implemented. 

Atanh 
✓ 
ATanh 

AvgPool 
△ 
Pad, Transpose, AveragePooling 
Some feature is not supported by Nnabla such as Pad’s edge mode. 
AvgPool3D 
Not yet implemented. 

BatchMatMul 
✓ 
BatchMatmul, Transpose 

BiasAdd 
✓ 
Add2, Reshape 

Cast 
Not yet implemented. 

Ceil 
✓ 
Ceil 

ConcatV2 
✓ 
Concatenate 

Const 
✓ 
Add2 

Conv2D 
△ 
Pad, Convolution, Transpose 
Tensorflow require GPU to perform related test cases. This issue is recorded only for memo. 
Conv2DBackpropFilter 
Not yet implemented. 

Conv2DBackpropInput 
△ 
Deconvolution, Transpose 
Tensorflow require GPU to perform related test cases. This issue is recorded only for memo. 
Conv3D 
Not yet implemented. 

Conv3DBackpropFilterV2 
Not yet implemented. 

Conv3DBackpropInputV2 
Not yet implemented. 

Cos 
✓ 
Cos 

Cosh 
✓ 
Cosh 

DepthToSpace 
△ 
Reshape, Transpose 
Tensorflow require GPU to perform related test cases. This issue is recorded only for memo. 
DepthwiseConv2dNative 
Not yet implemented. 

DepthwiseConv2dNativeBackpropFilter 
Not yet implemented. 

DepthwiseConv2dNativeBackpropInput 
Not yet implemented. 

Div 
✓ 
Div2 

Elu 
✓ 
ELU 

Equal 
✓ 
Equal 

Erf 
Not yet implemented. 

Erfc 
Not yet implemented. 

Exp 
✓ 
Exp 

ExpandDims 
✓ 
Reshape 

Fill 
Not yet implemented. 

Flatten 
✓ 
Reshape 

Floor 
✓ 
Floor 

FloorDiv 
✓ 
Floor, Div2 

FloorMod 
✓ 
Sub2, Floor, Mul2, Div2 

FusedBatchNorm 
X 
BatchNormalization, Transpose 
It did not pass testing for training mode. 
GatherNd 
Not yet implemented. 

GatherV2 
Not yet implemented. 

Greater 
✓ 
Greater 

GreaterEqual 
✓ 
Less, LogicalNot 

Identity 
✓ 
Identity 

IsInf 
Not yet implemented. 

IsNan 
✓ 
IsNaN 

LeakyRelu 
✓ 
LeakyReLU 

Less 
✓ 
Less 

LessEqual 
✓ 
Greater, LogicalNot 

Log 
✓ 
Log 

LogSoftmax 
Not yet implemented. 

LogicalAnd 
✓ 
LogicalAnd 

LogicalNot 
✓ 
LogicalNot 

LogicalOr 
✓ 
LogicalOr 

LogicalXor 
✓ 
LogicalAnd, LogicalNot, LogicalOr 

MatrixBandPart 
Not yet implemented. 

Max 
✓ 
Max 

MaxPool 
✓ 
Pad, MaxPooling, Transpose 

MaxPool3D 
Not yet implemented. 

MaxPoolWithArgmax 
Not yet implemented. 

Maximum 
✓ 
Maximum2 

Mean 
✓ 
Mean 

Min 
✓ 
Min 

Minimum 
✓ 
Minimum2 

Mul 
✓ 
Mul2 

Neg 
✓ 
MulScalar 

NotEqual 
✓ 
Equal, LogicalNot 

OneHot 
Not yet implemented. 

Pack 
✓ 
Concatenate, Reshape 

Pad 
✓ 
Pad 

Pow 
✓ 
Pow2 

Prod 
✓ 
Prod 

RandomShuffle 
Not yet implemented. 

RandomStandardNormal 
Not yet implemented. 

RandomUniform 
Not yet implemented. 

RealDiv 
✓ 
Div2 

Reciprocal 
✓ 
RDivScalar 

Relu 
✓ 
ReLU 

Relu6 
✓ 
MinimumScalar, MaximumScalar 

Reshape 
△ 
Reshape 
Some test cases failed for some nnabla’s implementation limitation (e.g. 1 is regarded as batch_size). 
ReverseSequence 
Not yet implemented. 

Rsqrt 
✓ 
RDivScalar, PowScalar 

Select 
Not yet implemented. 

Selu 
✓ 
SELU 

Shape 
Not yet implemented. 

Sigmoid 
✓ 
Sigmoid 

Sign 
✓ 
Sign 

Sin 
✓ 
Sin 

Sinh 
✓ 
Sinh 

Size 
Not yet implemented. 

Slice 
✓ 
Slice 

Softmax 
Not yet implemented. 

Softplus 
✓ 
SoftPlus 

Softsign 
✓ 
SoftSign 

SpaceToDepth 
△ 
Reshape, Transpose 
Tensorflow require GPU to perform related test cases. This issue is recorded only for memo. 
SplitV 
✓ 
Split, Stack 

Sqrt 
✓ 
PowScalar 

Square 
✓ 
Mul2 

SquaredDifference 
✓ 
Sub2, Mul2 

Squeeze 
✓ 
Reshape 

StopGradient 
✓ 
Identity 

StridedSlice 
✓ 
Slice 

Sub 
✓ 
Sub2 

Sum 
✓ 
Sum 

Tan 
✓ 
Tan 

Tanh 
✓ 
Tanh 

Tile 
✓ 
Tile 

TopKV2 
Not yet implemented. 

Transpose 
✓ 
Transpose 

TruncateDiv 
Not yet implemented. 

TruncateMod 
Not yet implemented. 

Unpack 
✓ 
Concatenate, Reshape, Stack, Split 
Export¶
✓: Supported
△: Partially supported
X: Supported, but test failed.
Empty: Not support yet.
Total: 114/173
Neural Network Layer¶
Count 11/14
NNabla Function
Status
TF Op
Description
Affine
✓
Mul, Add, Reshape, MatMul, Placeholder, Const
RNN
Not yet implemented.
LSTM
Not yet implemented.
GRU
Not yet implemented.
Convolution
△
BatchToSpaceND, Conv2D, Reshape, Add, Identity, SpaceToBatchND, ConcatV2, Pad, Split, Transpose, Placeholder, Const
The cases
dilations
andstrides
larger than 1 are not supported by tensorflow.DepthwiseConvolution
△
Add, Reshape, SpaceToBatchND, Const, Conv2D, ConcatV2, Pad, Split, Transpose, Placeholder, BatchToSpaceND
The cases
dilations
andstrides
larger than 1 are not supported by tensorflow.Deconvolution
△
Add, Reshape, Slice, Identity, ConcatV2, Conv2DBackpropInput, Pad, Split, Transpose, Placeholder, Const
The cases
dilations
larger than 1 are not supported by tensorflow.DepthwiseDeconvolution
△
Add, Reshape, Slice, ConcatV2, Conv2DBackpropInput, Pad, Split, Transpose, Placeholder, Const
The cases
dilations
larger than 1 are not supported by tensorflow.MaxPooling
✓
Reshape, MaxPool3D, MaxPool, PadV2, Transpose, Placeholder, Const
AveragePooling
△
Reshape, AvgPool, Pad, AvgPool3D, Transpose, Placeholder, Const
Currently only supports the cases both ignore_border and including_pad are True.
GlobalAveragePooling
✓
Sub, SplitV, Range, Pack, Mean, Const
SumPooling
✓
Mul, Reshape, AvgPool, Pad, AvgPool3D, Transpose, Placeholder, Const
Unpooling
△
Mul, Assert, Identity, Transpose, Reshape, StridedSlice, Switch, Merge, LogicalAnd, ResizeNearestNeighbor, Cast, NoOp, Equal, Placeholder, Const
The kernel only supports 2d.
Embed
✓
GatherV2, Placeholder, Const
Neural Network Activation Functions¶
Count 21/21
NNabla Function
Status
TF Op
Description
Sigmoid
✓
Sigmoid, Placeholder
Swish
✓
Mul, Sigmoid, Placeholder
Tanh
✓
Tanh, Placeholder
ReLU
✓
Relu, Placeholder
LeakyReLU
✓
LeakyRelu, Placeholder
Softmax
✓
RealDiv, Sub, Sum, Max, Exp, Placeholder, Const
LogSoftmax
✓
Log, Sub, Sum, Max, Exp, Placeholder, Const
ELU
✓
Mul, Add, Sub, Less, Elu, Exp, Cast, GreaterEqual, Placeholder, Const
SELU
✓
Mul, Add, Sub, Maximum, Minimum, Exp, Placeholder, Const
CReLU
✓
Neg, ConcatV2, Relu, Placeholder, Const
CELU
✓
Mul, Neg, Add, Sub, Less, ConcatV2, Elu, Exp, Cast, GreaterEqual, Placeholder, Const
PReLU
✓
Mul, Add, Sub, Reshape, Abs, Relu, Placeholder, Const
GELU
✓
RealDiv, Mul, Add, Pow, Sqrt, Placeholder, Tanh, Const
ReLU6
✓
Min, Const, Relu, Placeholder, Pack
HardSigmoid
✓
Mul, Add, Maximum, Minimum, Placeholder, Const
HardTanh
✓
Neg, Min, Const, Max, Placeholder, Pack
LogSigmoid
✓
Log, Sigmoid, Placeholder
SoftPlus
✓
Placeholder, Softplus
SoftSign
✓
Softsign, Placeholder
TanhShrink
✓
Tanh, Sub, Placeholder
Sinc
✓
RealDiv, Select, Sin, Equal, Placeholder, Const
Normalization¶
Count 0/6
NNabla Function
Status
TF Op
Description
FusedBatchNormalization
X
RealDiv, Mul, Add, Sub, Reshape, Rsqrt, Sum, Mean, Relu, Placeholder, Const
Not yet implemented.
BatchNormalization
X
RealDiv, Mul, Add, Sub, Reshape, Rsqrt, Sum, Mean, Placeholder, Const
In inferring stage, caffe2 mistmatch onnx 1.4.x’s implementation, “inplace” feature cannot be applied.
SyncBatchNormalization
Not yet implemented.
MeanSubtraction
Not yet implemented.
ClipGradByValue
Not yet implemented.
ClipGradByNorm
Not yet implemented.
Reduction¶
Count 5/7
NNabla Function
Status
TF Op
Description
Sum
✓
Sum, Placeholder, Const
Mean
✓
Mean, Placeholder, Const
Max
✓
Max, Placeholder, Const
Min
✓
Min, Placeholder, Const
Prod
✓
Prod, Placeholder, Const
ReduceSum
Not yet implemented.
ReduceMean
Not yet implemented.
Arithmetic¶
Count 11/12
NNabla Function
Status
TF Op
Description
Add2
✓
Add, Placeholder
BcAdd2
Not yet implemented.
Sub2
✓
Sub, Placeholder
Mul2
✓
Mul, Placeholder
Div2
✓
RealDiv, Placeholder
Pow2
✓
Pow, Placeholder
AddScalar
✓
Add, Placeholder, Const
MulScalar
✓
Mul, Placeholder, Const
PowScalar
✓
Pow, Placeholder, Const
RSubScalar
✓
Sub, Placeholder, Const
RDivScalar
✓
RealDiv, Placeholder, Const
RPowScalar
✓
Pow, Placeholder, Const
Logical¶
Count 27/29
NNabla Function
Status
TF Op
Description
Sign
✓
Placeholder, Sign
Minimum2
✓
Add, Min, Const, Placeholder, Pack
Maximum2
✓
Add, Const, Max, Placeholder, Pack
MinimumScalar
✓
Add, Min, Const, Placeholder, Pack
MaximumScalar
✓
Add, Const, Max, Placeholder, Pack
LogicalAnd
✓
LogicalAnd, Placeholder
LogicalOr
✓
Placeholder, LogicalOr
LogicalXor
✓
LogicalAnd, LogicalNot, Placeholder, LogicalOr
Equal
✓
Equal, Placeholder
NotEqual
✓
Equal, Placeholder, LogicalNot
GreaterEqual
✓
Less, Placeholder, LogicalNot
Greater
✓
Greater, Placeholder
LessEqual
✓
Greater, Placeholder, LogicalNot
Less
✓
Less, Placeholder
LogicalAndScalar
✓
LogicalAnd, Placeholder, Const
LogicalOrScalar
✓
LogicalOr, Placeholder, Const
LogicalXorScalar
✓
LogicalOr, LogicalAnd, LogicalNot, Placeholder, Const
EqualScalar
✓
Equal, Placeholder, Const
NotEqualScalar
✓
Equal, LogicalNot, Placeholder, Const
GreaterEqualScalar
✓
Less, LogicalNot, Placeholder, Const
GreaterScalar
✓
Greater, Placeholder, Const
LessEqualScalar
✓
Greater, LogicalNot, Placeholder, Const
LessScalar
✓
Less, Placeholder, Const
LogicalNot
✓
Placeholder, LogicalNot
IsNaN
✓
IsNan, Placeholder
IsInf
X
Not yet implemented.
ResetNaN
✓
IsNan, Select, Placeholder, Const
ResetInf
X
Not yet implemented.
Where
✓
Select, Placeholder
Math¶
Count 21/22
NNabla Function
Status
TF Op
Description
Constant
✓
Identity, Const
Arange
✓
Identity, Const
Abs
✓
Abs, Placeholder
Exp
✓
Exp, Placeholder
Log
✓
Log, Placeholder
Identity
✓
Identity, Placeholder
BatchMatmul
✓
Reshape, BatchMatMulV2, Transpose, Placeholder, Const
Round
X
Not yet implemented.
Ceil
✓
Ceil, Placeholder
Floor
✓
Floor, Placeholder
Sin
✓
Sin, Placeholder
Cos
✓
Placeholder, Cos
Tan
✓
Placeholder, Tan
Sinh
✓
Sinh, Placeholder
Cosh
✓
Cosh, Placeholder
ASin
✓
Asin, Placeholder
ACos
✓
Acos, Placeholder
ATan
✓
Atan, Placeholder
ATan2
✓
RealDiv, Atan, Placeholder
ASinh
✓
Asinh, Placeholder
ACosh
✓
Placeholder, Acosh
ATanh
✓
Placeholder, Atanh
Array Manipulation¶
Count 12/19
NNabla Function
Status
TF Op
Description
Concatenate
✓
ConcatV2, Placeholder, Const
Split
✓
Placeholder, SplitV, Const, Squeeze
Stack
✓
ExpandDims, ConcatV2, Placeholder, Const
Slice
△
Slice, Placeholder, Const
step != 1” exceed the scope of onnx opset 9, not supported.
Pad
△
PadV2, Placeholder, Const, MirrorPad
When the mode of the pad is reflect, if the size of the pad exceeds the input size, tensorflow cannot handle it.
Transpose
✓
Transpose, Placeholder, Const
Broadcast
✓
BroadcastTo
✓
Tile
✓
Reshape, Placeholder, Const, Tile
OneHot
✓
Reshape, GatherV2, Placeholder, Const
Flip
✓
Identity, GatherV2, Transpose, Placeholder, Const
Shift
Not yet implemented.
Sort
Not yet implemented.
Reshape
✓
Reshape, Placeholder, Const
MatrixDiag
Not yet implemented.
MatrixDiagPart
Not yet implemented.
Assign
Not yet implemented.
GatherNd
Not yet implemented.
ScatterNd
Not yet implemented.
Signal Processing¶
Count 0/3
NNabla Function
Status
TF Op
Description
Interpolate
X
Not yet implemented.
FFT
Not yet implemented.
IFFT
Not yet implemented.
Stochasticity¶
Count 0/11
NNabla Function
Status
TF Op
Description
Dropout
X
Placeholder
The Dropout in nnabla has no test mode and contains random parameters, so the test result is not the same as tensorflow.
TopKData
Not yet implemented.
TopKGrad
Not yet implemented.
Rand
Not yet implemented.
Randint
Not yet implemented.
Randn
Not yet implemented.
RandomChoice
Not yet implemented.
RandomCrop
Not yet implemented.
RandomFlip
Not yet implemented.
RandomShift
Not yet implemented.
ImageAugmentation
Not yet implemented.
Loss Functions¶
Count 0/9
NNabla Function
Status
TF Op
Description
SigmoidCrossEntropy
Not yet implemented.
BinaryCrossEntropy
Not yet implemented.
SoftmaxCrossEntropy
Not yet implemented.
CategoricalCrossEntropy
Not yet implemented.
SquaredError
Not yet implemented.
AbsoluteError
Not yet implemented.
HuberLoss
Not yet implemented.
EpsilonInsensitiveLoss
Not yet implemented.
KLMultinomial
Not yet implemented.
Quantization Neural Network Layers¶
Count 6/12
NNabla Function
Status
TF Op
Description
BinarySigmoid
✓
Greater, Select, Placeholder, Const
BinaryTanh
✓
Greater, Select, Placeholder, Const
BinaryConnectAffine
✓
Mul, Add, Reshape, MatMul, Placeholder, Const
BinaryConnectConvolution
△
Add, Reshape, Identity, Conv2D, ConcatV2, Pad, Split, Transpose, Placeholder, Const
The cases
dilations
andstrides
larger than 1 are not supported by tensorflow.BinaryWeightAffine
✓
Mul, MatMul, Reshape, Add, Placeholder, Const
BinaryWeightConvolution
△
Mul, Add, Reshape, Identity, Conv2D, ConcatV2, Pad, Split, Transpose, Placeholder, Const
The cases
dilations
andstrides
larger than 1 are not supported by tensorflow.INQAffine
Not yet implemented.
INQConvolution
Not yet implemented.
FixedPointQuantize
Not yet implemented.
MinMaxQuantize
Not yet implemented.
Pow2Quantize
Not yet implemented.
Prune
Not yet implemented.
Validation¶
Count 0/3
NNabla Function
Status
TF Op
Description
TopNError
Not yet implemented.
BinaryError
Not yet implemented.
ConfusionMatrix
Not yet implemented.
Unsupported, Special Use¶
Count 0/5
NNabla Function
Status
TF Op
Description
VATNoise
Not yet implemented.
Unlink
Not yet implemented.
Sink
Not yet implemented.
NmsDetection2d
Not yet implemented.
MaxPoolingBackward
Not yet implemented.
Tensorflow Lite Support Status¶
Export¶
✓: Supported
△: Partially supported
X: Supported, but test failed.
Empty: Not support yet.
Total: 74/173
Neural Network Layer¶
Count 5/14
NNabla Function
Status
Affine
✓
RNN
LSTM
GRU
Convolution
△
DepthwiseConvolution
△
Deconvolution
X
DepthwiseDeconvolution
X
MaxPooling
X
AveragePooling
X
GlobalAveragePooling
X
SumPooling
X
Unpooling
△
Embed
△
Neural Network Activation Functions¶
Count 18/21
NNabla Function
Status
Sigmoid
✓
Swish
✓
Tanh
✓
ReLU
✓
LeakyReLU
✓
Softmax
✓
LogSoftmax
✓
ELU
✓
SELU
✓
CReLU
✓
CELU
✓
PReLU
X
GELU
✓
ReLU6
✓
HardSigmoid
✓
HardTanh
✓
LogSigmoid
✓
SoftPlus
X
SoftSign
X
TanhShrink
✓
Sinc
✓
Normalization¶
Count 1/6
NNabla Function
Status
FusedBatchNormalization
X
BatchNormalization
✓
SyncBatchNormalization
MeanSubtraction
ClipGradByValue
ClipGradByNorm
Arithmetic¶
Count 11/12
NNabla Function
Status
Add2
✓
BcAdd2
Sub2
✓
Mul2
✓
Div2
✓
Pow2
✓
AddScalar
✓
MulScalar
✓
PowScalar
✓
RSubScalar
✓
RDivScalar
✓
RPowScalar
✓
Logical¶
Count 16/29
NNabla Function
Status
Sign
X
Minimum2
✓
Maximum2
✓
MinimumScalar
✓
MaximumScalar
✓
LogicalAnd
X
LogicalOr
X
LogicalXor
X
Equal
✓
NotEqual
✓
GreaterEqual
✓
Greater
✓
LessEqual
✓
Less
✓
LogicalAndScalar
X
LogicalOrScalar
X
LogicalXorScalar
X
EqualScalar
✓
NotEqualScalar
✓
GreaterEqualScalar
✓
GreaterScalar
✓
LessEqualScalar
✓
LessScalar
✓
LogicalNot
X
IsNaN
X
IsInf
X
ResetNaN
X
ResetInf
X
Where
X
Math¶
Count 9/22
NNabla Function
Status
Constant
X
Arange
X
Abs
✓
Exp
✓
Log
✓
Identity
✓
BatchMatmul
△
Round
X
Ceil
✓
Floor
✓
Sin
✓
Cos
✓
Tan
X
Sinh
X
Cosh
X
ASin
X
ACos
X
ATan
X
ATan2
X
ASinh
X
ACosh
X
ATanh
X
Array Manipulation¶
Count 10/19
NNabla Function
Status
Concatenate
✓
Split
✓
Stack
✓
Slice
△
Pad
△
Transpose
△
Broadcast
△
BroadcastTo
X
Tile
X
OneHot
✓
Flip
△
Shift
Sort
Reshape
✓
MatrixDiag
MatrixDiagPart
Assign
GatherNd
ScatterNd
Stochasticity¶
Count 0/11
NNabla Function
Status
Dropout
X
TopKData
TopKGrad
Rand
Randint
Randn
RandomChoice
RandomCrop
RandomFlip
RandomShift
ImageAugmentation
Loss Functions¶
Count 0/9
NNabla Function
Status
SigmoidCrossEntropy
BinaryCrossEntropy
SoftmaxCrossEntropy
CategoricalCrossEntropy
SquaredError
AbsoluteError
HuberLoss
EpsilonInsensitiveLoss
KLMultinomial
Quantization Neural Network Layers¶
Count 4/12
NNabla Function
Status
BinarySigmoid
✓
BinaryTanh
✓
BinaryConnectAffine
✓
BinaryConnectConvolution
X
BinaryWeightAffine
✓
BinaryWeightConvolution
X
INQAffine
INQConvolution
FixedPointQuantize
MinMaxQuantize
Pow2Quantize
Prune
Unsupported, Special Use¶
Count 0/5
NNabla Function
Status
VATNoise
Unlink
Sink
NmsDetection2d
MaxPoolingBackward
NNabla C Runtime Support Status¶
NNabla version: None
✓: Supported
△: Partially supported
X: Supported, but test failed or no test data.
Empty: Not support yet.
Export¶
Total: 56/173
Neural Network Layer¶
Count 8/14
NNabla Function
Status
Description
Affine
✓
RNN
LSTM
GRU
Convolution
✓
DepthwiseConvolution
✓
Deconvolution
✓
DepthwiseDeconvolution
MaxPooling
✓
AveragePooling
△
GlobalAveragePooling
SumPooling
✓
Unpooling
✓
Embed
Neural Network Activation Functions¶
Count 11/21
NNabla Function
Status
Description
Sigmoid
✓
Swish
✓
Tanh
✓
ReLU
✓
LeakyReLU
✓
Softmax
✓
LogSoftmax
ELU
✓
SELU
✓
CReLU
✓
CELU
✓
PReLU
✓
GELU
ReLU6
HardSigmoid
HardTanh
LogSigmoid
SoftPlus
SoftSign
TanhShrink
Sinc
Normalization¶
Count 1/6
NNabla Function
Status
Description
FusedBatchNormalization
BatchNormalization
✓
SyncBatchNormalization
MeanSubtraction
X
ClipGradByValue
ClipGradByNorm
Reduction¶
Count 1/7
NNabla Function
Status
Description
Sum
✓
Mean
Max
Min
Prod
ReduceSum
ReduceMean
Arithmetic¶
Count 11/12
NNabla Function
Status
Description
Add2
✓
BcAdd2
Sub2
✓
Mul2
✓
Div2
✓
Pow2
✓
AddScalar
✓
MulScalar
✓
PowScalar
✓
RSubScalar
✓
RDivScalar
✓
RPowScalar
✓
Logical¶
Count 5/29
NNabla Function
Status
Description
Sign
✓
Minimum2
✓
Maximum2
✓
MinimumScalar
✓
MaximumScalar
✓
LogicalAnd
LogicalOr
LogicalXor
Equal
NotEqual
GreaterEqual
Greater
LessEqual
Less
LogicalAndScalar
LogicalOrScalar
LogicalXorScalar
EqualScalar
NotEqualScalar
GreaterEqualScalar
GreaterScalar
LessEqualScalar
LessScalar
LogicalNot
IsNaN
IsInf
ResetNaN
ResetInf
Where
Math¶
Count 6/22
NNabla Function
Status
Description
Constant
Arange
Abs
✓
Exp
✓
Log
✓
Identity
✓
BatchMatmul
✓
Round
✓
Ceil
Floor
Sin
Cos
Tan
Sinh
Cosh
ASin
ACos
ATan
ATan2
ASinh
ACosh
ATanh
Array Manipulation¶
Count 7/19
NNabla Function
Status
Description
Concatenate
✓
Split
✓
Stack
✓
Slice
✓
Pad
Transpose
✓
Broadcast
BroadcastTo
Tile
OneHot
Flip
✓
Shift
X
Sort
Reshape
✓
MatrixDiag
X
MatrixDiagPart
X
Assign
GatherNd
ScatterNd
Stochasticity¶
Count 0/11
NNabla Function
Status
Description
Dropout
X
TopKData
TopKGrad
Rand
Randint
Randn
RandomChoice
RandomCrop
RandomFlip
RandomShift
ImageAugmentation
Loss Functions¶
Count 0/9
NNabla Function
Status
Description
SigmoidCrossEntropy
BinaryCrossEntropy
SoftmaxCrossEntropy
CategoricalCrossEntropy
SquaredError
AbsoluteError
HuberLoss
EpsilonInsensitiveLoss
KLMultinomial
Quantization Neural Network Layers¶
Count 6/12
NNabla Function
Status
Description
BinarySigmoid
✓
BinaryTanh
✓
BinaryConnectAffine
✓
BinaryConnectConvolution
✓
BinaryWeightAffine
✓
BinaryWeightConvolution
✓
INQAffine
INQConvolution
FixedPointQuantize
MinMaxQuantize
Pow2Quantize
Prune
Unsupported, Special Use¶
Count 0/5
NNabla Function
Status
Description
VATNoise
Unlink
Sink
NmsDetection2d
MaxPoolingBackward