class nbla::CudnnHandleManager

class CudnnHandleManager

Singleton class for storing cudnn handle for CUDA CUDNN Computation.

Public Functions

cudnnHandle_t handle(int device = -1, cudaStream_t stream = 0)

Get cuDNN handle for device.

Size_t get_workspace_limit_in_bytes()

Get a workspace limit.

The negative value means no limit of workspace size.

Note

The default value is -1. The default value is overwritten if an environment variable NNABLA_CUDNN_WORKSPACE_LIMIT is specified.

void set_workspace_limit_in_bytes(Size_t bytes)

Set a workspace limit.

The negative value means no limit of workspace size.

Parameters:

Limit[in] in bytes.

Public Members

unordered_map<CudnnConvDesc, shared_ptr<CudnnConvResource>, typename CudnnConvDesc::Hash> conv_resource

Hash map for CudnnConvResource.