|
|
NVIDIA TensorRT 8.6.11 API Reference
for DRIVE OS
SWE-SWDOCTRT-006-APIS
TensorRT API Reference
8.6.11
May 2023
b
Table 1 Revision history
Date
Summary of change
Apr. 2023
Initial draft
Jun. 2023
Review
Jun. 2023
Approval review
Contents
1
Standard and Safe
1
2
TensorRT
3
3
Deprecated List
5
4
Namespace Index
13
4.1
Namespace List
13
5
Hierarchical Index
15
5.1
Class Hierarchy
15
6
Class Index
19
6.1
Class List
19
7
File Index
27
7.1
File List
27
8
Namespace Documentation
29
8.1
nvcaffeparser1 Namespace Reference
29
8.1.1
Detailed Description
29
8.1.2
Function Documentation
29
8.1.2.1
createCaffeParser()
30
8.1.2.2
shutdownProtobufLibrary()
30
8.2
nvinfer1 Namespace Reference
30
8.2.1
Detailed Description
40
8.2.2
Typedef Documentation
40
8.2.2.1
AllocatorFlags
40
8.2.2.2
AsciiChar
40
8.2.2.3
BuilderFlags
40
8.2.2.4
char t
40
8.2.2.5
Dims
40
8.2.2.6
NetworkDefinitionCreationFlags
41
8.2.2.7
PluginFormat
41
8.2.2.8
QuantizationFlags
41
8.2.2.9
ResizeMode
42
8.2.2.10
SliceMode
42
8.2.2.11
TacticSources
42
8.2.2.12
TempfileControlFlags
42
8.2.2.13
TensorFormats
43
8.2.3
Enumeration Type Documentation
43
8.2.3.1
ActivationType
43
8.2.3.2
AllocatorFlag
43
ii
CONTENTS
8.2.3.3
BoundingBoxFormat
44
8.2.3.4
BuilderFlag
44
8.2.3.5
CalibrationAlgoType
46
8.2.3.6
DataType
46
8.2.3.7
DeviceType
47
8.2.3.8
DimensionOperation
47
8.2.3.9
ElementWiseOperation
48
8.2.3.10
EngineCapability
49
8.2.3.11
ErrorCode
49
8.2.3.12
FillOperation
51
8.2.3.13
GatherMode
51
8.2.3.14
HardwareCompatibilityLevel . .
52
8.2.3.15
InterpolationMode
52
8.2.3.16
LayerInformationFormat
52
8.2.3.17
LayerType
53
8.2.3.18
LoopOutput
54
8.2.3.19
MatrixOperation
55
8.2.3.20
MemoryPoolType
55
8.2.3.21
NetworkDefinitionCreationFlag .
56
8.2.3.22
OptProfileSelector
56
8.2.3.23
PaddingMode
57
8.2.3.24
PluginFieldType
60
8.2.3.25
PluginVersion
60
8.2.3.26
PoolingType
61
8.2.3.27
PreviewFeature
61
8.2.3.28
ProfilingVerbosity
62
8.2.3.29
QuantizationFlag
62
8.2.3.30
ReduceOperation
63
8.2.3.31
ResizeCoordinateTransformation
63
8.2.3.32
ResizeRoundMode
64
8.2.3.33
ResizeSelector
64
8.2.3.34
RNNDirection
65
8.2.3.35
RNNGateType
65
8.2.3.36
RNNInputMode
66
8.2.3.37
RNNOperation
66
8.2.3.38
SampleMode
67
8.2.3.39
ScaleMode
68
8.2.3.40
ScatterMode
68
8.2.3.41
TacticSource
69
8.2.3.42
TempfileControlFlag
69
8.2.3.43
TensorFormat
70
8.2.3.44
TensorIOMode
71
8.2.3.45
TensorLocation
73
8.2.3.46
TopKOperation
73
8.2.3.47
TripLimit
73
8.2.3.48
UnaryOperation
74
8.2.3.49
WeightsRole
75
8.2.4
Function Documentation
75
8.2.4.1
EnumMax()
75
8.2.4.2
EnumMax< BoundingBoxFormat >()
75
8.2.4.3
EnumMax< BuilderFlag >()
76
8.2.4.4
EnumMax< CalibrationAlgoType >()
76
8.2.4.5
EnumMax< DeviceType >()
76
8.2.4.6
EnumMax< DimensionOperation >()
76
CONTENTS
iii
8.2.4.7
EnumMax< FillOperation >()
77
8.2.4.8
EnumMax< GatherMode >()
77
8.2.4.9
EnumMax< LayerInformationFormat >() .
77
8.2.4.10
EnumMax< LayerType >()
77
8.2.4.11
EnumMax< LoopOutput >()
78
8.2.4.12
EnumMax< MatrixOperation >()
78
8.2.4.13
EnumMax< MemoryPoolType >()
78
8.2.4.14
EnumMax< NetworkDefinitionCreationFlag >()
78
8.2.4.15
EnumMax< OptProfileSelector >() . .
79
8.2.4.16
EnumMax< ProfilingVerbosity >() . .
79
8.2.4.17
EnumMax< QuantizationFlag >() . .
79
8.2.4.18
EnumMax< ReduceOperation >()
79
8.2.4.19
EnumMax< RNNDirection >()
80
8.2.4.20
EnumMax< RNNGateType >()
80
8.2.4.21
EnumMax< RNNInputMode >()
80
8.2.4.22
EnumMax< RNNOperation >()
80
8.2.4.23
EnumMax< SampleMode >()
81
8.2.4.24
EnumMax< ScaleMode >()
81
8.2.4.25
EnumMax< ScatterMode >()
81
8.2.4.26
EnumMax< TacticSource >()
81
8.2.4.27
EnumMax< TempfileControlFlag >()
82
8.2.4.28
EnumMax< TopKOperation >()
82
8.2.4.29
EnumMax< TripLimit >()
82
8.2.4.30
EnumMax< UnaryOperation >()
82
8.2.4.31
EnumMax< WeightsRole >()
83
8.2.4.32
getBuilderPluginRegistry()
83
8.2.4.33
getBuilderSafePluginRegistry() .
83
8.3
nvinfer1::consistency Namespace Reference
83
8.4
nvinfer1::impl Namespace Reference
84
8.5
nvinfer1::plugin Namespace Reference
84
8.5.1
Enumeration Type Documentation
85
8.5.1.1
CodeTypeSSD
85
8.6
nvinfer1::safe Namespace Reference
86
8.6.1
Detailed Description
86
8.6.2
Enumeration Type Documentation
86
8.6.2.1
RuntimeErrorType
86
8.6.3
Function Documentation
87
8.6.3.1
createInferRuntime()
87
8.6.3.2
getSafePluginRegistry()
87
8.7
nvinfer1::utils Namespace Reference
88
8.7.1
Function Documentation
88
8.7.1.1
reorderSubBuffers()
88
8.7.1.2
reshapeWeights()
89
8.7.1.3
transposeSubBuffers()
90
8.8
nvonnxparser Namespace Reference
90
8.8.1
Detailed Description
91
8.8.2
Typedef Documentation
91
8.8.2.1
OnnxParserFlags
92
8.8.3
Enumeration Type Documentation
92
8.8.3.1
ErrorCode
92
8.8.3.2
OnnxParserFlag
92
8.8.4
Function Documentation
93
8.8.4.1
createONNXConfig()
93
8.8.4.2
EnumMax()
93
iv
CONTENTS
8.8.4.3
EnumMax< ErrorCode >()
93
8.8.4.4
EnumMax< OnnxParserFlag >()
94
8.9
nvuffparser Namespace Reference
94
8.9.1
Detailed Description
94
8.9.2
Enumeration Type Documentation
95
8.9.2.1
FieldType
95
8.9.2.2
UffInputOrder
96
8.9.3
Function Documentation
96
8.9.3.1
createUffParser()
96
8.9.3.2
shutdownProtobufLibrary()
97
9
Class Documentation
99
9.1
nvinfer1::plugin::DetectionOutputParameters Struct Reference
99
9.1.1
Detailed Description
99
9.1.2
Member Data Documentation
100
9.1.2.1
backgroundLabelId
100
9.1.2.2
codeType
100
9.1.2.3
confidenceThreshold
100
9.1.2.4
confSigmoid
101
9.1.2.5
inputOrder
101
9.1.2.6
isBatchAgnostic
101
9.1.2.7
isNormalized
101
9.1.2.8
keepTopK
101
9.1.2.9
nmsThreshold
101
9.1.2.10
numClasses
101
9.1.2.11
shareLocation
102
9.1.2.12
topK
102
9.1.2.13
varianceEncodedInTarget
102
9.2
Dims Class Reference
102
9.2.1
Detailed Description
102
9.3
nvinfer1::Dims2 Class Reference
103
9.3.1
Detailed Description
103
9.3.2
Constructor & Destructor Documentation
103
9.3.2.1
Dims2() [1/2]
103
9.3.2.2
Dims2() [2/2]
103
9.4
nvinfer1::Dims3 Class Reference
104
9.4.1
Detailed Description
104
9.4.2
Constructor & Destructor Documentation
104
9.4.2.1
Dims3() [1/2]
105
9.4.2.2
Dims3() [2/2]
105
9.5
nvinfer1::Dims32 Class Reference
105
9.5.1
Member Data Documentation
106
9.5.1.1
d
106
9.5.1.2
MAX DIMS
106
9.5.1.3
nbDims
106
9.6
nvinfer1::Dims4 Class Reference
107
9.6.1
Detailed Description
107
9.6.2
Constructor & Destructor Documentation
107
9.6.2.1
Dims4() [1/2]
107
9.6.2.2
Dims4() [2/2]
107
9.7
nvinfer1::DimsExprs Class Reference
108
9.7.1
Detailed Description
108
9.7.2
Member Data Documentation
108
9.7.2.1
d
108
CONTENTS
v
9.7.2.2
nbDims
109
9.8
nvinfer1::DimsHW Class Reference
109
9.8.1
Detailed Description
109
9.8.2
Constructor & Destructor Documentation
110
9.8.2.1
DimsHW() [1/2]
110
9.8.2.2
DimsHW() [2/2]
110
9.8.3
Member Function Documentation
110
9.8.3.1
h() [1/2]
110
9.8.3.2
h() [2/2]
111
9.8.3.3
w() [1/2]
111
9.8.3.4
w() [2/2]
111
9.9
nvinfer1::DynamicPluginTensorDesc Class Reference
111
9.9.1
Detailed Description
112
9.9.2
Member Data Documentation
112
9.9.2.1
desc
112
9.9.2.2
max
112
9.9.2.3
min
112
9.10
nvinfer1::impl::EnumMaxImpl< T > Struct Template Reference . .
113
9.10.1
Detailed Description
113
9.11
nvinfer1::impl::EnumMaxImpl< ActivationType > Struct Reference .
113
9.11.1
Detailed Description
113
9.11.2
Member Data Documentation
113
9.11.2.1
kVALUE
113
9.12
nvinfer1::impl::EnumMaxImpl< AllocatorFlag > Struct Reference
114
9.12.1
Detailed Description
114
9.12.2
Member Data Documentation
114
9.12.2.1
kVALUE
114
9.13
nvinfer1::impl::EnumMaxImpl< DataType > Struct Reference
114
9.13.1
Detailed Description
115
9.13.2
Member Data Documentation
115
9.13.2.1
kVALUE
115
9.14
nvinfer1::impl::EnumMaxImpl< ElementWiseOperation > Struct Reference
115
9.14.1
Detailed Description
115
9.14.2
Member Data Documentation
115
9.14.2.1
kVALUE
116
9.15
nvinfer1::impl::EnumMaxImpl< EngineCapability > Struct Reference
116
9.15.1
Detailed Description
116
9.15.2
Member Data Documentation
116
9.15.2.1
kVALUE
116
9.16
nvinfer1::impl::EnumMaxImpl< ErrorCode > Struct Reference
117
9.16.1
Detailed Description
117
9.16.2
Member Data Documentation
117
9.16.2.1
kVALUE
117
9.17
nvinfer1::impl::EnumMaxImpl< HardwareCompatibilityLevel > Struct Reference
117
9.17.1
Detailed Description
118
9.17.2
Member Data Documentation
118
9.17.2.1
kVALUE
118
9.18
nvinfer1::impl::EnumMaxImpl< ILogger::Severity > Struct Reference
118
9.18.1
Detailed Description
118
9.18.2
Member Data Documentation
119
9.18.2.1
kVALUE
119
9.19
nvinfer1::impl::EnumMaxImpl< InterpolationMode > Struct Reference
119
9.19.1
Detailed Description
119
9.19.2
Member Data Documentation
119
vi
CONTENTS
9.19.2.1
kVALUE
119
9.20
nvinfer1::impl::EnumMaxImpl< PaddingMode > Struct Reference
120
9.20.1
Detailed Description
120
9.20.2
Member Data Documentation
120
9.20.2.1
kVALUE
120
9.21
nvinfer1::impl::EnumMaxImpl< PoolingType > Struct Reference
120
9.21.1
Detailed Description
120
9.21.2
Member Data Documentation
121
9.21.2.1
kVALUE
121
9.22
nvinfer1::impl::EnumMaxImpl< PreviewFeature > Struct Reference
121
9.22.1
Detailed Description
121
9.22.2
Member Data Documentation
121
9.22.2.1
kVALUE
121
9.23
nvinfer1::impl::EnumMaxImpl< ResizeCoordinateTransformation > Struct Reference
122
9.23.1
Detailed Description
122
9.23.2
Member Data Documentation
122
9.23.2.1
kVALUE
122
9.24
nvinfer1::impl::EnumMaxImpl< ResizeRoundMode > Struct Reference .
122
9.24.1
Detailed Description
123
9.24.2
Member Data Documentation
123
9.24.2.1
kVALUE
123
9.25
nvinfer1::impl::EnumMaxImpl< ResizeSelector > Struct Reference
123
9.25.1
Detailed Description
123
9.25.2
Member Data Documentation
123
9.25.2.1
kVALUE
124
9.26
nvinfer1::impl::EnumMaxImpl< TensorFormat > Struct Reference
124
9.26.1
Detailed Description
124
9.26.2
Member Data Documentation
124
9.26.2.1
kVALUE
124
9.27
nvinfer1::impl::EnumMaxImpl< TensorIOMode > Struct Reference .
125
9.27.1
Detailed Description
125
9.27.2
Member Data Documentation
125
9.27.2.1
kVALUE
125
9.28
nvinfer1::impl::EnumMaxImpl< TensorLocation > Struct Reference .
125
9.28.1
Detailed Description
126
9.28.2
Member Data Documentation
126
9.28.2.1
kVALUE
126
9.29
nvuffparser::FieldCollection Struct Reference
126
9.29.1
Member Data Documentation
126
9.29.1.1
fields
126
9.29.1.2
nbFields
127
9.30
nvuffparser::FieldMap Class Reference
127
9.30.1
Detailed Description
127
9.30.2
Constructor & Destructor Documentation
127
9.30.2.1
FieldMap() [1/2]
128
9.30.2.2
FieldMap() [2/2]
128
9.30.3
Member Data Documentation
128
9.30.3.1
data
128
9.30.3.2
length
128
9.30.3.3
name
128
9.30.3.4
type
129
9.31
nvinfer1::plugin::GridAnchorParameters Struct Reference
129
9.31.1
Detailed Description
129
9.31.2
Member Data Documentation
130
CONTENTS
vii
9.31.2.1
aspectRatios
130
9.31.2.2
H
130
9.31.2.3
maxSize
130
9.31.2.4
minSize
130
9.31.2.5
numAspectRatios
130
9.31.2.6
variance
130
9.31.2.7
W
131
9.32
nvinfer1::IActivationLayer Class Reference
131
9.32.1
Detailed Description
132
9.32.2
Constructor & Destructor Documentation
132
9.32.2.1
∼IActivationLayer()
132
9.32.3
Member Function Documentation
132
9.32.3.1
getActivationType()
132
9.32.3.2
getAlpha()
133
9.32.3.3
getBeta()
133
9.32.3.4
setActivationType()
133
9.32.3.5
setAlpha()
134
9.32.3.6
setBeta()
134
9.32.4
Member Data Documentation
134
9.32.4.1
mImpl
134
9.33
nvinfer1::IAlgorithm Class Reference
135
9.33.1
Detailed Description
135
9.33.2
Constructor & Destructor Documentation
136
9.33.2.1
∼IAlgorithm()
136
9.33.3
Member Function Documentation
136
9.33.3.1
getAlgorithmIOInfo()
136
9.33.3.2
getAlgorithmIOInfoByIndex()
136
9.33.3.3
getAlgorithmVariant()
137
9.33.3.4
getTimingMSec()
137
9.33.3.5
getWorkspaceSize()
137
9.33.4
Member Data Documentation
137
9.33.4.1
mImpl
137
9.34
nvinfer1::IAlgorithmContext Class Reference . .
138
9.34.1
Detailed Description
138
9.34.2
Constructor & Destructor Documentation
139
9.34.2.1
∼IAlgorithmContext()
139
9.34.3
Member Function Documentation
139
9.34.3.1
getDimensions()
139
9.34.3.2
getName()
139
9.34.3.3
getNbInputs()
139
9.34.3.4
getNbOutputs()
140
9.34.4
Member Data Documentation
140
9.34.4.1
mImpl
140
9.35
nvinfer1::IAlgorithmIOInfo Class Reference
140
9.35.1
Detailed Description
141
9.35.2
Constructor & Destructor Documentation
141
9.35.2.1
∼IAlgorithmIOInfo()
141
9.35.3
Member Function Documentation
141
9.35.3.1
getComponentsPerElement() .
141
9.35.3.2
getDataType()
142
9.35.3.3
getStrides()
142
9.35.3.4
getTensorFormat()
142
9.35.3.5
getVectorizedDim()
142
9.35.4
Member Data Documentation
143
viii
CONTENTS
9.35.4.1
mImpl
143
9.36
nvinfer1::IAlgorithmSelector Class Reference
143
9.36.1
Detailed Description
143
9.36.2
Constructor & Destructor Documentation .
143
9.36.2.1
∼IAlgorithmSelector()
144
9.36.3
Member Function Documentation
144
9.36.3.1
reportAlgorithms()
144
9.36.3.2
selectAlgorithms()
144
9.37
nvinfer1::IAlgorithmVariant Class Reference
145
9.37.1
Detailed Description
146
9.37.2
Constructor & Destructor Documentation .
146
9.37.2.1
∼IAlgorithmVariant()
146
9.37.3
Member Function Documentation
146
9.37.3.1
getImplementation()
146
9.37.3.2
getTactic()
147
9.37.4
Member Data Documentation
147
9.37.4.1
mImpl
147
9.38
nvinfer1::IAssertionLayer Class Reference
147
9.38.1
Detailed Description
148
9.38.2
Constructor & Destructor Documentation .
148
9.38.2.1
∼IAssertionLayer()
148
9.38.3
Member Function Documentation
148
9.38.3.1
getMessage()
148
9.38.3.2
setMessage()
149
9.38.4
Member Data Documentation
149
9.38.4.1
mImpl
149
9.39
nvcaffeparser1::IBinaryProtoBlob Class Reference
149
9.39.1
Detailed Description
149
9.39.2
Constructor & Destructor Documentation .
150
9.39.2.1
∼IBinaryProtoBlob()
150
9.39.3
Member Function Documentation
150
9.39.3.1
destroy()
150
9.39.3.2
getData()
150
9.39.3.3
getDataType()
150
9.39.3.4
getDimensions()
151
9.40
nvcaffeparser1::IBlobNameToTensor Class Reference .
151
9.40.1
Detailed Description
151
9.40.2
Constructor & Destructor Documentation . .
151
9.40.2.1
∼IBlobNameToTensor()
152
9.40.3
Member Function Documentation
152
9.40.3.1
find()
152
9.41
nvinfer1::IBuilder Class Reference
152
9.41.1
Detailed Description
154
9.41.2
Constructor & Destructor Documentation . .
154
9.41.2.1
∼IBuilder()
154
9.41.3
Member Function Documentation
154
9.41.3.1
buildEngineWithConfig()
154
9.41.3.2
buildSerializedNetwork()
154
9.41.3.3
createBuilderConfig()
155
9.41.3.4
createNetworkV2()
155
9.41.3.5
createOptimizationProfile()
156
9.41.3.6
destroy()
156
9.41.3.7
getErrorRecorder()
157
9.41.3.8
getLogger()
157
CONTENTS
ix
9.41.3.9
getMaxBatchSize()
157
9.41.3.10 getMaxDLABatchSize()
157
9.41.3.11 getMaxThreads()
158
9.41.3.12 getNbDLACores()
158
9.41.3.13 getPluginRegistry()
158
9.41.3.14 isNetworkSupported()
158
9.41.3.15 platformHasFastFp16()
159
9.41.3.16 platformHasFastInt8()
159
9.41.3.17 platformHasTf32()
159
9.41.3.18 reset()
160
9.41.3.19 setErrorRecorder()
160
9.41.3.20 setGpuAllocator()
160
9.41.3.21 setMaxBatchSize()
161
9.41.3.22 setMaxThreads()
161
9.41.4
Member Data Documentation
162
9.41.4.1
mImpl
162
9.42
nvinfer1::IBuilderConfig Class Reference
162
9.42.1
Detailed Description
165
9.42.2
Constructor & Destructor Documentation
165
9.42.2.1
∼IBuilderConfig()
165
9.42.3
Member Function Documentation
165
9.42.3.1
addOptimizationProfile()
165
9.42.3.2
canRunOnDLA()
166
9.42.3.3
clearFlag()
166
9.42.3.4
clearQuantizationFlag()
166
9.42.3.5
createTimingCache()
167
9.42.3.6
destroy()
167
9.42.3.7
getAlgorithmSelector()
168
9.42.3.8
getAvgTimingIterations()
168
9.42.3.9
getBuilderOptimizationLevel()
168
9.42.3.10
getCalibrationProfile()
168
9.42.3.11
getDefaultDeviceType()
169
9.42.3.12
getDeviceType()
169
9.42.3.13
getDLACore()
169
9.42.3.14
getEngineCapability()
169
9.42.3.15
getFlag()
170
9.42.3.16
getFlags()
170
9.42.3.17
getHardwareCompatibilityLevel() .
170
9.42.3.18
getInt8Calibrator()
171
9.42.3.19
getMaxAuxStreams()
171
9.42.3.20
getMaxWorkspaceSize()
171
9.42.3.21
getMemoryPoolLimit()
171
9.42.3.22
getMinTimingIterations()
172
9.42.3.23
getNbOptimizationProfiles() . .
172
9.42.3.24
getNbPluginsToSerialize()
173
9.42.3.25
getPluginToSerialize()
173
9.42.3.26
getPreviewFeature()
173
9.42.3.27
getProfileStream()
174
9.42.3.28
getProfilingVerbosity()
174
9.42.3.29
getQuantizationFlag()
174
9.42.3.30
getQuantizationFlags()
175
9.42.3.31
getTacticSources()
175
9.42.3.32
getTimingCache()
175
9.42.3.33
isDeviceTypeSet()
176
x
CONTENTS
9.42.3.34 reset()
176
9.42.3.35 resetDeviceType()
176
9.42.3.36 setAlgorithmSelector()
176
9.42.3.37 setAvgTimingIterations()
177
9.42.3.38 setBuilderOptimizationLevel() .
177
9.42.3.39 setCalibrationProfile()
178
9.42.3.40 setDefaultDeviceType()
178
9.42.3.41 setDeviceType()
178
9.42.3.42 setDLACore()
179
9.42.3.43 setEngineCapability()
179
9.42.3.44 setFlag()
180
9.42.3.45 setFlags()
180
9.42.3.46 setHardwareCompatibilityLevel() .
180
9.42.3.47 setInt8Calibrator()
181
9.42.3.48 setMaxAuxStreams()
181
9.42.3.49 setMaxWorkspaceSize()
182
9.42.3.50 setMemoryPoolLimit()
182
9.42.3.51 setMinTimingIterations()
183
9.42.3.52 setPluginsToSerialize()
183
9.42.3.53 setPreviewFeature()
184
9.42.3.54 setProfileStream()
184
9.42.3.55 setProfilingVerbosity()
184
9.42.3.56 setQuantizationFlag()
185
9.42.3.57 setQuantizationFlags()
185
9.42.3.58 setTacticSources()
186
9.42.3.59 setTimingCache()
186
9.42.4
Member Data Documentation
187
9.42.4.1
mImpl
187
9.43
nvcaffeparser1::ICaffeParser Class Reference . .
187
9.43.1
Detailed Description
188
9.43.2
Constructor & Destructor Documentation
188
9.43.2.1
∼ICaffeParser()
188
9.43.3
Member Function Documentation
188
9.43.3.1
destroy()
188
9.43.3.2
getErrorRecorder()
189
9.43.3.3
parse()
189
9.43.3.4
parseBinaryProto()
190
9.43.3.5
parseBuffers()
190
9.43.3.6
setErrorRecorder()
191
9.43.3.7
setPluginFactoryV2()
191
9.43.3.8
setPluginNamespace()
192
9.43.3.9
setProtobufBufferSize()
192
9.44
nvinfer1::ICastLayer Class Reference
192
9.44.1
Detailed Description
193
9.44.2
Constructor & Destructor Documentation
193
9.44.2.1
∼ICastLayer()
193
9.44.3
Member Function Documentation
193
9.44.3.1
getToType()
193
9.44.3.2
setToType()
194
9.44.4
Member Data Documentation
194
9.44.4.1
mImpl
194
9.45
nvinfer1::IConcatenationLayer Class Reference .
194
9.45.1
Detailed Description
195
9.45.2
Constructor & Destructor Documentation
195
CONTENTS
xi
9.45.2.1
∼IConcatenationLayer()
195
9.45.3
Member Function Documentation
195
9.45.3.1
getAxis()
195
9.45.3.2
setAxis()
196
9.45.4
Member Data Documentation
196
9.45.4.1
mImpl
196
9.46
nvinfer1::IConditionLayer Class Reference
196
9.46.1
Detailed Description
197
9.46.2
Constructor & Destructor Documentation
197
9.46.2.1
∼IConditionLayer()
197
9.46.3
Member Data Documentation
197
9.46.3.1
mImpl
197
9.47
nvinfer1::consistency::IConsistencyChecker Class Reference
197
9.47.1
Detailed Description
198
9.47.2
Constructor & Destructor Documentation
198
9.47.2.1
∼IConsistencyChecker()
198
9.47.2.2
IConsistencyChecker() [1/3] .
198
9.47.2.3
IConsistencyChecker() [2/3] .
199
9.47.2.4
IConsistencyChecker() [3/3] .
199
9.47.3
Member Function Documentation
199
9.47.3.1
operator=() [1/2]
199
9.47.3.2
operator=() [2/2]
199
9.47.3.3
validate()
199
9.47.4
Member Data Documentation
199
9.47.4.1
mImpl
200
9.48
nvinfer1::IConstantLayer Class Reference
200
9.48.1
Detailed Description
200
9.48.2
Constructor & Destructor Documentation
201
9.48.2.1
∼IConstantLayer()
201
9.48.3
Member Function Documentation
201
9.48.3.1
getDimensions()
201
9.48.3.2
getWeights()
201
9.48.3.3
setDimensions()
201
9.48.3.4
setWeights()
202
9.48.4
Member Data Documentation
202
9.48.4.1
mImpl
202
9.49
nvinfer1::IConvolutionLayer Class Reference . .
202
9.49.1
Detailed Description
204
9.49.2
Constructor & Destructor Documentation
204
9.49.2.1
∼IConvolutionLayer()
205
9.49.3
Member Function Documentation
205
9.49.3.1
getBiasWeights()
205
9.49.3.2
getDilation()
205
9.49.3.3
getDilationNd()
205
9.49.3.4
getKernelSize()
206
9.49.3.5
getKernelSizeNd()
206
9.49.3.6
getKernelWeights()
206
9.49.3.7
getNbGroups()
206
9.49.3.8
getNbOutputMaps()
207
9.49.3.9
getPadding()
207
9.49.3.10 getPaddingMode()
207
9.49.3.11 getPaddingNd()
208
9.49.3.12 getPostPadding()
208
9.49.3.13 getPrePadding()
208
xii
CONTENTS
9.49.3.14 getStride()
208
9.49.3.15 getStrideNd()
209
9.49.3.16 setBiasWeights()
209
9.49.3.17 setDilation()
209
9.49.3.18 setDilationNd()
210
9.49.3.19 setInput()
210
9.49.3.20 setKernelSize()
210
9.49.3.21 setKernelSizeNd()
211
9.49.3.22 setKernelWeights()
211
9.49.3.23 setNbGroups()
212
9.49.3.24 setNbOutputMaps()
212
9.49.3.25 setPadding()
213
9.49.3.26 setPaddingMode()
213
9.49.3.27 setPaddingNd()
213
9.49.3.28 setPostPadding()
214
9.49.3.29 setPrePadding()
214
9.49.3.30 setStride()
214
9.49.3.31 setStrideNd()
215
9.49.4
Member Data Documentation
215
9.49.4.1
mImpl
215
9.50
nvinfer1::ICudaEngine Class Reference
215
9.50.1
Detailed Description
218
9.50.2
Constructor & Destructor Documentation
218
9.50.2.1
∼ICudaEngine()
219
9.50.3
Member Function Documentation
219
9.50.3.1
bindingIsInput()
219
9.50.3.2
createEngineInspector()
219
9.50.3.3
createExecutionContext()
220
9.50.3.4
createExecutionContextWithoutDeviceMemory()
220
9.50.3.5
destroy()
220
9.50.3.6
getBindingBytesPerComponent()
220
9.50.3.7
getBindingComponentsPerElement()
221
9.50.3.8
getBindingDataType()
221
9.50.3.9
getBindingDimensions()
222
9.50.3.10 getBindingFormat()
223
9.50.3.11 getBindingFormatDesc()
223
9.50.3.12 getBindingIndex()
224
9.50.3.13 getBindingName()
224
9.50.3.14 getBindingVectorizedDim()
225
9.50.3.15 getDeviceMemorySize()
225
9.50.3.16 getEngineCapability()
226
9.50.3.17 getErrorRecorder()
226
9.50.3.18 getHardwareCompatibilityLevel()
226
9.50.3.19 getIOTensorName()
226
9.50.3.20 getLocation()
227
9.50.3.21 getMaxBatchSize()
227
9.50.3.22 getName()
228
9.50.3.23 getNbAuxStreams()
228
9.50.3.24 getNbBindings()
229
9.50.3.25 getNbIOTensors()
229
9.50.3.26 getNbLayers()
229
9.50.3.27 getNbOptimizationProfiles()
230
9.50.3.28 getProfileDimensions()
230
9.50.3.29 getProfileShape()
231
CONTENTS
xiii
9.50.3.30 getProfileShapeValues()
231
9.50.3.31 getProfilingVerbosity()
232
9.50.3.32 getTacticSources()
232
9.50.3.33 getTensorBytesPerComponent() [1/2] . .
233
9.50.3.34 getTensorBytesPerComponent() [2/2] . .
234
9.50.3.35 getTensorComponentsPerElement() [1/2]
235
9.50.3.36 getTensorComponentsPerElement() [2/2]
235
9.50.3.37 getTensorDataType()
236
9.50.3.38 getTensorFormat() [1/2]
236
9.50.3.39 getTensorFormat() [2/2]
237
9.50.3.40 getTensorFormatDesc() [1/2]
237
9.50.3.41 getTensorFormatDesc() [2/2]
237
9.50.3.42 getTensorIOMode()
238
9.50.3.43 getTensorLocation()
238
9.50.3.44 getTensorShape()
239
9.50.3.45 getTensorVectorizedDim() [1/2]
239
9.50.3.46 getTensorVectorizedDim() [2/2]
240
9.50.3.47 hasImplicitBatchDimension()
240
9.50.3.48 isExecutionBinding()
241
9.50.3.49 isRefittable()
241
9.50.3.50 isShapeBinding()
242
9.50.3.51 isShapeInferenceIO()
242
9.50.3.52 serialize()
243
9.50.3.53 setErrorRecorder()
243
9.50.4
Member Data Documentation
243
9.50.4.1
mImpl
244
9.51
nvinfer1::safe::ICudaEngine Class Reference
244
9.51.1
Detailed Description
245
9.51.2
Constructor & Destructor Documentation
245
9.51.2.1
ICudaEngine() [1/3]
246
9.51.2.2
∼ICudaEngine()
246
9.51.2.3
ICudaEngine() [2/3]
246
9.51.2.4
ICudaEngine() [3/3]
246
9.51.3
Member Function Documentation
246
9.51.3.1
bindingIsInput()
246
9.51.3.2
createExecutionContext()
247
9.51.3.3
createExecutionContextWithoutDeviceMemory()
247
9.51.3.4
getBindingBytesPerComponent()
248
9.51.3.5
getBindingComponentsPerElement()
248
9.51.3.6
getBindingDataType()
249
9.51.3.7
getBindingDimensions()
249
9.51.3.8
getBindingFormat()
250
9.51.3.9
getBindingIndex()
251
9.51.3.10 getBindingName()
251
9.51.3.11 getBindingVectorizedDim()
252
9.51.3.12 getDeviceMemorySize()
253
9.51.3.13 getErrorRecorder()
253
9.51.3.14 getIOTensorName()
253
9.51.3.15 getName()
254
9.51.3.16 getNbBindings()
255
9.51.3.17 getNbIOTensors()
255
9.51.3.18 getTensorBytesPerComponent()
255
9.51.3.19 getTensorComponentsPerElement()
256
9.51.3.20 getTensorDataType()
257
xiv
CONTENTS
9.51.3.21 getTensorFormat()
258
9.51.3.22 getTensorIOMode()
258
9.51.3.23 getTensorShape()
259
9.51.3.24 getTensorVectorizedDim()
259
9.51.3.25 operator=() [1/2]
260
9.51.3.26 operator=() [2/2]
260
9.51.3.27 setErrorRecorder()
260
9.52
nvinfer1::IDeconvolutionLayer Class Reference .
261
9.52.1
Detailed Description
263
9.52.2
Constructor & Destructor Documentation
263
9.52.2.1
∼IDeconvolutionLayer()
263
9.52.3
Member Function Documentation .
263
9.52.3.1
getBiasWeights()
263
9.52.3.2
getDilationNd()
264
9.52.3.3
getKernelSize()
264
9.52.3.4
getKernelSizeNd()
264
9.52.3.5
getKernelWeights()
264
9.52.3.6
getNbGroups()
265
9.52.3.7
getNbOutputMaps()
265
9.52.3.8
getPadding()
265
9.52.3.9
getPaddingMode()
266
9.52.3.10 getPaddingNd()
266
9.52.3.11 getPostPadding()
266
9.52.3.12 getPrePadding()
266
9.52.3.13 getStride()
267
9.52.3.14 getStrideNd()
267
9.52.3.15 setBiasWeights()
267
9.52.3.16 setDilationNd()
268
9.52.3.17 setInput()
268
9.52.3.18 setKernelSize()
268
9.52.3.19 setKernelSizeNd()
269
9.52.3.20 setKernelWeights()
269
9.52.3.21 setNbGroups()
270
9.52.3.22 setNbOutputMaps()
270
9.52.3.23 setPadding()
271
9.52.3.24 setPaddingMode()
271
9.52.3.25 setPaddingNd()
271
9.52.3.26 setPostPadding()
272
9.52.3.27 setPrePadding()
272
9.52.3.28 setStride()
272
9.52.3.29 setStrideNd()
273
9.52.4
Member Data Documentation
273
9.52.4.1
mImpl
273
9.53
nvinfer1::IDequantizeLayer Class Reference .
273
9.53.1
Detailed Description
274
9.53.2
Constructor & Destructor Documentation
275
9.53.2.1
∼IDequantizeLayer()
275
9.53.3
Member Function Documentation
275
9.53.3.1
getAxis()
275
9.53.3.2
setAxis()
275
9.53.4
Member Data Documentation
275
9.53.4.1
mImpl
276
9.54
nvinfer1::IDimensionExpr Class Reference
276
9.54.1
Detailed Description
276
CONTENTS
xv
9.54.2
Constructor & Destructor Documentation
277
9.54.2.1
∼IDimensionExpr()
277
9.54.3
Member Function Documentation
277
9.54.3.1
getConstantValue()
277
9.54.3.2
isConstant()
277
9.54.4
Member Data Documentation
277
9.54.4.1
mImpl
277
9.55
nvinfer1::IEinsumLayer Class Reference
278
9.55.1
Detailed Description
278
9.55.2
Constructor & Destructor Documentation
279
9.55.2.1
∼IEinsumLayer()
279
9.55.3
Member Function Documentation
279
9.55.3.1
getEquation()
279
9.55.3.2
setEquation()
279
9.55.4
Member Data Documentation
280
9.55.4.1
mImpl
280
9.56
nvinfer1::IElementWiseLayer Class Reference . .
280
9.56.1
Detailed Description
281
9.56.2
Constructor & Destructor Documentation
281
9.56.2.1
∼IElementWiseLayer()
281
9.56.3
Member Function Documentation
281
9.56.3.1
getOperation()
281
9.56.3.2
setOperation()
282
9.56.4
Member Data Documentation
282
9.56.4.1
mImpl
282
9.57
nvinfer1::IEngineInspector Class Reference
282
9.57.1
Detailed Description
283
9.57.2
Constructor & Destructor Documentation
283
9.57.2.1
∼IEngineInspector()
284
9.57.3
Member Function Documentation
284
9.57.3.1
getEngineInformation()
284
9.57.3.2
getErrorRecorder()
284
9.57.3.3
getExecutionContext()
285
9.57.3.4
getLayerInformation()
285
9.57.3.5
setErrorRecorder()
286
9.57.3.6
setExecutionContext()
286
9.57.4
Member Data Documentation
287
9.57.4.1
mImpl
287
9.58
nvinfer1::IErrorRecorder Class Reference
287
9.58.1
Detailed Description
288
9.58.2
Member Typedef Documentation
288
9.58.2.1
ErrorDesc
288
9.58.2.2
RefCount
288
9.58.3
Constructor & Destructor Documentation
288
9.58.3.1
IErrorRecorder()
289
9.58.3.2
∼IErrorRecorder()
289
9.58.4
Member Function Documentation
289
9.58.4.1
clear()
289
9.58.4.2
decRefCount()
290
9.58.4.3
getErrorCode()
290
9.58.4.4
getErrorDesc()
291
9.58.4.5
getNbErrors()
292
9.58.4.6
hasOverflowed()
292
9.58.4.7
incRefCount()
293
xvi
CONTENTS
9.58.4.8
reportError()
293
9.58.5
Member Data Documentation
294
9.58.5.1
kMAX DESC LENGTH
294
9.59
nvinfer1::IExecutionContext Class Reference . .
294
9.59.1
Detailed Description
297
9.59.2
Constructor & Destructor Documentation
297
9.59.2.1
∼IExecutionContext()
297
9.59.3
Member Function Documentation
297
9.59.3.1
allInputDimensionsSpecified()
298
9.59.3.2
allInputShapesSpecified()
298
9.59.3.3
destroy()
298
9.59.3.4
enqueue()
299
9.59.3.5
enqueueV2()
300
9.59.3.6
enqueueV3()
300
9.59.3.7
execute()
301
9.59.3.8
executeV2()
302
9.59.3.9
getBindingDimensions()
302
9.59.3.10
getDebugSync()
303
9.59.3.11
getEngine()
303
9.59.3.12
getEnqueueEmitsProfile()
304
9.59.3.13
getErrorRecorder()
304
9.59.3.14
getInputConsumedEvent()
304
9.59.3.15
getMaxOutputSize()
304
9.59.3.16
getName()
305
9.59.3.17
getNvtxVerbosity()
305
9.59.3.18
getOptimizationProfile()
306
9.59.3.19
getOutputAllocator()
306
9.59.3.20
getOutputTensorAddress() . .
306
9.59.3.21
getPersistentCacheLimit()
307
9.59.3.22
getProfiler()
307
9.59.3.23
getShapeBinding()
307
9.59.3.24
getStrides()
308
9.59.3.25
getTemporaryStorageAllocator()
309
9.59.3.26
getTensorAddress()
309
9.59.3.27
getTensorShape()
309
9.59.3.28
getTensorStrides()
310
9.59.3.29
inferShapes()
311
9.59.3.30
reportToProfiler()
311
9.59.3.31
setAuxStreams()
312
9.59.3.32
setBindingDimensions()
313
9.59.3.33
setDebugSync()
314
9.59.3.34
setDeviceMemory()
314
9.59.3.35
setEnqueueEmitsProfile()
315
9.59.3.36
setErrorRecorder()
315
9.59.3.37
setInputConsumedEvent()
315
9.59.3.38
setInputShape()
316
9.59.3.39
setInputShapeBinding()
316
9.59.3.40
setInputTensorAddress()
317
9.59.3.41
setName()
318
9.59.3.42
setNvtxVerbosity()
318
9.59.3.43
setOptimizationProfile()
319
9.59.3.44
setOptimizationProfileAsync() .
320
9.59.3.45
setOutputAllocator()
321
9.59.3.46
setPersistentCacheLimit()
322
CONTENTS
xvii
9.59.3.47 setProfiler()
322
9.59.3.48 setTemporaryStorageAllocator()
322
9.59.3.49 setTensorAddress()
323
9.59.4
Member Data Documentation
324
9.59.4.1
mImpl
324
9.60
nvinfer1::safe::IExecutionContext Class Reference
324
9.60.1
Detailed Description
325
9.60.2
Constructor & Destructor Documentation
325
9.60.2.1
IExecutionContext() [1/3] . .
326
9.60.2.2
∼IExecutionContext()
326
9.60.2.3
IExecutionContext() [2/3] . .
326
9.60.2.4
IExecutionContext() [3/3] . .
326
9.60.3
Member Function Documentation
326
9.60.3.1
enqueueV2()
326
9.60.3.2
enqueueV3()
327
9.60.3.3
getEngine()
328
9.60.3.4
getErrorBuffer()
328
9.60.3.5
getErrorRecorder()
329
9.60.3.6
getInputConsumedEvent()
329
9.60.3.7
getInputTensorAddress()
329
9.60.3.8
getName()
330
9.60.3.9
getOutputTensorAddress() . .
330
9.60.3.10 getStrides()
331
9.60.3.11 getTensorStrides()
332
9.60.3.12 operator=() [1/2]
332
9.60.3.13 operator=() [2/2]
332
9.60.3.14 setDeviceMemory()
333
9.60.3.15 setErrorBuffer()
333
9.60.3.16 setErrorRecorder()
334
9.60.3.17 setInputConsumedEvent()
334
9.60.3.18 setInputTensorAddress()
335
9.60.3.19 setName()
336
9.60.3.20 setOutputTensorAddress()
336
9.61
nvinfer1::IExprBuilder Class Reference
337
9.61.1
Detailed Description
338
9.61.2
Constructor & Destructor Documentation
338
9.61.2.1
∼IExprBuilder()
338
9.61.3
Member Function Documentation
338
9.61.3.1
constant()
338
9.61.3.2
operation()
339
9.61.4
Member Data Documentation
339
9.61.4.1
mImpl
339
9.62
nvinfer1::IFillLayer Class Reference
339
9.62.1
Detailed Description
340
9.62.2
Constructor & Destructor Documentation
341
9.62.2.1
∼IFillLayer()
341
9.62.3
Member Function Documentation
341
9.62.3.1
getAlpha()
341
9.62.3.2
getBeta()
342
9.62.3.3
getDimensions()
342
9.62.3.4
getOperation()
342
9.62.3.5
setAlpha()
342
9.62.3.6
setBeta()
343
9.62.3.7
setDimensions()
343
xviii
CONTENTS
9.62.3.8
setInput()
344
9.62.3.9
setOperation()
345
9.62.4
Member Data Documentation
345
9.62.4.1
mImpl
345
9.63
nvinfer1::IFullyConnectedLayer Class Reference
345
9.63.1
Detailed Description
346
9.63.2
Constructor & Destructor Documentation
347
9.63.2.1
∼IFullyConnectedLayer()
347
9.63.3
Member Function Documentation
347
9.63.3.1
getBiasWeights()
347
9.63.3.2
getKernelWeights()
347
9.63.3.3
getNbOutputChannels()
348
9.63.3.4
setBiasWeights()
348
9.63.3.5
setInput()
348
9.63.3.6
setKernelWeights()
349
9.63.3.7
setNbOutputChannels()
349
9.63.4
Member Data Documentation
349
9.63.4.1
mImpl
350
9.64
nvinfer1::IGatherLayer Class Reference
350
9.64.1
Detailed Description
351
9.64.2
Constructor & Destructor Documentation
352
9.64.2.1
∼IGatherLayer()
352
9.64.3
Member Function Documentation
353
9.64.3.1
getGatherAxis()
353
9.64.3.2
getMode()
353
9.64.3.3
getNbElementWiseDims()
353
9.64.3.4
setGatherAxis()
353
9.64.3.5
setMode()
354
9.64.3.6
setNbElementWiseDims()
354
9.64.4
Member Data Documentation
355
9.64.4.1
mImpl
355
9.65
nvinfer1::IGpuAllocator Class Reference
355
9.65.1
Detailed Description
355
9.65.2
Constructor & Destructor Documentation
355
9.65.2.1
∼IGpuAllocator()
355
9.65.2.2
IGpuAllocator()
356
9.65.3
Member Function Documentation
356
9.65.3.1
allocate()
356
9.65.3.2
deallocate()
356
9.65.3.3
free()
357
9.65.3.4
reallocate()
358
9.66
nvinfer1::IGridSampleLayer Class Reference . .
359
9.66.1
Detailed Description
360
9.66.2
Constructor & Destructor Documentation
360
9.66.2.1
∼IGridSampleLayer()
360
9.66.3
Member Function Documentation
360
9.66.3.1
getAlignCorners()
360
9.66.3.2
getInterpolationMode()
361
9.66.3.3
getSampleMode()
361
9.66.3.4
setAlignCorners()
361
9.66.3.5
setInterpolationMode()
362
9.66.3.6
setSampleMode()
362
9.66.4
Member Data Documentation
362
9.66.4.1
mImpl
362
CONTENTS
xix
9.67
nvinfer1::IHostMemory Class Reference
363
9.67.1
Detailed Description
363
9.67.2
Constructor & Destructor Documentation
363
9.67.2.1
∼IHostMemory()
364
9.67.3
Member Function Documentation
364
9.67.3.1
data()
364
9.67.3.2
destroy()
364
9.67.3.3
size()
364
9.67.3.4
type()
364
9.67.4
Member Data Documentation
365
9.67.4.1
mImpl
365
9.68
nvinfer1::IIdentityLayer Class Reference
365
9.68.1
Detailed Description
366
9.68.2
Constructor & Destructor Documentation
366
9.68.2.1
∼IIdentityLayer()
366
9.68.3
Member Data Documentation
366
9.68.3.1
mImpl
366
9.69
nvinfer1::IIfConditional Class Reference
367
9.69.1
Detailed Description
367
9.69.2
Constructor & Destructor Documentation
368
9.69.2.1
∼IIfConditional()
368
9.69.3
Member Function Documentation
368
9.69.3.1
addInput()
368
9.69.3.2
addOutput()
368
9.69.3.3
getName()
369
9.69.3.4
setCondition()
369
9.69.3.5
setName()
369
9.69.4
Member Data Documentation
370
9.69.4.1
mImpl
370
9.70
nvinfer1::IIfConditionalBoundaryLayer Class Reference
370
9.70.1
Detailed Description
371
9.70.2
Constructor & Destructor Documentation
371
9.70.2.1
∼IIfConditionalBoundaryLayer()
371
9.70.3
Member Function Documentation
371
9.70.3.1
getConditional()
371
9.70.4
Member Data Documentation
371
9.70.4.1
mBoundary
371
9.71
nvinfer1::IIfConditionalInputLayer Class Reference
372
9.71.1
Detailed Description
372
9.71.2
Constructor & Destructor Documentation
372
9.71.2.1
∼IIfConditionalInputLayer()
372
9.71.3
Member Data Documentation
372
9.71.3.1
mImpl
373
9.72
nvinfer1::IIfConditionalOutputLayer Class Reference . .
373
9.72.1
Detailed Description
373
9.72.2
Constructor & Destructor Documentation
373
9.72.2.1
∼IIfConditionalOutputLayer()
374
9.72.3
Member Data Documentation
374
9.72.3.1
mImpl
374
9.73
nvinfer1::IInt8Calibrator Class Reference
374
9.73.1
Detailed Description
375
9.73.2
Constructor & Destructor Documentation
375
9.73.2.1
∼IInt8Calibrator()
375
9.73.3
Member Function Documentation
375
xx
CONTENTS
9.73.3.1
getAlgorithm()
375
9.73.3.2
getBatch()
375
9.73.3.3
getBatchSize()
376
9.73.3.4
readCalibrationCache()
376
9.73.3.5
writeCalibrationCache()
377
9.74
nvinfer1::IInt8EntropyCalibrator Class Reference .
377
9.74.1
Detailed Description
378
9.74.2
Constructor & Destructor Documentation .
378
9.74.2.1
∼IInt8EntropyCalibrator()
378
9.74.3
Member Function Documentation
378
9.74.3.1
getAlgorithm()
378
9.75
nvinfer1::IInt8EntropyCalibrator2 Class Reference
378
9.75.1
Detailed Description
379
9.75.2
Constructor & Destructor Documentation
379
9.75.2.1
∼IInt8EntropyCalibrator2() . .
379
9.75.3
Member Function Documentation
379
9.75.3.1
getAlgorithm()
379
9.76
nvinfer1::IInt8LegacyCalibrator Class Reference
379
9.76.1
Detailed Description
380
9.76.2
Constructor & Destructor Documentation
380
9.76.2.1
∼IInt8LegacyCalibrator()
380
9.76.3
Member Function Documentation
380
9.76.3.1
getAlgorithm()
380
9.76.3.2
getQuantile()
381
9.76.3.3
getRegressionCutoff()
381
9.76.3.4
readHistogramCache()
381
9.76.3.5
writeHistogramCache()
381
9.77
nvinfer1::IInt8MinMaxCalibrator Class Reference .
382
9.77.1
Detailed Description
382
9.77.2
Constructor & Destructor Documentation
382
9.77.2.1
∼IInt8MinMaxCalibrator() . .
382
9.77.3
Member Function Documentation
383
9.77.3.1
getAlgorithm()
383
9.78
nvinfer1::IIteratorLayer Class Reference
383
9.78.1
Constructor & Destructor Documentation
384
9.78.1.1
∼IIteratorLayer()
384
9.78.2
Member Function Documentation
384
9.78.2.1
getAxis()
384
9.78.2.2
getReverse()
384
9.78.2.3
setAxis()
384
9.78.2.4
setReverse()
385
9.78.3
Member Data Documentation
385
9.78.3.1
mImpl
385
9.79
nvinfer1::ILayer Class Reference
385
9.79.1
Detailed Description
387
9.79.2
Constructor & Destructor Documentation
387
9.79.2.1
∼ILayer()
387
9.79.3
Member Function Documentation
388
9.79.3.1
getInput()
388
9.79.3.2
getMetadata()
388
9.79.3.3
getName()
388
9.79.3.4
getNbInputs()
389
9.79.3.5
getNbOutputs()
389
9.79.3.6
getOutput()
389
CONTENTS
xxi
9.79.3.7
getOutputType()
389
9.79.3.8
getPrecision()
390
9.79.3.9
getType()
390
9.79.3.10 outputTypeIsSet()
390
9.79.3.11 precisionIsSet()
391
9.79.3.12 resetOutputType()
391
9.79.3.13 resetPrecision()
392
9.79.3.14 setInput()
392
9.79.3.15 setMetadata()
392
9.79.3.16 setName()
393
9.79.3.17 setOutputType()
393
9.79.3.18 setPrecision()
394
9.79.4
Member Data Documentation
395
9.79.4.1
mLayer
395
9.80
nvinfer1::ILogger Class Reference
395
9.80.1
Detailed Description
396
9.80.2
Member Enumeration Documentation . .
396
9.80.2.1
Severity
396
9.80.3
Constructor & Destructor Documentation
396
9.80.3.1
ILogger()
396
9.80.3.2
∼ILogger()
396
9.80.4
Member Function Documentation
397
9.80.4.1
log()
397
9.81
nvinfer1::ILoggerFinder Class Reference
397
9.81.1
Detailed Description
398
9.81.2
Constructor & Destructor Documentation
398
9.81.2.1
∼ILoggerFinder()
398
9.81.3
Member Function Documentation
398
9.81.3.1
findLogger()
398
9.82
nvinfer1::ILoop Class Reference
399
9.82.1
Detailed Description
399
9.82.2
Constructor & Destructor Documentation
399
9.82.2.1
∼ILoop()
400
9.82.3
Member Function Documentation
400
9.82.3.1
addIterator()
400
9.82.3.2
addLoopOutput()
400
9.82.3.3
addRecurrence()
400
9.82.3.4
addTripLimit()
401
9.82.3.5
getName()
401
9.82.3.6
setName()
401
9.82.4
Member Data Documentation
402
9.82.4.1
mImpl
402
9.83
nvinfer1::ILoopBoundaryLayer Class Reference .
402
9.83.1
Constructor & Destructor Documentation
402
9.83.1.1
∼ILoopBoundaryLayer()
403
9.83.2
Member Function Documentation
403
9.83.2.1
getLoop()
403
9.83.3
Member Data Documentation
403
9.83.3.1
mBoundary
403
9.84
nvinfer1::ILoopOutputLayer Class Reference . .
403
9.84.1
Detailed Description
404
9.84.2
Constructor & Destructor Documentation
404
9.84.2.1
∼ILoopOutputLayer()
404
9.84.3
Member Function Documentation
405
xxii
CONTENTS
9.84.3.1
getAxis()
405
9.84.3.2
getLoopOutput()
405
9.84.3.3
setAxis()
405
9.84.3.4
setInput()
405
9.84.4
Member Data Documentation
406
9.84.4.1
mImpl
406
9.85
nvinfer1::ILRNLayer Class Reference
406
9.85.1
Detailed Description
407
9.85.2
Constructor & Destructor Documentation
407
9.85.2.1
∼ILRNLayer()
407
9.85.3
Member Function Documentation
408
9.85.3.1
getAlpha()
408
9.85.3.2
getBeta()
408
9.85.3.3
getK()
408
9.85.3.4
getWindowSize()
409
9.85.3.5
setAlpha()
409
9.85.3.6
setBeta()
409
9.85.3.7
setK()
410
9.85.3.8
setWindowSize()
410
9.85.4
Member Data Documentation
410
9.85.4.1
mImpl
410
9.86
nvinfer1::IMatrixMultiplyLayer Class Reference
411
9.86.1
Detailed Description
411
9.86.2
Constructor & Destructor Documentation
412
9.86.2.1
∼IMatrixMultiplyLayer()
412
9.86.3
Member Function Documentation
412
9.86.3.1
getOperation()
412
9.86.3.2
setOperation()
412
9.86.4
Member Data Documentation
413
9.86.4.1
mImpl
413
9.87
nvinfer1::INetworkDefinition Class Reference . .
413
9.87.1
Detailed Description
417
9.87.2
Constructor & Destructor Documentation
417
9.87.2.1
∼INetworkDefinition()
417
9.87.3
Member Function Documentation
418
9.87.3.1
addActivation()
418
9.87.3.2
addAssertion()
418
9.87.3.3
addCast()
419
9.87.3.4
addConcatenation()
419
9.87.3.5
addConstant()
420
9.87.3.6
addConvolution()
421
9.87.3.7
addConvolutionNd()
421
9.87.3.8
addDeconvolution()
422
9.87.3.9
addDeconvolutionNd()
423
9.87.3.10 addDequantize()
424
9.87.3.11 addEinsum()
424
9.87.3.12 addElementWise()
425
9.87.3.13 addFill()
425
9.87.3.14 addFullyConnected()
426
9.87.3.15 addGather()
427
9.87.3.16 addGatherV2()
427
9.87.3.17 addGridSample()
428
9.87.3.18 addIdentity()
428
9.87.3.19 addIfConditional()
429
CONTENTS
xxiii
9.87.3.20
addInput()
429
9.87.3.21
addLoop()
430
9.87.3.22
addLRN()
430
9.87.3.23
addMatrixMultiply() .
431
9.87.3.24
addNMS()
432
9.87.3.25
addNonZero()
432
9.87.3.26
addNormalization() .
433
9.87.3.27
addOneHot()
434
9.87.3.28
addPadding()
434
9.87.3.29
addPaddingNd()
435
9.87.3.30
addParametricReLU()
435
9.87.3.31
addPluginV2()
436
9.87.3.32
addPooling()
437
9.87.3.33
addPoolingNd()
437
9.87.3.34
addQuantize()
438
9.87.3.35
addRaggedSoftMax()
438
9.87.3.36
addReduce()
439
9.87.3.37
addResize()
440
9.87.3.38
addReverseSequence() .
440
9.87.3.39
addRNNv2()
441
9.87.3.40
addScale()
443
9.87.3.41
addScaleNd()
443
9.87.3.42
addScatter()
444
9.87.3.43
addSelect()
445
9.87.3.44
addShape()
446
9.87.3.45
addShuffle()
446
9.87.3.46
addSlice()
447
9.87.3.47
addSoftMax()
448
9.87.3.48
addTopK()
448
9.87.3.49
addUnary()
449
9.87.3.50
destroy()
450
9.87.3.51
getBuilder()
450
9.87.3.52
getErrorRecorder() .
450
9.87.3.53
getInput()
450
9.87.3.54
getLayer()
451
9.87.3.55
getName()
451
9.87.3.56
getNbInputs()
452
9.87.3.57
getNbLayers()
452
9.87.3.58
getNbOutputs()
453
9.87.3.59
getOutput()
453
9.87.3.60
hasExplicitPrecision()
454
9.87.3.61
hasImplicitBatchDimension()
454
9.87.3.62
markOutput()
454
9.87.3.63
markOutputForShapes()
455
9.87.3.64
removeTensor()
455
9.87.3.65
setErrorRecorder()
456
9.87.3.66
setName()
456
9.87.3.67
setWeightsName()
457
9.87.3.68
unmarkOutput()
457
9.87.3.69
unmarkOutputForShapes() .
458
9.87.4
Member Data Documentation
458
9.87.4.1
mImpl
458
9.88
nvinfer1::INMSLayer Class Reference
458
9.88.1
Detailed Description
459
xxiv
CONTENTS
9.88.2
Constructor & Destructor Documentation
460
9.88.2.1
∼INMSLayer()
460
9.88.3
Member Function Documentation
460
9.88.3.1
getBoundingBoxFormat()
460
9.88.3.2
getTopKBoxLimit()
461
9.88.3.3
setBoundingBoxFormat()
461
9.88.3.4
setInput()
461
9.88.3.5
setTopKBoxLimit()
462
9.88.4
Member Data Documentation
462
9.88.4.1
mImpl
462
9.89
nvinfer1::INoCopy Class Reference
463
9.89.1
Detailed Description
463
9.89.2
Constructor & Destructor Documentation
464
9.89.2.1
INoCopy() [1/3]
464
9.89.2.2
∼INoCopy()
464
9.89.2.3
INoCopy() [2/3]
464
9.89.2.4
INoCopy() [3/3]
464
9.89.3
Member Function Documentation
464
9.89.3.1
operator=() [1/2]
464
9.89.3.2
operator=() [2/2]
465
9.90
INonZero Class Reference
465
9.90.1
Detailed Description
465
9.91
nvinfer1::INonZeroLayer Class Reference
465
9.91.1
Constructor & Destructor Documentation
466
9.91.1.1
∼INonZeroLayer()
466
9.91.2
Member Data Documentation
466
9.91.2.1
mImpl
466
9.92
nvinfer1::INormalizationLayer Class Reference .
466
9.92.1
Detailed Description
467
9.92.2
Constructor & Destructor Documentation
467
9.92.2.1
∼INormalizationLayer()
468
9.92.3
Member Function Documentation
468
9.92.3.1
getAxes()
468
9.92.3.2
getComputePrecision()
468
9.92.3.3
getEpsilon()
468
9.92.3.4
getNbGroups()
469
9.92.3.5
setAxes()
469
9.92.3.6
setComputePrecision()
469
9.92.3.7
setEpsilon()
470
9.92.3.8
setNbGroups()
470
9.92.4
Member Data Documentation
470
9.92.4.1
mImpl
470
9.93
nvinfer1::IOneHotLayer Class Reference
471
9.93.1
Detailed Description
471
9.93.2
Member Function Documentation
472
9.93.2.1
getAxis()
472
9.93.2.2
setAxis()
472
9.93.3
Member Data Documentation
472
9.93.3.1
mImpl
473
9.94
nvonnxparser::IOnnxConfig Class Reference
473
9.94.1
Detailed Description
474
9.94.2
Member Typedef Documentation
474
9.94.2.1
Verbosity
474
9.94.3
Constructor & Destructor Documentation
474
CONTENTS
xxv
9.94.3.1
∼IOnnxConfig()
474
9.94.4
Member Function Documentation
474
9.94.4.1
addVerbosity()
474
9.94.4.2
destroy()
474
9.94.4.3
getFullTextFileName()
475
9.94.4.4
getModelDtype()
475
9.94.4.5
getModelFileName()
476
9.94.4.6
getPrintLayerInfo()
476
9.94.4.7
getTextFileName()
476
9.94.4.8
getVerbosityLevel()
477
9.94.4.9
reduceVerbosity()
477
9.94.4.10 setFullTextFileName()
477
9.94.4.11 setModelDtype()
478
9.94.4.12 setModelFileName()
478
9.94.4.13 setPrintLayerInfo()
478
9.94.4.14 setTextFileName()
479
9.94.4.15 setVerbosityLevel()
479
9.95
nvinfer1::IOptimizationProfile Class Reference .
480
9.95.1
Detailed Description
481
9.95.2
Constructor & Destructor Documentation
481
9.95.2.1
∼IOptimizationProfile()
481
9.95.3
Member Function Documentation
481
9.95.3.1
getDimensions()
481
9.95.3.2
getExtraMemoryTarget()
482
9.95.3.3
getNbShapeValues()
482
9.95.3.4
getShapeValues()
482
9.95.3.5
isValid()
483
9.95.3.6
setDimensions()
483
9.95.3.7
setExtraMemoryTarget()
484
9.95.3.8
setShapeValues()
484
9.95.4
Member Data Documentation
485
9.95.4.1
mImpl
485
9.96
nvinfer1::IOutputAllocator Class Reference
486
9.96.1
Detailed Description
486
9.96.2
Constructor & Destructor Documentation
486
9.96.2.1
∼IOutputAllocator()
486
9.96.3
Member Function Documentation
486
9.96.3.1
getInterfaceVersion()
487
9.96.3.2
notifyShape()
487
9.96.3.3
reallocateOutput()
487
9.97
nvinfer1::IPaddingLayer Class Reference
488
9.97.1
Detailed Description
489
9.97.2
Constructor & Destructor Documentation
489
9.97.2.1
∼IPaddingLayer()
489
9.97.3
Member Function Documentation
489
9.97.3.1
getPostPadding()
489
9.97.3.2
getPostPaddingNd()
489
9.97.3.3
getPrePadding()
490
9.97.3.4
getPrePaddingNd()
490
9.97.3.5
setPostPadding()
491
9.97.3.6
setPostPaddingNd()
491
9.97.3.7
setPrePadding()
491
9.97.3.8
setPrePaddingNd()
492
9.97.4
Member Data Documentation
492
xxvi
CONTENTS
9.97.4.1
mImpl
492
9.98
nvinfer1::IParametricReLULayer Class Reference .
492
9.98.1
Detailed Description
493
9.98.2
Constructor & Destructor Documentation
493
9.98.2.1
∼IParametricReLULayer() . .
493
9.98.3
Member Data Documentation
493
9.98.3.1
mImpl
493
9.99
nvonnxparser::IParser Class Reference
494
9.99.1
Detailed Description
495
9.99.2
Constructor & Destructor Documentation
495
9.99.2.1
∼IParser()
495
9.99.3
Member Function Documentation
495
9.99.3.1
clearErrors()
495
9.99.3.2
clearFlag()
495
9.99.3.3
destroy()
495
9.99.3.4
getError()
496
9.99.3.5
getFlag()
496
9.99.3.6
getFlags()
496
9.99.3.7
getNbErrors()
497
9.99.3.8
getUsedVCPluginLibraries() .
497
9.99.3.9
parse()
497
9.99.3.10 parseFromFile()
498
9.99.3.11 parseWithWeightDescriptors()
498
9.99.3.12 setFlag()
499
9.99.3.13 setFlags()
499
9.99.3.14 supportsModel()
500
9.99.3.15 supportsOperator()
500
9.100nvonnxparser::IParserError Class Reference
501
9.100.1 Detailed Description
501
9.100.2 Constructor & Destructor Documentation
501
9.100.2.1 ∼IParserError()
501
9.100.3 Member Function Documentation
502
9.100.3.1 code()
502
9.100.3.2 desc()
502
9.100.3.3 file()
502
9.100.3.4 func()
502
9.100.3.5 line()
502
9.100.3.6 node()
503
9.101nvinfer1::consistency::IPluginChecker Class Reference
503
9.101.1 Detailed Description
503
9.101.2 Constructor & Destructor Documentation
504
9.101.2.1 IPluginChecker() [1/3]
504
9.101.2.2 ∼IPluginChecker()
504
9.101.2.3 IPluginChecker() [2/3]
504
9.101.2.4 IPluginChecker() [3/3]
504
9.101.3 Member Function Documentation
504
9.101.3.1 operator=() [1/2]
504
9.101.3.2 operator=() [2/2]
505
9.101.3.3 validate()
505
9.102nvinfer1::IPluginCreator Class Reference
505
9.102.1 Detailed Description
506
9.102.2 Constructor & Destructor Documentation
506
9.102.2.1 IPluginCreator()
506
9.102.2.2 ∼IPluginCreator()
507
CONTENTS
xxvii
9.102.3 Member Function Documentation
507
9.102.3.1 createPlugin()
507
9.102.3.2 deserializePlugin()
507
9.102.3.3 getFieldNames()
508
9.102.3.4 getPluginName()
508
9.102.3.5 getPluginNamespace()
508
9.102.3.6 getPluginVersion()
509
9.102.3.7 getTensorRTVersion()
509
9.102.3.8 setPluginNamespace()
510
9.103nvcaffeparser1::IPluginFactoryV2 Class Reference
510
9.103.1 Detailed Description
510
9.103.2 Constructor & Destructor Documentation
511
9.103.2.1 ∼IPluginFactoryV2()
511
9.103.3 Member Function Documentation
511
9.103.3.1 createPlugin()
511
9.103.3.2 isPluginV2()
511
9.104nvinfer1::IPluginRegistry Class Reference
512
9.104.1 Detailed Description
513
9.104.2 Member Typedef Documentation
513
9.104.2.1 PluginLibraryHandle
513
9.104.3 Constructor & Destructor Documentation
513
9.104.3.1 ∼IPluginRegistry()
513
9.104.4 Member Function Documentation
513
9.104.4.1 deregisterCreator()
514
9.104.4.2 deregisterLibrary()
514
9.104.4.3 getErrorRecorder()
514
9.104.4.4 getPluginCreator()
515
9.104.4.5 getPluginCreatorList()
515
9.104.4.6 isParentSearchEnabled()
516
9.104.4.7 loadLibrary()
516
9.104.4.8 registerCreator()
516
9.104.4.9 setErrorRecorder()
517
9.104.4.10setParentSearchEnabled()
517
9.105nvinfer1::safe::IPluginRegistry Class Reference .
518
9.105.1 Detailed Description
519
9.105.2 Constructor & Destructor Documentation
519
9.105.2.1 ∼IPluginRegistry()
519
9.105.3 Member Function Documentation
519
9.105.3.1 deregisterCreator()
519
9.105.3.2 getErrorRecorder()
520
9.105.3.3 getPluginCreator()
520
9.105.3.4 getPluginCreatorList()
521
9.105.3.5 registerCreator()
521
9.105.3.6 setErrorRecorder()
521
9.106nvinfer1::IPluginV2 Class Reference
522
9.106.1 Detailed Description
523
9.106.2 Member Function Documentation
524
9.106.2.1 clone()
524
9.106.2.2 configureWithFormat()
524
9.106.2.3 destroy()
525
9.106.2.4 enqueue()
525
9.106.2.5 getNbOutputs()
526
9.106.2.6 getOutputDimensions()
526
9.106.2.7 getPluginNamespace()
527
xxviii
CONTENTS
9.106.2.8 getPluginType()
527
9.106.2.9 getPluginVersion()
528
9.106.2.10getSerializationSize()
528
9.106.2.11getTensorRTVersion()
529
9.106.2.12getWorkspaceSize()
529
9.106.2.13initialize()
530
9.106.2.14serialize()
530
9.106.2.15setPluginNamespace()
531
9.106.2.16supportsFormat()
531
9.106.2.17terminate()
532
9.107nvinfer1::IPluginV2DynamicExt Class Reference
533
9.107.1 Detailed Description
534
9.107.2 Constructor & Destructor Documentation
534
9.107.2.1 ∼IPluginV2DynamicExt()
534
9.107.3 Member Function Documentation
534
9.107.3.1 clone()
534
9.107.3.2 configurePlugin()
535
9.107.3.3 enqueue()
536
9.107.3.4 getOutputDimensions()
536
9.107.3.5 getTensorRTVersion()
537
9.107.3.6 getWorkspaceSize()
537
9.107.3.7 supportsFormatCombination()
538
9.107.4 Member Data Documentation
538
9.107.4.1 kFORMAT COMBINATION LIMIT
538
9.108nvinfer1::IPluginV2Ext Class Reference
539
9.108.1 Detailed Description
540
9.108.2 Constructor & Destructor Documentation
540
9.108.2.1 IPluginV2Ext()
540
9.108.2.2 ∼IPluginV2Ext()
540
9.108.3 Member Function Documentation
540
9.108.3.1 attachToContext()
540
9.108.3.2 canBroadcastInputAcrossBatch() . .
541
9.108.3.3 clone()
542
9.108.3.4 configurePlugin()
542
9.108.3.5 configureWithFormat()
543
9.108.3.6 detachFromContext()
544
9.108.3.7 getOutputDataType()
544
9.108.3.8 getTensorRTVersion()
545
9.108.3.9 isOutputBroadcastAcrossBatch() . .
545
9.109nvinfer1::IPluginV2IOExt Class Reference
546
9.109.1 Detailed Description
546
9.109.2 Member Function Documentation
547
9.109.2.1 configurePlugin()
547
9.109.2.2 getTensorRTVersion()
547
9.109.2.3 supportsFormatCombination()
548
9.110nvinfer1::IPluginV2Layer Class Reference
549
9.110.1 Detailed Description
549
9.110.2 Constructor & Destructor Documentation
549
9.110.2.1 ∼IPluginV2Layer()
550
9.110.3 Member Function Documentation
550
9.110.3.1 getPlugin()
550
9.110.4 Member Data Documentation
550
9.110.4.1 mImpl
550
9.111nvinfer1::IPoolingLayer Class Reference
550
CONTENTS
xxix
9.111.1 Detailed Description
552
9.111.2 Constructor & Destructor Documentation
552
9.111.2.1 ∼IPoolingLayer()
552
9.111.3 Member Function Documentation
552
9.111.3.1 getAverageCountExcludesPadding()
553
9.111.3.2 getBlendFactor()
553
9.111.3.3 getPadding()
553
9.111.3.4 getPaddingMode()
554
9.111.3.5 getPaddingNd()
554
9.111.3.6 getPoolingType()
554
9.111.3.7 getPostPadding()
554
9.111.3.8 getPrePadding()
555
9.111.3.9 getStride()
555
9.111.3.10getStrideNd()
555
9.111.3.11getWindowSize()
555
9.111.3.12getWindowSizeNd()
556
9.111.3.13setAverageCountExcludesPadding()
556
9.111.3.14setBlendFactor()
556
9.111.3.15setPadding()
557
9.111.3.16setPaddingMode()
557
9.111.3.17setPaddingNd()
557
9.111.3.18setPoolingType()
558
9.111.3.19setPostPadding()
558
9.111.3.20setPrePadding()
558
9.111.3.21setStride()
559
9.111.3.22setStrideNd()
559
9.111.3.23setWindowSize()
559
9.111.3.24setWindowSizeNd()
560
9.111.4 Member Data Documentation
560
9.111.4.1 mImpl
560
9.112nvinfer1::IProfiler Class Reference
560
9.112.1 Detailed Description
560
9.112.2 Constructor & Destructor Documentation
561
9.112.2.1 ∼IProfiler()
561
9.112.3 Member Function Documentation
561
9.112.3.1 reportLayerTime()
561
9.113nvinfer1::IQuantizeLayer Class Reference
561
9.113.1 Detailed Description
562
9.113.2 Constructor & Destructor Documentation
563
9.113.2.1 ∼IQuantizeLayer()
563
9.113.3 Member Function Documentation
563
9.113.3.1 getAxis()
563
9.113.3.2 setAxis()
563
9.113.4 Member Data Documentation
564
9.113.4.1 mImpl
564
9.114nvinfer1::IRaggedSoftMaxLayer Class Reference
564
9.114.1 Detailed Description
564
9.114.2 Constructor & Destructor Documentation
565
9.114.2.1 ∼IRaggedSoftMaxLayer() . .
565
9.114.3 Member Data Documentation
565
9.114.3.1 mImpl
565
9.115nvinfer1::IRecurrenceLayer Class Reference
565
9.115.1 Constructor & Destructor Documentation
566
9.115.1.1 ∼IRecurrenceLayer()
566
xxx
CONTENTS
9.115.2 Member Function Documentation
566
9.115.2.1 setInput()
566
9.115.3 Member Data Documentation
567
9.115.3.1 mImpl
567
9.116nvinfer1::IReduceLayer Class Reference
567
9.116.1 Detailed Description
568
9.116.2 Constructor & Destructor Documentation
568
9.116.2.1 ∼IReduceLayer()
568
9.116.3 Member Function Documentation
568
9.116.3.1 getKeepDimensions()
568
9.116.3.2 getOperation()
569
9.116.3.3 getReduceAxes()
569
9.116.3.4 setKeepDimensions()
569
9.116.3.5 setOperation()
569
9.116.3.6 setReduceAxes()
570
9.116.4 Member Data Documentation
570
9.116.4.1 mImpl
570
9.117nvinfer1::IRefitter Class Reference
570
9.117.1 Detailed Description
571
9.117.2 Constructor & Destructor Documentation
572
9.117.2.1 ∼IRefitter()
572
9.117.3 Member Function Documentation
572
9.117.3.1 destroy()
572
9.117.3.2 getAll()
572
9.117.3.3 getAllWeights()
573
9.117.3.4 getDynamicRangeMax()
573
9.117.3.5 getDynamicRangeMin()
574
9.117.3.6 getErrorRecorder()
574
9.117.3.7 getLogger()
574
9.117.3.8 getMaxThreads()
575
9.117.3.9 getMissing()
575
9.117.3.10getMissingWeights()
575
9.117.3.11getTensorsWithDynamicRange()
576
9.117.3.12refitCudaEngine()
576
9.117.3.13setDynamicRange()
577
9.117.3.14setErrorRecorder()
577
9.117.3.15setMaxThreads()
578
9.117.3.16setNamedWeights()
578
9.117.3.17setWeights()
579
9.117.4 Member Data Documentation
579
9.117.4.1 mImpl
579
9.118nvinfer1::IResizeLayer Class Reference
580
9.118.1 Detailed Description
581
9.118.2 Constructor & Destructor Documentation .
582
9.118.2.1 ∼IResizeLayer()
582
9.118.3 Member Function Documentation
582
9.118.3.1 getAlignCorners()
582
9.118.3.2 getCoordinateTransformation() .
583
9.118.3.3 getCubicCoeff()
583
9.118.3.4 getExcludeOutside()
583
9.118.3.5 getNearestRounding()
583
9.118.3.6 getOutputDimensions()
584
9.118.3.7 getResizeMode()
584
9.118.3.8 getScales()
584
CONTENTS
xxxi
9.118.3.9 getSelectorForSinglePixel()
585
9.118.3.10setAlignCorners()
585
9.118.3.11setCoordinateTransformation() .
585
9.118.3.12setCubicCoeff()
586
9.118.3.13setExcludeOutside()
586
9.118.3.14setInput()
586
9.118.3.15setNearestRounding()
587
9.118.3.16setOutputDimensions()
587
9.118.3.17setResizeMode()
588
9.118.3.18setScales()
588
9.118.3.19setSelectorForSinglePixel()
589
9.118.4 Member Data Documentation
589
9.118.4.1 mImpl
589
9.119nvinfer1::IReverseSequenceLayer Class Reference
589
9.119.1 Detailed Description
590
9.119.2 Constructor & Destructor Documentation
590
9.119.2.1 ∼IReverseSequenceLayer() . .
590
9.119.3 Member Function Documentation
590
9.119.3.1 getBatchAxis()
591
9.119.3.2 getSequenceAxis()
591
9.119.3.3 setBatchAxis()
591
9.119.3.4 setSequenceAxis()
591
9.119.4 Member Data Documentation
592
9.119.4.1 mImpl
592
9.120nvinfer1::IRNNv2Layer Class Reference
592
9.120.1 Detailed Description
593
9.120.2 Constructor & Destructor Documentation
594
9.120.2.1 ∼IRNNv2Layer()
594
9.120.3 Member Function Documentation
594
9.120.3.1 getBiasForGate()
594
9.120.3.2 getCellState()
594
9.120.3.3 getDataLength()
595
9.120.3.4 getDirection()
595
9.120.3.5 getHiddenSize()
595
9.120.3.6 getHiddenState()
595
9.120.3.7 getInputMode()
596
9.120.3.8 getLayerCount()
596
9.120.3.9 getMaxSeqLength()
596
9.120.3.10getOperation()
596
9.120.3.11getSequenceLengths()
597
9.120.3.12getWeightsForGate()
597
9.120.3.13setBiasForGate()
597
9.120.3.14setCellState()
598
9.120.3.15setDirection()
598
9.120.3.16setHiddenState()
599
9.120.3.17setInputMode()
599
9.120.3.18setOperation()
599
9.120.3.19setSequenceLengths()
600
9.120.3.20setWeightsForGate()
600
9.120.4 Member Data Documentation
601
9.120.4.1 mImpl
601
9.121nvinfer1::IRuntime Class Reference
601
9.121.1 Detailed Description
603
9.121.2 Constructor & Destructor Documentation
603
xxxii
CONTENTS
9.121.2.1 ∼IRuntime()
603
9.121.3 Member Function Documentation
603
9.121.3.1 deserializeCudaEngine() [1/2]
603
9.121.3.2 deserializeCudaEngine() [2/2]
604
9.121.3.3 destroy()
604
9.121.3.4 getDLACore()
605
9.121.3.5 getEngineHostCodeAllowed() .
605
9.121.3.6 getErrorRecorder()
605
9.121.3.7 getLogger()
606
9.121.3.8 getMaxThreads()
606
9.121.3.9 getNbDLACores()
606
9.121.3.10getPluginRegistry()
606
9.121.3.11getTempfileControlFlags() . .
607
9.121.3.12getTemporaryDirectory()
607
9.121.3.13loadRuntime()
607
9.121.3.14setDLACore()
608
9.121.3.15setEngineHostCodeAllowed() .
608
9.121.3.16setErrorRecorder()
609
9.121.3.17setGpuAllocator()
609
9.121.3.18setMaxThreads()
609
9.121.3.19setTempfileControlFlags()
610
9.121.3.20setTemporaryDirectory()
610
9.121.4 Member Data Documentation
611
9.121.4.1 mImpl
611
9.122nvinfer1::safe::IRuntime Class Reference
611
9.122.1 Detailed Description
612
9.122.2 Constructor & Destructor Documentation
612
9.122.2.1 IRuntime() [1/3]
612
9.122.2.2 ∼IRuntime()
613
9.122.2.3 IRuntime() [2/3]
613
9.122.2.4 IRuntime() [3/3]
613
9.122.3 Member Function Documentation
613
9.122.3.1 deserializeCudaEngine()
613
9.122.3.2 getErrorRecorder()
614
9.122.3.3 operator=() [1/2]
614
9.122.3.4 operator=() [2/2]
615
9.122.3.5 setErrorRecorder()
615
9.122.3.6 setGpuAllocator()
615
9.123nvinfer1::IScaleLayer Class Reference
616
9.123.1 Detailed Description
617
9.123.2 Constructor & Destructor Documentation
617
9.123.2.1 ∼IScaleLayer()
618
9.123.3 Member Function Documentation
618
9.123.3.1 getChannelAxis()
618
9.123.3.2 getMode()
618
9.123.3.3 getPower()
618
9.123.3.4 getScale()
619
9.123.3.5 getShift()
619
9.123.3.6 setChannelAxis()
619
9.123.3.7 setMode()
620
9.123.3.8 setPower()
620
9.123.3.9 setScale()
620
9.123.3.10setShift()
620
9.123.4 Member Data Documentation
621
CONTENTS
xxxiii
9.123.4.1 mImpl
621
9.124nvinfer1::IScatterLayer Class Reference
621
9.124.1 Detailed Description
622
9.124.2 Constructor & Destructor Documentation
623
9.124.2.1 ∼IScatterLayer()
623
9.124.3 Member Function Documentation
623
9.124.3.1 getAxis()
623
9.124.3.2 getMode()
623
9.124.3.3 setAxis()
623
9.124.3.4 setMode()
624
9.124.4 Member Data Documentation
624
9.124.4.1 mImpl
624
9.125nvinfer1::ISelectLayer Class Reference
624
9.125.1 Detailed Description
624
9.125.2 Constructor & Destructor Documentation
625
9.125.2.1 ∼ISelectLayer()
625
9.125.3 Member Data Documentation
625
9.125.3.1 mImpl
625
9.126nvinfer1::IShapeLayer Class Reference
625
9.126.1 Detailed Description
626
9.126.2 Constructor & Destructor Documentation
626
9.126.2.1 ∼IShapeLayer()
626
9.126.3 Member Data Documentation
626
9.126.3.1 mImpl
626
9.127nvinfer1::IShuffleLayer Class Reference
627
9.127.1 Detailed Description
628
9.127.2 Constructor & Destructor Documentation
628
9.127.2.1 ∼IShuffleLayer()
628
9.127.3 Member Function Documentation
628
9.127.3.1 getFirstTranspose()
628
9.127.3.2 getReshapeDimensions()
629
9.127.3.3 getSecondTranspose()
629
9.127.3.4 getZeroIsPlaceholder()
629
9.127.3.5 setFirstTranspose()
629
9.127.3.6 setInput()
630
9.127.3.7 setReshapeDimensions()
631
9.127.3.8 setSecondTranspose()
631
9.127.3.9 setZeroIsPlaceholder()
632
9.127.4 Member Data Documentation
632
9.127.4.1 mImpl
632
9.128nvinfer1::ISliceLayer Class Reference
632
9.128.1 Detailed Description
633
9.128.2 Constructor & Destructor Documentation
634
9.128.2.1 ∼ISliceLayer()
634
9.128.3 Member Function Documentation
634
9.128.3.1 getMode()
634
9.128.3.2 getSize()
635
9.128.3.3 getStart()
635
9.128.3.4 getStride()
635
9.128.3.5 setInput()
635
9.128.3.6 setMode()
636
9.128.3.7 setSize()
636
9.128.3.8 setStart()
637
9.128.3.9 setStride()
637
xxxiv
CONTENTS
9.128.4 Member Data Documentation
638
9.128.4.1 mImpl
638
9.129nvinfer1::ISoftMaxLayer Class Reference
638
9.129.1 Detailed Description
639
9.129.2 Constructor & Destructor Documentation
639
9.129.2.1 ∼ISoftMaxLayer()
639
9.129.3 Member Function Documentation
639
9.129.3.1 getAxes()
639
9.129.3.2 setAxes()
640
9.129.4 Member Data Documentation
640
9.129.4.1 mImpl
640
9.130nvinfer1::ITensor Class Reference
640
9.130.1 Detailed Description
642
9.130.2 Constructor & Destructor Documentation
642
9.130.2.1 ∼ITensor()
642
9.130.3 Member Function Documentation
643
9.130.3.1 dynamicRangeIsSet()
643
9.130.3.2 getAllowedFormats()
643
9.130.3.3 getBroadcastAcrossBatch() . .
643
9.130.3.4 getDimensionName()
643
9.130.3.5 getDimensions()
644
9.130.3.6 getDynamicRangeMax()
644
9.130.3.7 getDynamicRangeMin()
645
9.130.3.8 getLocation()
645
9.130.3.9 getName()
645
9.130.3.10getType()
646
9.130.3.11isExecutionTensor()
646
9.130.3.12isNetworkInput()
646
9.130.3.13isNetworkOutput()
647
9.130.3.14isShapeTensor()
647
9.130.3.15resetDynamicRange()
647
9.130.3.16setAllowedFormats()
648
9.130.3.17setBroadcastAcrossBatch() . .
648
9.130.3.18setDimensionName()
649
9.130.3.19setDimensions()
649
9.130.3.20setDynamicRange()
650
9.130.3.21setLocation()
650
9.130.3.22setName()
651
9.130.3.23setType()
651
9.130.4 Member Data Documentation
651
9.130.4.1 mImpl
652
9.131nvinfer1::ITimingCache Class Reference
652
9.131.1 Detailed Description
652
9.131.2 Constructor & Destructor Documentation
653
9.131.2.1 ∼ITimingCache()
653
9.131.3 Member Function Documentation
653
9.131.3.1 combine()
653
9.131.3.2 reset()
654
9.131.3.3 serialize()
654
9.131.4 Member Data Documentation
654
9.131.4.1 mImpl
654
9.132nvinfer1::ITopKLayer Class Reference
655
9.132.1 Detailed Description
655
9.132.2 Constructor & Destructor Documentation
656
CONTENTS
xxxv
9.132.2.1 ∼ITopKLayer()
656
9.132.3 Member Function Documentation
656
9.132.3.1 getK()
656
9.132.3.2 getOperation()
656
9.132.3.3 getReduceAxes()
657
9.132.3.4 setInput()
657
9.132.3.5 setK()
657
9.132.3.6 setOperation()
658
9.132.3.7 setReduceAxes()
658
9.132.4 Member Data Documentation
658
9.132.4.1 mImpl
658
9.133nvinfer1::ITripLimitLayer Class Reference
658
9.133.1 Constructor & Destructor Documentation
659
9.133.1.1 ∼ITripLimitLayer()
659
9.133.2 Member Function Documentation
659
9.133.2.1 getTripLimit()
659
9.133.3 Member Data Documentation
659
9.133.3.1 mImpl
659
9.134nvuffparser::IUffParser Class Reference
660
9.134.1 Detailed Description
660
9.134.2 Constructor & Destructor Documentation
660
9.134.2.1 ∼IUffParser()
661
9.134.3 Member Function Documentation
661
9.134.3.1 destroy()
661
9.134.3.2 getErrorRecorder()
661
9.134.3.3 getUffRequiredVersionMajor()
661
9.134.3.4 getUffRequiredVersionMinor()
662
9.134.3.5 getUffRequiredVersionPatch()
662
9.134.3.6 parse()
662
9.134.3.7 parseBuffer()
662
9.134.3.8 registerInput()
663
9.134.3.9 registerOutput()
663
9.134.3.10setErrorRecorder()
663
9.134.3.11setPluginNamespace()
664
9.135nvinfer1::IUnaryLayer Class Reference
664
9.135.1 Detailed Description
665
9.135.2 Constructor & Destructor Documentation
665
9.135.2.1 ∼IUnaryLayer()
665
9.135.3 Member Function Documentation
665
9.135.3.1 getOperation()
665
9.135.3.2 setOperation()
666
9.135.4 Member Data Documentation
666
9.135.4.1 mImpl
666
9.136nvinfer1::plugin::NMSParameters Struct Reference
666
9.136.1 Detailed Description
666
9.136.2 Member Data Documentation
667
9.136.2.1 backgroundLabelId
667
9.136.2.2 iouThreshold
667
9.136.2.3 isNormalized
667
9.136.2.4 keepTopK
667
9.136.2.5 numClasses
668
9.136.2.6 scoreThreshold
668
9.136.2.7 shareLocation
668
9.136.2.8 topK
668
xxxvi
CONTENTS
9.137nvinfer1::Permutation Struct Reference
668
9.137.1 Member Data Documentation
668
9.137.1.1 order
669
9.138nvinfer1::PluginField Class Reference
669
9.138.1 Detailed Description
669
9.138.2 Constructor & Destructor Documentation
669
9.138.2.1 PluginField()
670
9.138.3 Member Data Documentation
670
9.138.3.1 data
670
9.138.3.2 length
670
9.138.3.3 name
670
9.138.3.4 type
670
9.139nvinfer1::PluginFieldCollection Struct Reference
671
9.139.1 Detailed Description
671
9.139.2 Member Data Documentation
671
9.139.2.1 fields
671
9.139.2.2 nbFields
671
9.140nvinfer1::PluginRegistrar< T > Class Template Reference
672
9.140.1 Detailed Description
672
9.140.2 Constructor & Destructor Documentation
672
9.140.2.1 PluginRegistrar()
672
9.141nvinfer1::safe::PluginRegistrar< T > Class Template Reference
672
9.141.1 Detailed Description
673
9.141.2 Constructor & Destructor Documentation
673
9.141.2.1 PluginRegistrar()
673
9.142nvinfer1::PluginTensorDesc Struct Reference
673
9.142.1 Detailed Description
674
9.142.2 Member Data Documentation
674
9.142.2.1 dims
674
9.142.2.2 format
674
9.142.2.3 scale
674
9.142.2.4 type
674
9.143PluginVersion Struct Reference
675
9.143.1 Detailed Description
675
9.144nvinfer1::plugin::PriorBoxParameters Struct Reference
675
9.144.1 Detailed Description
675
9.144.2 Member Data Documentation
676
9.144.2.1 aspectRatios
676
9.144.2.2 clip
676
9.144.2.3 flip
676
9.144.2.4 imgH
677
9.144.2.5 imgW
677
9.144.2.6 maxSize
677
9.144.2.7 minSize
677
9.144.2.8 numAspectRatios
677
9.144.2.9 numMaxSize
677
9.144.2.10numMinSize
677
9.144.2.11offset
678
9.144.2.12stepH
678
9.144.2.13stepW
678
9.144.2.14variance
678
9.145nvinfer1::plugin::Quadruple Struct Reference
678
9.145.1 Detailed Description
678
9.145.2 Member Data Documentation
679
CONTENTS
xxxvii
9.145.2.1 data
679
9.146nvinfer1::plugin::RegionParameters Struct Reference
679
9.146.1 Detailed Description
679
9.146.2 Member Data Documentation
680
9.146.2.1 classes
680
9.146.2.2 coords
680
9.146.2.3 num
680
9.146.2.4 smTree
680
9.147nvinfer1::plugin::RPROIParams Struct Reference
680
9.147.1 Detailed Description
680
9.147.2 Member Data Documentation
681
9.147.2.1 anchorsRatioCount
681
9.147.2.2 anchorsScaleCount
681
9.147.2.3 featureStride
681
9.147.2.4 iouThreshold
681
9.147.2.5 minBoxSize
682
9.147.2.6 nmsMaxOut
682
9.147.2.7 poolingH
682
9.147.2.8 poolingW
682
9.147.2.9 preNmsTop
682
9.147.2.10spatialScale
682
9.148nvinfer1::safe::RuntimeErrorInformation Struct Reference
682
9.148.1 Detailed Description
683
9.148.2 Member Data Documentation
683
9.148.2.1 bitMask
683
9.149nvinfer1::plugin::softmaxTree Struct Reference
683
9.149.1 Detailed Description
684
9.149.2 Member Data Documentation
684
9.149.2.1 child
684
9.149.2.2 group
684
9.149.2.3 groupOffset
684
9.149.2.4 groups
684
9.149.2.5 groupSize
684
9.149.2.6 leaf
685
9.149.2.7 n
685
9.149.2.8 name
685
9.149.2.9 parent
685
9.150nvinfer1::Weights Class Reference
685
9.150.1 Detailed Description
686
9.150.2 Member Data Documentation
686
9.150.2.1 count
686
9.150.2.2 type
686
9.150.2.3 values
686
10 File Documentation
687
10.1
NvCaffeParser.h File Reference
687
10.1.1
Detailed Description
688
10.2
NvCaffeParser.h
688
10.3
NvInfer.h File Reference
689
10.3.1
Detailed Description
696
10.4
NvInfer.h
696
10.5
NvInferConsistency.h File Reference
742
10.5.1
Function Documentation
742
10.5.1.1
createConsistencyChecker INTERNAL() .
742
xxxviii
CONTENTS
10.6
NvInferConsistency.h
743
10.7
NvInferLegacyDims.h File Reference
744
10.7.1
Detailed Description
744
10.8
NvInferLegacyDims.h
745
10.9
NvInferPlugin.h File Reference
746
10.9.1
Detailed Description
747
10.9.2
Function Documentation
747
10.9.2.1
createAnchorGeneratorPlugin()
748
10.9.2.2
createBatchedNMSPlugin()
748
10.9.2.3
createInstanceNormalizationPlugin()
748
10.9.2.4
createNMSPlugin()
749
10.9.2.5
createNormalizePlugin()
749
10.9.2.6
createPriorBoxPlugin()
750
10.9.2.7
createRegionPlugin()
750
10.9.2.8
createReorgPlugin()
750
10.9.2.9
createRPNROIPlugin()
751
10.9.2.10 createSplitPlugin()
752
10.9.2.11 initLibNvInferPlugins()
752
10.10NvInferPlugin.h
752
10.11NvInferPluginUtils.h File Reference
753
10.11.1 Detailed Description
754
10.12NvInferPluginUtils.h
754
10.13NvInferRuntime.h File Reference
756
10.13.1 Detailed Description
759
10.13.2 Macro Definition Documentation
759
10.13.2.1 REGISTER TENSORRT PLUGIN
759
10.13.3 Function Documentation
759
10.13.3.1 getLogger()
759
10.13.3.2 getPluginRegistry()
760
10.14NvInferRuntime.h
760
10.15NvInferRuntimeBase.h File Reference
776
10.15.1 Detailed Description
777
10.15.2 Macro Definition Documentation
778
10.15.2.1 NV TENSORRT VERSION
778
10.15.2.2 TENSORRTAPI
778
10.15.2.3 TRT DEPRECATED
778
10.15.2.4 TRT DEPRECATED API
778
10.15.2.5 TRT DEPRECATED ENUM
778
10.15.2.6 TRTNOEXCEPT
778
10.15.3 Function Documentation
779
10.15.3.1 getInferLibVersion()
779
10.16NvInferRuntimeBase.h
779
10.17NvInferRuntimeCommon.h File Reference
783
10.17.1 Detailed Description
784
10.18NvInferRuntimeCommon.h
784
10.19NvInferRuntimePlugin.h File Reference
785
10.19.1 Detailed Description
786
10.20NvInferRuntimePlugin.h
786
10.21NvInferSafeRuntime.h File Reference
789
10.21.1 Detailed Description
791
10.21.2 Macro Definition Documentation
791
10.21.2.1 REGISTER SAFE TENSORRT PLUGIN
791
10.22NvInferSafeRuntime.h
791
10.23NvInferVersion.h File Reference
794
CONTENTS
xxxix
10.23.1 Detailed Description
795
10.23.2 Macro Definition Documentation
795
10.23.2.1 NV TENSORRT BUILD
795
10.23.2.2 NV TENSORRT LWS MAJOR
795
10.23.2.3 NV TENSORRT LWS MINOR
795
10.23.2.4 NV TENSORRT LWS PATCH
795
10.23.2.5 NV TENSORRT MAJOR
796
10.23.2.6 NV TENSORRT MINOR
796
10.23.2.7 NV TENSORRT PATCH
796
10.23.2.8 NV TENSORRT RELEASE TYPE
796
10.23.2.9 NV TENSORRT RELEASE TYPE EARLY ACCESS
796
10.23.2.10NV TENSORRT RELEASE TYPE GENERAL AVAILABILITY
796
10.23.2.11NV TENSORRT RELEASE TYPE RELEASE CANDIDATE
797
10.23.2.12NV TENSORRT SONAME MAJOR
797
10.23.2.13NV TENSORRT SONAME MINOR
797
10.23.2.14NV TENSORRT SONAME PATCH
797
10.24NvInferVersion.h
797
10.25NvOnnxConfig.h File Reference
798
10.25.1 Detailed Description
798
10.26NvOnnxConfig.h
799
10.27NvUffParser.h File Reference
799
10.27.1 Detailed Description
800
10.27.2 Macro Definition Documentation
800
10.27.2.1 UFF REQUIRED VERSION MAJOR
801
10.27.2.2 UFF REQUIRED VERSION MINOR
801
10.27.2.3 UFF REQUIRED VERSION PATCH
801
10.28NvUffParser.h
801
10.29NvUtils.h File Reference
802
10.29.1 Detailed Description
803
10.30NvUtils.h
803
10.31NvOnnxParser.h File Reference
803
10.31.1 Detailed Description
805
10.31.2 Macro Definition Documentation
805
10.31.2.1 NV ONNX PARSER MAJOR
805
10.31.2.2 NV ONNX PARSER MINOR
805
10.31.2.3 NV ONNX PARSER PATCH
805
10.31.3 Typedef Documentation
805
10.31.3.1 SubGraph t
805
10.31.3.2 SubGraphCollection t
805
10.31.4 Function Documentation
806
10.31.4.1 createNvOnnxParser INTERNAL() . .
806
10.31.4.2 getNvOnnxParserVersion()
806
10.32NvOnnxParser.h
806
Index
809
Chapter 1
Standard and Safe
This document covers both the standard TensorRT release and the safe TensorRT release. Interfaces supported in the
safe runtime are exclusively defined in the following interface files:
NvInferRuntimeCommon.h
783
NvInferSafeRuntime.h
789
NvInferVersion.h
794
See the TensorRT Safety Developer Guide Supplement for more details on the Standard/Safe split. The safety runtime
is designed to support automotive Safety Integrity Level B (ASIL-B) for safety flows. Applications using the safety
runtime must follow the NVIDIA DRIVE OS 6.0 Safety Manual. The safety runtime makes use of CUDA® and is
designed to work with applications using CUDA.
2
Standard and Safe
Chapter 2
TensorRT
This is the API documentation for the NVIDIA TensorRT library. It provides information on individual functions,
classes and methods. Use the index on the left to navigate the documentation.
Please see the accompanying user guide and samples for higher-level information and general advice on using Tensor←↩
RT.
4
TensorRT
Chapter 3
Deprecated List
Member createAnchorGeneratorPlugin (nvinfer1::plugin::GridAnchorParameters ∗param, int32 t num←↩
Layers)
Deprecated in TensorRT 8.5. Use GridAnchorPluginCreator::createPlugin() to create an instance of ”GridAnchor←↩
TRT” version 1 plugin.
Member createBatchedNMSPlugin (nvinfer1::plugin::NMSParameters param)
Deprecated in TensorRT 8.5. Use BatchedNMSPluginCreator::createPlugin() to create an instance of ”Batched←↩
NMS TRT” version 1 plugin.
Member createInstanceNormalizationPlugin (float epsilon, nvinfer1::Weights scale weights, nvinfer1::Weights
bias weights)
Deprecated in TensorRT 8.5. Use InstanceNormalizationPluginCreator::createPlugin() to create an instance of ”←↩
InstanceNormalization TRT” version 1 plugin.
Member createNMSPlugin (nvinfer1::plugin::DetectionOutputParameters param)
Deprecated in TensorRT 8.5. Use NMSPluginCreator::createPlugin() to create an instance of ”NMS TRT” version
1 plugin.
Member createNormalizePlugin (nvinfer1::Weights const ∗scales, bool acrossSpatial, bool channelShared, float
eps)
Deprecated in TensorRT 8.5. Use NormalizePluginCreator::createPlugin() to create an instance of ”Normalize ←↩
TRT” version 1 plugin.
Member createPriorBoxPlugin (nvinfer1::plugin::PriorBoxParameters param)
Deprecated in TensorRT 8.5. Use PriorBoxPluginCreator::createPlugin() to create an instance of ”PriorBox TRT”
version 1 plugin.
Member createRegionPlugin (nvinfer1::plugin::RegionParameters params)
Deprecated in TensorRT 8.5. Use RegionPluginCreator::createPlugin() to create an instance of ”Region TRT”
version 1 plugin.
Member createReorgPlugin (int32 t stride)
Deprecated in TensorRT 8.5. Use ReorgPluginCreator::createPlugin() to create an instance of ”Reorg TRT” version
1 plugin.
Member createRPNROIPlugin (int32 t featureStride, int32 t preNmsTop, int32 t nmsMaxOut, float iou←↩
Threshold, float minBoxSize, float spatialScale, nvinfer1::DimsHW pooling, nvinfer1::Weights anchor←↩
Ratios, nvinfer1::Weights anchorScales)
Deprecated in TensorRT 8.5. Use RPROIPluginCreator::createPlugin() to create an instance of ”RPROI TRT”
version 1 plugin.
6
Deprecated List
Member createSplitPlugin (int32 t axis, int32 t ∗output lengths, int32 t noutput)
Deprecated in TensorRT 8.5 along with the ”Split” plugin. Use INetworkDefinition::addSlice() to add slice layer(s)
as necessary to accomplish the required effect.
Member nvcaffeparser1::createCaffeParser () noexcept
ICaffeParser will be removed in TensorRT 9.0. Plan to migrate your workflow to use nvonnxparser::IParser for
deployment.
Member nvcaffeparser1::IBinaryProtoBlob::destroy () noexcept=0
Deprecated in TensorRT 8.0. Superseded by delete.
Member nvcaffeparser1::ICaffeParser::destroy () noexcept=0
Deprecated in TensorRT 8.0. Superseded by delete.
Member nvinfer1::IAlgorithm::getAlgorithmIOInfo (int32 t index) const noexcept
Deprecated in TensorRT 8.0. Superseded by IAlgorithm::getAlgorithmIOInfoByIndex().
Member nvinfer1::IAlgorithmIOInfo::getTensorFormat () const noexcept
Deprecated in TensorRT 8.6. The strides, data type, and vectorization information is sufficient to uniquely identify
tensor formats.
Member nvinfer1::IBuilder::buildEngineWithConfig (INetworkDefinition &network, IBuilderConfig &config)
noexcept
Deprecated in TensorRT 8.0. Superseded by IBuilder::buildSerializedNetwork().
Member nvinfer1::IBuilder::destroy () noexcept
Deprecated in TensorRT 8.0. Superseded by delete.
Member nvinfer1::IBuilder::getMaxBatchSize () const noexcept
Deprecated in TensorRT 8.4.
Member nvinfer1::IBuilder::setMaxBatchSize (int32 t batchSize) noexcept
Deprecated in TensorRT 8.4.
Member nvinfer1::IBuilderConfig::destroy () noexcept
Deprecated in TensorRT 8.0. Superseded by delete.
Member nvinfer1::IBuilderConfig::getMaxWorkspaceSize () const noexcept
Deprecated in TensorRT 8.3. Superseded by IBuilderConfig::getMemoryPoolLimit() with MemoryPoolType::kWORKSPACE.
Member nvinfer1::IBuilderConfig::getMinTimingIterations () const noexcept
Deprecated in TensorRT 8.4. Superseded by getAvgTimingIterations().
Member nvinfer1::IBuilderConfig::setMaxWorkspaceSize (std::size t workspaceSize) noexcept
Deprecated in TensorRT 8.3. Superseded by IBuilderConfig::setMemoryPoolLimit() with MemoryPoolType::kWORKSPACE.
Member nvinfer1::IBuilderConfig::setMinTimingIterations (int32 t minTiming) noexcept
Deprecated in TensorRT 8.4. Superseded by setAvgTimingIterations().
Member nvinfer1::IConvolutionLayer::getDilation () const noexcept
Superseded by getDilationNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::IConvolutionLayer::getKernelSize () const noexcept
Superseded by getKernelSizeNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::IConvolutionLayer::getPadding () const noexcept
Superseded by getPaddingNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::IConvolutionLayer::getStride () const noexcept
Superseded by getStrideNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
7
Member nvinfer1::IConvolutionLayer::setDilation (DimsHW dilation) noexcept
Superseded by setDilationNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::IConvolutionLayer::setKernelSize (DimsHW kernelSize) noexcept
Superseded by setKernelSizeNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::IConvolutionLayer::setPadding (DimsHW padding) noexcept
Superseded by setPaddingNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::IConvolutionLayer::setStride (DimsHW stride) noexcept
Superseded by setStrideNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::ICudaEngine::bindingIsInput (int32 t bindingIndex) const noexcept
Deprecated in TensorRT 8.5. Superseded by getTensorIOMode().
Member nvinfer1::ICudaEngine::destroy () noexcept
Deprecated in TRT 8.0. Superseded by delete.
Member nvinfer1::ICudaEngine::getBindingBytesPerComponent (int32 t bindingIndex) const noexcept
Deprecated in TensorRT 8.5. Superseded by getTensorBytesPerComponent().
Member nvinfer1::ICudaEngine::getBindingComponentsPerElement (int32 t bindingIndex) const noexcept
Deprecated in TensorRT 8.5. Superseded by getTensorComponentsPerElement().
Member nvinfer1::ICudaEngine::getBindingDataType (int32 t bindingIndex) const noexcept
Deprecated in TensorRT 8.5. Superseded by getTensorDataType().
Member nvinfer1::ICudaEngine::getBindingDimensions (int32 t bindingIndex) const noexcept
Deprecated in TensorRT 8.5. Superseded by getTensorShape().
Member nvinfer1::ICudaEngine::getBindingFormat (int32 t bindingIndex) const noexcept
Deprecated in TensorRT 8.5. Superseded by getTensorFormat().
Member nvinfer1::ICudaEngine::getBindingFormatDesc (int32 t bindingIndex) const noexcept
Deprecated in TensorRT 8.5. Superseded by getTensorFormatDesc().
Member nvinfer1::ICudaEngine::getBindingIndex (char const ∗name) const noexcept
Deprecated in TensorRT 8.5. Superseded by name-based methods. Use them instead of binding-index based meth-
ods.
Member nvinfer1::ICudaEngine::getBindingName (int32 t bindingIndex) const noexcept
Deprecated in TensorRT 8.5. Superseded by name-based methods. Use them instead of binding-index based meth-
ods.
Member nvinfer1::ICudaEngine::getBindingVectorizedDim (int32 t bindingIndex) const noexcept
Deprecated in TensorRT 8.5. Superseded by getTensorVectorizedDim().
Member nvinfer1::ICudaEngine::getLocation (int32 t bindingIndex) const noexcept
Deprecated in TensorRT 8.5. Superseded by getTensorLocation().
Member nvinfer1::ICudaEngine::getMaxBatchSize () const noexcept
Deprecated in TensorRT 8.4.
Member nvinfer1::ICudaEngine::getNbBindings () const noexcept
Deprecated in TensorRT 8.5. Superseded by getNbIOTensors.
Member nvinfer1::ICudaEngine::getProfileDimensions (int32 t bindingIndex, int32 t profileIndex, Opt←↩
ProfileSelector select) const noexcept
Deprecated in TensorRT 8.5. Superseded by getProfileShape().
8
Deprecated List
Member nvinfer1::ICudaEngine::getProfileShapeValues (int32 t profileIndex, int32 t inputIndex, OptProfile←↩
Selector select) const noexcept
Deprecated in TensorRT 8.5. Superseded by getShapeValues(). Difference between Execution and shape tensor is
superficial since TensorRT 8.5.
Member nvinfer1::ICudaEngine::isExecutionBinding (int32 t bindingIndex) const noexcept
No name-based equivalent replacement. Use getTensorLocation() instead to know the location of tensor data. Dis-
tinction between execution binding and shape binding is superficial since TensorRT 8.5.
Member nvinfer1::ICudaEngine::isShapeBinding (int32 t bindingIndex) const noexcept
Use name-based isShapeInferenceIO() instead to know whether a tensor is a shape tensor.
Member nvinfer1::IDeconvolutionLayer::getKernelSize () const noexcept
Superseded by getKernelSizeNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::IDeconvolutionLayer::getPadding () const noexcept
Superseded by getPaddingNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::IDeconvolutionLayer::getStride () const noexcept
Superseded by getStrideNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::IDeconvolutionLayer::setKernelSize (DimsHW kernelSize) noexcept
Superseded by setKernelSizeNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::IDeconvolutionLayer::setPadding (DimsHW padding) noexcept
Superseded by setPaddingNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::IDeconvolutionLayer::setStride (DimsHW stride) noexcept
Superseded by setStrideNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::IExecutionContext::destroy () noexcept
Deprecated in TRT 8.0. Superseded by delete.
Member nvinfer1::IExecutionContext::enqueue (int32 t batchSize, void ∗const ∗bindings, cudaStream ←↩
t stream, cudaEvent t ∗inputConsumed) noexcept
Deprecated in TensorRT 8.4. Superseded by enqueueV2() if the network is created with NetworkDefinitionCreationFlag::kEXPLICIT
flag.
Member nvinfer1::IExecutionContext::enqueueV2 (void ∗const ∗bindings, cudaStream t stream, cudaEvent t
∗inputConsumed) noexcept
Superseded by enqueueV3(). Deprecated in TensorRT 8.5
Member nvinfer1::IExecutionContext::execute (int32 t batchSize, void ∗const ∗bindings) noexcept
Deprecated in TensorRT 8.4. Superseded by executeV2() if the network is created with NetworkDefinitionCreationFlag::kEXPLICIT
flag.
Member nvinfer1::IExecutionContext::getBindingDimensions (int32 t bindingIndex) const noexcept
Deprecated in TensorRT 8.5. Superseded by getTensorShape().
Member nvinfer1::IExecutionContext::getShapeBinding (int32 t bindingIndex, int32 t ∗data) const noexcept
Deprecated in TensorRT 8.5. Superseded by getTensorAddress() or getOutputTensorAddress().
Member nvinfer1::IExecutionContext::getStrides (int32 t bindingIndex) const noexcept
Deprecated in TensorRT 8.5. Superseded by getTensorStrides().
Member nvinfer1::IExecutionContext::setBindingDimensions (int32 t bindingIndex, Dims dimensions) noex-
cept
Deprecated in TensorRT 8.5. Superseded by setInputShape().
9
Member nvinfer1::IExecutionContext::setInputShapeBinding (int32 t bindingIndex, int32 t const ∗data) noex-
cept
Deprecated in TensorRT 8.5. Superseded by setInputTensorAddress() or setTensorAddress().
Member nvinfer1::IExecutionContext::setOptimizationProfile (int32 t profileIndex) noexcept
Superseded by setOptimizationProfileAsync. Deprecated prior to TensorRT 8.0 and will be removed in 9.0.
Class nvinfer1::IFullyConnectedLayer
Deprecated in TensorRT 8.4. Superseded by IMatrixMultiplyLayer.
Member nvinfer1::IGpuAllocator::free (void ∗const memory) noexcept=0
Deprecated in TensorRT 8.0. Superseded by deallocate.
Member nvinfer1::IHostMemory::destroy () noexcept
Deprecated in TRT 8.0. Superseded by delete.
Member nvinfer1::INetworkDefinition::addConvolution (ITensor &input, int32 t nbOutputMaps, DimsHW
kernelSize, Weights kernelWeights, Weights biasWeights) noexcept
Superseded by addConvolutionNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::INetworkDefinition::addDeconvolution (ITensor &input, int32 t nbOutputMaps, DimsHW
kernelSize, Weights kernelWeights, Weights biasWeights) noexcept
Superseded by addDeconvolutionNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::INetworkDefinition::addFullyConnected (ITensor &input, int32 t nbOutputs, Weights
kernelWeights, Weights biasWeights) noexcept
Deprecated in TensorRT 8.4. Superseded by addMatrixMultiply().
Member nvinfer1::INetworkDefinition::addPadding (ITensor &input, DimsHW prePadding, DimsHW post←↩
Padding) noexcept
Superseded by addPaddingNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::INetworkDefinition::addPaddingNd (ITensor &input, Dims prePadding, Dims postPadding)
noexcept
Deprecated in TensorRT 8.0. Superseded by addSlice().
Member nvinfer1::INetworkDefinition::addPooling (ITensor &input, PoolingType type, DimsHW windowSize)
noexcept
Superseded by addPoolingNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::INetworkDefinition::addRNNv2 (ITensor &input, int32 t layerCount, int32 t hiddenSize,
int32 t maxSeqLen, RNNOperation op) noexcept
Deprecated prior to TensorRT 8.0 and will be removed in 9.0. Superseded by INetworkDefinition::addLoop().
Member nvinfer1::INetworkDefinition::destroy () noexcept
Deprecated in TensorRT 8.0. Superseded by delete.
Member nvinfer1::INetworkDefinition::hasExplicitPrecision () const noexcept
Deprecated in TensorRT 8.0.
Member nvinfer1::IPaddingLayer::getPostPadding () const noexcept
Superseded by getPostPaddingNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::IPaddingLayer::getPrePadding () const noexcept
Superseded by getPrePaddingNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::IPaddingLayer::setPostPadding (DimsHW padding) noexcept
Superseded by setPostPaddingNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
10
Deprecated List
Member nvinfer1::IPaddingLayer::setPrePadding (DimsHW padding) noexcept
Superseded by setPrePaddingNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Class nvinfer1::IPluginV2
Deprecated in TensorRT 8.5. Implement IPluginV2DynamicExt or IPluginV2IOExt depending on your require-
ment.
Class nvinfer1::IPluginV2Ext
Deprecated in TensorRT 8.5. Implement IPluginV2DynamicExt or IPluginV2IOExt depending on your require-
ment.
Member nvinfer1::IPoolingLayer::getPadding () const noexcept
Superseded by getPaddingNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::IPoolingLayer::getStride () const noexcept
Superseded by getStrideNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::IPoolingLayer::getWindowSize () const noexcept
Superseded by getWindowSizeNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::IPoolingLayer::setPadding (DimsHW padding) noexcept
Superseded by setPaddingNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::IPoolingLayer::setStride (DimsHW stride) noexcept
Superseded by setStrideNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::IPoolingLayer::setWindowSize (DimsHW windowSize) noexcept
Superseded by setWindowSizeNd. Deprecated prior to TensorRT 8.0 and will be removed in 9.0
Member nvinfer1::IRefitter::destroy () noexcept
Deprecated in TRT 8.0. Superseded by delete.
Member nvinfer1::IResizeLayer::getAlignCorners () const noexcept
Deprecated in TensorRT 8.0. Superseded by IResizeLayer::getCoordinateTransformation().
Member nvinfer1::IResizeLayer::setAlignCorners (bool alignCorners) noexcept
Deprecated in TensorRT 8.0. Superseded by IResizeLayer::setCoordinateTransformation().
Class nvinfer1::IRNNv2Layer
Deprecated prior to TensorRT 8.0 and will be removed in 9.0. Superseded by INetworkDefinition::addLoop().
Member nvinfer1::IRuntime::deserializeCudaEngine (void const ∗blob, std::size t size, IPluginFactory
∗pluginFactory) noexcept
Deprecated in TensorRT 8.0.
Member nvinfer1::IRuntime::destroy () noexcept
Deprecated in TRT 8.0. Superseded by delete.
Member nvinfer1::kDEFAULT
Deprecated in TensorRT 8.0. Superseded by kLAYER NAMES ONLY.
Member nvinfer1::kDEFAULT
Deprecated in TensorRT 8.0. Superseded by kSTANDARD.
Member nvinfer1::kENABLE TACTIC HEURISTIC
Superseded by builder optimization level 2. Deprecated in TensorRT 8.6
Member nvinfer1::kFASTER DYNAMIC SHAPES 0805
Turning it off is deprecated in TensorRT 8.6. The flag kFASTER DYNAMIC SHAPES 0805 will be removed in
9.0.
11
Member nvinfer1::kSAFE DLA
Deprecated in TensorRT 8.0. Superseded by kDLA STANDALONE.
Member nvinfer1::kSAFE GPU
Deprecated in TensorRT 8.0. Superseded by kSAFETY.
Member nvinfer1::kVERBOSE
Deprecated in TensorRT 8.0. Superseded by kDETAILED.
Member nvinfer1::kWRAP
Use kSTRICT BOUNDS.
Member nvinfer1::ResizeMode
Deprecated in TensorRT 8.5. Superseded by InterpolationMode.
Member nvinfer1::safe::ICudaEngine::bindingIsInput (std::int32 t const bindingIndex) const noexcept=0
Deprecated in TensorRT 8.5. Superseded by tensorIOMode().
Member nvinfer1::safe::ICudaEngine::getBindingBytesPerComponent (std::int32 t const bindingIndex) const
noexcept=0
Deprecated in TensorRT 8.5. Superseded by getTensorBytesPerComponent().
Member nvinfer1::safe::ICudaEngine::getBindingComponentsPerElement (std::int32 t const bindingIndex)
const noexcept=0
Deprecated in TensorRT 8.5. Superseded by getTensorComponentsPerElement().
Member nvinfer1::safe::ICudaEngine::getBindingDataType (std::int32 t const bindingIndex) const noexcept=0
Deprecated in TensorRT 8.5. Superseded by getTensorDataType().
Member nvinfer1::safe::ICudaEngine::getBindingDimensions (std::int32 t const bindingIndex) const noex-
cept=0
Deprecated in TensorRT 8.5. Superseded by getTensorShape().
Member nvinfer1::safe::ICudaEngine::getBindingFormat (std::int32 t const bindingIndex) const noexcept=0
Deprecated in TensorRT 8.5. Superseded by getTensorFormat().
Member nvinfer1::safe::ICudaEngine::getBindingIndex (AsciiChar const ∗const name) const noexcept=0
Deprecated in TensorRT 8.5. Superseded by name-based methods. Use them instead of binding-index based meth-
ods.
Member nvinfer1::safe::ICudaEngine::getBindingName (std::int32 t const bindingIndex) const noexcept=0
Deprecated in TensorRT 8.5. Superseded by name-based methods. Use them instead of binding-index based meth-
ods.
Member nvinfer1::safe::ICudaEngine::getBindingVectorizedDim (std::int32 t const bindingIndex) const noex-
cept=0
Deprecated in TensorRT 8.5. Superseded by getTensorVectorizedDim().
Member nvinfer1::safe::ICudaEngine::getNbBindings () const noexcept=0
Deprecated in TensorRT 8.5. Superseded by getNbIOTensors.
Member nvinfer1::safe::IExecutionContext::enqueueV2 (void ∗const ∗const bindings, cudaStream t const
stream, cudaEvent t const ∗const inputConsumed) noexcept=0
Deprecated in TensorRT 8.5. Superseded by enqueueV3().
Member nvinfer1::safe::IExecutionContext::getStrides (std::int32 t const bindingIndex) const noexcept=0
Deprecated in TensorRT 8.5. Superseded by getTensorStrides().
Member nvinfer1::SliceMode
Deprecated in TensorRT 8.5. Superseded by SampleMode.
12
Deprecated List
Member nvinfer1::utils::reorderSubBuffers (void ∗input, int32 t const ∗order, int32 t num, int32 t size) noex-
cept
Deprecated in TensorRT 8.0.
Member nvinfer1::utils::reshapeWeights (Weights const &input, int32 t const ∗shape, int32 t const ∗shape←↩
Order, void ∗data, int32 t nbDims) noexcept
Deprecated in TensorRT 8.0.
Member nvinfer1::utils::transposeSubBuffers (void ∗input, DataType type, int32 t num, int32 t height, int32 t
width) noexcept
Deprecated in TensorRT 8.0.
Member nvonnxparser::IOnnxConfig::destroy () noexcept=0
Use delete instead. Deprecated in TRT 8.0.
Member nvuffparser::createUffParser () noexcept
IUffParser will be removed in TensorRT 9.0. Plan to migrate your workflow to use nvonnxparser::IParser for de-
ployment.
Member nvuffparser::FieldMap::FieldMap (char const ∗name, void const ∗data, FieldType const type, int32 t
length=1)
Legacy constructor, retained for ABI compatibility. Deprecated in TensorRT 8.6. Use the default constructor in-
stead.
Member nvuffparser::IUffParser::destroy () noexcept=0
Use delete instead. Deprecated in TRT 8.0.
Chapter 4
Namespace Index
4.1
Namespace List
Here is a list of all namespaces with brief descriptions:
nvcaffeparser1
The TensorRT Caffe parser API namespace
29
nvinfer1
The TensorRT API version 1 namespace
30
nvinfer1::consistency
83
nvinfer1::impl
84
nvinfer1::plugin
84
nvinfer1::safe
The safety subset of TensorRT's API version 1 namespace
86
nvinfer1::utils
88
nvonnxparser
The TensorRT ONNX parser API namespace
90
nvuffparser
The TensorRT UFF parser API namespace
94
14
Namespace Index
Chapter 5
Hierarchical Index
5.1
Class Hierarchy
This inheritance list is sorted roughly, but not completely, alphabetically:
nvinfer1::plugin::DetectionOutputParameters
99
Dims
102
nvinfer1::Dims32
105
nvinfer1::Dims2
103
nvinfer1::Dims3
104
nvinfer1::Dims4
107
nvinfer1::DimsHW
109
nvinfer1::DimsExprs
108
nvinfer1::DynamicPluginTensorDesc
111
nvinfer1::impl::EnumMaxImpl< T >
113
nvinfer1::impl::EnumMaxImpl< ActivationType >
113
nvinfer1::impl::EnumMaxImpl< AllocatorFlag >
114
nvinfer1::impl::EnumMaxImpl< DataType >
114
nvinfer1::impl::EnumMaxImpl< ElementWiseOperation >
115
nvinfer1::impl::EnumMaxImpl< EngineCapability >
116
nvinfer1::impl::EnumMaxImpl< ErrorCode >
117
nvinfer1::impl::EnumMaxImpl< HardwareCompatibilityLevel >
117
nvinfer1::impl::EnumMaxImpl< ILogger::Severity >
118
nvinfer1::impl::EnumMaxImpl< InterpolationMode >
119
nvinfer1::impl::EnumMaxImpl< PaddingMode >
120
nvinfer1::impl::EnumMaxImpl< PoolingType >
120
nvinfer1::impl::EnumMaxImpl< PreviewFeature >
121
nvinfer1::impl::EnumMaxImpl< ResizeCoordinateTransformation >
122
nvinfer1::impl::EnumMaxImpl< ResizeRoundMode >
122
nvinfer1::impl::EnumMaxImpl< ResizeSelector >
123
nvinfer1::impl::EnumMaxImpl< TensorFormat >
124
nvinfer1::impl::EnumMaxImpl< TensorIOMode >
125
nvinfer1::impl::EnumMaxImpl< TensorLocation >
125
nvuffparser::FieldCollection
126
nvuffparser::FieldMap
127
nvinfer1::plugin::GridAnchorParameters
129
16
Hierarchical Index
nvinfer1::IAlgorithmSelector
143
nvcaffeparser1::IBinaryProtoBlob
149
nvcaffeparser1::IBlobNameToTensor
151
nvcaffeparser1::ICaffeParser
187
nvinfer1::consistency::IConsistencyChecker
197
nvinfer1::safe::ICudaEngine
244
nvinfer1::IErrorRecorder
287
nvinfer1::safe::IExecutionContext . .
324
nvinfer1::IGpuAllocator
355
nvinfer1::IInt8Calibrator
374
nvinfer1::IInt8EntropyCalibrator .
377
nvinfer1::IInt8EntropyCalibrator2
378
nvinfer1::IInt8LegacyCalibrator .
379
nvinfer1::IInt8MinMaxCalibrator .
382
nvinfer1::ILogger
395
nvinfer1::ILoggerFinder
397
nvinfer1::INoCopy
463
nvinfer1::IAlgorithm
135
nvinfer1::IAlgorithmContext
138
nvinfer1::IAlgorithmIOInfo
140
nvinfer1::IAlgorithmVariant
145
nvinfer1::IBuilder
152
nvinfer1::IBuilderConfig
162
nvinfer1::ICudaEngine
215
nvinfer1::IDimensionExpr
276
nvinfer1::IEngineInspector
282
nvinfer1::IExecutionContext
294
nvinfer1::IExprBuilder
337
nvinfer1::IHostMemory
363
nvinfer1::IIfConditional
367
nvinfer1::ILayer
385
nvinfer1::IActivationLayer . .
131
nvinfer1::IAssertionLayer
147
nvinfer1::ICastLayer
192
nvinfer1::IConcatenationLayer
194
nvinfer1::IConstantLayer
200
nvinfer1::IConvolutionLayer .
202
nvinfer1::IDeconvolutionLayer
261
nvinfer1::IDequantizeLayer . .
273
nvinfer1::IEinsumLayer
278
nvinfer1::IElementWiseLayer .
280
nvinfer1::IFillLayer
339
nvinfer1::IFullyConnectedLayer
345
nvinfer1::IGatherLayer
350
nvinfer1::IGridSampleLayer . .
359
nvinfer1::IIdentityLayer
365
nvinfer1::IIfConditionalBoundaryLayer
370
nvinfer1::IConditionLayer
196
nvinfer1::IIfConditionalInputLayer .
372
nvinfer1::IIfConditionalOutputLayer
373
nvinfer1::ILRNLayer
406
nvinfer1::ILoopBoundaryLayer
402
nvinfer1::IIteratorLayer
383
nvinfer1::ILoopOutputLayer
403
5.1 Class Hierarchy
17
nvinfer1::IRecurrenceLayer . .
565
nvinfer1::ITripLimitLayer
658
nvinfer1::IMatrixMultiplyLayer .
411
nvinfer1::INMSLayer
458
nvinfer1::INonZeroLayer
465
nvinfer1::INormalizationLayer . .
466
nvinfer1::IOneHotLayer
471
nvinfer1::IPaddingLayer
488
nvinfer1::IParametricReLULayer .
492
nvinfer1::IPluginV2Layer
549
nvinfer1::IPoolingLayer
550
nvinfer1::IQuantizeLayer
561
nvinfer1::IRNNv2Layer
592
nvinfer1::IRaggedSoftMaxLayer .
564
nvinfer1::IReduceLayer
567
nvinfer1::IResizeLayer
580
nvinfer1::IReverseSequenceLayer
589
nvinfer1::IScaleLayer
616
nvinfer1::IScatterLayer
621
nvinfer1::ISelectLayer
624
nvinfer1::IShapeLayer
625
nvinfer1::IShuffleLayer
627
nvinfer1::ISliceLayer
632
nvinfer1::ISoftMaxLayer
638
nvinfer1::ITopKLayer
655
nvinfer1::IUnaryLayer
664
nvinfer1::ILoop
399
nvinfer1::INetworkDefinition
413
nvinfer1::IOptimizationProfile
480
nvinfer1::IRefitter
570
nvinfer1::IRuntime
601
nvinfer1::ITensor
640
nvinfer1::ITimingCache
652
INonZero
465
nvonnxparser::IOnnxConfig
473
nvinfer1::IOutputAllocator
486
nvonnxparser::IParser
494
nvonnxparser::IParserError
501
nvinfer1::IPluginCreator
505
nvinfer1::consistency::IPluginChecker
503
nvcaffeparser1::IPluginFactoryV2
510
nvinfer1::IPluginRegistry
512
nvinfer1::safe::IPluginRegistry
518
nvinfer1::IPluginV2
522
nvinfer1::IPluginV2Ext
539
nvinfer1::IPluginV2DynamicExt .
533
nvinfer1::IPluginV2IOExt
546
nvinfer1::IProfiler
560
nvinfer1::safe::IRuntime
611
nvuffparser::IUffParser
660
nvinfer1::plugin::NMSParameters
666
nvinfer1::Permutation
668
nvinfer1::PluginField
669
18
Hierarchical Index
nvinfer1::PluginFieldCollection
671
nvinfer1::PluginRegistrar< T >
672
nvinfer1::safe::PluginRegistrar< T >
672
nvinfer1::PluginTensorDesc
673
PluginVersion
675
nvinfer1::plugin::PriorBoxParameters
675
nvinfer1::plugin::Quadruple
678
nvinfer1::plugin::RegionParameters
679
nvinfer1::plugin::RPROIParams
680
nvinfer1::safe::RuntimeErrorInformation
682
nvinfer1::plugin::softmaxTree
683
nvinfer1::Weights
685
Chapter 6
Class Index
6.1
Class List
Here are the classes, structs, unions and interfaces with brief descriptions:
nvinfer1::plugin::DetectionOutputParameters
The DetectionOutput plugin layer generates the detection output based on location and confidence
predictions by doing non maximum suppression. This plugin first decodes the bounding boxes
based on the anchors generated. It then performs non max suppression on the decoded bounding
boxes. DetectionOutputParameters defines a set of parameters for creating the DetectionOutput
plugin layer. It contains:
99
Dims
Structure to define the dimensions of a tensor
102
nvinfer1::Dims2
Descriptor for two-dimensional data
103
nvinfer1::Dims3
Descriptor for three-dimensional data
104
nvinfer1::Dims32
105
nvinfer1::Dims4
Descriptor for four-dimensional data
107
nvinfer1::DimsExprs
108
nvinfer1::DimsHW
Descriptor for two-dimensional spatial data
109
nvinfer1::DynamicPluginTensorDesc
111
nvinfer1::impl::EnumMaxImpl< T >
Declaration of EnumMaxImpl struct to store maximum number of elements in an enumeration type
113
nvinfer1::impl::EnumMaxImpl< ActivationType >
113
nvinfer1::impl::EnumMaxImpl< AllocatorFlag >
Maximum number of elements in AllocatorFlag enum
114
nvinfer1::impl::EnumMaxImpl< DataType >
Maximum number of elements in DataType enum
114
nvinfer1::impl::EnumMaxImpl< ElementWiseOperation >
115
nvinfer1::impl::EnumMaxImpl< EngineCapability >
Maximum number of elements in EngineCapability enum
116
nvinfer1::impl::EnumMaxImpl< ErrorCode >
Maximum number of elements in ErrorCode enum
117
20
Class Index
nvinfer1::impl::EnumMaxImpl< HardwareCompatibilityLevel >
117
nvinfer1::impl::EnumMaxImpl< ILogger::Severity >
Maximum number of elements in ILogger::Severity enum
118
nvinfer1::impl::EnumMaxImpl< InterpolationMode >
119
nvinfer1::impl::EnumMaxImpl< PaddingMode >
120
nvinfer1::impl::EnumMaxImpl< PoolingType >
120
nvinfer1::impl::EnumMaxImpl< PreviewFeature >
121
nvinfer1::impl::EnumMaxImpl< ResizeCoordinateTransformation >
122
nvinfer1::impl::EnumMaxImpl< ResizeRoundMode >
122
nvinfer1::impl::EnumMaxImpl< ResizeSelector >
123
nvinfer1::impl::EnumMaxImpl< TensorFormat >
Maximum number of elements in TensorFormat enum
124
nvinfer1::impl::EnumMaxImpl< TensorIOMode >
Maximum number of elements in TensorIOMode enum
125
nvinfer1::impl::EnumMaxImpl< TensorLocation >
Maximum number of elements in TensorLocation enum
125
nvuffparser::FieldCollection
126
nvuffparser::FieldMap
An array of field params used as a layer parameter for plugin layers
127
nvinfer1::plugin::GridAnchorParameters
The Anchor Generator plugin layer generates the prior boxes of designated sizes and aspect ratios
across all dimensions (H x W). GridAnchorParameters defines a set of parameters for creating the
plugin layer for all feature maps. It contains:
129
nvinfer1::IActivationLayer
An Activation layer in a network definition
131
nvinfer1::IAlgorithm
Describes a variation of execution of a layer. An algorithm is represented by IAlgorithmVariant and
the IAlgorithmIOInfo for each of its inputs and outputs. An algorithm can be selected or reproduced
using AlgorithmSelector::selectAlgorithms().”
135
nvinfer1::IAlgorithmContext
Describes the context and requirements, that could be fulfilled by one or more instances of
IAlgorithm
138
nvinfer1::IAlgorithmIOInfo
Carries information about input or output of the algorithm. IAlgorithmIOInfo for all the input and
output along with IAlgorithmVariant denotes the variation of algorithm and can be used to select or
reproduce an algorithm using IAlgorithmSelector::selectAlgorithms()
140
nvinfer1::IAlgorithmSelector
Interface implemented by application for selecting and reporting algorithms of a layer provided by
the builder
143
nvinfer1::IAlgorithmVariant
Unique
128-bit identifier, which along with the input and output information denotes
the variation of algorithm and can be used to select or reproduce an algorithm, using
IAlgorithmSelector::selectAlgorithms()
145
nvinfer1::IAssertionLayer
An assertion layer in a network
147
nvcaffeparser1::IBinaryProtoBlob
Object used to store and query data extracted from a binaryproto file using the ICaffeParser . . .
149
nvcaffeparser1::IBlobNameToTensor
Object used to store and query Tensors after they have been extracted from a Caffe model using the
ICaffeParser
151
nvinfer1::IBuilder
Builds an engine from a network definition
152
nvinfer1::IBuilderConfig
Holds properties for configuring a builder to produce an engine
162
6.1 Class List
21
nvcaffeparser1::ICaffeParser
Class used for parsing Caffe models
187
nvinfer1::ICastLayer
A cast layer in a network
192
nvinfer1::IConcatenationLayer
A concatenation layer in a network definition
194
nvinfer1::IConditionLayer
196
nvinfer1::consistency::IConsistencyChecker
Validates a serialized engine blob
197
nvinfer1::IConstantLayer
Layer that represents a constant value
200
nvinfer1::IConvolutionLayer
A convolution layer in a network definition
202
nvinfer1::ICudaEngine
An engine for executing inference on a built network, with functionally unsafe features
215
nvinfer1::safe::ICudaEngine
A functionally safe engine for executing inference on a built network
244
nvinfer1::IDeconvolutionLayer
A deconvolution layer in a network definition
261
nvinfer1::IDequantizeLayer
A Dequantize layer in a network definition
273
nvinfer1::IDimensionExpr
276
nvinfer1::IEinsumLayer
An Einsum layer in a network
278
nvinfer1::IElementWiseLayer
A elementwise layer in a network definition
280
nvinfer1::IEngineInspector
An engine inspector which prints out the layer information of an engine or an execution context
282
nvinfer1::IErrorRecorder
Reference counted application-implemented error reporting interface for TensorRT objects
287
nvinfer1::IExecutionContext
Context for executing inference using an engine, with functionally unsafe features
294
nvinfer1::safe::IExecutionContext
Functionally safe context for executing inference using an engine
324
nvinfer1::IExprBuilder
337
nvinfer1::IFillLayer
Generate an output tensor with specified mode
339
nvinfer1::IFullyConnectedLayer
A fully connected layer in a network definition. This layer expects an input tensor of three or more
non-batch dimensions. The input is automatically reshaped into an MxV tensor X, where V is a
product of the last three dimensions and M is a product of the remaining dimensions (where the
product over 0 dimensions is defined as 1). For example:
345
nvinfer1::IGatherLayer
A Gather layer in a network definition. Supports several kinds of gathering
350
nvinfer1::IGpuAllocator
Application-implemented class for controlling allocation on the GPU
355
nvinfer1::IGridSampleLayer
A GridSample layer in a network definition
359
nvinfer1::IHostMemory
Class to handle library allocated memory that is accessible to the user
363
nvinfer1::IIdentityLayer
A layer that represents the identity function
365
nvinfer1::IIfConditional
367
nvinfer1::IIfConditionalBoundaryLayer
370
22
Class Index
nvinfer1::IIfConditionalInputLayer
372
nvinfer1::IIfConditionalOutputLayer
373
nvinfer1::IInt8Calibrator
Application-implemented interface for calibration
374
nvinfer1::IInt8EntropyCalibrator
377
nvinfer1::IInt8EntropyCalibrator2
378
nvinfer1::IInt8LegacyCalibrator
379
nvinfer1::IInt8MinMaxCalibrator
382
nvinfer1::IIteratorLayer
383
nvinfer1::ILayer
Base class for all layer classes in a network definition
385
nvinfer1::ILogger
Application-implemented logging interface for the builder, refitter and runtime
395
nvinfer1::ILoggerFinder
A virtual base class to find a logger. Allows a plugin to find an instance of a logger if it needs to
emit a log message. A pointer to an instance of this class is passed to a plugin shared library on
initialization when that plugin is serialized as part of a version-compatible plan.
See the plugin
chapter in the developer guide for details
397
nvinfer1::ILoop
399
nvinfer1::ILoopBoundaryLayer
402
nvinfer1::ILoopOutputLayer
403
nvinfer1::ILRNLayer
A LRN layer in a network definition
406
nvinfer1::IMatrixMultiplyLayer
Layer that represents a Matrix Multiplication
411
nvinfer1::INetworkDefinition
A network definition for input to the builder
413
nvinfer1::INMSLayer
A non-maximum suppression layer in a network definition
458
nvinfer1::INoCopy
Forward declaration of IEngineInspector for use by other interfaces .
463
INonZero
A NonZero layer in a network
465
nvinfer1::INonZeroLayer
465
nvinfer1::INormalizationLayer
A normalization layer in a network definition
466
nvinfer1::IOneHotLayer
A OneHot layer in a network definition
471
nvonnxparser::IOnnxConfig
Configuration Manager Class
473
nvinfer1::IOptimizationProfile
Optimization profile for dynamic input dimensions and shape tensors
480
nvinfer1::IOutputAllocator
Callback from ExecutionContext::enqueueV3()
486
nvinfer1::IPaddingLayer
Layer that represents a padding operation
488
nvinfer1::IParametricReLULayer
Layer that represents a parametric ReLU operation
492
nvonnxparser::IParser
Object for parsing ONNX models into a TensorRT network definition
494
nvonnxparser::IParserError
Object containing information about an error
501
nvinfer1::consistency::IPluginChecker
Consistency Checker plugin class for user implemented Plugins
503
6.1 Class List
23
nvinfer1::IPluginCreator
Plugin creator class for user implemented layers
505
nvcaffeparser1::IPluginFactoryV2
Plugin factory used to configure plugins
510
nvinfer1::IPluginRegistry
Single registration point for all plugins in an application. It is used to find plugin implementations
during engine deserialization. Internally, the plugin registry is considered to be a singleton so
all plugins in an application are part of the same global registry. Note that the plugin registry is
only supported for plugins of type IPluginV2 and should also have a corresponding IPluginCreator
implementation
512
nvinfer1::safe::IPluginRegistry
Single registration point for all plugins in an application. It is used to find plugin implementations
during engine deserialization. Internally, the plugin registry is considered to be a singleton so
all plugins in an application are part of the same global registry. Note that the plugin registry is
only supported for plugins of type IPluginV2 and should also have a corresponding IPluginCreator
implementation
518
nvinfer1::IPluginV2
Plugin class for user-implemented layers
522
nvinfer1::IPluginV2DynamicExt
533
nvinfer1::IPluginV2Ext
Plugin class for user-implemented layers
539
nvinfer1::IPluginV2IOExt
Plugin class for user-implemented layers
546
nvinfer1::IPluginV2Layer
Layer type for pluginV2
549
nvinfer1::IPoolingLayer
A Pooling layer in a network definition
550
nvinfer1::IProfiler
Application-implemented interface for profiling
560
nvinfer1::IQuantizeLayer
A Quantize layer in a network definition
561
nvinfer1::IRaggedSoftMaxLayer
A RaggedSoftmax layer in a network definition
564
nvinfer1::IRecurrenceLayer
565
nvinfer1::IReduceLayer
Layer that represents a reduction across a non-bool tensor
567
nvinfer1::IRefitter
Updates weights in an engine
570
nvinfer1::IResizeLayer
A resize layer in a network definition
580
nvinfer1::IReverseSequenceLayer
A ReverseSequence layer in a network definition
589
nvinfer1::IRNNv2Layer
An RNN layer in a network definition, version 2
592
nvinfer1::IRuntime
Allows a serialized functionally unsafe engine to be deserialized
601
nvinfer1::safe::IRuntime
Allows a serialized functionally safe engine to be deserialized .
611
nvinfer1::IScaleLayer
A Scale layer in a network definition
616
nvinfer1::IScatterLayer
A scatter layer in a network definition. Supports several kinds of scattering
621
nvinfer1::ISelectLayer
624
24
Class Index
nvinfer1::IShapeLayer
Layer type for getting shape of a tensor
625
nvinfer1::IShuffleLayer
Layer type for shuffling data
627
nvinfer1::ISliceLayer
Slices an input tensor into an output tensor based on the offset and strides
632
nvinfer1::ISoftMaxLayer
A Softmax layer in a network definition
638
nvinfer1::ITensor
A tensor in a network definition
640
nvinfer1::ITimingCache
Class to handle tactic timing info collected from builder
652
nvinfer1::ITopKLayer
Layer that represents a TopK reduction
655
nvinfer1::ITripLimitLayer
658
nvuffparser::IUffParser
Class used for parsing models described using the UFF format
660
nvinfer1::IUnaryLayer
Layer that represents an unary operation
664
nvinfer1::plugin::NMSParameters
The NMSParameters are used by the BatchedNMSPlugin for performing the non max suppression
operation over boxes for object detection networks
666
nvinfer1::Permutation
668
nvinfer1::PluginField
Structure containing plugin attribute field names and associated data This information can be parsed
to decode necessary plugin metadata
669
nvinfer1::PluginFieldCollection
Plugin field collection struct
671
nvinfer1::PluginRegistrar< T >
Register the plugin creator to the registry The static registry object will be instantiated when the
plugin library is loaded. This static object will register all creators available in the library to the
registry
672
nvinfer1::safe::PluginRegistrar< T >
Register the plugin creator to the registry The static registry object will be instantiated when the
plugin library is loaded. This static object will register all creators available in the library to the
registry
672
nvinfer1::PluginTensorDesc
Fields that a plugin might see for an input or output
673
PluginVersion
Definition of plugin versions
675
nvinfer1::plugin::PriorBoxParameters
The PriorBox plugin layer generates the prior boxes of designated sizes and aspect ratios across
all dimensions (H x W). PriorBoxParameters defines a set of parameters for creating the PriorBox
plugin layer. It contains:
675
nvinfer1::plugin::Quadruple
The Permute plugin layer permutes the input tensor by changing the memory order of the data.
Quadruple defines a structure that contains an array of 4 integers. They can represent the permute
orders or the strides in each dimension
678
nvinfer1::plugin::RegionParameters
The Region plugin layer performs region proposal calculation: generate 5 bounding boxes per cell
(for yolo9000, generate 3 bounding boxes per cell). For each box, calculating its probablities of
objects detections from 80 pre-defined classifications (yolo9000 has 9418 pre-defined classifica-
tions, and these 9418 items are organized as work-tree structure). RegionParameters defines a set
of parameters for creating the Region plugin layer
679
6.1 Class List
25
nvinfer1::plugin::RPROIParams
RPROIParams is used to create the RPROIPlugin instance. It contains:
680
nvinfer1::safe::RuntimeErrorInformation
Space to record information about runtime errors
682
nvinfer1::plugin::softmaxTree
When performing yolo9000, softmaxTree is helping to do softmax on confidence scores, for ele-
ment to get the precise classification through word-tree structured classification definition
683
nvinfer1::Weights
An array of weights used as a layer parameter
685
26
Class Index
Chapter 7
File Index
7.1
File List
Here is a list of all files with brief descriptions:
NvCaffeParser.h
687
NvInfer.h
689
NvInferConsistency.h
742
NvInferLegacyDims.h
744
NvInferPlugin.h
746
NvInferPluginUtils.h
753
NvInferRuntime.h
756
NvInferRuntimeBase.h
776
NvInferRuntimeCommon.h
783
NvInferRuntimePlugin.h . .
785
NvInferSafeRuntime.h
789
NvInferVersion.h
794
NvOnnxConfig.h
798
NvUffParser.h
799
NvUtils.h
802
NvOnnxParser.h
803
28
File Index
Chapter 8
Namespace Documentation
8.1
nvcaffeparser1 Namespace Reference
The TensorRT Caffe parser API namespace.
Classes
• class IBinaryProtoBlob
Object used to store and query data extracted from a binaryproto file using the ICaffeParser.
• class IBlobNameToTensor
Object used to store and query Tensors after they have been extracted from a Caffe model using the ICaffeParser.
• class ICaffeParser
Class used for parsing Caffe models.
• class IPluginFactoryV2
Plugin factory used to configure plugins.
Functions
• ICaffeParser ∗ createCaffeParser () noexcept
Creates a ICaffeParser object.
• void shutdownProtobufLibrary () noexcept
Shuts down protocol buffers library.
8.1.1
Detailed Description
The TensorRT Caffe parser API namespace.
8.1.2
Function Documentation
30
Namespace Documentation
8.1.2.1
createCaffeParser()
ICaffeParser ∗ nvcaffeparser1::createCaffeParser ( ) [noexcept]
Creates a ICaffeParser object.
Returns
A pointer to the ICaffeParser object is returned.
See also
nvcaffeparser1::ICaffeParser
Deprecated ICaffeParser will be removed in TensorRT 9.0. Plan to migrate your workflow to use nvonnxparser::IParser
for deployment.
8.1.2.2
shutdownProtobufLibrary()
void nvcaffeparser1::shutdownProtobufLibrary ( ) [noexcept]
Shuts down protocol buffers library.
Note
No part of the protocol buffers library can be used after this function is called.
8.2
nvinfer1 Namespace Reference
The TensorRT API version 1 namespace.
Namespaces
• namespace consistency
• namespace impl
• namespace plugin
• namespace safe
The safety subset of TensorRT's API version 1 namespace.
• namespace utils
8.2 nvinfer1 Namespace Reference
31
Classes
•
class Dims2
Descriptor for two-dimensional data.
•
class Dims3
Descriptor for three-dimensional data.
•
class Dims32
•
class Dims4
Descriptor for four-dimensional data.
•
class DimsExprs
•
class DimsHW
Descriptor for two-dimensional spatial data.
•
class DynamicPluginTensorDesc
•
class IActivationLayer
An Activation layer in a network definition.
•
class IAlgorithm
Describes a variation of execution of a layer. An algorithm is represented by IAlgorithmVariant and the IAlgorithmIOInfo
for each of its inputs and outputs. An algorithm can be selected or reproduced using AlgorithmSelector::select←↩
Algorithms().”.
•
class IAlgorithmContext
Describes the context and requirements, that could be fulfilled by one or more instances of IAlgorithm.
•
class IAlgorithmIOInfo
Carries information about input or output of the algorithm. IAlgorithmIOInfo for all the input and output along
with IAlgorithmVariant denotes the variation of algorithm and can be used to select or reproduce an algorithm using
IAlgorithmSelector::selectAlgorithms().
•
class IAlgorithmSelector
Interface implemented by application for selecting and reporting algorithms of a layer provided by the builder.
•
class IAlgorithmVariant
provides a unique 128-bit identifier, which along with the input and output information denotes the variation of algorithm
and can be used to select or reproduce an algorithm, using IAlgorithmSelector::selectAlgorithms()
•
class IAssertionLayer
An assertion layer in a network.
•
class IBuilder
Builds an engine from a network definition.
•
class IBuilderConfig
Holds properties for configuring a builder to produce an engine.
•
class ICastLayer
A cast layer in a network.
•
class IConcatenationLayer
A concatenation layer in a network definition.
•
class IConditionLayer
•
class IConstantLayer
Layer that represents a constant value.
•
class IConvolutionLayer
A convolution layer in a network definition.
•
class ICudaEngine
An engine for executing inference on a built network, with functionally unsafe features.
•
class IDeconvolutionLayer
A deconvolution layer in a network definition.
////////////////////////////////////////// |
||
|
|
|