NVIDIA_NIM_Arguments
(
ApiType('nim')
[AUTHORIZATION([DatabaseName.]AuthorizationObjectName]
|{
ApiBase('<nim_base_url>')
ApiKey('<api_key>')
}
ModelName('<nvida-nim-model-name>')
[ModelArgs('{}')]
)
Required Syntax Elements
- ApiType
- Identification of the cloud platform.
Permitted values (not case-sensitive): aws, azure, gcp, nim, litellm
- AUTHORIZATION
- Mutually exclusive with ApiKey and ApiBase.
Authorization object containing the credentials.
- ApiBase
- Mutually exclusive with AUTHORIZATION.
Specifies the Full URL for NIM-based service.
- ApiKey
- Mutually exclusive with AUTHORIZATION.
Specifies the NIM API key.
Optional Syntax Elements
- ModelName
- Name of NVIDIA NIM hosted model to be used for text analytics tasks.
Permitted values: Case-sensitive alphanumeric string with dashes. The value is used as is for connection to NVIDIA NIM.
- ModelArgs
- JSON string representing the inference parameters for the selected LLM model.