Lite_LLM_Arguments
(
ApiType('litellm')
[AUTHORIZATION([DatabaseName.]AuthorizationObjectName]
|{
ApiBase("<lite_llm_base_url>")
ApiKey("<lite_llm_api_key>")
}
ModelName('<lite_llm_model_name>')
[ModelArgs('{}')]
)
Required Syntax Elements
- ApiType
- Identification of the cloud platform.
Permitted values (not case-sensitive): aws, azure, gcp, nim, litellm
- AUTHORIZATION
- Mutually exclusive with ApiKey and ApiBase.
Authorization object containing the credentials.
- ApiBase
- Mutually exclusive with AUTHORIZATION.
Specifies the Full URL for LiteLLM-based service.
- ApiKey
- Mutually exclusive with AUTHORIZATION.
Specifies the LiteLLM API key.
Optional Syntax Elements
- ModelName
- Name of LiteLLM hosted model to be used for text analytics tasks.
Permitted values: Case-sensitive alphanumeric string with dashes. The value is used as is for connection to LiteLLM.
- ModelArgs
- JSON string representing the inference parameters for the selected LLM model.