ModelOps provides multiple environments where you can deploy your models in production. You can monitor each deployment and re-evaluate or retire it based on its performance.
An admin user must create a service connection before you can deploy a model.
- From the Model Version Lifecycle page, select Deploy.
The Deploy Model Version dialog displays.
- In the Select Engine tab, set the following properties, then select Next:
Property Description Engine type Specify the engine type for deployment: - In-Vantage
- Docker
- For In-Vantage engine type, no other properties needs to be set.
- For Docker engine type, set the following additional property:
Property Description Deployment Mode Specify the deployment mode for docker deployment: - RESTful
- Batch
- In the Publish tab, set the following properties, then select Next:
- For In-Vantage engine type:
Property Description Connection Select the service connection to use when deploying a model. Database Specify the database name used to select the table for the deployment job. Table Select the database table from the drop-down list for the deployment job. Advanced options Engine name Select the engine name from drop-down for the deployment job. Docker image Select the docker image from drop-down for the deployment job. - For Docker Batch engine type/deployment modes:
Property Description Dataset Template Select the required dataset template for the deployment job Connection Select the dataset connection settings for the deployment job - For Docker RESTful engine type/deployment modes, no basic properties are required.Expand the ADVANCED OPTIONS section to set the properties:
Property Description Engine name Specify the engine for the deployment job. Docker image Specify the docker image for the deployment job. Advanced options are the same across all engine types/deployment modes.
- For In-Vantage engine type:
- In the Schedule tab, set the following properties:
- For In-Vantage or Docker Batch engine type:
Property Description Enable scheduling Select the checkbox to enable scheduling. If you clear Enable scheduling, deployment properties will indicate Publish only in the scheduling area.Scheduling options Specify the scheduling options to run the scoring job. - Radio button to choose one of the following: Time scheduler, Cron, Run Once, or Manual.
- Drop-down menu to set the schedule to Hourly, Daily, Weekly, Monthly, or Yearly.
- Drop-down menu to set hours and minutes.
Advanced options Resource template Select the resource template from the drop-down list: S Standard, M Medium, L Large, or Custom. When Custom is selected, an additional option displays to provide GPU resource.
Build properties You have the option to provide key value pairs for it. - For Docker RESTful engine type / deployment mode:
Property Description Replicas Specify the number of container replicas to be deployed. Expand the ADVANCED OPTIONS section to set the properties:Property Description Resource Template Specify one of the predefined resource templates or enter custom values for: memory, cpu, gpu Build Properties Define build properties as key/value pairs. Advanced options are the same across all engine types / deployment modes.
- For In-Vantage or Docker Batch engine type:
- Select Deploy.If you selected Run Once in the scheduling options, the job is run immediately.
- Close the dialog box when the deployment progress completes.
The model version status changes to Deployed. The Deployment Details section displays on the page with the following details:
Property Description Job ID Specifies the deployment job ID. You can select View Job Details to see the event details of the job. See Jobs. Deployment Date Specifies the deployment date. Deployed By Specifies the username who executed the deployment job. Status Shows the status of the deployed job as Completed Engine Specifies the deployment engine. Job Progress Lists all phases of the deployment job: - Status: Status of each phase as Created, Completed
- Start Date/Time: Start date and time for each phase
- End Date/Time: End date and time for each phase
- Duration: Duration of each phase