Skip to content

Model Service

Overview

Model Service on TurboAI Cloud allows users to deploy machine learning models as API services. This service enables easy deployment, API access, auto-scaling, and monitoring of model performance.

Deploying a Model

Step 1: Access Model Service

Log in to the TurboAI Cloud platform and navigate to the Model Service section.

Access Model Service

Step 2: Create a New Model Service

Click on the "New Model Service" button to start the deployment process.

Create New Model Service

Step 3: Configure Model Service

  • Name: Enter a name for your model service.
  • Model: Choose between an official or private model. Select the model from the dropdown menu.
  • Workers: Specify the number of workers needed for your service.
  • Resources: Select the appropriate resources for your model service, including CPU, memory, and GPU options.

Tip

Choose the number of workers and resources based on the expected load and performance requirements.

Step 4: Confirm Deployment

Review your selections and click "Confirm" to deploy the model service.

Managing Model Services

Viewing Model Services

You can view all your deployed model services in the Model Services list. Here you can see the service status, resource usage, and creation time.

Viewing Model Services

Deleting a Model Service

To delete a model service, click the "Delete" button next to the service you wish to remove.

Warning

Deletion is permanent and cannot be undone. Ensure that you no longer need the service before deleting.

Updating a Model Service

If you need to update the configuration of a model service, click the "Detail" button to access the service settings and make necessary changes.

Model Service Detail

Step 5: Model Operations

Once the model is deployed, you can perform operations such as viewing API documentation, model fine-tuning, model evaluation, and online experience.

Integration

Use the provided API documentation to integrate the model seamlessly into your applications.

Next Steps

After deploying your model service, you may want to explore Training Services to further develop and train your models, enhancing their performance and capabilities.

We wish you a successful experience with Model Service on TurboAI Cloud!