Skip to content

Models

Click on Models to view the list of serverless models (hosted by the service provider) available to the user.

List of Models

Info

These models can be hosted on endpoints shared by multiple tenants or can be dedicated to a single tenant.

Use Model

Select a model by clicking on "Try Model". The user is presented with instructions on how to access the endpoint URL for the model using the following:

  • cURL
  • Python
  • Typescript

Use Model

The specifications of the model are shown to the user on the right hand side to help the user determine if this is a model suitable for their use case and budget.

  1. Name of the model
  2. Input Token Cost (per 1M tokens)
  3. Output Token Cost (per 1M tokens)