Skip to content

Overview

This is an introductory Get Started guide designed for GPU Clouds (aka CSPs) to learn about and experience foundational capabilities of Rafay's GPU PaaS for CSPs. This guide can be broken down into the steps described in the image below.

1. GPU powered Infrastructure

In this step, the GPU Cloud Provider will provision a Kubernetes cluster with GPUs attached to it. Since this cluster will be shared by multiple organizations, we will ensure that the cluster is configured with critical software add-ons for soft multi-tenancy.

2. SKU Creation

In this step, the GPU Cloud Provider's administrator will configure and publish various Compute and Service Profiles. For each profile, the administrator will associate billing data (e.g. $1/GPU/hour).

3. Customer Orgs (Tenants)

In this step, the GPU Cloud Provider administrator will use Rafay's Operations Console to provision create one or more Rafay Orgs (i.e. tenants) for different customers. The administrator will then publish the common compute and service SKUs to the customer Org.

Once an Org is activated, Org Admins for the Rafay Org will be sent activation emails so that they can gain access. The Org Admins can then onboard

We will model for a customer scenario where an organization such as University acquires X GPUs per month from the GPU Cloud.

4. Customer Usage

In this step, we will take on the end customer persona. We will login into our assigned Rafay Org as an Org Admin and invite end users such as a data scientist, Gen AI developer to the Org.

These users will use the Developer Hub portal in the Rafay Platform to provision GPU based compute resources and AI/ML tooling via self-service.

5. Billing Data

In this step, as a GPU Cloud Administrator, we will use the Rafay APIs to programmatically retrieve billing data for a customer Org.

Info

This step will require a reasonable run time for the compute and services so that billing data is available.

6. Special SKUs

In this step, as a GPU Cloud Administrator, we will publish the following SKUs

  • Promotional SKUs to all Customer Orgs (e.g. special pricing for the month)
  • Custom SKUs (e.g. special pricing for a customer)