API
The Gcore Customer Portal is being updated. Screenshots may not show the current version.
Edge AI
Edge AI
About GPU CloudCreate an AI Cluster
Prepare a custom model for deployment
Deploy AI models in the Customer PortalDeploy AI models in the Customer Portal
Manage deployments in the Customer PortalCreate and manage API keysCreate and configure a registry
API
Chosen image
Home/Edge AI/GPU Cloud/Create an AI Cluster

Create an AI cluster

1. In the Gcore Customer Portal, open the GPU cloud page. You'll be taken to the page for AI cluster creation.

Create an AI Cluster

2. Select a region, which is a physical location of the data center. For example, if you choose Helsinki, your cluster will be deployed on servers in Helsinki.

3. Choose the flavor with relevant cluster configuration and allocated resources:

  • The GPU number means the number of GPU cards allocated per server.

  • 2x Intel Xeon 8480+ is the type of processor that powers the servers within your cluster.

  • The amount of RAM specifies the total memory available for processing data.

  • NVMe size indicates the total solid-state storage capacity available within each server in the cluster.

  • 8 x 400G Infiniband refers to the number and speed of Infiniband connections within the cluster.

4. Select the OS image on which your model will be running.

Create an AI Cluster image settings

5. Set up a network interface. You can choose a public or private one:

  • Public: Attach this interface if you are planning to use the GPU Cloud with servers hosted outside of Gcore Cloud. Your cluster will be accessible from external networks.

  • Private: If you want to use the service with Gcore servers only. Your cluster will be available only for internal networks.
    Select one of the existing networks or create a new one to attach it to your server.

6. (Optional) If you want to assign a reserved IP address to your server, turn on the Use reserved IP toggle and select one. For more details, refer to the article Create and configure a reserved IP address. 

7. Turn on the Use floating IP toggle if you want to use a floating IP address. It’ll make your server accessible from outside networks even if they have only a private interface. Create a new IP address or choose an existing one. For more details, check out the article Create and configure a floating IP address.

Create an AI Cluster network settings

8. (Optional) If you need several network interfaces, click Add Interface and repeat the instructions from Step 5.

9. Select one of your SSH keys from the list, add a new key, or generate a key pair. You'll use this SSH key to connect to your cluster.

Create an AI Cluster ssh key settings

10. (Optional) To add metadata to your cluster, enable the Additional options toggle and add tags as key-value pairs.

11. Name your cluster and click Create Cluster.

Create an AI Cluster tag and name settings

You’ve successfully created the cluster. Use the IP address of your AI Cluster and the SSH key from Step 10 and connect to your server.

User login: ubuntu

Connection port: 22

Was this article helpful?

Edit on GitHub