How-to guides
Users can create the service by entering the required information for the Multi-node GPU Cluster service and selecting detailed options through the Samsung Cloud Platform Console.
Multi-node GPU Cluster Getting Started
You can create and use a Multi-node GPU Cluster service from the Samsung Cloud Platform Console.
This service consists of a GPU Node and a Cluster Fabric service.
Create GPU Node
Follow the steps below to create a Multi-node GPU Cluster.
All Services > Compute > Multi-node GPU Cluster Click the menu. 1. Go to the Service Home page of the Multi-node GPU Cluster.
On the Service Home page, click the Create GPU Node button. 2. Navigate to the GPU Node Creation page.
On the GPU Node creation page, enter the information required to create the service, and select detailed options.
- Select the required information in the Image and Version Selection area.
Category required statusDetailed description image Required Select the type of image provided - Ubuntu
Image version Required Select version of the selected image - Provide version list of the provided server image
Table. GPU Node image and version selection options - Enter or select the required information in the Service Information Input area.
Category required statusDetailed description Number of servers Required Number of GPU Node servers to create simultaneously - Only numeric input is allowed, and the minimum number of servers to create is 2.
- When initially configuring, you must create at least 2, and expansions can be done one at a time.
Service Type > Server Type Required GPU Node server type - Select the desired CPU, Memory, GPU, and Disk specifications
- For detailed information about the server types provided by GPU Node, refer to Multi-node GPU Cluster server type
Service Type > Planned Compute Required Planned Compute가 설정된 자원 현황 - In Use: Number of resources with Planned Compute that are currently in use
- Configured: Number of resources with Planned Compute set
- Coverage Preview: Amount applied per resource by Planned Compute
- Apply for Planned Compute Service: Go to the Planned Compute service application page
- For more details, see Planned Compute 신청하기
Table. GPU Node Service Information Input Items - In the Required Information Input area, enter or select the required information.
Category required statusDetailed description Administrator account Required Set the administrator account and password to be used when connecting to the server - Ubuntu OS is provided with a fixed root account
Server name Prefix Required Enter a prefix to distinguish each GPU Node generated when the selected number of servers is 2 or more - Automatically generated in the form of user input value (prefix) + ‘
-###’
- Must start with a lowercase English letter and be entered using lowercase letters, numbers, and special characters (
-) within 3 to 11 characters
- Must not end with a special character (
-)
Network Settings Required Set the network where the GPU Node will be installed - VPC Name: Select a pre‑created VPC
- General Subnet Name: Select a pre‑created standard Subnet
- IP can be Auto‑generated or Manual Input; if Manual Input is selected, the user enters the IP directly
- NAT: Available only when there is a single server and the VPC is attached to an Internet Gateway. Checking the option allows selection of a NAT IP. (Initially, only configurations with two or more servers can be created, so modify on the resource detail page)
- NAT IP: Select a NAT IP
- If no NAT IP is available to select, click the Create New button to generate a Public IP
- Refresh button to view and select the created Public IP
- Creating a Public IP incurs charges according to the Public IP pricing policy
Table. GPU Node required information input items - In the Cluster Selection area, create or select a Cluster Fabric.
Category required statusDetailed description Cluster Fabric Required Configuration of GPU Node server groups that can apply GPU Direct RDMA together - Optimal GPU performance and speed can be secured only within the same Cluster Fabric
- When creating a new Cluster Fabric, *New Input > select Node pool, then enter the name of the Cluster Fabric to be created
- To add to an existing Cluster Fabric, Existing Input > select Node pool, then choose the previously created Cluster Fabric
Table. GPU Node Cluster Fabric options - In the Additional Information Input area, enter or select the required information.
Category required statusDetailed description Lock Selection Using a lock prevents actions caused by mistakes, such as terminating, starting, or stopping the server. Init Script Selection Script to run at server startup - The Init Script must be selected differently depending on the image type
- For Linux: Choose Shell Script or cloud-init
tag Selection Add Tag - You can add up to 50 per resource
- After clicking the Add Tag button, enter or select Key, Value values
Table. GPU Node additional information input fields - The Init Script must be selected differently depending on the image type
- Select the required information in the Image and Version Selection area.
Summary Check the detailed information and estimated billing amount generated in the panel, and click the Create button.
When the popup notifying creation opens, click the Confirm button.
- When creation is complete, check the created resources on the GPU Node List page.
- When creating a service, the GPU MIG/ECC settings are reset. * However, to apply the correct settings, perform an initial reboot, verify that the settings have been applied, and then use it.
- For detailed information on resetting GPU MIG/ECC settings, refer to the GPU MIG/ECC 설정 초기화 점검 가이드.
Check GPU Node detailed information
The Multi-node GPU Cluster service can view and modify the full list of GPU Node resources and detailed information.
GPU Node Details page consists of Details, Tags, Job History tabs.
To view detailed information about the GPU Node, follow these steps.
Click the All Services > Compute > Multi-node GPU Cluster > GPU Node menu. 1. Go to the Service Home page of the Multi-node GPU Cluster.
On the Service Home page, click the GPU Node menu. 2. Go to the GPU Node list page.
- Resource items other than the required columns can be added through the Settings button.
Category required statusDetailed description Resource ID Selection User-created GPU Node ID Cluster Fabric name Required User-created Cluster Fabric name Server name Required User-created GPU Node name Server type Required Server type of GPU Node - The user can view the number of cores, memory capacity, and GPU type and count of the created resources
image Required User-generated GPU Node image version IP Required IP of the GPU node created by the user status Required Status of the GPU Node created by the user Creation date and time Selection GPU Node creation timestamp Table. GPU Node resource list items
- Resource items other than the required columns can be added through the Settings button.
GPU Node List page, click the resource to view detailed information. 3. Go to the GPU Node Details page.
- GPU Server Details At the top of the page, status information and descriptions of additional features are displayed.
Category Detailed description GPU Node status Status of the GPU Node created by the user - Creating: State while the server is being created
- Running:: State when creation is complete and the server is available for use
- Editing:: State while the IP is being changed
- Unknown: Error state
- Starting: State while the server is starting
- Stopping: State while the server is stopping
- Stopped: State when the server has stopped
- Terminating: State while terminating
- Terminated: State when termination is complete
Server control Button to change server status - Start: Start a stopped server
- Stop: Stop a running server
Service cancellation Cancel service button Table. GPU Node status information and additional features
- GPU Server Details At the top of the page, status information and descriptions of additional features are displayed.
Detailed Information
On the GPU Node List page’s Details Tab, you can view the detailed information of the selected resource and edit the information if needed.
| Category | Detailed description |
|---|---|
| service | service name |
| Resource Type | Resource Type |
| SRN | Unique resource ID in Samsung Cloud Platform
|
| Resource name | Resource name
|
| Resource ID | Unique resource ID in the service |
| Constructor | User who created the service |
| Creation date and time | Service creation date and time |
| Modifier | User who edited the service information |
| Modification date and time | Date and time the service information was modified |
| Server name | server name |
| Node pool | A collection of nodes that can be grouped into the same Cluster Fabric |
| Cluster Fabric name | User-created Cluster Fabric name |
| Image/Version | Server OS image and version |
| Server type | CPU, memory, GPU, information display |
| Planned Compute | Resource status with Planned Compute configured
|
| Lock | Indicates whether Lock is enabled/disabled
|
| Network | GPU Node network information
|
| Block Storage | Block Storage information connected to the server
|
| Init Script | View the Init Script content entered during server creation |
Tag
On the GPU Node List page’s Tag Tab, you can view the selected resource’s tag information, and add, modify, or delete it.
| Category | Detailed description |
|---|---|
| Tag list | Tag list
|
Job History
GPU Node List page’s Job History Tab allows you to view the job history of the selected resource.
| Category | Detailed description |
|---|---|
| Task History List | Resource Change History
|
Control GPU Node operation
If you need server control and management functions for the created GPU Node resources, you can perform tasks on the GPU Node List or GPU Node Details page. You can start and stop the running GPU Node resources.
Getting Started with GPU Node
You can start a stopped (Stopped) GPU Node. To start the GPU Node, follow these steps.
- All Services > Compute > Multi-node GPU Cluster Click the menu. 1. Go to the Service Home page of the Multi-node GPU Cluster.
- On the Service Home page, click the GPU Node menu. 2. Go to the GPU Node list page.
- GPU Node List page, after selecting individual or multiple servers with the checkbox, you can Start via the More button at the top.
- GPU Node List page, click Resources. 3. Go to the GPU Node Details page.
- On the GPU Node Details page, click the Start button at the top to start the server.
- Check the server status and complete the status change.
Stop GPU Node
You can stop a GPU node that is (Active). To stop the GPU Node, follow the steps below.
- All Services > Compute > Multi-node GPU Cluster Click the menu. 1. Go to the Service Home page of the Multi-node GPU Cluster.
- On the Service Home page, click the GPU Node menu. 2. Go to the GPU Node list page.
- GPU Node List page, after selecting individual or multiple servers with the checkboxes, you can control them using the Stop button at the top.
- On the GPU Node List page, click Resources. 3. Go to the GPU Node Details page.
- Click the 중지 button at the top of the GPU Node 상세 page to stop the server.
- Check the server status and complete the status change.
Terminate GPU Node
You can terminate unused GPU nodes to reduce operating costs. However, if you terminate the service, the running service may be discontinued immediately, so you should proceed with the termination only after fully considering the impact that may arise from the service interruption.
To cancel a GPU Node, follow these steps.
- All Services > Compute > Multi-node GPU Server Click the menu. 1. Go to the Service Home page of the Multi-node GPU Cluster.
- On the Service Home page, click the Cluster Fabric menu. 2. Go to the Cluster Fabric List page.
- On the Cluster Fabric List page, select the resources to cancel, and click the Cancel Service button.
- Resources that use the same Cluster Fabric can be terminated simultaneously.
- When termination is complete, check on the GPU Node List page whether the resources have been terminated.
The cases where a GPU Node cannot be terminated are as follows.
- When Block Storage(BM) is connected: Please disconnect the Block Storage(BM) connection first.
- When File Storage is connected: Please disconnect the File Storage connection first.
- If Lock is set: Please change the Lock setting to disabled and try again.
- If the selection includes a server that cannot be terminated simultaneously: Please re-select only resources that can be terminated.
- If the server you want to decommission has a different Cluster Fabric: Select only resources that use the same Cluster Fabric.