How-to guides
Users can create the service by entering the required GPU Server information and selecting detailed options through the Samsung Cloud Platform Console.
Create GPU Server
You can create and use a GPU Server service via the Samsung Cloud Platform Console.
To create a GPU Server, follow these steps.
All Services > Compute > GPU Server Click the menu. 1. Navigate to the GPU Server’s Service Home page.
On the Service Home page, click the GPU Server Creation button. 2. Go to the Create GPU Server page.
On the GPU Server Creation page, enter the information required to create the service and select detailed options.
- Select the required information in the Image and Version Selection area.
Category RequiredDetailed description Image Required Select the type of Image provided - Standard: Samsung Cloud Platform standard provided Image
- RHEL, Ubuntu
- Custom: User-created Image
- Kubernetes: Image for Kubernetes
- Ubuntu
Image version Required Select the version of the chosen image - Provide a list of versions for the offered server image
- For detailed information about the provided server image, refer to OS 및 GPU 드라이버 버전
Table. GPU Server image and version selection input fields - Standard: Samsung Cloud Platform standard provided Image
- In the Service Information Input area, enter or select the required information.
Category RequiredDetailed description Number of servers Required Number of GPU Server instances to create concurrently - Only numeric input is allowed; enter a value between 1 ~ 100
Service Type > Server Type Required GPU Server server type - Indicates the specifications of a GPU-type server and selects a server that includes 1, 2, 4, or 8 GPUs
- For detailed information about the server types provided by GPU Server, refer to GPU Server 서버 타입
Service Type > Planned Compute Selection Status of resources with Planned Compute configured Block Storage required Configure the Block Storage used by the GPU Server according to its purpose - Basic: The area where the OS is installed and used
- Capacity can be entered in Unit increments (minimum capacity varies depending on the OS image type)
- RHEL: Values between 3 and 1,536 can be entered
- Ubuntu: Values between 3 and 1,536 can be entered
- SSD: High‑performance standard volume
- HDD: Standard volume
- SSD/HDD_KMS: Additional encrypted volume using Samsung Cloud Platform KMS (Key Management System) encryption keys
- Encryption can be applied only at initial creation (cannot be changed after creation)
- Performance degradation occurs when using the SSD_KMS disk type
- SSD_Provisioned: SSD volume with configurable IOPS and Throughput
- Capacity can be entered in Unit increments (minimum capacity varies depending on the OS image type)
- Additional: Use when extra space beyond the OS area is needed
- After selecting Use, enter the storage type and capacity
- To add storage, click the + button (up to 25 can be added); to delete, click the x button
- Capacity can be entered in Unit increments, values between 1 and 1,536
- Since 1 Unit equals 8 GB, this creates 8 GB to 12,288 GB
- SSD: High‑performance standard volume
- HDD: Standard volume
- SSD/HDD_KMS: Additional encrypted volume using Samsung Cloud Platform KMS (Key Management System) encryption keys
- Encryption can be applied only at initial creation (cannot be changed after creation)
- Performance degradation may occur when using the SSD_KMS disk type
- HDD/SSD_MultiAttach: Volume that can be attached to two or more servers
- SSD_Provisioned: SSD volume with configurable IOPS and Throughput
- For detailed information on each Block Storage type, refer to Block Storage 생성하기
- Delete on termination: If Delete on Termination is set to Enabled, the volume is deleted together with the server when the server is terminated
- Volumes with existing snapshots are not deleted even if Delete on termination is set to Enabled
- A multi‑attach volume can be deleted only when the server being removed is the last remaining server attached to the volume
Max IOPS Required Enter the maximum IOPS value between 5,000~20,000 - Can be set only when the disk type is SSD_Provisioned
Max Throughput Required Enter the maximum Throughput value between 250~1,000 - Disk type can be set only when it is SSD_Provisioned
Table. GPU Server Service Configuration Items - Required Information area, please enter or select the necessary information.
Category RequiredDetailed description Server name required When the selected number of servers is 1, enter a name to distinguish the server - Set the hostname to the entered server name
- Enter using English letters, numbers, spaces, and special characters (
-_) within 63 characters
Server name Prefix Required Enter a Prefix - user input value (prefix) + ‘
-#’ automatically generated in that form
- Enter using English letters, numbers, spaces, and special characters (
-,_) within 59 characters
Network Settings > Create New Network Port required Set the network where the GPU server will be installed - Select a pre-created VPC.
- General Subnet: Select a pre-created general Subnet
- IP can be auto-generate or manually entered; if input is selected, the user can directly enter the IP
- NAT: Available only when there is a single server and the VPC is connected to an Internet Gateway. Checking Use allows selection of a NAT IP
- NAT IP: Select a NAT IP
- If no NAT IP is available to select, click the Create New button to generate a Public IP
- Click the Refresh button to view and select the created Public IP
- Creating a Public IP incurs charges according to the Public IP pricing policy
- Local Subnet (optional): Select Use for the local Subnet
- It is not a required element for creating the service
- A pre-created local Subnet must be selected
- IP can be auto-generate or manually entered; selecting Input allows the user to directly enter the IP
Network Settings > Specify Existing Network Port Required Set the network where the GPU server will be installed - Select the pre-created VPC
- General Subnet: Select the pre-created general Subnet and Port
- NAT: Available only if there is a single server and the VPC has an Internet Gateway attached. Checking usage allows you to select a NAT IP.
- NAT IP: Select a NAT IP
- If no NAT IP is available to select, click the Create New button to generate a Public IP
- Click the Refresh button to view and select the created Public IP
- Local Subnet (optional): Select Use for the local Subnet
- Select the pre-created local Subnet and Port
Security Group Select Settings required to connect to the server - Select: You can select up to five pre‑created Security Groups
- Create New: If there is no Security Group to apply, create one separately in the Security Group service
- If you do not configure a Security Group, all connections will be blocked, so you must set it to allow required access
Keypair Required User authentication methods to use when connecting to the server - New creation: Create a new one if a new Keypair is required
- Refer to Create Keypair
- Default login account list by OS
- RHEL: cloud-user
- Ubuntu: ubuntu
Table. Required information fields for GPU Server - Additional Information Input area, please enter or select the required information.
Category RequiredDetailed description Allocation Type Required Select Allocation type - General: general resources
- Spot: discounted computing resources provided based on idle resources
Lock Selection Lock usage setting - When Lock is enabled, it prevents actions such as server termination, start, and stop from being executed, thereby avoiding misoperations caused by mistakes
- If the Allocation Type is Spot, it cannot be used
Init script Selection Script executed when the server starts - The init script must be written as a Batch script for Windows, a Shell script for Linux, or cloud‑init, depending on the image type.
- Up to 45,000 bytes can be entered
tag Selection Add Tag - Up to 50 can be added per resource
- After clicking the Add Tag button, enter or select Key, Value values
Table. GPU Server Additional Information Input ItemsCaution- Spot type is not covered by SLA guarantees, so it is not suitable for production use, and we recommend backing up important data separately.
- When using the Spot type, if the available resources are insufficient, they may be reclaimed without prior notice, which can lead to instance termination or service interruption, or cause running tasks to fail to terminate properly.
- Select the required information in the Image and Version Selection area.
Summary Check the detailed information and estimated charges generated in the panel, and click the Create button.
When the popup indicating creation opens, click the Confirm button.
- When creation is complete, check the resources you created on the GPU Server list page.
Check GPU Server detailed information
The GPU Server service allows you to view and edit the full resource list and detailed information. GPU Server Details page consists of the Detailed Information, Tags, Operation History tabs. To view detailed information about the GPU Server service, follow these steps.
- All Services > Compute > GPU Server Click the menu. 1. Go to the Service Home page of the GPU Server.
- On the Service Home page, click the GPU Server menu. 2. Go to the GPU Server List page.
- On the GPU Server list page, click the resource to view detailed information. 3. GPU Server Details page.
- GPU Server Details page displays status information and additional feature information, and consists of the Details, Tags, Job History tabs.
- For detailed information about GPU Server Additional Features, refer to GPU Server 관리 부가 기능.
Category Detailed description GPU Server status Status of the GPU Server created by the user - Build: State where a Build command has been issued
- Building: Build in progress
- Networking: Server creation process in progress
- Scheduling: Server creation process in progress
- Block_Device_Mapping: Connecting Block Storage during server creation
- Spawning: State where the server creation process is ongoing
- Active: Available state
- Powering_off: State when a stop request is made
- Deleting: Server deletion in progress
- Reboot_Started: Reboot in progress state
- Error: Error state
- Migrating: State where the server is migrating to another host
- Reboot: State where a Reboot command has been issued
- Rebooting: Reboot in progress
- Rebuild: State where a Rebuild command has been issued
- Rebuilding: State when a Rebuild request is made
- Rebuild_Spawning: State where the Rebuild process is ongoing
- Shutoff: State when powering off is complete
Server control Buttons to change the server status - Start: Start a stopped server
- Stop: Stop a running server
- Restart: Restart a running server
Image generation Create a user custom image using the current server’s image Console log Current server console log view - You can view the console logs output by the current server. For more details, refer to 콘솔 로그 확인하기.
Create dump Create a dump of the current server - The dump file is created inside the GPU Server
- For detailed dump creation instructions, see Dump 생성하기
Rebuild All data and settings of the existing server will be deleted, and a new server will be configured - For details, refer to Rebuild 수행하기.
Service cancellation Cancel service button Table. GPU Server status information and additional features
Detailed Information
GPU Server List page, you can view detailed information of the selected resource and, if needed, modify the information.
| Category | Detailed description |
|---|---|
| service | Service Name |
| Resource Type | Resource Type |
| SRN | Unique resource ID in Samsung Cloud Platform
|
| Resource name | Resource name
|
| Resource ID | Unique resource ID in the service |
| constructor | User who created the service |
| Creation date and time | Service creation date and time |
| Editor | User who edited the service information |
| Modification date | Date and time the service information was modified |
| Server name | server name |
| Server type | vCPU, memory, GPU information display
|
| Image name | Service OS image and version |
| Lock | Indicates whether Lock is used or not
|
| Keypair name | User-configured server authentication information |
| Planned Compute | Resource status with Planned Compute configured
|
| LLM Endpoint | URL for LLM usage |
| ServiceWatch detailed monitoring | When enabled, data monitoring is possible in the ServiceWatch service
|
| Allocation Type | Allocation type information
|
| Network | GPU Server network information
|
| Local Subnet | Local Subnet information of the GPU Server
|
| Block Storage | Information of Block Storage attached to the server
|
Tag
GPU Server List page lets you view the tag information of the selected resource, and add, modify, or delete it.
| Category | Detailed description |
|---|---|
| Tag list | Tag list
|
Job History
GPU Server List page allows you to view the job history of the selected resources.
| Category | Detailed description |
|---|---|
| Task History List | Resource Change History
|
Control GPU Server Operation
If you need to control the operation of generated GPU Server resources, you can perform the tasks on the GPU Server List or GPU Server Details page. You can start, stop, and restart a running server.
Getting Started with GPU Server
You can start a GPU Server that is shut off (Shutoff). To start the GPU Server, follow these steps.
- Click the All Services > Compute > GPU Server menu. 1. Navigate to the Service Home page of the GPU Server.
- On the Service Home page, click the GPU Server menu. 2. Navigate to the GPU Server list page.
- On the GPU Server List page, click the resource to start among the shutoff servers, and navigate to the GPU Server Details page.
- On the GPU Server List page, you can Start each resource via the right More button.
- After selecting multiple servers with the checkboxes, you can control multiple servers simultaneously using the Start button at the top.
- On the GPU Server Details page, click the Start button at the top to start the server. 4. Check the status of the changed server in the Status Display item.
- When the GPU server startup is complete, the server status changes from Shutoff to Active.
- For detailed information about the GPU Server status, refer to GPU Server Detailed Information.
Stop GPU Server
You can stop a running (Active) GPU Server. To stop the GPU server, follow the steps below.
- All Services > Compute > GPU Server Click the menu. 1. Go to the Service Home page of the GPU Server.
- Click the GPU Server menu on the Service Home page. 2. Go to the GPU Server list page.
- On the GPU Server List page, click the resource to stop among the servers that are running (Active), and navigate to the GPU Server Details page.
- On the GPU Server List page, you can stop each resource via the right More button.
- After selecting multiple servers with the checkboxes, you can control multiple servers simultaneously using the Stop button at the top.
- GPU Server Details On the page, click the Stop button at the top to start the server. 4. Check the status of the modified server in the Status Indicator item.
- When the GPU server shutdown is complete, the server status changes from Active to Shutoff.
- For detailed information about the GPU Server status, please refer to GPU Server detailed information.
Restart GPU Server
You can restart the created GPU Server.
To restart the GPU server, follow the steps below.
- All Services > Compute > GPU Server Click the menu. 1. Navigate to the Service Home page of the GPU Server.
- On the Service Home page, click the GPU Server menu. 2. Go to the GPU Server List page.
- On the GPU Server List page, click the resource to restart, and go to the GPU Server Details page.
- On the GPU Server list page, you can restart each resource via the right More button.
- After selecting multiple servers with checkboxes, you can control multiple servers simultaneously via the Restart button at the top.
- On the GPU Server Details page, click the Restart button at the top to start the server. 4. Check the status of the changed server in the Status Indicator item.
- During a GPU Server restart, the server status goes through Rebooting and finally changes to Active.
- For detailed information about the GPU Server status, please refer to Check GPU Server details.
Managing GPU Server Resources
If you need server control and management functions for the created GPU Server resources, you can perform tasks on the GPU Server Resource List or GPU Server Details page.
Create Image
You can create an image of a running GPU server.
This document provides instructions on how to create a user custom image from the image of a running GPU server.
- GPU Server List or GPU Server Details page, click the Create Image button to create a user Custom Image.
To create an image of the GPU server, follow these steps.
All Services > Compute > GPU Server Click the menu. 1. Navigate to the Service Home page of the GPU Server.
On the Service Home page, click the GPU Server menu. 2. GPU Server list page is accessed.
On the GPU Server List page, click the resource to create an Image. 3. GPU Server Details Navigate to the page.
Click the Create Image button on the GPU Server Details page. 4. Navigate to the Image generation page.
- Enter the required information in the Service Information Input area.
Category Required?Detailed description image name required Name of the image to be created - Enter within 200 characters using English letters, numbers, spaces, and special characters (
-_)
Table. Image service information input fields - Enter within 200 characters using English letters, numbers, spaces, and special characters (
- Enter the required information in the Service Information Input area.
Check the input information and click the Create button.
- After creation is complete, check the created resources on the All Services > Compute > GPU Server > Image List page.
- When an Image is created, the generated Image is stored in the Object Storage used as internal storage. * Therefore, a Object Storage usage fee is charged for image storage.
- Since the file system of an image generated from an active GPU server cannot be guaranteed to be intact, it is recommended to stop the server before creating the image.
Enable detailed monitoring for ServiceWatch
By default, the GPU Server is linked to the basic monitoring of the ServiceWatch and Virtual Server namespaces. You can enable detailed monitoring as needed to identify operational issues more quickly and take action. For detailed information about ServiceWatch, please refer to ServiceWatch Overview.
To enable detailed monitoring of ServiceWatch on the GPU Server, follow these steps.
- All Services > Compute > GPU Server Click the menu. 1. Go to the Service Home page of the GPU Server.
- On the Service Home page, click the GPU Server menu. 2. Go to the GPU Server List page.
- On the GPU Server List page, click the resource to enable detailed ServiceWatch monitoring. 3. Go to the GPU Server Details page.
- GPU Server Details on the page, click the Edit button for ServiceWatch detailed monitoring. 4. ServiceWatch Detailed Monitoring Edit Navigate to the popup window.
- ServiceWatch Detailed Monitoring Edit In the popup window, after selecting Enable, check the guidance message and click the Confirm button.
- GPU Server Details On the page, view the detailed ServiceWatch monitoring items.
Disable detailed monitoring of ServiceWatch
To disable detailed monitoring of ServiceWatch on the GPU Server, follow these steps.
- Click the All Services > Compute > GPU Server menu. 1. Navigate to the Service Home page of the GPU Server.
- On the Service Home page, click the GPU Server menu. 2. Go to the GPU Server list page.
- On the GPU Server List page, click the resource to disable ServiceWatch detailed monitoring. 3. GPU Server Details navigate to the page.
- On the GPU Server Details page, click the Edit button for ServiceWatch detailed monitoring. 4. ServiceWatch Detailed Monitoring Edit Navigate to the popup window.
- ServiceWatch Detailed Monitoring Edit After deselecting Enable in the popup window, review the guidance message and click the Confirm button.
- On the GPU Server Details page, check the ServiceWatch detailed monitoring items.
GPU Server Management Additional Features
For GPU Server management, you can view console logs, generate dumps, and perform rebuilds. To view the Console logs, create a Dump, and perform a Rebuild on the GPU Server, follow these steps.
Check console log
You can view the current console log of the GPU Server.
To check the console log of the GPU Server, follow the steps below.
- Click the All Services > Compute > GPU Server menu. 1. Go to the Service Home page of the GPU Server.
- On the Service Home page, click the GPU Server menu. 2. Go to the GPU Server list page.
- On the GPU Server List page, click the resource to view the console log. 3. Go to the GPU Server Details page.
- On the GPU Server Details page, click the Console Log button. 4. Console log moves to the popup window.
- Console Log Verify the console log displayed in the popup window.
Create Dump
To create a dump file on the GPU server, follow these steps.
- Click the All Services > Compute > GPU Server menu. 1. Go to the Service Home page of the GPU Server.
- On the Service Home page, click the GPU Server menu. 2. Go to the GPU Server list page.
- On the GPU Server List page, click the resource to view detailed information. 3. Go to the GPU Server Details page.
- Click the Create Dump button on the GPU Server Details page.
- The dump file is created inside the GPU server.
Execute Rebuild
You can delete all data and settings of the existing GPU Server and rebuild it on a new server.
To perform a Rebuild of the GPU Server, follow these steps.
- Click the All Services > Compute > GPU Server menu. 1. Go to the Service Home page of the GPU Server.
- On the Service Home page, click the GPU Server menu. 2. Navigate to the GPU Server List page.
- On the GPU Server List page, click the resource to perform Rebuild. 3. Go to the GPU Server Details page.
- On the GPU Server Details page, click the Rebuild button.
- During a GPU Server Rebuild, the server status changes to Rebuilding, and when the Rebuild is complete, it returns to its state before the Rebuild.
- For detailed information about the GPU Server status, please refer to GPU Server Detailed Information.
Terminate GPU Server
Terminating an unused GPU server can reduce operating costs. However, if you terminate the GPU Server, the running service may be stopped immediately, so you should proceed with the termination only after fully considering the impact of service interruption.
To cancel the GPU Server, follow the steps below.
- Click the All Services > Compute > GPU Server menu. 1. Go to the Service Home page of the GPU Server.
- On the Service Home page, click the GPU Server menu. 2. Go to the GPU Server List page.
- On the GPU Server List page, select the resource to cancel and click the Cancel Service button.
- The termination of attached storage depends on the Delete on termination setting. For more information, see Termination constraints.
- After termination is complete, check on the GPU Server List page whether the resources have been terminated.
Termination Constraints
If a GPU Server termination request cannot be processed, a popup will provide guidance. Please refer to the case below.
- When an LB server group is attached: First detach the attached LB server group.
- If Lock is set: Please change the Lock setting to disabled and try again.
The termination of attached storage depends on the Delete on termination setting.
- Whether the volume is deleted also depends on the Delete on termination setting.
- Delete on termination When not set: The volume will not be deleted even if the GPU Server is terminated.
- When Delete on termination is set: terminating the GPU server will delete the associated volume.
- Volumes that have a snapshot will not be deleted even if Delete on termination is set.
- A multi-attach volume can be deleted only when the server being deleted is the last remaining server attached to the volume.