The page has been translated by Gen AI.

How-to guides

Users can create the service by entering the required GPU Server information and selecting detailed options through the Samsung Cloud Platform Console.

Create GPU Server

You can create and use a GPU Server service via the Samsung Cloud Platform Console.

To create a GPU Server, follow these steps.

  1. All Services > Compute > GPU Server Click the menu. 1. Navigate to the GPU Server’s Service Home page.

  2. On the Service Home page, click the GPU Server Creation button. 2. Go to the Create GPU Server page.

  3. On the GPU Server Creation page, enter the information required to create the service and select detailed options.

    • Select the required information in the Image and Version Selection area.
      Category
      Required
      Detailed description
      ImageRequiredSelect the type of Image provided
      • Standard: Samsung Cloud Platform standard provided Image
        • RHEL, Ubuntu
      • Custom: User-created Image
      • Kubernetes: Image for Kubernetes
        • Ubuntu
      Image versionRequiredSelect the version of the chosen image
      • Provide a list of versions for the offered server image
      Table. GPU Server image and version selection input fields
    • In the Service Information Input area, enter or select the required information.
      Category
      Required
      Detailed description
      Number of serversRequiredNumber of GPU Server instances to create concurrently
      • Only numeric input is allowed; enter a value between 1 ~ 100
      Service Type > Server TypeRequiredGPU Server server type
      • Indicates the specifications of a GPU-type server and selects a server that includes 1, 2, 4, or 8 GPUs
      Service Type > Planned ComputeSelectionStatus of resources with Planned Compute configured
      In Use: Number of resources with Planned Compute configured that are currently in useConfigured: Number of resources with Planned Compute configuredCoverage Preview: Amount applied per resource by Planned ComputeApply for Planned Compute Service: Go to the Planned Compute service application pageFor more details, see Planned Compute Apply
      Block StoragerequiredConfigure the Block Storage used by the GPU Server according to its purpose
      • Basic: The area where the OS is installed and used
        • Capacity can be entered in Unit increments (minimum capacity varies depending on the OS image type)
          • RHEL: Values between 3 and 1,536 can be entered
          • Ubuntu: Values between 3 and 1,536 can be entered
        • SSD: High‑performance standard volume
        • HDD: Standard volume
        • SSD/HDD_KMS: Additional encrypted volume using Samsung Cloud Platform KMS (Key Management System) encryption keys
          • Encryption can be applied only at initial creation (cannot be changed after creation)
          • Performance degradation occurs when using the SSD_KMS disk type
        • SSD_Provisioned: SSD volume with configurable IOPS and Throughput
      • Additional: Use when extra space beyond the OS area is needed
        • After selecting Use, enter the storage type and capacity
        • To add storage, click the + button (up to 25 can be added); to delete, click the x button
        • Capacity can be entered in Unit increments, values between 1 and 1,536
          • Since 1 Unit equals 8 GB, this creates 8 GB to 12,288 GB
        • SSD: High‑performance standard volume
        • HDD: Standard volume
        • SSD/HDD_KMS: Additional encrypted volume using Samsung Cloud Platform KMS (Key Management System) encryption keys
          • Encryption can be applied only at initial creation (cannot be changed after creation)
          • Performance degradation may occur when using the SSD_KMS disk type
        • HDD/SSD_MultiAttach: Volume that can be attached to two or more servers
        • SSD_Provisioned: SSD volume with configurable IOPS and Throughput
      • Delete on termination: If Delete on Termination is set to Enabled, the volume is deleted together with the server when the server is terminated
        • Volumes with existing snapshots are not deleted even if Delete on termination is set to Enabled
        • A multi‑attach volume can be deleted only when the server being removed is the last remaining server attached to the volume
      Max IOPSRequiredEnter the maximum IOPS value between 5,000~20,000
      • Can be set only when the disk type is SSD_Provisioned
      Max ThroughputRequiredEnter the maximum Throughput value between 250~1,000
      • Disk type can be set only when it is SSD_Provisioned
      Table. GPU Server Service Configuration Items
    • Required Information area, please enter or select the necessary information.
      Category
      Required
      Detailed description
      Server namerequiredWhen the selected number of servers is 1, enter a name to distinguish the server
      • Set the hostname to the entered server name
      • Enter using English letters, numbers, spaces, and special characters (- _) within 63 characters
      Server name PrefixRequiredEnter a Prefix
      • user input value (prefix) + ‘-#’ automatically generated in that form
      • Enter using English letters, numbers, spaces, and special characters (-, _) within 59 characters
      Network Settings > Create New Network PortrequiredSet the network where the GPU server will be installed
      • Select a pre-created VPC.
      • General Subnet: Select a pre-created general Subnet
        • IP can be auto-generate or manually entered; if input is selected, the user can directly enter the IP
        • NAT: Available only when there is a single server and the VPC is connected to an Internet Gateway. Checking Use allows selection of a NAT IP
        • NAT IP: Select a NAT IP
          • If no NAT IP is available to select, click the Create New button to generate a Public IP
          • Click the Refresh button to view and select the created Public IP
          • Creating a Public IP incurs charges according to the Public IP pricing policy
      • Local Subnet (optional): Select Use for the local Subnet
        • It is not a required element for creating the service
        • A pre-created local Subnet must be selected
        • IP can be auto-generate or manually entered; selecting Input allows the user to directly enter the IP
      Network Settings > Specify Existing Network PortRequiredSet the network where the GPU server will be installed
      • Select the pre-created VPC
      • General Subnet: Select the pre-created general Subnet and Port
        • NAT: Available only if there is a single server and the VPC has an Internet Gateway attached. Checking usage allows you to select a NAT IP.
        • NAT IP: Select a NAT IP
          • If no NAT IP is available to select, click the Create New button to generate a Public IP
          • Click the Refresh button to view and select the created Public IP
      • Local Subnet (optional): Select Use for the local Subnet
        • Select the pre-created local Subnet and Port
      Security GroupSelectSettings required to connect to the server
      • Select: You can select up to five pre‑created Security Groups
      • Create New: If there is no Security Group to apply, create one separately in the Security Group service
      • If you do not configure a Security Group, all connections will be blocked, so you must set it to allow required access
      KeypairRequiredUser authentication methods to use when connecting to the server
      • New creation: Create a new one if a new Keypair is required
      • Default login account list by OS
        • RHEL: cloud-user
        • Ubuntu: ubuntu
      Table. Required information fields for GPU Server
    • Additional Information Input area, please enter or select the required information.
      Category
      Required
      Detailed description
      Allocation TypeRequiredSelect Allocation type
      • General: general resources
      • Spot: discounted computing resources provided based on idle resources
      LockSelectionLock usage setting
      • When Lock is enabled, it prevents actions such as server termination, start, and stop from being executed, thereby avoiding misoperations caused by mistakes
      • If the Allocation Type is Spot, it cannot be used
      Init scriptSelectionScript executed when the server starts
      • The init script must be written as a Batch script for Windows, a Shell script for Linux, or cloud‑init, depending on the image type.
      • Up to 45,000 bytes can be entered
      tagSelectionAdd Tag
      • Up to 50 can be added per resource
      • After clicking the Add Tag button, enter or select Key, Value values
      Table. GPU Server Additional Information Input Items
      Caution
      • Spot type is not covered by SLA guarantees, so it is not suitable for production use, and we recommend backing up important data separately.
      • When using the Spot type, if the available resources are insufficient, they may be reclaimed without prior notice, which can lead to instance termination or service interruption, or cause running tasks to fail to terminate properly.
  4. Summary Check the detailed information and estimated charges generated in the panel, and click the Create button.

  5. When the popup indicating creation opens, click the Confirm button.

    • When creation is complete, check the resources you created on the GPU Server list page.

Check GPU Server detailed information

The GPU Server service allows you to view and edit the full resource list and detailed information. GPU Server Details page consists of the Detailed Information, Tags, Operation History tabs. To view detailed information about the GPU Server service, follow these steps.

  1. All Services > Compute > GPU Server Click the menu. 1. Go to the Service Home page of the GPU Server.
  2. On the Service Home page, click the GPU Server menu. 2. Go to the GPU Server List page.
  3. On the GPU Server list page, click the resource to view detailed information. 3. GPU Server Details page.
    • GPU Server Details page displays status information and additional feature information, and consists of the Details, Tags, Job History tabs.
    • For detailed information about GPU Server Additional Features, refer to GPU Server 관리 부가 기능.
      CategoryDetailed description
      GPU Server statusStatus of the GPU Server created by the user
      • Build: State where a Build command has been issued
      • Building: Build in progress
      • Networking: Server creation process in progress
      • Scheduling: Server creation process in progress
      • Block_Device_Mapping: Connecting Block Storage during server creation
      • Spawning: State where the server creation process is ongoing
      • Active: Available state
      • Powering_off: State when a stop request is made
      • Deleting: Server deletion in progress
      • Reboot_Started: Reboot in progress state
      • Error: Error state
      • Migrating: State where the server is migrating to another host
      • Reboot: State where a Reboot command has been issued
      • Rebooting: Reboot in progress
      • Rebuild: State where a Rebuild command has been issued
      • Rebuilding: State when a Rebuild request is made
      • Rebuild_Spawning: State where the Rebuild process is ongoing
      • Shutoff: State when powering off is complete
      Server controlButtons to change the server status
      • Start: Start a stopped server
      • Stop: Stop a running server
      • Restart: Restart a running server
      Image generationCreate a user custom image using the current server’s image
      Console logCurrent server console log view
      Create dumpCreate a dump of the current server
      • The dump file is created inside the GPU Server
      RebuildAll data and settings of the existing server will be deleted, and a new server will be configured
      Service cancellationCancel service button
      Table. GPU Server status information and additional features
guide
If you are using the mig feature, you must re‑verify the mig settings after the GPU Server’s Rebooting state has finished.

Detailed Information

GPU Server List page, you can view detailed information of the selected resource and, if needed, modify the information.

CategoryDetailed description
serviceService Name
Resource TypeResource Type
SRNUnique resource ID in Samsung Cloud Platform
  • In the GPU Server service, it refers to the GPU Server SRN
Resource nameResource name
  • In the GPU Server service, it means the GPU Server name
Resource IDUnique resource ID in the service
constructorUser who created the service
Creation date and timeService creation date and time
EditorUser who edited the service information
Modification dateDate and time the service information was modified
Server nameserver name
Server typevCPU, memory, GPU information display
  • If you need to change to a different server type, click the Edit button to configure
Image nameService OS image and version
LockIndicates whether Lock is used or not
  • If you need to change the Lock attribute value, click the Edit button to set it
  • If the Allocation Type is Spot, editing is not allowed
Keypair nameUser-configured server authentication information
Planned ComputeResource status with Planned Compute configured
  • Spot type, Planned Compute not applied
LLM EndpointURL for LLM usage
ServiceWatch detailed monitoringWhen enabled, data monitoring is possible in the ServiceWatch service
  • Click the Edit button to configure the activation setting
Allocation TypeAllocation type information
  • General: general resources
  • Spot: discounted computing resources provided based on idle resources
NetworkGPU Server network information
  • VPC name, Subnet name, IP, NAT IP, NAT IP status, Security Group name
  • If you need to change the NAT IP value, click the Edit button to configure it
  • If you need to change the Security Group, click the Edit button to configure it
  • Add as new network: select a Subnet and IP
    • You can select another Subnet within the same VPC
    • The IP can be auto-generated or manually entered; if manual entry is selected, the user can input the IP directly
  • Add using existing port: select a pre-created Subnet and port
Local SubnetLocal Subnet information of the GPU Server
  • Local Subnet name, Local Subnet IP, Security Group name
  • If a Security Group change is required, you can click the Edit button to configure
  • Add to new network: select the local Subnet and IP
    • You can select a different local Subnet within the same VPC
    • IP can be set to auto-generated or user input; if input is selected, the user can directly enter the IP
  • Add using existing port: select a pre-created local Subnet and port
Block StorageInformation of Block Storage attached to the server
  • Volume ID, Volume Name, Type, Capacity, Connection Info, Category, Delete on termination, Status
  • Add: Additional Block Storage can be attached if needed
  • Modify Delete on termination: Modify the Delete on termination value
  • More > Detach: Detach the selected Block Storage from the list
Table. GPU Server detailed information tab items
Caution
If you use ServiceWatch detailed monitoring, additional charges will apply.

Tag

GPU Server List page lets you view the tag information of the selected resource, and add, modify, or delete it.

CategoryDetailed description
Tag listTag list
  • You can view the Key and Value information of the tag
  • Up to 50 tags can be added per resource
  • When entering a tag, you can search and select from the list of previously created Keys and Values
Table. GPU Server Tag Tab Items

Job History

GPU Server List page allows you to view the job history of the selected resources.

CategoryDetailed description
Task History ListResource Change History
  • Task Date/Time, Resource ID, Resource Name, Task Details, Event Topic, Task Result, Verify Operator Information
Table. Work History tab detailed information items

Control GPU Server Operation

If you need to control the operation of generated GPU Server resources, you can perform the tasks on the GPU Server List or GPU Server Details page. You can start, stop, and restart a running server.

Getting Started with GPU Server

You can start a GPU Server that is shut off (Shutoff). To start the GPU Server, follow these steps.

  1. Click the All Services > Compute > GPU Server menu. 1. Navigate to the Service Home page of the GPU Server.
  2. On the Service Home page, click the GPU Server menu. 2. Navigate to the GPU Server list page.
  3. On the GPU Server List page, click the resource to start among the shutoff servers, and navigate to the GPU Server Details page.
    • On the GPU Server List page, you can Start each resource via the right More button.
    • After selecting multiple servers with the checkboxes, you can control multiple servers simultaneously using the Start button at the top.
  4. On the GPU Server Details page, click the Start button at the top to start the server. 4. Check the status of the changed server in the Status Display item.
    • When the GPU server startup is complete, the server status changes from Shutoff to Active.
    • For detailed information about the GPU Server status, refer to GPU Server Detailed Information.

Stop GPU Server

You can stop a running (Active) GPU Server. To stop the GPU server, follow the steps below.

  1. All Services > Compute > GPU Server Click the menu. 1. Go to the Service Home page of the GPU Server.
  2. Click the GPU Server menu on the Service Home page. 2. Go to the GPU Server list page.
  3. On the GPU Server List page, click the resource to stop among the servers that are running (Active), and navigate to the GPU Server Details page.
    • On the GPU Server List page, you can stop each resource via the right More button.
    • After selecting multiple servers with the checkboxes, you can control multiple servers simultaneously using the Stop button at the top.
  4. GPU Server Details On the page, click the Stop button at the top to start the server. 4. Check the status of the modified server in the Status Indicator item.
    • When the GPU server shutdown is complete, the server status changes from Active to Shutoff.
    • For detailed information about the GPU Server status, please refer to GPU Server detailed information.

Restart GPU Server

You can restart the created GPU Server.

Caution
If the type is Spot, you can restart only up to 2 minutes before a forced termination.

To restart the GPU server, follow the steps below.

  1. All Services > Compute > GPU Server Click the menu. 1. Navigate to the Service Home page of the GPU Server.
  2. On the Service Home page, click the GPU Server menu. 2. Go to the GPU Server List page.
  3. On the GPU Server List page, click the resource to restart, and go to the GPU Server Details page.
    • On the GPU Server list page, you can restart each resource via the right More button.
    • After selecting multiple servers with checkboxes, you can control multiple servers simultaneously via the Restart button at the top.
  4. On the GPU Server Details page, click the Restart button at the top to start the server. 4. Check the status of the changed server in the Status Indicator item.
    • During a GPU Server restart, the server status goes through Rebooting and finally changes to Active.
    • For detailed information about the GPU Server status, please refer to Check GPU Server details.

Managing GPU Server Resources

If you need server control and management functions for the created GPU Server resources, you can perform tasks on the GPU Server Resource List or GPU Server Details page.

Create Image

You can create an image of a running GPU server.

Reference

This document provides instructions on how to create a user custom image from the image of a running GPU server.

  • GPU Server List or GPU Server Details page, click the Create Image button to create a user Custom Image.

To create an image of the GPU server, follow these steps.

  1. All Services > Compute > GPU Server Click the menu. 1. Navigate to the Service Home page of the GPU Server.

  2. On the Service Home page, click the GPU Server menu. 2. GPU Server list page is accessed.

  3. On the GPU Server List page, click the resource to create an Image. 3. GPU Server Details Navigate to the page.

  4. Click the Create Image button on the GPU Server Details page. 4. Navigate to the Image generation page.

    • Enter the required information in the Service Information Input area.
      Category
      Required?
      Detailed description
      image namerequiredName of the image to be created
      • Enter within 200 characters using English letters, numbers, spaces, and special characters (- _)
      Table. Image service information input fields
  5. Check the input information and click the Create button.

    • After creation is complete, check the created resources on the All Services > Compute > GPU Server > Image List page.
Info
  • When an Image is created, the generated Image is stored in the Object Storage used as internal storage. * Therefore, a Object Storage usage fee is charged for image storage.
  • Since the file system of an image generated from an active GPU server cannot be guaranteed to be intact, it is recommended to stop the server before creating the image.

Enable detailed monitoring for ServiceWatch

By default, the GPU Server is linked to the basic monitoring of the ServiceWatch and Virtual Server namespaces. You can enable detailed monitoring as needed to identify operational issues more quickly and take action. For detailed information about ServiceWatch, please refer to ServiceWatch Overview.

Reference
GPU Server provides basic and detailed monitoring in the same namespace as Virtual Server. GPU Server’s GPU metrics will be provided by the ServiceWatch Agent. (Scheduled for December 2025)
Caution
Basic monitoring is provided for free, but enabling detailed monitoring incurs additional charges. Please note the usage.

To enable detailed monitoring of ServiceWatch on the GPU Server, follow these steps.

  1. All Services > Compute > GPU Server Click the menu. 1. Go to the Service Home page of the GPU Server.
  2. On the Service Home page, click the GPU Server menu. 2. Go to the GPU Server List page.
  3. On the GPU Server List page, click the resource to enable detailed ServiceWatch monitoring. 3. Go to the GPU Server Details page.
  4. GPU Server Details on the page, click the Edit button for ServiceWatch detailed monitoring. 4. ServiceWatch Detailed Monitoring Edit Navigate to the popup window.
  5. ServiceWatch Detailed Monitoring Edit In the popup window, after selecting Enable, check the guidance message and click the Confirm button.
  6. GPU Server Details On the page, view the detailed ServiceWatch monitoring items.

Disable detailed monitoring of ServiceWatch

Caution
Disabling detailed monitoring is required for cost efficiency. Maintain detailed monitoring only when absolutely necessary, and disable detailed monitoring otherwise.

To disable detailed monitoring of ServiceWatch on the GPU Server, follow these steps.

  1. Click the All Services > Compute > GPU Server menu. 1. Navigate to the Service Home page of the GPU Server.
  2. On the Service Home page, click the GPU Server menu. 2. Go to the GPU Server list page.
  3. On the GPU Server List page, click the resource to disable ServiceWatch detailed monitoring. 3. GPU Server Details navigate to the page.
  4. On the GPU Server Details page, click the Edit button for ServiceWatch detailed monitoring. 4. ServiceWatch Detailed Monitoring Edit Navigate to the popup window.
  5. ServiceWatch Detailed Monitoring Edit After deselecting Enable in the popup window, review the guidance message and click the Confirm button.
  6. On the GPU Server Details page, check the ServiceWatch detailed monitoring items.

GPU Server Management Additional Features

For GPU Server management, you can view console logs, generate dumps, and perform rebuilds. To view the Console logs, create a Dump, and perform a Rebuild on the GPU Server, follow these steps.

Check console log

You can view the current console log of the GPU Server.

To check the console log of the GPU Server, follow the steps below.

  1. Click the All Services > Compute > GPU Server menu. 1. Go to the Service Home page of the GPU Server.
  2. On the Service Home page, click the GPU Server menu. 2. Go to the GPU Server list page.
  3. On the GPU Server List page, click the resource to view the console log. 3. Go to the GPU Server Details page.
  4. On the GPU Server Details page, click the Console Log button. 4. Console log moves to the popup window.
  5. Console Log Verify the console log displayed in the popup window.

Create Dump

To create a dump file on the GPU server, follow these steps.

  1. Click the All Services > Compute > GPU Server menu. 1. Go to the Service Home page of the GPU Server.
  2. On the Service Home page, click the GPU Server menu. 2. Go to the GPU Server list page.
  3. On the GPU Server List page, click the resource to view detailed information. 3. Go to the GPU Server Details page.
  4. Click the Create Dump button on the GPU Server Details page.
    • The dump file is created inside the GPU server.

Execute Rebuild

You can delete all data and settings of the existing GPU Server and rebuild it on a new server.

Caution
If the type is Spot, you can only perform a Rebuild up to 2 minutes before forced termination.

To perform a Rebuild of the GPU Server, follow these steps.

  1. Click the All Services > Compute > GPU Server menu. 1. Go to the Service Home page of the GPU Server.
  2. On the Service Home page, click the GPU Server menu. 2. Navigate to the GPU Server List page.
  3. On the GPU Server List page, click the resource to perform Rebuild. 3. Go to the GPU Server Details page.
  4. On the GPU Server Details page, click the Rebuild button.
    • During a GPU Server Rebuild, the server status changes to Rebuilding, and when the Rebuild is complete, it returns to its state before the Rebuild.
    • For detailed information about the GPU Server status, please refer to GPU Server Detailed Information.

Terminate GPU Server

Terminating an unused GPU server can reduce operating costs. However, if you terminate the GPU Server, the running service may be stopped immediately, so you should proceed with the termination only after fully considering the impact of service interruption.

Caution
Please note that data cannot be recovered after terminating the service.

To cancel the GPU Server, follow the steps below.

  1. Click the All Services > Compute > GPU Server menu. 1. Go to the Service Home page of the GPU Server.
  2. On the Service Home page, click the GPU Server menu. 2. Go to the GPU Server List page.
  3. On the GPU Server List page, select the resource to cancel and click the Cancel Service button.
    • The termination of attached storage depends on the Delete on termination setting. For more information, see Termination constraints.
  4. After termination is complete, check on the GPU Server List page whether the resources have been terminated.

Termination Constraints

If a GPU Server termination request cannot be processed, a popup will provide guidance. Please refer to the case below.

Cancellation not possible
  • When an LB server group is attached: First detach the attached LB server group.
  • If Lock is set: Please change the Lock setting to disabled and try again.

The termination of attached storage depends on the Delete on termination setting.

Delete on termination delete per setting
  • Whether the volume is deleted also depends on the Delete on termination setting.
    • Delete on termination When not set: The volume will not be deleted even if the GPU Server is terminated.
    • When Delete on termination is set: terminating the GPU server will delete the associated volume.
  • Volumes that have a snapshot will not be deleted even if Delete on termination is set.
  • A multi-attach volume can be deleted only when the server being deleted is the last remaining server attached to the volume.
ServiceWatch Metrics
Manage Image