How-to guides

Users can create the service by entering the required information for Cloud Hadoop and selecting detailed options through the Samsung Cloud Platform Console.

Create Cloud Hadoop

You can create and use the Cloud Hadoop service in the Samsung Cloud Platform Console.

To create Cloud Hadoop, follow these steps.

1. All Services > Data Analytics > Cloud Hadoop Click the menu. You will be taken to the Service Home page of Cloud Hadoop.

2. On the Service Home page, click the Create Cloud Hadoop button. You will be taken to the Create Cloud Hadoop page.

3. On the Cloud Hadoop Creation page, enter the information required to create the service and select detailed options.

   • Select the required information in the Image and version selection area.

     Category	Required	Detailed description
     image	Required	Select the type of image provided Cloud Hadoop With Ubuntu 22.04
     Image version	Required	Select version of the selected image Provide a list of versions of the provided image

     Table. Cloud Hadoop image and version selection options
   • Enter or select the required information in the Service Information Input area.

     Category	Required	Detailed description
     Server name Prefix	Required	Server name for installing Cloud Hadoop must start with a lowercase English letter and be entered using lowercase letters, numbers, and special characters (-) with a length of 3 to 13 characters A postfix such as 001, 002 is appended to the server name to create the actual server name
     Cluster name	Required	Cluster name of the servers Enter using English letters, 3 to 20 characters A cluster is a unit that groups multiple servers
     Planned Compute	Selection	For servers where Cloud Hadoop is installed, you can use a discounted price by selecting a Planned Compute commitment All Services > Financial Management > Planned Compute menu can be applied For more details, refer to Planned Compute Apply
     Master Node > Number of Master Nodes	Required	Number of Master nodes The number of Master nodes is fixed at two per Hadoop cluster A Master node is the node where Hadoop Master is installed and provides the default HA (high availability) configuration The Master node includes Hadoop Manager and various Hadoop ecosystem components installed together
     Master Node > Server Type	Required	CPU and Memory types for distributed data processing Standard-1: Standard specifications commonly used High Capacity-2: Large-capacity server with 24 vCores or more Recommended specifications: vCPU 8, Memory 64G
     Master Node > Block Storage	Required	Block Storage type to be used for the Master node Basic OS: Area where the engine is installed DATA: Data file storage area Select a storage type and then enter the capacity (see Create Block Storage for details on each Block Storage type) SSD: High‑performance general volume HDD: General volume Capacity can be entered in multiples of 8 within the range 25 to 1,536 Delete on termination: When the server is terminated, the volume is terminated as well; however, volumes with snapshots are not deleted even when Delete on termination is enabled. Add Disk: Data storage area After selecting Use, enter the capacity of the storage Click the + button to add storage, or the x button to delete. Up to 9 can be added Capacity can be entered in multiples of 8 within the range 25 to 1,536
     Worker Node > Number of Worker Nodes	Required	Number of Worker nodes Worker nodes can be selected from 3 to 90 Worker nodes are the nodes where Hadoop data nodes and the Resource Manager are installed, and they process and store distributed data
     Worker Node > Server Type	Required	CPU and Memory types for distributed data processing Standard-1: Standard specification commonly used High Capacity-2: Large-capacity server with 24 vCore or more Recommended specification: vCPU 8, Memory 64G For detailed information about server types provided by Cloud Hadoop, see Cloud Hadoop Server Types
     Worker Node > Block Storage	Required	Block Storage type to be used on the Worker node Basic OS: Area where the engine is installed DATA: Data file storage area Select the storage type and then enter the capacity (see Block Storage 생성하기 for details on each Block Storage type) SSD: High‑performance general volume HDD: General volume Capacity can be entered in multiples of 8 within the range 25 to 1,536 Delete on termination: When the server is terminated, the volume is terminated as well; however, volumes with snapshots are not deleted even when Delete on termination is enabled. Add Disk: Data storage area After selecting Use, enter the capacity of the storage Click the + button to add storage, or the x button to delete. Up to 9 can be added Capacity can be entered in multiples of 8 within the range 25 to 1,536
     Data Governance	Selection	Additional installation of the Hadoop ecosystem for data governance If you select Use, Atlas and Ranger are installed automatically Cannot be modified or removed after creation
     Analytical Data Warehouse	Selection	Additional installation of the Hadoop ecosystem for fast data analysis If you select Use, Iceberg and Kyuubi are installed automatically Cannot be modified or removed after creation
     Data Ingestion	Selection	Additional installation of the Hadoop ecosystem for data collection and loading If you select Use, Kafka, Flume, and Sqoop are installed automatically
     Data Ingestion > Ingestion Node count	Selection	Ingestion node count Ingestion nodes can be selected from 3 to 10 Worker nodes are the nodes where Hadoop data nodes and the Resource Manager are installed, and they process and store distributed data
     Data Ingestion > Server Type	Selection	CPU and Memory types for distributed data processing Standard-1: Standard specification commonly used High Capacity-2: Large-capacity server with 24 vCore or more Recommended specification: vCPU 8, Memory 64G For detailed information about the server types provided by Cloud Hadoop, see Cloud Hadoop server types
     Data Ingestion > Block Storage	Selection	Block Storage type to be used for the Ingestion node Base OS: Area where the engine is installed DATA: Data file storage area Select a storage type and then enter the capacity (see Create Block Storage for details on each Block Storage type) SSD: High-performance general volume HDD: General volume Capacity can be entered in multiples of 8 within the range 25 to 1,536 Add Disk: Data storage area After selecting Use, enter the storage capacity Click the + button to add storage, or the x button to delete. Up to 9 can be added Capacity can be entered in multiples of 8 within the range 25 to 1,536, and up to 9 can be created
     Object Storage bucket	Selection	Object Storage to be used in the cluster Bucket Selection after selecting, select Object Storage bucket You can add up to 10, to delete click the x button After adding a bucket, to set access permission for that bucket, select server resources from the All Services > Object Storage list > the relevant Object Storage Details > Access Control > Allow Server Resources menu

     Table. Cloud Hadoop Service Information Input Items
   • In the Required Information Input area, enter or select the required information.

     Category	Required	Detailed description
     Enter PrivateLink information	Required	Enter authentication key for PrivateLink connection Create authentication key: IAM > My info > Authentication Key Management tab > Click Create Authentication Key button Copy authentication key: IAM > My info > Authentication Key Management tab > Click the generated authentication key > Authentication Key Details > Basic Information tab > Authentication Key > Click View button > Copy the authentication key from the popup screen Access Key: Enter Access Key, can be entered only when first applying for the service Secret Key: Enter Secret Key, can be entered only when first applying for the service
     Cloud Hadoop Manager account	Required	Enter the account and password to log in to Cloud Hadoop Manager Account name: Enter the account to use for login Password: Enter the password to use for login Confirm password: Re-enter the password
     Network > Common Settings	Required	Network settings for servers created by the service Select this when you want to apply the same settings to all servers being installed Select the pre‑created VPC and Subnet IP is generated automatically Public NAT: Available when the VPC is connected to an Internet Gateway and the Subnet is of Public type. Checking Use enables NAT IP configuration
     Network > Server-specific Settings	Required	Network settings for servers created by the service Select when you want to apply different settings for each server being installed Select a pre‑created VPC and Subnet Automatically displayed according to the selected node Enter the IP for each server Public NAT: Available when the VPC is connected to an Internet Gateway and the Subnet is of type Public. When Use is checked, NAT IP can be configured. See Create Public IP for details
     Security Group	Required	Add Security Group Click the Select button to choose from the list Before the service creation is complete, you can delete the added Security Group by clicking the x button on its right
     Keypair	Required	Select the user authentication method used when connecting to the Virtual Server Default login accounts by OS Alma Linux: almalinux Oracle Linux: cloud-user RHEL:cloud-user Rocky Linux: rocky Ubuntu: ubuntu Windows: sysadmin

     Table. Cloud Hadoop required information input items
     Caution

     • For a PrivateLink connection, you must enter an authentication key that was generated as a permanent key, and you must not delete that key.
       If the authentication key expires or is deleted, rendering it invalid, it may cause issues with resource changes or service termination in the Cloud Hadoop service.
     • When using a public subnet and assigning a public IP, you may be exposed to security attacks such as external hacking and malware infection.
     information

     • When creating a Cloud Hadoop service, only one Security Group can be selected, but after the service is created, you can select up to four Security Groups, including the initially selected one. However, the Security Group chosen at the initial service creation cannot be modified or deleted.
     • If Cloud Hadoop is installed correctly, API communication between the installed Cloud Hadoop service and the Samsung Cloud Platform Console may occur continuously for the following reasons.
       • Changing resources of Cloud Hadoop service (adding nodes and resources)
       • State changes of Cloud Hadoop services (start, stop, restart, and termination)
       • Check the status of Cloud Hadoop service (Health Check)
   • In the Additional Information Input area, enter or select the required information.

     Category	Required status	Detailed description
     time zone	Required	Select the time zone for the database to use
     tag	Selection	Add Tag Add Tag Click the button to create and add a tag, or add an existing tag You can add up to 50 The newly added tags are applied after the service creation is completed

     Table. Cloud Hadoop additional information input fields

4. Summary Check the detailed information and estimated billing amount generated in the panel, and click the Complete button.

   • Once creation is complete, check the created resource on the Resource List page.

View detailed information of Cloud Hadoop

Cloud Hadoop service allows you to view and edit the full resource list and detailed information. The Cloud Hadoop Details page consists of Details, Tags, Job History tabs.

To view detailed information about the Cloud Hadoop service, follow these steps.

1. Click the All Services > Data Analytics > Cloud Hadoop menu. Navigate to the Service Home page of Cloud Hadoop.
2. On the Service Home page, click the Cloud Hadoop menu. You will be taken to the Cloud Hadoop List page.
3. On the Cloud Hadoop List page, click the resource you want to view detailed information for. You will be taken to the Cloud Hadoop Details page.
   • Cloud Hadoop Details At the top of the page, status information and details about additional features are displayed.

     Category	Detailed description
     status	Cloud Hadoop Service Status Creating: Creating Running: Created, service is available Updating: Updating settings Stopping: Stopping Starting: Starting Stopped: Stopped Restarting: Restarting Terminating: Terminating service Error: Error occurred during creation or service abnormal state Undeployed: Deployment error occurred
     Start	Start of discontinued service operation
     Stop	Force service termination
     Restart	Restart the service
     Add Worker Node	Add a server with the same specifications as the previously created Worker node to the cluster.
     Service termination	Terminate all Cloud Hadoop services and servers

     Table. Cloud Hadoop status information and additional features

Detailed Information

On the Cloud Hadoop List page, you can view detailed information of the selected resource and edit the information if necessary.

tag

On the Cloud Hadoop List page, you can view the tag information of the selected resource and add, modify, or delete it.

Job History

On the Cloud Hadoop List page, you can view the operation history of the selected resource.

Managing Cloud Hadoop Resources

If you need to modify the existing configuration options of a created Cloud Hadoop resource or require additional configuration, you can perform the operation on the Cloud Hadoop Details page.

Add Worker Node

If you need to scale a Cloud Hadoop cluster due to increased workload or other reasons, you can add Worker nodes with the same specifications as the existing Worker nodes.

Add Worker Node (Network configuration: common settings)

You can add a Worker node to a Cloud Hadoop cluster that was created with network settings as common settings.

To add a Worker node, follow the steps below.

1. Click the All Services > Data Analytics > Cloud Hadoop menu. You will be taken to the Service Home page of Cloud Hadoop.
2. On the Service Home page, click the Cloud Hadoop menu. You will be taken to the Cloud Hadoop List page.
3. Cloud Hadoop List page, click the resource you want to add a node to. You will be taken to the Cloud Hadoop Details page.
4. Click the Add Worker Node button. You will be taken to the Add Worker Node page.
5. After selecting the Worker Node count, click the Complete button.

Add Worker Node (Network configuration: per-server settings)

Network settings allow adding Worker nodes to a Cloud Hadoop cluster created with server-specific settings.

To add a Worker node, follow the steps below.

1. Click the All Services > Data Analytics > Cloud Hadoop menu. You will be taken to the Service Home page of Cloud Hadoop.
2. On the Service Home page, click the Cloud Hadoop menu. You will be taken to the Cloud Hadoop List page.
3. On the Cloud Hadoop List page, click the resource you want to add a node to. You will be taken to the Cloud Hadoop Details page.
4. Click the Add Worker Node button. You will be taken to the Add Worker Node page.
5. Please select the Number of Worker Nodes. The server configuration area will be added automatically based on the selected number of nodes.
6. In the added server configuration area, enter the IP and NAT IP, then click the Complete button.

Change Security Group

To change the Security Group of Cloud Hadoop, follow the steps below.

1. All Services > Data Analytics > Cloud Hadoop Click the menu. Navigate to the Service Home page of Cloud Hadoop.
2. On the Service Home page, click the Cloud Hadoop menu. You will be taken to the Cloud Hadoop List page.
3. Click the resource whose Security Group you want to change on the Cloud Hadoop List page. You will be taken to the Cloud Hadoop Details page.
4. On the detail information page, click the Edit button of Security Group. The Security Group Selection popup window opens.
5. Search for the Security Group you want to add, then select the checkbox. The selected Security Group will appear in the list below.
6. Click Confirm. The selected Security Group will be applied.

Add optional service

You can additionally install the Cloud Hadoop ecosystem (Data Governance, Analytical Data Warehouse, Data Ingestion).

Data Governance/Analytical Data Warehouse addition

Follow these steps to install Data Governance and the Analytical Data Warehouse additionally.

1. Click the All Services > Data Analytics > Cloud Hadoop menu. You will be taken to the Service Home page of Cloud Hadoop.
2. On the Service Home page, click the Cloud Hadoop menu. You will be taken to the Cloud Hadoop List page.
3. On the Cloud Hadoop List page, click the resource for which you want to add an optional service. You will be taken to the Cloud Hadoop Details page.
4. On the detail information page, click the Add button of the option service you want to add. A notification popup will open.
5. After reviewing the contents of the popup window, click the Confirm button. The corresponding option service will be added automatically.
   • It may take some time depending on the scale.

Add Data Ingestion

To install Data Ingestion additionally, follow the steps below.

1. Click the All Services > Data Analytics > Cloud Hadoop menu. Navigate to the Service Home page of Cloud Hadoop.
2. On the Service Home page, click the Cloud Hadoop menu. You will be taken to the Cloud Hadoop List page.
3. Cloud Hadoop List page, click the resource you want to add an optional service to. Navigate to the Cloud Hadoop Details page.
4. On the detail information page, click the Add button of Data Ingestion. You will be taken to the Data Ingestion Add page.
5. After selecting the Ingestion Node count, server type, and storage type and capacity, click the Complete button. The selected option service will be added automatically.
   • It may take some time depending on the scale.

Change Server Type

You can change the server type of the Master node, Worker node, or Ingestion node in Cloud Hadoop.

To change the server type, follow these steps.

1. Click the All Services > Data Analytics > Cloud Hadoop menu. Navigate to the Service Home page of Cloud Hadoop.
2. On the Service Home page, click the Cloud Hadoop menu. You will be taken to the Cloud Hadoop List page.
3. On the Cloud Hadoop List page, click the resource whose server type you want to change. You will be taken to the Cloud Hadoop Details page.
4. On the detail information page, click the Edit button of the Server Type of the node you want to change. The Edit Server Type popup window opens.
5. After selecting the server type, click the Confirm button. A notification popup will appear.
   • Scale-Down for server type is not allowed.
6. After reviewing the contents of the popup window, click the Confirm button.
   • The entire server of the node will be changed to the requested specifications, and the Cloud Hadoop cluster will restart.

Expanding Storage

You can expand the storage added to the data zone up to a maximum of 12 TB based on the initially allocated capacity. You can expand the storage without stopping Cloud Hadoop, and if it is configured as a cluster, all nodes are expanded simultaneously.

To increase storage capacity, follow the steps below.

1. Click the All Services > Data Analytics > Cloud Hadoop menu. Navigate to the Service Home page of Cloud Hadoop.
2. On the Service Home page, click the Cloud Hadoop menu. You will be taken to the Cloud Hadoop List page.
3. On the Cloud Hadoop List page, click the resource you want to expand capacity for. Navigate to the Cloud Hadoop Details page.
4. On the detail information page, click the Edit button of the node’s Disk you want to expand. The Disk Edit popup window opens.
5. After entering the number of units, click the Confirm button. A notification popup will appear.
   • You can set the capacity by entering the number of units provided in 8 GB increments.
6. After reviewing the contents of the popup window, click the Confirm button.
   • It may take some time depending on the scale.

Add storage

If the storage allocated to the data area exceeds 12 TB, you can add additional storage. When configured as a cluster, it is added simultaneously for each node type.

Follow the steps below to add storage.

1. Click the All Services > Data Analytics > Cloud Hadoop menu. You will be taken to the Service Home page of Cloud Hadoop.
2. On the Service Home page, click the Cloud Hadoop menu. You will be taken to the Cloud Hadoop List page.
3. On the Cloud Hadoop List page, click the resource you want to add storage to. You will be taken to the Cloud Hadoop Details page.
4. On the detail page, click the Add Disk button of the node where you want to add storage. The Add Disk popup will open.
5. Select the disk type and enter the capacity, then click the Confirm button. A notification popup will appear.
   • If encryption is configured on the existing Block Storage, encryption will also be applied to the additional Disk.
   • If you configure it by selecting HDD, performance degradation may occur.
6. After reviewing the contents of the popup window, click the Confirm button.
   • It may take some time depending on the scale.

Connecting to Cloud Hadoop

To access Cloud Hadoop, follow the steps below.

1. Check the IP of the Windows system(PC) that will connect to Cloud Hadoop.
   • Since external access is required, you need to check the system’s NAT IP.
2. Add the following content to the hosts file on a Windows system.
   • VM host IP of the Cloud Hadoop cluster
   • VM host name of the Cloud Hadoop cluster
3. Add the following rule to the Security Group you selected when applying for the Cloud Hadoop service.
   • Category: Inbound
   • Protocol: TCP
   • Target address: Windows system IP
   • Port: 7080
4. On the Windows system you want to connect to, launch the Chrome browser and then access the Cloud Hadoop Manager URL.

Apache Hadoop Ecosystem Target IP/Port information

Terminate Cloud Hadoop

You can reduce operating costs by terminating unused Cloud Hadoop.

To cancel the service, follow the steps below.

1. Click the All Services > Data Analytics > Cloud Hadoop menu. Navigate to the Service Home page of Cloud Hadoop.
2. On the Service Home page, click the Cloud Hadoop menu. You will be taken to the Cloud Hadoop list page.
3. On the Cloud Hadoop List page, select the resource to cancel, then click the Cancel Service button. An alert popup will appear.
4. Review the contents of the popup window, enter the name of the resource to be terminated, and then click the Confirm button.
5. After the termination request is completed, verify on the Cloud Hadoop list page that the resource has been terminated.
   • It may take some time depending on the scale.