How-to guides
Users can create the service by entering the required Data Flow information and selecting detailed options through the Samsung Cloud Platform Console.
Create Data Flow
You can create and use the Data Flow service from the Samsung Cloud Platform Console.
To create a Data Flow, follow these steps.
All Services > Data Analytics > Data Flow menu, click it. 1. Navigate to the Service Home page of Data Flow.
On the Service Home page, click the Create Data Flow button. 2. Navigate to the Create Data Flow page.
On the Data Flow creation page, enter the information required to create the service, and select detailed options.
- Select the required information in the Version Selection area.
| Category | required status | Detailed description |
|---|
| Data Flow version | Required | Select version of the selected image- Provide a version list of the offered server image
|
Table. Data Flow version selection item
- In the Cluster Selection area, enter or select the required information. * To install Data Flow, you first need to create nodes for the Kubernetes cluster and the work environment.
| Category | Required | Detailed description |
|---|
| Cluster name | Required | Select cluster to use |
Table. Data Flow cluster selection item
- Service Information Input area, enter or select the required information.
| Category | Required | Detailed description |
|---|
| Data Flow name | Required | Enter Data Flow name- must start with a lowercase English letter and must not end with a special character (
-), use lowercase English letters, numbers, and special characters (-) to enter 3 to 30 characters
|
| Storage Class | Required | Select the storage class used by the selected cluster |
| Explanation | Selection | Enter additional information or description about Data Flow within 150 characters. |
| Domain Settings | Required | Enter Data Flow domain- must start with a lowercase English letter and must not end with a special character (
-), enter using lowercase letters, numbers, and special characters (-) with a length of 3 to 50 characters
- {Data Flow명}.{설정한 도메인} becomes the Data Flow access URL.
|
| Node Selector | Required | To install on a specific node, enter a distinguishable label among the node’s labels- If you enter an incorrect node label, installation errors may occur, so verify the node label in advance
- The node label can be found in the node’s yaml file
|
| account | Required | Data Flow Manager account input- ID: Enter a value between 6 and 30 characters, starting with a lowercase English letter and using lowercase letters and numbers
- Password: Enter 8~50 characters including uppercase (English), lowercase (English), numbers, and special characters (
!@#$%^&*)
- Password Confirmation: Enter the password again to confirm
|
| Host Alias | Select | Add host information to be connected with Data Flow (up to 20 total, including defaults)- Use after selecting, click the + button
- Hostname: Enter a host name or domain format using lowercase letters, numbers, and special characters (
-), 3~63 characters long
- Click the X button to delete
- The added host information can be used only if the firewall between the cluster and the server is open
|
Table. Data Flow service information input items
- In the Additional Information Input area, enter or select the required information.
| Category | Required status | Detailed description |
|---|
| tag | Selection | Add tag- Add tag Click the button to create and add a tag, or add an existing tag.
- You can add up to 50 tags.
- Added new tags are applied after the service creation is completed.
|
Table. Data Flow additional information input fields
Summary Check the detailed information and estimated charges generated in the panel, and click the Complete button.
- When creation is complete, check the created resources on the Data Flow List page.
Check detailed information of Data Flow
You can view and edit the complete list of resources and detailed information for the Data Flow. Data Flow Details page consists of Details, Tags, Activity History tabs.
Follow these steps to view detailed information of the Data Flow.
- All Services > Data Analytics > Data Flow menu, click it. 1. Go to the Service Home page of Data Flow.
- Click the Data Flow menu on the Service Home page. 2. Navigate to the Data Flow List page.
- On the Data Flow List page, click the resource to view detailed information. 3. Data Flow Details Navigate to the page.
- Data Flow Details At the top of the page, status information and additional feature information are displayed.
| Category | Detailed description |
|---|
| Status display | Data Flow status- Running: Running, Data Flow Services can be created
- Updating: Updating settings
- Terminating: Terminating service
- Error: Error occurred during creation or service abnormal state
|
| Hosts file setting information | Button that checks and copies the host file information to access Data Flow |
| Service termination | Button to cancel the service |
Table. Data Flow status information and additional functions
Data Flow list page lets you view detailed information of the selected resource and, if needed, modify the information.
| Category | Detailed description |
|---|
| Service | Service Name |
| Resource Type | Resource Type |
| SRN | Unique resource ID in Samsung Cloud Platform- refers to the cluster SRN
|
| Resource Name | Resource name |
| Resource ID | Unique resource ID in the service |
| Constructor | User who created the service |
| Creation Date/Time | Service creation date and time |
| Modifier | User who edited the service information |
| Modification date and time | Date and time the service information was modified |
| Cluster name | Cluster name of the configured servers |
| Storage Class | The storage class used by the selected cluster |
| Explanation | Additional information or explanation about Data Flow |
| Domain Settings | Data Flow domain name |
| Node Selector | Node Label |
| Web Url | Data Flow URL |
| Account | Data Flow Manager account |
| Host Alias | Host information to be connected with Data Flow |
Table. Data Flow Detailed Information Tab Items
Tag
Data Flow List page lets you view the tag information of the selected resource, and add, modify, or delete it.
| Category | Detailed description |
|---|
| Tag List | Tag list- You can view the Key, Value information of the tag
- Up to 50 tags can be added per resource
- When entering a tag, you can search and select from the list of previously created Keys and Values
|
Table. Data Flow Tag Tab Item
Job History
On the Data Flow List page, you can view the operation history of the selected resource.
| Category | Detailed description |
|---|
| Task History List | Resource Change History- Operation timestamp, Resource ID, Resource name, Operation details, Event topic, Operation result, Operator information verification
|
Table. Data Flow Job History Tab Detailed Information Items
Terminate Data Flow
You can cancel unused Data Flows to reduce operating costs. However, if you terminate the service, the running service may be discontinued immediately, so you should proceed with the termination only after fully considering the impact of any service interruption.
To cancel Data Flow, follow the steps below.
- All Services > Data Analytics > Data Flow click the menu. 1. Navigate to the Service Home page of Data Flow.
- On the Service Home page, click the Data Flow menu. 2. Go to the Data Flow List page.
- Data Flow List page, select the resource to terminate, and click the Terminate Service button.
- When the termination is complete, check on the Data Flow List page whether the resource has been terminated.
안내
- Data Flow cancellation requires first deleting the connected Data Flow Services.
- If you cancel Data Flow, the created namespace will also be deleted.
1 - Data Flow Services
Users can create the service by entering the required information for Data Flow Services within the Data Flow service through the Samsung Cloud Platform Console and selecting detailed options.
Creating Data Flow Services
Users can add a service by selecting detailed options for Data Flow or by entering configuration values.
Information
When applying for Data Flow Services, the resource size must be secured to be at least the available capacity of the K8s cluster.
To create Data Flow Services, follow these steps.
Click the All Services > Data Analytics > Data Flow menu. You will be taken to the Data Flow Service Home page.
From the Service Home page, click Data Flow Servies. Navigate to the Data Flow Services list page.
On the Data Flow Services List page, click the Data Flow Services Create button. You will be taken to the Data Flow Services Create page.
Data Flow Services Creation page: enter the information required to create the service and select detailed options.
- Enter or select the required information in the Service Information Input area.
| Category | Required | Detailed description |
|---|
| Data Flow name | Required | Select Data Flow |
| Flow Service name | Required | Enter Data Flow Services name- Start with a lowercase English letter and ensure it does not end with a special character (
-), using lowercase letters, numbers, and special characters (-) to enter 3 to 30 characters
|
| Storage Class | Required | Select the storage class used by the selected cluster |
| description | Selection | Enter additional information or description about Data Flow Services within 150 characters. |
| Domain Settings | Required | Data Flow Services domain input- Start with a lowercase English letter and ensure it does not end with a special character (
-), using lowercase letters, numbers, and special characters (-) to enter 3 to 50 characters
- {Data Flow Services name}.{configured domain} becomes the Data Flow Services access URL.
|
| Node Selector | Required | To install on a specific node, enter a distinguishable label among the node’s Labels- If you enter an incorrect node label, installation errors may occur, so verify the node label in advance
- The node label can be found in the node’s yaml file
|
| Service Workload | Required | - Nifi: Module that provides Apache Nifi’s services and UI
- Nifi Registry: Module that configures and deploys Nifi templates
- Zookeeper: Module that supports proper distributed processing of Nifi across multiple nodes
|
| account | Required | Enter Nifi account- ID: Enter a value between 6 and 30 characters, starting with a lowercase English letter and using lowercase letters and numbers
- Password: Enter 8 to 50 characters, including uppercase letters, lowercase letters, numbers, and special characters(
!@#$%^&*)
- Confirm Password: Re-enter the password exactly the same
|
Table. Data Flow Services service information input items
- In the Additional Information Input area, enter or select the required information.
| Category | Required | Detailed description |
|---|
| Host Alias | Selection | Add host information to be linked with Data Flow (up to 20 total, including defaults)- Select Use, then click the + button
- Hostname: Enter a hostname or domain format using lowercase letters, numbers, and special characters (
-) with a length of 3 to 63 characters
- To delete, click the X button
- The added host information can be used only if the firewall between the cluster and the server is open
|
| tag | Selection | Add Tag- Add Tag Click the button to create and add a tag, or add an existing tag.
- You can add up to 50 tags.
- The newly added tags will be applied after the service creation is completed.
|
Table. Data Flow additional information input fields
Summary Verify the detailed information and estimated billing amount generated in the panel, then click the Complete button.
- Once creation is complete, check the created resources on the Data Flow Services List page.
Data Flow Services Check detailed information
You can view and edit the complete list of resources and detailed information for Data Flow Services. Data Flow Services Details page consists of Details, Tags, Operation History tabs.
To view detailed information about Data Flow Services, follow these steps.
- Click the All Services > Data Analytics > Data Flow menu. Navigate to the Service Home page of Data Flow.
- On the Service Home page, click the Data Flow Services menu. You will be taken to the Data Flow Services list page.
- On the Data Flow Services List page, click the resource to view detailed information. You will be taken to the Data Flow Services Details page.
- Data Flow Services Details At the top of the page, status information and additional feature information are displayed.
| Category | Detailed description |
|---|
| Status display | Data Flow Services status- Updating: Updating configuration
- Terminating: Terminating service
- Error: Creation failed or service unavailable
|
| Hosts file configuration information | Button to view and copy the host file information needed to access Data Flow Services |
| Delete Data Flow Services | Cancel Service button |
Table. Data Flow Services status information and additional functions
Data Flow Services List page lets you view detailed information of the selected resource and edit the information if needed.
| Category | Detailed description |
|---|
| service | Service name |
| Resource Type | Resource Type |
| SRN | Unique resource ID in Samsung Cloud Platform- refers to the cluster SRN
|
| Resource name | Resource name |
| Resource ID | Unique resource ID in the service |
| constructor | User who created the service |
| Creation date and time | Service creation date and time |
| editor | User who edited the service information |
| Modification date | Date and time the service information was modified |
| Data Flow name | Data Flow name |
| Storage Class | Storage class used by the selected cluster |
| description | Additional information or explanation about Data Flow Services |
| Domain Settings | Data Flow Services domain name |
| Node Selector | Node Label |
| Web Url | Data Flow Services URL |
| account | Airflow account |
| Host Alias | Host information to be connected to Data Flow Services |
Table. Data Flow Services detailed information tab items
tag
Data Flow Services List page allows you to view the tag information of the selected resource, and you can add, modify, or delete it.
| Category | Detailed description |
|---|
| Tag list | Tag list- You can view the Key, Value information of the tag
- Up to 50 tags can be added per resource
- When entering a tag, you can search and select from the list of previously created Keys and Values
|
Table. Data Flow Services Tag Tab Items
Job History
Data Flow Services List page lets you view the operation history of the selected resource.
| Category | Detailed description |
|---|
| Task History List | Resource Change History- Operation Time, Resource ID, Resource Name, Operation Details, Event Topic, Operation Result, Check Operator Information
|
Table. Data Flow Services Job History Tab Detailed Information Items
Terminate Data Flow Services
You can cancel unused Data Flow Services to reduce operating costs. However, if you cancel the service, the running service may be stopped immediately, so you should thoroughly consider the impact of service interruption before proceeding with the cancellation.
To cancel Data Flow or Data Flow Services, follow the steps below.
- Click the All Services > Data Analytics > Data Flow menu. You will be taken to the Service Home page of Data Flow.
- On the Service Home page, click the Data Flow Services menu. You will be taken to the Data Flow Services list page.
- On the Data Flow Services List page, select the resource to cancel, and click the Data Flow Services Delete button.
- When termination is complete, check on the Data Flow Services list page whether the resource has been terminated.
information
- If you cancel Data Flow Services, the created namespace will also be deleted.