Data Ops Services
Users can create the service by entering the required information for Data Ops Services within the Data Ops service through the Samsung Cloud Platform Console and selecting detailed options.
Create Data Ops Services
Users can add a service by selecting detailed options of Data Ops or by entering configuration values.
To create Data Ops Services, follow these steps.
Click the All Services > Data Analytics > Data Ops menu. Navigate to the Service Home page of Data Ops.
On the Service Home page, click Data Ops Servies. You will be taken to the Data Ops Services list page.
On the Data Ops Services List page, click the Create Data Ops Services button. You will be taken to the Create Data Ops Services page.
On the Data Ops Services Creation page, enter the information required to create the service and select detailed options.
- Enter or select the required information in the Service Information Input area.
Category Required statusDetailed description Data Ops name Required Select Data Ops Ops Service name Required Enter the Data Ops Services name - starting with a lowercase English letter and not ending with a special character (
-), using lowercase letters, numbers, and special characters (-) for 3 to 30 characters
Storage Class Required Select the storage class used by the selected cluster Explanation Selection Enter additional information or description about Data Ops Services within 150 characters. Domain Settings Required Data Ops Services domain entry - Enter 3 to 50 characters, starting with a lowercase English letter, not ending with special characters (
-), using lowercase letters, numbers, and special characters (-)
- {Data Ops Services name}.{configured domain} becomes the Data Ops Services access address.
Node Selector Required To install on a specific node, enter a distinguishable label among the node’s Labels - If you enter an incorrect node label, installation errors may occur, so verify the node label in advance
- The node label can be checked in the node’s yaml file
Service Workload Required - Web Server: Provides visualization of DAG components and status, and serves as the Airflow configuration management module
- Scheculer: Manages DAG scheduling and execution to orchestrate various DAGs and their tasks
- Worker: Executes actual orchestration and data processing tasks
- Worker(Kubernetes): When the Worker operates, pods are dynamically created, allowing efficient resource usage. When Kubernetes is selected, the Replica text box is disabled.
- Worker(Celery): When the Worker operates, a static pod is created and maintained, enabling faster handling of a large number of requests. When Celery is selected, the Replica text box is enabled and user input is allowed.
- The selected executor type cannot be changed once chosen
account Required Airflow account input - ID: Start with a lowercase English letter and use lowercase letters and numbers, entering a value between 6 and 30 characters
- Password: Include uppercase (English), lowercase (English), numbers, and special characters (
!@#$%^&*) and enter 8 to 50 characters
- Confirm Password: Re-enter the password identically
Table. Data Ops Services service information input items - starting with a lowercase English letter and not ending with a special character (
- Additional Information Input area, enter or select the required information.
Category required or notDetailed description Host Alias Select Add host information to be linked with Data Ops (up to 20 total, including defaults) - Select Use, then click the + button
- Hostname: Enter the host name or domain format using lowercase letters, numbers, and special characters (
-) with a length of 3 to 63 characters
- IP: Enter in IP format
- Click the X button to delete
- The firewall between the cluster and the server must be open to use the added host information
tag Selection Add Tag - Add Tag Click the button to create and add a tag, or add an existing tag.
- You can add up to 50 tags.
- The newly added tags will be applied after the service creation is completed.
Table. Data Ops additional information input fields
- Enter or select the required information in the Service Information Input area.
Summary Check the detailed information and estimated billing amount generated in the panel, and click the Complete button.
- Once creation is complete, check the created resources on the Data Ops Services List page.
Data Ops Services View detailed information
You can view and edit the full list of resources and detailed information for Data Ops Services. The Data Ops Services Details page consists of Details, Tags, Activity History tabs.
Follow these steps to view detailed information about Data Ops Services.
- Click the All Services > Data Analytics > Data Ops menu. You will be taken to the Service Home page of Data Ops.
- On the Service Home page, click the Data Ops Services menu. You will be taken to the Data Ops Services list page.
- On the Data Ops Services List page, click the resource to view detailed information. You will be taken to the Data Ops Services Details page.
- Data Ops Services Details At the top of the page, status information and additional feature information are displayed.
Category Detailed description Status display Data Ops Services status - Creating: Creating
- Running: Running
- Updating: Updating configuration
- Terminating: Terminating service
- Error: Creation failed or service unavailable
Hosts file configuration information Button to view and copy host file information for accessing Data Ops Services Delete Data Ops Services Cancel service button Table. Data Ops Services status information and additional features
- Data Ops Services Details At the top of the page, status information and additional feature information are displayed.
Detailed Information
Data Ops Services List page lets you view detailed information of the selected resource and modify the information if necessary.
| Category | Detailed description |
|---|---|
| service | Service name |
| Resource Type | Resource Type |
| SRN | Unique resource ID in Samsung Cloud Platform
|
| Resource name | Resource name
|
| Resource ID | Unique resource ID in the service |
| constructor | User who created the service |
| Creation date and time | Service creation date and time |
| editor | User who edited the service information |
| Modification date | Date and time the service information was modified |
| Data Ops name | Data Ops name |
| Storage Class | Storage class used by the selected cluster |
| description | Additional information or explanation about Data Ops Services |
| Domain Settings | Data Ops Services domain name |
| Node Selector | Node Lable |
| Web Url | Data Ops Services URL |
| account | Airflow account |
| Host Alias | Host information to be connected to Data Ops Services |
tag
Data Ops Services List page allows you to view the tag information of the selected resource, and to add, modify, or delete it.
| Category | Detailed description |
|---|---|
| Tag list | Tag list
|
Job History
You can view the operation history of the selected resource on the Data Ops Services List page.
| Category | Detailed description |
|---|---|
| Task History List | Resource Change History
|
Data Ops Services Terminate
You can cancel unused Data Ops Services to reduce operating costs. However, canceling a service may cause the running service to stop immediately, so you should fully consider the impact of any service interruption before proceeding with the cancellation.
To cancel Data Ops Services, follow the steps below.
- Click the All Services > Data Analytics > Data Ops menu. Go to the Service Home page of Data Ops.
- From the Service Home page, click the Data Ops Services menu. You will be taken to the Data Ops Services list page.
- On the Data Ops Services List page, select the resource to cancel and click the Data Ops Services Delete button.
- When termination is complete, verify on the Data Ops Services List page whether the resource has been terminated.