Data Ops Services
Users can enter essential information for Data Ops Services within the Data Ops service and create the service by selecting detailed options through the Samsung Cloud Platform Console.
Create Data Ops Services
The user can add a service by selecting detailed options for Data Ops or entering setting values.
To create Data Ops Services, follow the procedure below.
Click on the menu for all services > Data Analytics > Data Ops. It moves to the Service Home page of Data Ops.
On the Service Home page, click Data Ops Services. It moves to the Data Ops Services list page.
On the Data Ops Services list page, click the Create Data Ops Services button. It moves to the Create Data Ops Services page.
Data Ops Services Creation page, enter the information required for service creation and select detailed options.
Enter Service Information area, enter or select the required information.
Division NecessityDetailed Description Data Ops Name Required Data Ops Selection Ops Service Name Required Enter Data Ops Services name - Start with lowercase English letters and do not end with a special character (
-), use lowercase letters, numbers, and special characters (-) to input 3 ~ 30 characters
Storage Class Required Select the storage class used by the chosen cluster Description Optional Enter additional information or description about Data Ops Services within 150 characters Domain setting Mandatory Enter Data Ops Services domain - Start with lowercase English letters and do not end with a special character (
-), use lowercase letters, numbers, and special characters (-) to input 3 ~ 50 characters
- {Data Ops Services name}.{set domain} will be the Data Ops Services access address.
Node Selector Required To install on a specific node, enter a distinguishable label from the node’s labels - If the node label is entered incorrectly, an installation error may occur, so check the node label in advance
- Node labels can be checked in the yaml file of the corresponding node
Service Workload Required - Web Server: Provides visualization of DAG components and status, and Airflow configuration management module
- Scheduler: Manages scheduling and execution of various DAGs and tasks for orchestration
- Worker: Performs actual orchestration and data processing tasks
- Worker(Kubernetes): Dynamically creates and runs pods when worker conditions are met, allowing for efficient resource usage. The Replica text box is disabled when Kubernetes is selected.
- Worker(Celery): Creates and maintains static pods when worker conditions are met, allowing for faster performance with large requests. The Replica text box is enabled and user input is allowed when Celery is selected.
- The type of executor chosen cannot be changed once selected
Account Required Enter Airflow account - ID: Starts with lowercase English letters and uses lowercase letters and numbers to enter a value between 6 and 30 characters
- Password: Includes uppercase (English), lowercase (English), numbers, and special characters (
!@#$%^&*) and enters 8 to 50 characters
- Password Confirmation: Enter the password again
Table. Data Ops Services service information input items - Start with lowercase English letters and do not end with a special character (
Enter Additional Information area, enter or select the required information.
Classification NecessityDetailed Description Host Alias Selection Add host information to be connected to Data Ops (up to 20 can be created, including default) - Select “Use” and click the + button
- Hostname: Enter in hostname or domain format, using lowercase letters, numbers, and special characters (
-) with 3 ~ 63 characters
- IP: Enter in IP format
- To delete, click the X button
- The firewall between the cluster and the server must be open to use the added host information
Tag Selection Tag addition - Tag addition button to create and add tags or add existing tags possible
- Up to 50 tags can be added
- Newly added tags are applied after service creation is complete
Fig. Additional Data Ops information input items
In the Summary panel, review the detailed information and estimated charges, then click the Complete button.
- Once creation is complete, check the created resource on the Data Ops Services list page.
Data Ops Services detailed information check
You can check and modify the full list of Data Ops Services resources and detailed information. The Data Ops Services details page consists of details, tags, and work history tabs.
To check the details of Data Ops Services, follow the next procedure.
- Click on the menu for all services > Data Analytics > Data Ops. It moves to the Service Home page of Data Ops.
- On the Service Home page, click the Data Ops Services menu. It moves to the Data Ops Services list page.
- Data Ops Services list page, click on the resource to check the detailed information. It moves to the Data Ops Services details page.
- Data Ops Services Details page top shows status information and additional features.
| Classification | Detailed Description |
|---|---|
| Status Indicator | Data Ops Services status
|
| Hosts file setting information | Button to check and copy host file information to access Data Ops Services |
| Data Ops Services deletion | button to cancel the service |
Detailed Information
On the Data Ops Services list page, you can check the detailed information of the selected resource and modify the information if necessary.
| Classification | Detailed Description |
|---|---|
| Service | Service Category |
| Resource Type | Service Name |
| SRN | Unique resource ID in Samsung Cloud Platform
|
| Resource Name | Resource Name
|
| Resource ID | Unique resource ID in the service |
| Creator | User who created the service |
| Creation Time | Time when the service was created |
| Modifier | User who modified the service information |
| Revision Time | The time when service information was revised |
| Data Ops Name | Data Ops Full Name |
| Storage Class | Storage class used by the selected cluster |
| Description | Additional information or description about Data Ops Services |
| Domain Setting | Data Ops Services domain name |
| Node Selector | Node Label |
| Web Url | Data Ops Services URL |
| Account | Airflow Account |
| Host Alias | Host information to be connected to Data Ops Services |
| Fig. Data Ops Services detailed information tab items |
Tag
On the Data Ops Services list page, you can check the tag information of the selected resource and add, change, or delete it.
| Classification | Detailed Description |
|---|---|
| Tag list | Tag list
|
Work History
You can check the operation history of the selected resource on the Data Ops Services list page.
| Classification | Detailed Description |
|---|---|
| Work history list | Resource change history
|
| Fig. Data Ops Services job history tab detailed information items |
Data Ops Services cancellation
You can cancel unused Data Ops Services to reduce operating costs. However, when canceling a service, the operating service may be stopped immediately, so you should consider the impact of stopping the service sufficiently before proceeding with the cancellation work.
To cancel Data Ops Services, follow the procedure below.
- Click on the menu for all services > Data Analytics > Data Ops. It moves to the Service Home page of Data Ops.
- On the Service Home page, click the Data Ops Services menu. It moves to the Data Ops Services list page.
- Data Ops Services list page, select the resource to be canceled and click the Data Ops Services delete button.
- Once the cancellation is complete, please check if the resource has been cancelled on the Data Ops Services list page.