The page has been translated by Gen AI.

Data Ops Services

Users can create the service by entering the required information for Data Ops Services within the Data Ops service through the Samsung Cloud Platform Console and selecting detailed options.

Create Data Ops Services

Users can add a service by selecting detailed options of Data Ops or by entering configuration values.

Information
When applying for Data Ops Services, the resource size must be secured to at least the available capacity of the K8s cluster.

To create Data Ops Services, follow these steps.

  1. Click the All Services > Data Analytics > Data Ops menu. Navigate to the Service Home page of Data Ops.

  2. On the Service Home page, click Data Ops Servies. You will be taken to the Data Ops Services list page.

  3. On the Data Ops Services List page, click the Create Data Ops Services button. You will be taken to the Create Data Ops Services page.

  4. On the Data Ops Services Creation page, enter the information required to create the service and select detailed options.

    • Enter or select the required information in the Service Information Input area.
      Category
      Required status
      Detailed description
      Data Ops nameRequiredSelect Data Ops
      Ops Service nameRequiredEnter the Data Ops Services name
      • starting with a lowercase English letter and not ending with a special character (-), using lowercase letters, numbers, and special characters (-) for 3 to 30 characters
      Storage ClassRequiredSelect the storage class used by the selected cluster
      ExplanationSelectionEnter additional information or description about Data Ops Services within 150 characters.
      Domain SettingsRequiredData Ops Services domain entry
      • Enter 3 to 50 characters, starting with a lowercase English letter, not ending with special characters (-), using lowercase letters, numbers, and special characters (-)
      • {Data Ops Services name}.{configured domain} becomes the Data Ops Services access address.
      Node SelectorRequiredTo install on a specific node, enter a distinguishable label among the node’s Labels
      • If you enter an incorrect node label, installation errors may occur, so verify the node label in advance
      • The node label can be checked in the node’s yaml file
      Service WorkloadRequired
      • Web Server: Provides visualization of DAG components and status, and serves as the Airflow configuration management module
      • Scheculer: Manages DAG scheduling and execution to orchestrate various DAGs and their tasks
      • Worker: Executes actual orchestration and data processing tasks
        • Worker(Kubernetes): When the Worker operates, pods are dynamically created, allowing efficient resource usage. When Kubernetes is selected, the Replica text box is disabled.
        • Worker(Celery): When the Worker operates, a static pod is created and maintained, enabling faster handling of a large number of requests. When Celery is selected, the Replica text box is enabled and user input is allowed.
        • The selected executor type cannot be changed once chosen
      accountRequiredAirflow account input
      • ID: Start with a lowercase English letter and use lowercase letters and numbers, entering a value between 6 and 30 characters
      • Password: Include uppercase (English), lowercase (English), numbers, and special characters (!@#$%^&*) and enter 8 to 50 characters
      • Confirm Password: Re-enter the password identically
      Table. Data Ops Services service information input items
    • Additional Information Input area, enter or select the required information.
      Category
      required or not
      Detailed description
      Host AliasSelectAdd host information to be linked with Data Ops (up to 20 total, including defaults)
      • Select Use, then click the + button
      • Hostname: Enter the host name or domain format using lowercase letters, numbers, and special characters (-) with a length of 3 to 63 characters
      • IP: Enter in IP format
      • Click the X button to delete
      • The firewall between the cluster and the server must be open to use the added host information
      tagSelectionAdd Tag
      • Add Tag Click the button to create and add a tag, or add an existing tag.
      • You can add up to 50 tags.
      • The newly added tags will be applied after the service creation is completed.
      Table. Data Ops additional information input fields
  5. Summary Check the detailed information and estimated billing amount generated in the panel, and click the Complete button.

    • Once creation is complete, check the created resources on the Data Ops Services List page.

Data Ops Services View detailed information

You can view and edit the full list of resources and detailed information for Data Ops Services. The Data Ops Services Details page consists of Details, Tags, Activity History tabs.

Follow these steps to view detailed information about Data Ops Services.

  1. Click the All Services > Data Analytics > Data Ops menu. You will be taken to the Service Home page of Data Ops.
  2. On the Service Home page, click the Data Ops Services menu. You will be taken to the Data Ops Services list page.
  3. On the Data Ops Services List page, click the resource to view detailed information. You will be taken to the Data Ops Services Details page.
    • Data Ops Services Details At the top of the page, status information and additional feature information are displayed.
      CategoryDetailed description
      Status displayData Ops Services status
      • Creating: Creating
      • Running: Running
      • Updating: Updating configuration
      • Terminating: Terminating service
      • Error: Creation failed or service unavailable
      Hosts file configuration informationButton to view and copy host file information for accessing Data Ops Services
      Delete Data Ops ServicesCancel service button
      Table. Data Ops Services status information and additional features

Detailed Information

Data Ops Services List page lets you view detailed information of the selected resource and modify the information if necessary.

CategoryDetailed description
serviceService name
Resource TypeResource Type
SRNUnique resource ID in Samsung Cloud Platform
  • means cluster SRN
Resource nameResource name
  • means the cluster name
Resource IDUnique resource ID in the service
constructorUser who created the service
Creation date and timeService creation date and time
editorUser who edited the service information
Modification dateDate and time the service information was modified
Data Ops nameData Ops name
Storage ClassStorage class used by the selected cluster
descriptionAdditional information or explanation about Data Ops Services
Domain SettingsData Ops Services domain name
Node SelectorNode Lable
Web UrlData Ops Services URL
accountAirflow account
Host AliasHost information to be connected to Data Ops Services
Table. Data Ops Services detailed information tab items

tag

Data Ops Services List page allows you to view the tag information of the selected resource, and to add, modify, or delete it.

CategoryDetailed description
Tag listTag list
  • You can view the Key, Value information of the tag
  • Up to 50 tags can be added per resource
  • When entering a tag, you can search and select from the list of previously created Keys and Values
Table. Data Ops Services Tag Tab Items

Job History

You can view the operation history of the selected resource on the Data Ops Services List page.

CategoryDetailed description
Task History ListResource Change History
  • Operation Time, Resource ID, Resource Name, Operation Details, Event Topic, Operation Result, Verify Operator Information
Table. Data Ops Services Job History Tab Detailed Information Items

Data Ops Services Terminate

You can cancel unused Data Ops Services to reduce operating costs. However, canceling a service may cause the running service to stop immediately, so you should fully consider the impact of any service interruption before proceeding with the cancellation.

To cancel Data Ops Services, follow the steps below.

  1. Click the All Services > Data Analytics > Data Ops menu. Go to the Service Home page of Data Ops.
  2. From the Service Home page, click the Data Ops Services menu. You will be taken to the Data Ops Services list page.
  3. On the Data Ops Services List page, select the resource to cancel and click the Data Ops Services Delete button.
  4. When termination is complete, verify on the Data Ops Services List page whether the resource has been terminated.
How-to guides
Installing Ingress Controller