The page has been translated by Gen AI.

Data Ops Services

Users can enter essential information for Data Ops Services within the Data Ops service and create the service by selecting detailed options through the Samsung Cloud Platform Console.

Create Data Ops Services

The user can add a service by selecting detailed options for Data Ops or entering setting values.

Notice
When applying for Data Ops Services, the scale of resources should be secured to be more than the available capacity of the K8s cluster.

To create Data Ops Services, follow the procedure below.

  1. Click on the menu for all services > Data Analytics > Data Ops. It moves to the Service Home page of Data Ops.

  2. On the Service Home page, click Data Ops Services. It moves to the Data Ops Services list page.

  3. On the Data Ops Services list page, click the Create Data Ops Services button. It moves to the Create Data Ops Services page.

  4. Data Ops Services Creation page, enter the information required for service creation and select detailed options.

    • Enter Service Information area, enter or select the required information.

      Division
      Necessity
      Detailed Description
      Data Ops NameRequiredData Ops Selection
      Ops Service NameRequiredEnter Data Ops Services name
      • Start with lowercase English letters and do not end with a special character (-), use lowercase letters, numbers, and special characters (-) to input 3 ~ 30 characters
      Storage ClassRequiredSelect the storage class used by the chosen cluster
      DescriptionOptionalEnter additional information or description about Data Ops Services within 150 characters
      Domain settingMandatoryEnter Data Ops Services domain
      • Start with lowercase English letters and do not end with a special character (-), use lowercase letters, numbers, and special characters (-) to input 3 ~ 50 characters
      • {Data Ops Services name}.{set domain} will be the Data Ops Services access address.
      Node SelectorRequiredTo install on a specific node, enter a distinguishable label from the node’s labels
      • If the node label is entered incorrectly, an installation error may occur, so check the node label in advance
      • Node labels can be checked in the yaml file of the corresponding node
      Service WorkloadRequired
      • Web Server: Provides visualization of DAG components and status, and Airflow configuration management module
      • Scheduler: Manages scheduling and execution of various DAGs and tasks for orchestration
      • Worker: Performs actual orchestration and data processing tasks
        • Worker(Kubernetes): Dynamically creates and runs pods when worker conditions are met, allowing for efficient resource usage. The Replica text box is disabled when Kubernetes is selected.
        • Worker(Celery): Creates and maintains static pods when worker conditions are met, allowing for faster performance with large requests. The Replica text box is enabled and user input is allowed when Celery is selected.
        • The type of executor chosen cannot be changed once selected
      AccountRequiredEnter Airflow account
      • ID: Starts with lowercase English letters and uses lowercase letters and numbers to enter a value between 6 and 30 characters
      • Password: Includes uppercase (English), lowercase (English), numbers, and special characters (!@#$%^&*) and enters 8 to 50 characters
      • Password Confirmation: Enter the password again
      Table. Data Ops Services service information input items

    • Enter Additional Information area, enter or select the required information.

      Classification
      Necessity
      Detailed Description
      Host AliasSelectionAdd host information to be connected to Data Ops (up to 20 can be created, including default)
      • Select “Use” and click the + button
      • Hostname: Enter in hostname or domain format, using lowercase letters, numbers, and special characters (-) with 3 ~ 63 characters
      • IP: Enter in IP format
      • To delete, click the X button
      • The firewall between the cluster and the server must be open to use the added host information
      TagSelectionTag addition
      • Tag addition button to create and add tags or add existing tags possible
      • Up to 50 tags can be added
      • Newly added tags are applied after service creation is complete
      Fig. Additional Data Ops information input items

  5. In the Summary panel, review the detailed information and estimated charges, then click the Complete button.

    • Once creation is complete, check the created resource on the Data Ops Services list page.

Data Ops Services detailed information check

You can check and modify the full list of Data Ops Services resources and detailed information. The Data Ops Services details page consists of details, tags, and work history tabs.

To check the details of Data Ops Services, follow the next procedure.

  1. Click on the menu for all services > Data Analytics > Data Ops. It moves to the Service Home page of Data Ops.
  2. On the Service Home page, click the Data Ops Services menu. It moves to the Data Ops Services list page.
  3. Data Ops Services list page, click on the resource to check the detailed information. It moves to the Data Ops Services details page.
    • Data Ops Services Details page top shows status information and additional features.
ClassificationDetailed Description
Status IndicatorData Ops Services status
  • Creating: being created
  • Running: operating
  • Updating: updating settings
  • Terminating: service termination in progress
  • Error: creation failed or service unavailable
Hosts file setting informationButton to check and copy host file information to access Data Ops Services
Data Ops Services deletionbutton to cancel the service
Fig. Data Ops Services Status Information and Additional Features

Detailed Information

On the Data Ops Services list page, you can check the detailed information of the selected resource and modify the information if necessary.

ClassificationDetailed Description
ServiceService Category
Resource TypeService Name
SRNUnique resource ID in Samsung Cloud Platform
  • Means cluster SRN
Resource NameResource Name
  • Means cluster name
Resource IDUnique resource ID in the service
CreatorUser who created the service
Creation TimeTime when the service was created
ModifierUser who modified the service information
Revision TimeThe time when service information was revised
Data Ops NameData Ops Full Name
Storage ClassStorage class used by the selected cluster
DescriptionAdditional information or description about Data Ops Services
Domain SettingData Ops Services domain name
Node SelectorNode Label
Web UrlData Ops Services URL
AccountAirflow Account
Host AliasHost information to be connected to Data Ops Services
Fig. Data Ops Services detailed information tab items

Tag

On the Data Ops Services list page, you can check the tag information of the selected resource and add, change, or delete it.

ClassificationDetailed Description
Tag listTag list
  • Key, Value information of the tag can be checked
  • Up to 50 tags can be added per resource
  • When entering a tag, search and select from the existing Key and Value list
Fig. Data Ops Services tags tab items

Work History

You can check the operation history of the selected resource on the Data Ops Services list page.

ClassificationDetailed Description
Work history listResource change history
  • Check work time, resource ID, resource name, work details, event topic, work result, and worker information
Fig. Data Ops Services job history tab detailed information items

Data Ops Services cancellation

You can cancel unused Data Ops Services to reduce operating costs. However, when canceling a service, the operating service may be stopped immediately, so you should consider the impact of stopping the service sufficiently before proceeding with the cancellation work.

To cancel Data Ops Services, follow the procedure below.

  1. Click on the menu for all services > Data Analytics > Data Ops. It moves to the Service Home page of Data Ops.
  2. On the Service Home page, click the Data Ops Services menu. It moves to the Data Ops Services list page.
  3. Data Ops Services list page, select the resource to be canceled and click the Data Ops Services delete button.
  4. Once the cancellation is complete, please check if the resource has been cancelled on the Data Ops Services list page.
How-to guides
Installing Ingress Controller