How-to guides

• 1: Cluster Deployment
• 2: Kubeflow Usage Guide

1 - Cluster Deployment

Cluster deployment area

In Samsung Cloud Platform, the AI&MLOps Platform creation’s service type selection provides two cloud deployment regions.

• Deploy from SCP Kubernetes Engine
• Deploy to a new cluster

Depending on the selection of the cluster deployment region, the installation details on the AI&MLOps Platform creation service information input page differ.

Deploy from SCP Kubernetes Engine

1. Click the All Services > AI/ML > AI&MLOps Platform menu. You will be taken to the Service Home page of AI&MLOps Platform.
2. On the Service Home page, click the AI&MLOps Platform Create button. It navigates to the AI&MLOps Platform Create page.
3. On the service type selection page of AI&MLOps Platform creation, enter the information required to create the service and select detailed options.
   Cluster deployment

   Select the Deploy on SCP Kubernetes Engine option.
4. On the Service Information Input page of AI&MLOps Platform Creation, enter the information required to create the service, and select detailed options.
   • In the Service Information Input area, enter or view the information required to create a service.

     Category	Required status	Detailed description
     Service name	Required	Enter AI&MLOps Platform name AI&MLOps Platform name cannot be duplicated within a project
     Storage Class	Required	Storage Class is automatically registered
     Installation node information	Lookup	View the node information of the selected Kubernetes Engine
     Admin Email Address	Required	Enter the administrator (Admin) email address to use for login
     password	Required	Enter the password to use for login
     Confirm Password	Required	Re-enter password to prevent password errors

     Table. AI&MLOps Platform service information input fields
   • Additional Information Input area: enter or select the information required to create a service.

     Category	Required status	Detailed description
     tag	Selection	Select tags to add to the AI&MLOps Platform Click ‘Add Tag’ to create a new tag or add an existing tag You can register up to 50 tags The newly added tags will be applied after the service creation is completed

     Table. AI&MLOps Platform service additional information input fields

Deploy to a new cluster

1. Click the All Services > AI/ML > AI&MLOps Platform menu. You will be taken to the Service Home page of AI&MLOps Platform.
2. Service Home page, click the Create AI&MLOps Platform button. It navigates to the Create AI&MLOps Platform page.
3. On the Service Type Selection page of the AI&MLOps Platform creation, enter the information required to create the service and select detailed options.
   Cluster deployment

   Select the Deploy to a new cluster option.
4. On the Service Information Input page of AI&MLOps Platform creation, enter the information required to create a service and select detailed options.

   • In the Service Information Input area, enter or view the information required to create a service.

     Category	Required	Detailed description
     Service name	Required	Enter AI&MLOps Platform name AI&MLOps Platform name cannot be duplicated within a project
     Storage Class	Required	Storage Class is automatically registered
     Installation node information	Lookup	View the node information of the selected Kubernetes Engine
     Admin Email Address	Required	Enter the email address of the administrator (Admin) to be used for login.
     password	Required	Enter the password to use for login
     Confirm Password	Required	Re-enter password to prevent password errors

     Table. AI&MLOps Platform Service Information Input Items

   • Kubernetes Engine Information Input Enter or select the required information in this area.

     Category	Required	Detailed description
     Cluster name	Required	Cluster name must start with an English letter and may use English letters, numbers, and special characters (-) Enter within 3 to 30 characters
     Control plane settings > Kubernetes version	Required	Select Kubernetes version
     Control Area Settings > Control Area Logging	Selection	Select whether to enable control plane logging Audit/Event logs from the cluster control plane can be viewed in Cloud Monitoring’s log analysis Log storage up to 1 GB for all services within the account is provided for free, and logs exceeding 1 GB are deleted sequentially For more details, see Cloud Monitoring > Log Analysis
     Network Settings	Required	Network connection settings for the node pool VPC: Select a pre‑created VPC Subnet: Select a standard Subnet to use from the subnets of the chosen VPC Security Group: Click the Search button, then select a Security Group in the Select Security Group popup Load Balancer: Provides the type:LoadBalancer feature in a Kubernetes Service object Select a load balancer on the same network Select whether to use Cannot be changed after configuration
     File Storage Settings	Required	Select the file storage volume to use in the cluster Default Volume (NFS): Select File Storage using the Search button The default Volume file storage provides only the NFS format

     Table. Kubernetes Engine Service Information Input Items

   • Enter or select the required information in the Node Pool Information Input area.

     Category	Required status	Detailed description
     Node pool configuration	Required	Select node pool information * Items marked with an asterisk are required fields and must be entered For the AI&MLOps Platform, image size may continuously increase depending on usage, so setting Block Storage to at least 200 GB enables smooth system configuration

     Table. AI&MLOps Platform Service Information Input Items
     Reference

     • A Windows OS node pool can be created only when an additional storage (CIFS) volume is in use in the cluster.
     • Volume encryption for node pool Block Storage can only be set at initial creation.
       • Enabling encryption may cause performance degradation in some features.
     • Only when you have selected the node pool auto‑scaling or shrinking feature can you input node count, minimum node count, maximum node count.

   • In the Additional Information Input area, enter or select the required information.

     Category	Required	Detailed description
     tag	Selection	Select tags to add to the AI&MLOps Platform Click ‘Add Tag’ to create a new tag or add an existing tag You can register up to 50 tags The newly added tags will be applied after the service creation is completed

     Table. AI&MLOps Platform Service Information Input Items

Cluster specifications

To use the AI&MLOps Platform, you need a Kubernetes Engine to install the AI&MLOps Platform. You can select an existing Kubernetes Engine, or you can create a Kubernetes Engine together when creating the AI&MLOps Platform.

The specifications of the Kubernetes cluster required for installation are as follows.

• Node pool resource size (composed of 2 or more nodes)

  • AI&MLOps Platform: vCPU 32, Memory 128G or more
  • Kubeflow Mini: vCPU 24, Memory 96G or more

• Kubernetes version

  • AI&MLOps Platform v1.9.1 (k8s v1.30)
  • Kubeflow Mini v1.9.1 (k8s v1.30)

2 - Kubeflow Usage Guide

Below, we guide you on how to use Kubeflow after creating it.

Add Kubeflow User

Below is a guide on how to use Kubeflow after it has been created.

Kubeflow only creates the account of the single Admin User entered on the initial installation screen.

When using the Kubeflow Dashboard, to add users other than the initial user, you must modify the settings of Dex (the authentication integration component of Kubeflow).

• Dex is deployed in the auth namespace, and its configuration is stored in a configmap named dex.

The following is an example of Dex configuration.

apiVersion: v1
kind: ConfigMap
metadata:
  name: dex
  namespace: auth
data:
  config.yaml: |
    issuer: http://dex.auth.svc.cluster.local:5556/dex
    storage:
      type: kubernetes
      config:
        inCluster: true
    web:
      http: 0.0.0.0:5556
    logger:
      level: "debug"
      format: text
    oauth2:
      skipApprovalScreen: true
    enablePasswordDB: true
    staticPasswords:
    - email: admin@kubeflow.org
      hash: $2y$10$Yb9WVbn8pzVSM6fBgKdFae1Bh6Z.XTihi7bNu3sB6/h5bt1JuUOgq
      username: admin
      userID: 9cb67307-fd6d-4441-9b59-52acd78f4c9e
    staticClients:
    - id: kubeflow-oidc-authservice
      redirectURIs: ["/login/oidc"]
      name: 'Dex Login Application'
      secret: pUBnBOY80SnXgjibTYM9ZWNzY2xreNGQok    

apiVersion: v1
kind: ConfigMap
metadata:
  name: dex
  namespace: auth
data:
  config.yaml: |
    issuer: http://dex.auth.svc.cluster.local:5556/dex
    storage:
      type: kubernetes
      config:
        inCluster: true
    web:
      http: 0.0.0.0:5556
    logger:
      level: "debug"
      format: text
    oauth2:
      skipApprovalScreen: true
    enablePasswordDB: true
    staticPasswords:
    - email: admin@kubeflow.org
      hash: $2y$10$Yb9WVbn8pzVSM6fBgKdFae1Bh6Z.XTihi7bNu3sB6/h5bt1JuUOgq
      username: admin
      userID: 9cb67307-fd6d-4441-9b59-52acd78f4c9e
    staticClients:
    - id: kubeflow-oidc-authservice
      redirectURIs: ["/login/oidc"]
      name: 'Dex Login Application'
      secret: pUBnBOY80SnXgjibTYM9ZWNzY2xreNGQok    

When the enablePasswordDB value in the configuration is true, Dex stores the list of users defined in staticPasswords from the configmap into its internal storage when the service starts. Therefore, by adding new user entries composed of email, hash, username, and userID to staticPasswords, you can freely add users beyond the initial ones and use the Kubeflow service.

The attribute values for adding a user can be defined as follows.

From a node where you can use kubectl, use the following command to enter the edit screen of dex configmap.

kubectl edit configmap dex -n auth

kubectl edit configmap dex -n auth

staticPasswords:
    - email: admin@kubeflow.org
      hash: $2y$10$Yb9WVbn8pzVSM6fBgKdFae1Bh6Z.XTihi7bNu3sB6/h5bt1JuUOgq
      username: admin
      userID: 9cb67307-fd6d-4441-9b59-52acd78f4c9e
    - email: sds@samsung.com
      hash: $2y$12$0g5.y86jnrt0v6In5NRCZ.YVuvrAUQ6j/RJYO3rV.kNulaDALOKfq
      username: sds
      userID: 8961d517-3498-4148-90c9-7e442ee91154

staticPasswords:
    - email: admin@kubeflow.org
      hash: $2y$10$Yb9WVbn8pzVSM6fBgKdFae1Bh6Z.XTihi7bNu3sB6/h5bt1JuUOgq
      username: admin
      userID: 9cb67307-fd6d-4441-9b59-52acd78f4c9e
    - email: sds@samsung.com
      hash: $2y$12$0g5.y86jnrt0v6In5NRCZ.YVuvrAUQ6j/RJYO3rV.kNulaDALOKfq
      username: sds
      userID: 8961d517-3498-4148-90c9-7e442ee91154

Since the staticPasswords value in the configmap is applied when the Dex service starts, restart the Dex service using the following command.

kubectl rollout restart deployment dex -n auth

kubectl rollout restart deployment dex -n auth

Attempt to log in using new user information.

Verify that after successful login, it transitions to the screen for creating a new Namespace(profile).

The above content was written with reference to the official Kubeflow site. For more details, see Kubeflow Profiles.

How to use Custom Image in Kubeflow Jupyter Notebook

To use a custom image in the Kubeflow Notebook Controller that manages the Notebook life cycle of Kubeflow, you must meet several requirements.

Kubeflow assumes that Jupyter will start automatically when a Notebook image is run. Therefore, you need to set the default command to start Jupyter in the container image.

The following is an example of what should be included in a Dockerfile.

ENV NB_PREFIX

CMD ["sh","-c", "jupyter notebook --notebook-dir=/home/${NB_USER} --ip=0.0.0.0 --no-browser --allow-root --port=8888 --NotebookApp.token='' --NotebookApp.password='' --NotebookApp.allow_origin='*' --NotebookApp.base_url=${NB_PREFIX}"]

ENV NB_PREFIX

CMD ["sh","-c", "jupyter notebook --notebook-dir=/home/${NB_USER} --ip=0.0.0.0 --no-browser --allow-root --port=8888 --NotebookApp.token='' --NotebookApp.password='' --NotebookApp.allow_origin='*' --NotebookApp.base_url=${NB_PREFIX}"]

The above items are explained as follows.

You can create a Custom Image by referring to the Dockerfile that builds the tesorflow notebook image.

• https://github.com/kubeflow/kubeflow/blob/v1.2.0/components/tensorflow-notebook-image/Dockerfile Please refer to it.

1. On the Notebook Servers page, click the +NEW SERVER button.

   

2. If you have created a Custom Image, check Custom Image on the Kubeflow Notebook Server screen and enter the Custom Image address to create a new Notebook Server.