How-to guides

• 1: Cluster Deployment
• 2: Kubeflow User Guide

1 - Cluster Deployment

Cluster Deployment Area

On the Samsung Cloud Platform, the AI&MLOps Platform creation’s service type selection provides 2 cloud deployment areas.

• Deploy on SCP Kubernetes Engine
• [Deploy to a new cluster](#Deploy to a new cluster)

Depending on the selection of the cluster deployment area, the installation content on the Service Information Input page of AI&MLOps Platform creation varies.

Deploying on SCP Kubernetes Engine

1. Click on the All Services > AI/ML > AI&MLOps Platform menu. It moves to the Service Home page of AI&MLOps Platform.
2. Service Home page, click the AI&MLOps Platform creation button. Move to the AI&MLOps Platform creation page.
3. On the Service Type Selection page of AI&MLOps Platform creation, enter the information required for service creation and select detailed options.
   Cluster Deployment

   Select the SCP Kubernetes Engine deployment option.
4. On the Service Information Input page of AI&MLOps Platform creation, enter the information required for service creation and select detailed options.
   • Service Information Input area where you can enter or inquire the necessary information for service creation.

     Classification	Necessity	Detailed Description
     Service Name	Required	Enter AI&MLOps Platform name AI&MLOps Platform name cannot be duplicated within the project
     Storage Class	Required	Storage Class is registered automatically
     Installation Node Information	Query	Confirm node information of the selected Kubernetes Engine
     Admin Email Address	Required	Input the email address of the administrator (Admin) to use when logging in
     Password	Required	Enter the password to use when logging in
     Password Confirmation	Required	Re-enter password to prevent password errors

     Table. AI&MLOps Platform Service Information Input Items
   • Additional Information Input area, please enter or select the information needed to create the service.

     Classification	Necessity	Detailed Description
     Tag	Selection	Select a tag to add to the AI&MLOps Platform Clicking on tag addition creates and adds a tag or adds an existing tag Up to 50 tags can be registered Newly added tags are applied after service creation is completed

     Table. Additional Information Input Items for AI&MLOps Platform Service

Deploy to a new cluster

1. Click all services > AI/ML > AI&MLOps Platform menu. It moves to the Service Home page of AI&MLOps Platform.
2. On the Service Home page, click the Create AI&MLOps Platform button. It moves to the Create AI&MLOps Platform page.
3. AI&MLOps Platform creation’s service type selection page, enter the information required for service creation and select detailed options.
   Cluster Deployment

   Select the new cluster to deploy option.
4. On the Service Information Input page of AI&MLOps Platform creation, enter the information required for service creation and select detailed options.

   • Service Information Input area where you can enter or inquire about the information needed to create a service.

     Classification	Necessity	Detailed Description
     Service Name	Required	Enter AI&MLOps Platform name AI&MLOps Platform name cannot be duplicated within the project
     Storage Class	required	Storage Class is registered automatically
     Installation Node Information	Query	Confirm node information of the selected Kubernetes Engine
     Admin Email Address	Required	Enter the email address of the administrator (Admin) to use when logging in
     Password	Required	Enter the password to use when logging in
     Password Confirmation	Required	Re-enter password to prevent password errors

     Table. AI&MLOps Platform Service Information Input Items

   • Enter Kubernetes Engine information Enter or select the necessary information in the area.

     Classification	Necessity	Detailed Description
     Cluster Name	Required	Cluster name Starts with English and uses English, numbers, and special characters(-) Input within 3~30 characters
     Control Plane Version > Kubernetes Version	Required	Select Kubernetes Version
     Control Area Setting > Control Area Logging	Select	Select whether to use control area logging Audit/Event logs of the cluster control area can be checked in Cloud Monitoring’s log analysis 1GB of log storage for all services in the account is provided for free, and logs are deleted sequentially when exceeding 1GB For more information, refer to Cloud Monitoring > Log Analysis
     Network Settings	Required	Network connection settings for the node pool VPC: Select a pre-created VPC Subnet: Select a general Subnet to use from the selected VPC’s subnets Security Group: Click the Search button and select a Security Group from the Security Group Selection popup window Load Balancer: Provides type: LoadBalancer functionality in Kubernetes Service objects Select a load balancer on the same network Usage: Select whether to use it Cannot be changed after setting
     File Storage settings	Required	Select the file storage volume to be used in the cluster Default volume (NFS): Select File Storage through the Search button The default volume file storage only provides NFS format

     Table. Kubernetes Engine service information input items

   • Enter Node Pool Information Enter or select the required information in the area.

     Classification	Necessity	Detailed Description
     Node Pool Configuration	Required	Select node pool information * marked items are required input items, so they must be entered In the case of AI&MLOps Platform, the image capacity may continue to increase depending on use, so setting Block Storage to at least 200GB or more allows for smooth system configuration

     Table. AI&MLOps Platform Service Information Input Items

 * **Additional Information Input** area, please enter or select the necessary information.






  



Classification
Necessity
Detailed Description




Tag
Selection
Select a tag to add to the AI&MLOps Platform 
Clicking on tag addition creates and adds a tag or adds an existing tag
Up to 50 tags can be registered
Newly added tags are applied after service creation is completed




  Table. AI&MLOps Platform Service Information Input Items



 

Cluster Specifications

To use the AI&MLOps Platform, a Kubernetes Engine to install the AI&MLOps Platform is required. You can select an existing Kubernetes Engine or create a Kubernetes Engine when creating the AI&MLOps Platform.

The specifications of the Kubernetes cluster required for installation are as follows.

• Node pool resource scale (composed of 2 or more nodes)

  • AI&MLOps Platform : vCPU 32, Memory 128G or more
  • Kubeflow Mini: vCPU 24, Memory 96G or more

• Kubernetes version

  • AI&MLOps Platform v1.9.1 (k8s v1.30)
  • Kubeflow Mini v1.9.1 (k8s v1.30)

2 - Kubeflow User Guide

Below is a guide on how to use Kubeflow after creation.

Adding Kubeflow Users

Below is a guide on how to use Kubeflow after creation.

Kubeflow only has one Admin User account created from the initial setup screen.

To add users to the Kubeflow Dashboard, you need to change the Dex settings (Kubeflow’s authentication component).

• Dex is deployed in the auth namespace and its settings are stored in a configmap named dex.

The following is an example of the Dex configuration.

apiVersion: v1
kind: ConfigMap
metadata:
  name: dex
  namespace: auth
data:
  config.yaml: |
    issuer: http://dex.auth.svc.cluster.local:5556/dex
    storage:
      type: kubernetes
      config:
        inCluster: true
    web:
      http: 0.0.0.0:5556
    logger:
      level: "debug"
      format: text
    oauth2:
      skipApprovalScreen: true
    enablePasswordDB: true
    staticPasswords:
    - email: admin@kubeflow.org
      hash: $2y$10$Yb9WVbn8pzVSM6fBgKdFae1Bh6Z.XTihi7bNu3sB6/h5bt1JuUOgq
      username: admin
      userID: 9cb67307-fd6d-4441-9b59-52acd78f4c9e
    staticClients:
    - id: kubeflow-oidc-authservice
      redirectURIs: ["/login/oidc"]
      name: 'Dex Login Application'
      secret: pUBnBOY80SnXgjibTYM9ZWNzY2xreNGQok

If the enablePasswordDB value is true in the configuration, Dex saves the list of users defined in staticPasswords in the internal storage when the service starts. Therefore, you can add new users by adding new values to staticPasswords with email, hash, username, and userID.

The properties for adding users are defined as follows.

You can edit the dex configmap using the following command on a node where kubectl is available.

$ kubectl edit configmap dex -n auth

staticPasswords:
    - email: admin@kubeflow.org
      hash: $2y$10$Yb9WVbn8pzVSM6fBgKdFae1Bh6Z.XTihi7bNu3sB6/h5bt1JuUOgq
      username: admin
      userID: 9cb67307-fd6d-4441-9b59-52acd78f4c9e
    - email: sds@samsung.com
      hash: $2y$12$0g5.y86jnrt0v6In5NRCZ.YVuvrAUQ6j/RJYO3rV.kNulaDALOKfq
      username: sds
      userID: 8961d517-3498-4148-90c9-7e442ee91154

The staticPasswords value in the configmap is reflected when the Dex service starts, so you need to restart the Dex service using the following command.

kubectl rollout restart deployment dex -n auth

Try logging in with the new user information.

You should see that you are logged in successfully and can create a new namespace (profile).

The above content was written with reference to the Kubeflow official website. For more information, please refer to Kubeflow Profiles.

Using Custom Images in Kubeflow Jupyter Notebook

To use a custom image in Kubeflow Notebook Controller, which manages the Notebook life cycle, you need to meet certain requirements.

Kubeflow assumes that Jupyter starts automatically when the notebook image runs. Therefore, you need to set the default command to start Jupyter in the container image.

The following is an example of what you need to include in your Dockerfile.

ENV NB_PREFIX /

CMD ["sh","-c", "jupyter notebook --notebook-dir=/home/${NB_USER} --ip=0.0.0.0 --no-browser --allow-root --port=8888 --NotebookApp.token='' --NotebookApp.password='' --NotebookApp.allow_origin='*' --NotebookApp.base_url=${NB_PREFIX}"]

The above items are explained as follows.

You can create a custom image by referencing the Dockerfile used to create the TensorFlow notebook image.

• Refer to https://github.com/kubeflow/kubeflow/blob/v1.2.0/components/tensorflow-notebook-image/Dockerfile.

1. Click the +NEW SERVER button on the Notebook Servers page.

   

2. If you have created a custom image, check Custom Image on the Kubeflow Notebook Server screen and enter the Custom Image address to create a new Notebook Server.