Quick Query

• 1: Overview
• 2: How-to guides
• 3: API Reference
• 4: CLI Reference
• 5: Release Note

1 - Overview

Service Overview

Quick Query is an interactive query service that allows you to analyze large amounts of data quickly and easily using standard SQL. It is automatically installed on a standard Kubernetes cluster and provides easy and fast access to various data sources such as Cloud Hadoop, Object Storage, and RDB, enabling data retrieval and processing.

Key Features

• Easy and Fast Data Retrieval: After defining a schema for data stored in Object Storage, you can easily and quickly retrieve data using standard SQL. Any user who can handle SQL can easily analyze large datasets without being a professional analyst.
• Rapid Parallel Distributed Processing: Using the Trino engine, which supports parallel distributed processing, queries are automatically divided and processed in parallel on multiple nodes, allowing you to quickly retrieve query results even for large amounts of data.
• Various Service Structures: It provides a shared fixed resource mode, a shared resource expansion mode, and a personal resource expansion mode. The shared fixed resource mode supports a stable response speed for large data queries, while the shared resource expansion mode allows for more affordable use in cases of irregular usage. Additionally, the personal resource expansion mode supports each user’s independent analysis work, enabling the use of Quick Query with a structure that meets user demands.

Service Composition Diagram

Provided Functions

Quick Query provides the following functions:

• Single Access Support for Various Data Sources (Supporting 11 Data Sources)
• Automatic Storage Function for Result Data in Object Storage
• Reuse Function for Query Results
• Access Control Function through Ranger Integration
• Data Usage Control Function

Components

Query Engine Type: Shared

The query engine is a structure that is shared by multiple users when one is running.

• Fixed Resource Mode (No Auto Scaling): When Auto Scaling is not used, the query engine runs with fixed resources according to the user’s selection. Since the query engine always runs with the same resources, it can guarantee consistent query performance.

  

• Resource Expansion Mode (Using Auto Scaling): When Auto Scaling is used, the query engine’s worker nodes automatically scale in/out according to the processing volume. When the processing volume is low, the worker nodes decrease to one, and when the processing volume increases, the worker nodes increase. Additionally, resources can be adjusted according to the cluster size.

  

Query Engine Type: Personal

• Resource Expansion Mode (Using Auto Scaling): The personal query engine type is a structure where the query engine runs separately for each user. Each query engine supports Auto Scale in/out and automatically stops when not used for an extended period. When used again, the query engine automatically restarts. The worker nodes decrease to one when the processing volume is low and increase when the processing volume increases. Additionally, resources can be adjusted according to the cluster size.

  

Server Type

The server types supported by Quick Query are as follows:

The minimum specifications required to use Quick Query are as follows:

Region-Based Provisioning Status

Quick Query is available in the following environments:

Preceding Services

The following services must be configured before creating Quick Query. Please refer to the guides provided for each service to prepare them in advance.

2 - How-to guides

Users can create Quick Query services by entering the required information and selecting detailed options through the Samsung Cloud Platform Console.

Creating Quick Query

You can create Quick Query services through the Samsung Cloud Platform Console.

To create Quick Query, follow these steps:

1. Click All Services > Data Analytics > Quick Query. This will take you to the Service Home page of Quick Query.

2. On the Service Home page, click the Create Quick Query button. This will take you to the Create Quick Query page.

3. On the Create Quick Query page, enter the required information and select the detailed options.

   • In the Version Selection section, select the required information.

     Category	Required	Description
     Quick Query	Required	Select the Quick Query service version Provides a list of available versions

     Table. Quick Query Service Version Selection Items
   • In the Service Information Input section, enter or select the required information.

     Category	Required	Description
     Quick Query Name	Required	Enter the Quick Query name Starts with a lowercase letter and does not end with a special character (-), uses lowercase letters, numbers, and special characters (-) to enter 3-30 characters
     Description	Optional	Enter additional information or description of Quick Query within 150 characters
     Domain Setting	Required	Enter the Quick Query domain Starts with a lowercase letter and does not end with special characters (-, .), uses lowercase letters, numbers, and special characters (-, .) to enter 3-50 characters {Quick Query Name}.{Set Domain} will be the Quick Query access address.
     Query Engine Type	Required	Select the query engine type Shared: Multiple users share a single query engine Dedicated: Each user has a separate engine
     Cluster Size	Required	Select the resource capacity for cluster configuration If the engine type is Shared, Auto Scaling can be selected to choose the cluster capacity (Small, Medium, Large, Extra Large). If Auto Scaling is not selected, the cluster capacity can be set by entering Replica, CPU, and Memory. If the engine type is Dedicated, the cluster capacity can be selected (Small, Medium, Large, Extra Large). Engine capacity (when using Auto Scaling) Small: 1Core, 4GB Medium: 4Core, 16GB Large: 8Core, 64GB Extra Large: 16Core, 128GB Engine capacity (when not using Auto Scaling) Replica: 1-9 input possible, default: 1 CPU: 4-24 input possible (4, 6, 8, 10, 12, 14, 16, 18, 20, 22, 24 input possible), default: 4 Memory: 8-256 input possible (8, 16, 32, 64, 128, 192, 256 input possible), default: 8
     Maximum Concurrent Query Execution	Required	Select the maximum number of queries to execute concurrently in Quick Query Available values: 32, 64, 96, 128
     Data Service Console Connection	Required	Enter the Data Service Console domain Starts with a lowercase letter and does not end with special characters (-, .), uses lowercase letters, numbers, and special characters (-, .) to enter 3-50 characters
     Host Alias	Optional	Add host information to be connected to Quick Query (up to 20 can be created, including the default) Use is selected, and the + button is clicked Hostname: Hostname or domain format, using lowercase letters, numbers, and special characters (-, .) to enter 3-63 characters IP: IP format input To delete, click the X button The firewall between the cluster and the corresponding server must be open to use the added host information

     Table. Quick Query Service Information Input Items
   • In the Cluster Information Input section, enter or select the required information.

     Category	Required	Description
     Cluster Name	Required	Enter the cluster name Starts with a lowercase letter and does not end with a special character (-), uses lowercase letters, numbers, and special characters (-) to enter 3-30 characters
     Control Area Setting	Required/Optional	Kubernetes Version: Displays the Kubernetes version The Kubernetes version can be upgraded after provisioning. Public Endpoint Access: To access the Kubernetes API server endpoint from outside, select Use and enter the Access Control IP Range (cannot be changed after service application). Control Area Logging: Select whether to use control area logging If Use is selected, the cluster control area’s Audit/event log can be checked in Management > Cloud Monitoring > Log Analysis. 1GB of log storage is provided free of charge for all services in the project, and logs exceeding 1GB will be deleted sequentially.
     Network Setting	Required	Set the network connection VPC: Use the same VPC as Data Service Console Subnet: Select a subnet from the selected VPC Security Group: Click Search and select a security group in the Security Group Selection popup window
     File Storage Setting	Required	Select the file storage volume to be used by the cluster Default Volume (NFS): Click Search and select a file storage in the File Storage Selection popup window

     Table. Quick Query Service Cluster Information Input Items
   • Enter Node Pool Information area, enter or select the required information.

     Classification	Required	Detailed Description
     Node Pool Configuration	Required/Optional	Enter detailed information about the node pool to be added * marked items are required input items If the Query Engine Type is Public and Auto Scaling is set to Not Used, only the Node Pool Configuration (Fixed) item can be set. Keypair: Select the authentication method to use when connecting to the Virtual Server

     Table. Quick Query Service Node Pool Information Input Items
   • Enter Additional Information area, enter or select the required information.

     Classification	Required	Detailed Description
     Tags	Optional	Add tags Tag Add button to create and add tags or add existing tags Up to 50 tags can be added Newly added tags are applied after service creation is complete

     Table. Quick Query Service Additional Information Input Items

4. In the Summary panel, check the detailed information created and the estimated billing amount, and click the Complete button.

• After creation is complete, check the created resource in the Quick Query List page.

Check Quick Query Details

You can check the entire resource list and detailed information of the Quick Query service and modify it. The Quick Query Details page consists of Details, Tags, and Work History tabs.

To check the detailed information of the Quick Query service, follow these steps:

1. Click All Services > Data Analytics > Quick Query menu. Move to the Quick Query Service Home page.
2. Click the Quick Query menu on the Service Home page. Move to the Quick Query List page.
3. Click the resource to check the detailed information on the Quick Query List page. Move to the Quick Query Details page.
   • At the top of the Quick Query Details page, status information and additional feature information are displayed.

     Classification	Detailed Description
     Status Display	Status of the Quick Query created by the user Creating: Creating Running: Creation complete, service available Updating: Setting update in progress Terminating: Service termination in progress Error: Error occurred during creation or service abnormal state
     Hosts File Setting Information	Button to check and copy host file information for accessing Quick Query and Data Service Console
     Service Termination	Button to terminate the service

     Table. Quick Query Status Information and Additional Features

Details

You can check the detailed information of the resource selected on the Quick Query List page and modify it if necessary.

Tags

You can check the tag information of the resource selected on the Quick Query List page and add, change, or delete it.

Work History

You can check the work history of the resource selected on the Quick Query List page.

Connecting to Quick Query

To connect to Quick Query, follow these steps:

1. Check the IP of the Windows system (PC) that you want to connect to Quick Query.
   • You need to check the public IP of the system since external access is required.
2. Check if the IGW connection is set to use in the VPC where Quick Query is installed.
   • The Internet Gateway setting must be enabled for external access.
3. Add the following contents to the hosts file of the Windows system:
   • Domain address of Data Service Console
   • Domain address of Data Service Console IAM
   • Domain address of Quick Query
   • You can check the hosts file setting information by clicking Hosts file setting information in the Quick Query detailed screen.
4. Add the following rules to the VPC IGW Firewall that you selected when applying for the Quick Query service:
   • Source IP: IP of the Windows system (PC)
   • Destination IP: Subnet range of the Kubernetes where Quick Query is installed
   • Protocol: TCP
   • Port: 443
5. Add the following rules to the Load Balancer Firewall that you selected when applying for the Quick Query service:
   • Source IP: IP of the Windows system (PC)
   • Destination IP: Subnet range of the Kubernetes where Quick Query is installed
   • Protocol: TCP
   • Port: 443
6. Add the following rules to the Security Group that you selected when applying for the Quick Query service:
   • Type: Inbound rule
   • Destination address: IP of the Windows system (PC)
   • Protocol: TCP
   • Port: 443, 30000 ~ 32767
7. Run the Chrome browser on the Windows system (PC) that you want to connect to and access the Quick Query URL.

Quick Query Target IP/Port Information

To access Quick Query, add the target IP and port for each service to the Security Group as follows:

Canceling Quick Query

You can cancel the service to reduce operating costs. However, canceling the service may immediately stop the operating service, so you should carefully consider the impact of service cancellation before proceeding.

To cancel Quick Query, follow these steps:

1. Click the All Services > Data Analytics > Quick Query menu. You will be taken to the Service Home page of Quick Query.
2. Click the Quick Query menu on the Service Home page. You will be taken to the Quick Query List page.
3. On the Quick Query List page, select the resource you want to cancel and click the Cancel Service button.
4. After cancellation is complete, check if the resource has been canceled on the Quick Query List page.

3 - API Reference

4 - CLI Reference

5 - Release Note

Quick Query