Quick Query

• 1: Overview
• 1.1: ServiceWatch metric
• 2: How-to guides
• 3: API Reference
• 4: CLI Reference
• 5: Release Note

1 - Overview

Service Overview

Quick Query is an interactive query service that allows you to easily and quickly analyze large-scale data using standard SQL. It is automatically installed on a standard Kubernetes cluster, and you can easily and quickly access various data sources such as Cloud Hadoop, Object Storage, and RDB for data retrieval and processing.

Features

• Easy and Fast Data Retrieval: After defining a schema for data stored in Object Storage and executing queries using standard SQL, you can retrieve data easily and quickly. Any user who can work with SQL can easily analyze large data sets, even without being a professional analyst.
• Fast Parallel Distributed Processing: Using the Trino engine capable of parallel distributed processing, queries are automatically split and processed in parallel across multiple nodes simultaneously, allowing rapid query results even for large-scale data.
• Various Service Architectures: We provide a public fixed-resource mode, a public resource-scaling mode, and a personal resource-scaling mode. The public fixed-resource mode supports stable response times for large-scale data queries, while the public resource-scaling mode can be used at a lower cost when usage frequency is irregular. Additionally, the personal resource-scaling mode enables each user to perform analysis tasks in an independent environment, allowing the use of Quick Query with a structure that meets user requirements.

Service Architecture Diagram

Provided features

Quick Query provides the following features.

• Support single access to various data sources (support for 11 types of data sources)
• Automatic saving of result data in Object Storage
• Result reuse feature for identical queries
• Access control feature through Ranger integration
• Data Usage Control Feature

Component

Query Engine Type: Shared

The query engine is structured so that a single instance, once started, can be shared by multiple users.

• Fixed Resource Mode (Auto Scaling Disabled): When Auto Scaling is not used, the query engine for the fixed resources is launched according to the resources selected by the user. Because the query engine always runs on the same resources, it can guarantee consistent query performance.

  

• Resource Expansion Mode (Auto Scaling enabled): When Auto Scaling is used, the query engine’s Worker nodes automatically scale in/out based on throughput. If the throughput is low, the number of Worker nodes can be reduced to as few as one, and when the throughput increases, the Worker nodes expand. Additionally, resources can be adjusted according to the cluster size.

  

Query Engine Type: Private

• Resource Expansion Mode (Auto Scaling Enabled): The personal query engine type runs a separate query engine for each user. Each query engine supports Auto Scale in/out, and if unused for an extended period, the engine automatically stops. When reconnecting for reuse, the query engine automatically restarts. When the throughput is low, the number of Worker nodes can decrease to as few as one, and when the throughput increases, the number of Worker nodes grows. Additionally, resources can be adjusted according to the cluster size.

  

Server type

The server types supported by Quick Query are as follows.

The minimum specifications required to use Quick Query are as follows.

Provision status by region

Quick Query is available in the following environments.

Preliminary Service

This is a list of services that must be pre-configured before creating the service. Please refer to the guide provided for each service and prepare in advance.

1.1 - ServiceWatch metric

You can view Kubernetes Engine metrics in ServiceWatch for the Kubernetes Engine created from Quick Query. As with Kubernetes Engine, the metrics provided by default monitoring are data collected at one‑minute intervals.

Basic Metrics

The following are basic metrics for the Kubernetes Engine namespace.

The metrics whose names are shown in bold below are the key metrics selected from the default metrics provided by Kubernetes Engine. Key metrics are used to build service dashboards that are automatically created for each service in ServiceWatch.

Each metric provides guidance in the user guide on which statistical values are meaningful when querying that metric, and among the meaningful statistics, the values shown in bold are the primary statistics. In the service dashboard, you can view key metrics using primary statistical values.

2 - How-to guides

Users can create the service by entering the required Quick Query information and selecting detailed options through the Samsung Cloud Platform Console.

Create Quick Query

You can create and use the Quick Query service in the Samsung Cloud Platform Console.

To create a Quick Query, follow these steps.

1. Click the All Services > Data Analytics > Quick Query menu. Go to the Service Home page of Quick Query.

2. On the Service Home page, click the Quick Query Create button. You will be taken to the Quick Query Create page.

3. On the Quick Query creation page, enter the information required to create the service and select detailed options.

   • In the Version selection area, select the required information.

     Category	Required status	Detailed description
     Quick Query	Required	Select Quick Query Service Version Provide a list of available versions

     Table. Quick Query Service Version Selection
   • In the Service Information Input area, enter or select the required information.

     Category	Required status	Detailed description
     Quick Query name	Required	Enter Quick Query name Start with a lowercase English letter and ensure it does not end with a special character (-), using lowercase letters, numbers, and special characters (-) to enter 3 ~ 30 characters
     description	Selection	Enter additional information or description about Quick Query within 150 characters.
     Domain Settings	Required	Enter Quick Query domain must start with a lowercase English letter and must not end with a special character (-, .), using lowercase letters, numbers, and special characters (-, .) to enter 3 to 50 characters {Quick Query name}.{configured domain} becomes the Quick Query access URL.
     Query engine type	Required	Select query engine type Shared: A single query engine is shared among multiple users Personal: Each user uses a separate engine
     Cluster size	Required	Select resource capacity for cluster configuration When the engine type is selected as Public If Auto Scaling is set to Enabled, you can choose the cluster capacity from Small, Medium, Large, or Extra Large. If Auto Scaling is not set to Enabled, you can configure the cluster capacity by specifying Replica, CPU, and Memory. When the engine type is selected as Private You can select the cluster capacity from Small, Medium, Large, or Extra Large. Engine capacity (when Auto Scaling is enabled) Small: 1Core, 4GB Medium: 4Core, 16GB Large: 8Core, 64GB Extra Large: 16Core, 128GB Engine capacity (when Auto Scaling is disabled) Replica: can be set from 1 to 9, default: 1 CPU: can be set from 4 to 24 (allowed values: 4, 6, 8, 10, 12, 14, 16, 18, 20, 22, 24), default: 4 Memory: can be set from 8 to 256 (allowed values: 8, 16, 32, 64, 128, 192, 256), default: 8
     Maximum number of concurrent queries	Required	Select the maximum number of queries to run simultaneously in Quick Query Selectable values: 32, 64, 96, 128
     Data Service Console connection	Required	Enter Data Service Console domain that starts with a lowercase English letter and does not end with a special character (-, .)using lowercase letters, numbers, and special characters (-, .)to enter 3 to 50 characters
     Host Alias	Selection	Add host information to be linked with Quick Query (up to 20 total, including defaults) After selecting Use, click the + button Hostname: Enter 3–63 characters using lowercase letters, numbers, and special characters (-, .) in host name or domain format IP: Enter in IP format To delete, click the X button The added host information can be used only if the firewall between the cluster and the server is open

     Table. Quick Query Service Information Input
   • In the Cluster Information Input area, enter or select the required information.

     Category	Required	Detailed description
     Cluster name	Required	Enter cluster name must start with a lowercase English letter and must not end with a special character (-), using lowercase letters, numbers, and special characters (-) enter 3 to 30 characters
     Control area setting	Required/Optional	Kubernetes version: Display Kubernetes version You can upgrade the Kubernetes version after provisioning. Public endpoint access: To enable access to the Kubernetes API server endpoint from outside, select Use and then enter the Access control IP range (cannot be changed after service request). Control plane logging: Select whether to enable control plane logging If you select Use, you can view the cluster control plane’s Audit/Event logs in Management > Cloud Monitoring > Log Analytics. Log storage up to 1GB for all services in the project is provided for free, and logs exceeding 1GB are deleted sequentially.
     Network Settings	Required	Network Connection Settings VPC: Use the same VPC as the Data Service Console Subnet: Select the subnet to use from the chosen VPC’s subnets Security Group: After clicking Search, select a security group in the Select Security Group popup
     File Storage configuration	Required	Select file storage volume to use in the cluster Default Volume (NFS): After clicking Search, select file storage in the File Storage Selection popup

     Table. Quick Query Service Cluster Information Input
   • Node Pool Information Input Enter or select the required information in this area.

     Category	Required status	Detailed description
     Node pool configuration	Required/Optional	Enter detailed information for the node pool to add * Items marked with an asterisk are required fields If the Query Engine Type is Public and Auto Scaling is set to Disabled, only the Node Pool Configuration (Fixed) option can be configured. Keypair: Select the authentication method used when connecting to the Virtual Server

     Table. Quick Query Service Node Pool Information Input
   • In the Additional Information Input area, enter or select the required information.

     Category	Whether required	Detailed description
     tag	Selection	Add Tag Add Tag Click the button to create and add a tag, or add an existing tag. You can add up to 50 tags. The newly added tags will be applied after the service creation is completed.

     Table. Quick Query Service Additional Information Input

4. Summary Check the detailed information and estimated billing amount generated in the panel, and click the Complete button.

   • When creation is complete, check the created resource on the Quick Query List page.

Quick Query Check detailed information

You can view and edit the complete list of resources and detailed information of the Quick Query service. The Quick Query Details page consists of Detailed Information, Tags, Activity Log tabs.

Follow these steps to view the detailed information of the Quick Query service.

1. Click the All Services > Data Analytics > Quick Query menu. Navigate to the Service Home page of Quick Query.
2. On the Service Home page, click the Quick Query menu. Navigate to the Quick Query list page.
3. Quick Query List page: click the resource to view detailed information. You will be taken to the Quick Query Detail page.
   • Quick Query Details At the top of the page, status information and additional feature information are displayed.

     Category	Detailed description
     Status display	Status of user-created Quick Query Creating: In progress Running: Creation complete, service available Updating: Updating settings Terminating: Service termination in progress Error: Error occurred during creation or service abnormal state
     Hosts file configuration information	Button to view and copy host file information for accessing Quick Query and Data Service Console
     Service termination	Cancel service button

     Table. Quick Query Status Information and Additional Features

Detailed Information

Quick Query List page allows you to view detailed information of the selected resource and edit the information if needed.

tag

Quick Query List page lets you view the tag information of the selected resource, and add, modify, or delete it.

Job History

You can view the operation history of the selected resource on the Quick Query List page.

Quick Query Connect

Follow these steps to access Quick Query.

1. Check the IP of the Windows system(PC) that will connect to Quick Query.
   • Since external access is required, you need to check the system’s public IP.
2. Check that the IGW connection in the VPC where Quick Query is installed is enabled.
   • An Internet Gateway that can be connected must be configured for external access.
3. Add the following to the Windows system’s hosts file. You can view it by clicking Hosts file setting information on the Quick Query detail screen.
   • Domain address of Data Service Console
   • Domain address of Data Service Console IAM
   • Domain address of Quick Query
4. Add the following rule to the VPC IGW firewall you selected when applying for the Quick Query service.

   Category	Protocol	Source	Target IP	Port
   Inbound	TCP	User IP	Load Balancer service IP	80,443

   Table. VPC IGW Firewall Rules
5. Add the following rule to the Load Balancer Firewall you selected when applying for the Quick Query service.

   Category	Protocol	Source	Target IP	Port
   Outbound	TCP	User IP	Load Balancer service IP	80,443
   Inbound	TCP	Load Balancer’s Source NAT IP	Subnet range of the Kubernetes Node Pool	30000-32767
   	TCP	Load Balancer’s Health Check IP	Subnet range of the Kubernetes Node Pool	30000-32767

   Table. Load Balancer Firewall Rules
6. Add the following rule to the Security Group you selected when applying for the Quick Query service.

   Category	Protocol	Target IP	Port
   Inbound	TCP	Load Balancer’s Source NAT IP	30000-32767
   	TCP	Load Balancer’s Health Check IP	30000-32767

   Table. Security Group Rules
7. On the Windows system (PC) you want to connect to, launch the Chrome browser and then access the Quick Query URL.

Terminate Quick Query

You can cancel the unused service to reduce operating costs. However, canceling the service may immediately stop the running service, so you should thoroughly consider the impact of service interruption before proceeding with the cancellation.

To cancel Quick Query, follow the steps below.

1. Click the All Services > Data Analytics > Quick Query menu. Go to the Service Home page of Quick Query.
2. On the Service Home page, click the Quick Query menu. You will be taken to the Quick Query List page.
3. On the Quick Query List page, select the resource to cancel, and click the Cancel Service button.
4. After the termination is complete, check on the Quick Query list page whether the resource has been terminated.

3 - API Reference

4 - CLI Reference

5 - Release Note

Quick Query