Cloud Hadoop-based platform

Overview

A platform capable of efficiently managing data collected in various forms is required for big data processing and analysis.

Samsung Cloud Platform can configure and manage Hadoop clusters using loud Hadoop. Cloud Hadoop packages and provides the major components of the Hadoop ecosystem, and offers a Manager for administrative functions.

Architecture Diagram

1. To collect data received from various data sources (RDB, NoSQL, files, etc.), it is stored using the Cloud Hadoop Data Ingestion Tool.
   
   

2. To ensure smooth Data Operation in the cluster, schedule server resource management and tasks, and share information between distributed applications while checking their status.
   
   

3. Manage Hadoop service configuration with Hadoop Manager, and monitor Hadoop services through Monitoring Server.
   
   

4. Supports various Data Storage for loading and utilizing large-scale data. 4. Warm Data(HDFS, Hbase), Hot Data(Kudu), Archive Data(Object Storage)
   
   

5. Data Processing: Using Hive, Spark, and Impala to distribute-process, refine (Refine), and prepare (Preparation) large-scale data.
   
   

6. Data Discovery: Explore data to evaluate large-scale data and obtain new insights (Insight).
   
   

7. Data Security: Authenticate users and services for all services within the cluster.
   
   

8. Data Governance: Create and modify data according to data standards and policies, and manage the availability, usefulness, integrity, and security of the generated data.
   
   

9. The user accesses the data of Cloud Hadoop through the analytics solution to explore and analyze the data.
   
   

Use Cases

Building a Big Data Integration Platform

A unified big data platform offering for structured and unstructured data analysis is required, and a big data platform can be built for systems that need real-time processing of large volumes of data and node-level integrated monitoring support.

Data Lake Construction

From the stage of collecting and generating customer business data, you can standardize the data, manage it systematically, and build a data lake platform that enables data‑driven operations.

Data Platform Construction

You can collect and store big data from various data sources, and build a distributed big data exploration and analysis environment tailored to the customer’s business environment.

Prerequisites

None

Constraints

None

Considerations

None

Related service

This is a list of Samsung Cloud Platform services that are related to the features or configurations described in this guide. Refer to this when selecting and designing services.