Loading demo links...
What to study for each Big-Data-Certified-Developer domain
Defining Big Data
Defines Big Data and its characteristics, describes the Hadoop ecosystem, differentiates Talend architecture from Big Data architecture, and describes cloud storage architecture in a Big Data context.
Key skills
Big Data characteristics, Hadoop ecosystem, HDFS and YARN roles, Talend vs Big Data architecture, cloud object storage architecture
Configuring a Big Data environment
Covers securing and configuring access to a Big Data environment, including managing Kerberos authentication and managing Apache Knox security with Cloudera Data Platform (CDP).
Key skills
Kerberos principals and keytabs, kinit, Apache Knox gateway security, CDP security configuration, secured cluster connections
Managing metadata in a Big Data environment
Covers managing Talend metadata stored in the Repository, describing the main elements of Hadoop cluster metadata, creating Hadoop cluster metadata, and creating metadata connections to HBase, HDFS, YARN, and Hive.
Key skills
Repository metadata, Hadoop cluster metadata creation, HBase connections, HDFS connections, YARN connections, Hive connections, schema retrieval and propagation
Managing data on Hadoop and cloud
Covers the principle usage of Hadoop (HDFS, HBase, and Hive) and cloud technologies, exporting and importing big data files to HDFS and to the cloud, and exporting data to an HBase table.
Key skills
tHDFSInput and tHDFSOutput, tHDFSPut and tHDFSGet, cloud storage components, HBase output and row keys, file formats and partitioning
Managing data using Hive
Covers importing data to a Hive table, processing data stored in a Hive table, analysing Hive tables in the Profiling perspective, and managing Hive tables on the Hive Warehouse Connector with CDP public cloud.
Key skills
Hive metastore, managed and external tables, tHiveConnection, tHiveInput and tHiveOutput, HiveQL, partitioning, Profiling perspective, Hive Warehouse Connector
Manage Big Data Jobs
Covers differentiating between Big Data Batch and Big Data Streaming Jobs and migrating and converting Jobs in a Big Data environment, including reworking components and adding Spark configuration.
Key skills
Batch vs Streaming Jobs, Job migration and conversion, Spark-compatible components, tMap in Big Data Jobs, contexts, validation
Managing Spark in a Big Data Environment
Covers the principle usage of Spark, managing Spark Universal including modes, environments, and distributions, configuring Spark Batch and Streaming Jobs, and troubleshooting and optimising Spark Jobs at runtime.
Key skills
Spark principles, Spark Universal, tSparkConfiguration, modes and distributions, DataFrames, lazy evaluation, caching, troubleshooting, runtime optimisation
Managing a Spark cluster
Covers defining Spark on YARN, the principle usage of YARN, managing YARN in client and cluster modes, monitoring Big Data Job executions, and using Studio to configure resource requests to YARN.
Key skills
Spark on YARN, ResourceManager and NodeManager, client vs cluster mode, executor and memory requests, YARN queues, execution monitoring
Streaming with Talend Big Data
Covers the principle usage of Kafka, using Kafka components in Streaming Jobs, managing Big Data Streaming Jobs in Studio, and tuning Streaming Jobs including windowing, caching, and checkpointing.
Key skills
Kafka topics and consumer groups, tKafkaInput and tKafkaOutput, streaming Job management, windowing, caching, checkpointing