Get in Touch
 Duration 21 hours

Course Outline

Module 1: Overview of Confluent Apache Kafka Architecture and Configuration

  • The role of Kafka in modern data pipelines
  • Distinctions between Apache Kafka and Confluent Kafka
  • Key components: producers, consumers, brokers, topics, and partitions
  • Deployment models and scaling considerations for Kafka clusters

Module 2: Configuring Zookeeper Quorums

  • Introduction to Zookeeper
  • The function of Zookeeper within a Kafka cluster
  • Determining Zookeeper Quorum size
  • Zookeeper configuration settings
  • Setting up SSH on servers
  • Practical exercise: Configuring Zookeeper as both a team and a service
  • Utilizing the Zookeeper Command Line Interface (CLI)
  • Practical exercise: Configuring the Zookeeper Quorum
  • Understanding the Zookeeper internal file system
  • Performance factors influencing Zookeeper
  • Demonstration of management tools for Zookeeper and Zoonavigator

Module 3: Configuring the Kafka Cluster

  • Fundamental Kafka concepts
  • General Kafka configuration
  • Practical exercise: Configuring a Kafka broker
  • Practical exercise: Running Kafka commands
  • Practical exercise: Setting up a Kafka Multi-Broker Cluster
  • Practical exercise: Testing the Kafka cluster
  • Verifying connectivity to the Kafka cluster
  • The critical Advertised.listeners configuration
  • Topic configuration details
  • Configuring the download and ingestion of messages into topics
  • Practical exercise: Demonstrating Kafka resilience
  • Kafka performance: I/O optimization
  • Kafka performance: Network (RED method)
  • Kafka performance: RAM usage
  • Kafka performance: CPU efficiency
  • Kafka performance: Operating System (OS) considerations
  • Kafka performance: Other factors
  • Practical exercise: Modifying Kafka broker configurations

Module 4: Advanced Kafka Configuration

  • Configuring Landoop Kafka topic UI, Confluent REST Proxy, and Confluent Schema Registry
  • Sending and receiving messages via CLI, Java, and the Spring framework
  • Monitoring metrics and utilizing tools such as Confluent Control Center and Elasticsearch
  • Managing log files and offsets
  • High availability and disaster recovery strategies
  • Achieving high availability through replication
  • Optimizing producer and consumer performance
  • Formulating disaster recovery plans
  • Controlling failover and managing data recovery
  • Connector configuration
  • Implementing Kafka Connect
  • Implementing Kafka security features

Summary and Next Steps

Requirements

  • Proficiency with distributed systems and messaging concepts
  • Hands-on experience using the Linux command line
  • Fundamental understanding of networking and system administration

Target Audience

  • System administrators
  • DevOps engineers
  • Platform and infrastructure teams

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories