Get in Touch
 Duration 16 hours

Course Outline

Module 1: Overview of Confluent Apache Kafka Architecture and Cluster Configuration

  • Introduction to Apache Kafka and the Confluent Platform
  • Fundamentals of Kafka brokers, producers, consumers, and topics
  • The function of Kafka in data streaming and messaging architectures
  • Confluent specific extensions: REST Proxy, Schema Registry, and Control Center
  • Cluster architecture components: brokers, partitions, and replication mechanisms

Module 2: Configuring Zookeeper Quorums

  • Overview of Zookeeper
  • The role of Zookeeper within a Kafka cluster
  • Determining optimal Zookeeper quorum sizes
  • Configuring Zookeeper parameters
  • Implementing SSH on server infrastructure
  • Hands-on: Configuring Zookeeper (as both a team and a service)
  • Utilizing the Zookeeper Command Line Interface (CLI)
  • Hands-on: Setting up Zookeeper quorums
  • Understanding the internal file system of Zookeeper
  • Performance factors that impact Zookeeper operations
  • Demo: Reviewing Zookeeper management tools and Zoonavigator

Module 3: Configuring Kafka Clusters

  • Core concepts of Kafka
  • General configuration practices
  • Hands-on: Configuring Kafka on a single broker
  • Hands-on: Running essential Kafka commands
  • Hands-on: Establishing a multi-broker (cluster) setup
  • Hands-on: Testing the functionality of a Kafka cluster
  • Verification of cluster connectivity
  • Configuring Advertised.listeners: a critical setting
  • Topic-level configuration options
  • Setting up message ingestion and delivery within topics
  • Hands-on: Demonstrating Kafka resilience features
  • Performance considerations: I/O, network, RAM, CPU, and OS
  • Other influencing factors in Kafka performance
  • Hands-on: Modifying broker configurations effectively

Module 4: Advanced Kafka Configuration

  • Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry
  • Messaging patterns: sending and receiving via CLI, Java, and Spring Framework
  • Leveraging metrics and monitoring tools (e.g., Confluent Control Center, Elasticsearch)
  • Managing log files and offsets
  • Strategies for high availability and disaster recovery
  • Ensuring resilience through replication
  • Tuning producer and consumer performance
  • Implementing disaster recovery strategies
  • Managing failover controls and data recovery processes
  • Configuring connectors
  • Implementing Kafka Connect
  • Enhancing security through Kafka security features

Summary and Recommended Next Steps

Requirements

  • Proficiency with Linux-based operating systems and command-line interfaces
  • Working knowledge of distributed systems principles
  • Foundational understanding of network configurations and system administration

Target Audience

  • DevOps and Site Reliability Engineering (SRE) teams responsible for Kafka deployments
  • System administrators managing Confluent and Zookeeper infrastructure
  • Kafka developers and architects focused on building scalable systems

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories