Get in Touch
 Duration 16 hours

Course Outline

Module 1: Introduction to Confluent Apache Kafka Architecture & Cluster Configuration

  • Overview of Apache Kafka and the Confluent Platform
  • Core concepts: Kafka brokers, producers, consumers, and topics
  • The significance of Kafka in data streaming and messaging workflows
  • Confluent platform extensions: REST Proxy, Schema Registry, and Control Center
  • Understanding cluster architecture: brokers, partitions, and replication

Module 2: Configuring Zookeeper Quorums

  • Introduction to Zookeeper
  • The function of Zookeeper within a Kafka cluster
  • Determining optimal Zookeeper quorum sizes
  • Configuring Zookeeper effectively
  • Implementing SSH on server infrastructure
  • Hands-on: Configuring Zookeeper (both as a team and as a service)
  • Utilizing the Zookeeper Command Line Interface (CLI)
  • Hands-on: Setting up a Zookeeper quorum
  • Exploring Zookeeper’s internal file system structure
  • Key performance factors impacting Zookeeper
  • Demo: Overview of Zookeeper management tools and Zoonavigator

Module 3: Configuring Kafka Clusters

  • Fundamental Kafka concepts
  • General Kafka configuration procedures
  • Hands-on: Configuring Kafka on a single broker
  • Hands-on: Executing essential Kafka commands
  • Hands-on: Establishing a multi-broker (cluster) environment
  • Hands-on: Testing the Kafka cluster setup
  • Verifying connectivity to the Kafka cluster
  • Configuring advertised.listeners: critical settings
  • Managing topic configurations
  • Setting up message ingestion and delivery within topics
  • Hands-on: Demonstrating Kafka’s resilience
  • Performance considerations: I/O, network, RAM, CPU, and OS
  • Additional factors influencing Kafka performance
  • Hands-on: Modifying broker configurations

Module 4: Advanced Kafka Configuration

  • Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry
  • Message handling via CLI, Java, and Spring Framework
  • Utilizing metrics and monitoring tools (e.g., Confluent Control Center, Elasticsearch)
  • Managing log files and offsets
  • Strategies for high availability and disaster recovery
  • Achieving high availability through replication
  • Tuning producer/consumer performance
  • Developing disaster recovery plans
  • Controlling failover and managing data recovery
  • Setting up connectors
  • Implementing Kafka Connect
  • Enhancing Kafka security features

Summary and Recommended Next Steps

Requirements

  • Proficiency with Linux-based systems and command-line utilities
  • Working knowledge of distributed systems principles
  • Basic understanding of networking and system configuration

Target Audience

  • DevOps and SRE teams overseeing Kafka deployments
  • System administrators working with Confluent and Zookeeper
  • Kafka developers and architects focused on building scalable systems

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories