Get in Touch
 Duration 21 hours

Course Outline

Module 1: Overview of Confluent Apache Kafka Architecture and Configuration

  • The role of Kafka in modern data ecosystems
  • Distinguishing Apache Kafka from Confluent Kafka
  • Key elements: producers, consumers, brokers, topics, and partitions
  • Deployment strategies and scaling considerations for Kafka clusters

Module 2: Configuring the Zookeeper Quorum

  • Introduction to Zookeeper
  • The function of Zookeeper within a Kafka cluster
  • Determining appropriate Zookeeper Quorum sizes
  • Zookeeper setup procedures
  • Implementing SSH across server environments
  • Lab: Configuring Zookeeper as both a team and a service
  • Utilizing the Zookeeper Command Line Interface (CLI)
  • Lab: Setting up the Zookeeper Quorum
  • Managing the Zookeeper internal file system
  • Performance variables impacting Zookeeper
  • Demonstration of Zookeeper management tools and Zoonavigator

Module 3: Configuring the Kafka Cluster

  • Fundamental Kafka concepts
  • General Kafka configuration
  • Lab: Setting up Kafka brokers
  • Lab: Running Kafka commands
  • Lab: Configuring a Multi-Broker Kafka Cluster
  • Lab: Testing Kafka cluster integrity
  • Verifying connectivity to the Kafka cluster
  • Advertised.listeners: A critical configuration setting
  • Topic-specific configurations
  • Settings for downloading and ingesting topic messages
  • Lab: Demonstrating Kafka resilience
  • Kafka performance metrics: I/O
  • Kafka performance metrics: Network (RED)
  • Kafka performance metrics: RAM
  • Kafka performance metrics: CPU
  • Kafka performance metrics: Operating System (OS)
  • Additional performance factors
  • Lab: Modifying Kafka broker configurations

Module 4: Advanced Kafka Configuration

  • Configuring Landoop Kafka topic UI, Confluent REST Proxy, and Confluent Schema Registry
  • Message handling via CLI, Java, and the Spring framework
  • Monitoring metrics and utilizing tools (e.g., Confluent Control Center, Elasticsearch)
  • Managing log files and offsets
  • Establishing high availability and disaster recovery
  • Achieving high availability through replication
  • Optimizing producer and consumer performance
  • Formulating disaster recovery strategies
  • Controlling failover and managing data recovery
  • Setting up connectors
  • Implementing Kafka Connect
  • Integrating Kafka security features

Conclusion and Future Steps

Requirements

  • Working knowledge of distributed systems and messaging concepts
  • Proficiency with the Linux command line
  • Fundamental understanding of networking and system administration

Intended Audience

  • System administrators
  • DevOps engineers
  • Platform and infrastructure teams

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories