Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 16 hours
Course Outline
Module 1: Overview of Confluent Apache Kafka Architecture and Cluster Configuration
- Introduction to Apache Kafka and the Confluent Platform
- Fundamentals of Kafka brokers, producers, consumers, and topics
- The function of Kafka in data streaming and messaging architectures
- Confluent specific extensions: REST Proxy, Schema Registry, and Control Center
- Cluster architecture components: brokers, partitions, and replication mechanisms
Module 2: Configuring Zookeeper Quorums
- Overview of Zookeeper
- The role of Zookeeper within a Kafka cluster
- Determining optimal Zookeeper quorum sizes
- Configuring Zookeeper parameters
- Implementing SSH on server infrastructure
- Hands-on: Configuring Zookeeper (as both a team and a service)
- Utilizing the Zookeeper Command Line Interface (CLI)
- Hands-on: Setting up Zookeeper quorums
- Understanding the internal file system of Zookeeper
- Performance factors that impact Zookeeper operations
- Demo: Reviewing Zookeeper management tools and Zoonavigator
Module 3: Configuring Kafka Clusters
- Core concepts of Kafka
- General configuration practices
- Hands-on: Configuring Kafka on a single broker
- Hands-on: Running essential Kafka commands
- Hands-on: Establishing a multi-broker (cluster) setup
- Hands-on: Testing the functionality of a Kafka cluster
- Verification of cluster connectivity
- Configuring Advertised.listeners: a critical setting
- Topic-level configuration options
- Setting up message ingestion and delivery within topics
- Hands-on: Demonstrating Kafka resilience features
- Performance considerations: I/O, network, RAM, CPU, and OS
- Other influencing factors in Kafka performance
- Hands-on: Modifying broker configurations effectively
Module 4: Advanced Kafka Configuration
- Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry
- Messaging patterns: sending and receiving via CLI, Java, and Spring Framework
- Leveraging metrics and monitoring tools (e.g., Confluent Control Center, Elasticsearch)
- Managing log files and offsets
- Strategies for high availability and disaster recovery
- Ensuring resilience through replication
- Tuning producer and consumer performance
- Implementing disaster recovery strategies
- Managing failover controls and data recovery processes
- Configuring connectors
- Implementing Kafka Connect
- Enhancing security through Kafka security features
Summary and Recommended Next Steps
Requirements
- Proficiency with Linux-based operating systems and command-line interfaces
- Working knowledge of distributed systems principles
- Foundational understanding of network configurations and system administration
Target Audience
- DevOps and Site Reliability Engineering (SRE) teams responsible for Kafka deployments
- System administrators managing Confluent and Zookeeper infrastructure
- Kafka developers and architects focused on building scalable systems
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)