Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Module 1: Overview of Confluent Apache Kafka Architecture and Configuration
- The role of Kafka in modern data pipelines
- Distinctions between Apache Kafka and Confluent Kafka
- Key components: producers, consumers, brokers, topics, and partitions
- Deployment models and scaling considerations for Kafka clusters
Module 2: Configuring Zookeeper Quorums
- Introduction to Zookeeper
- The function of Zookeeper within a Kafka cluster
- Determining Zookeeper Quorum size
- Zookeeper configuration settings
- Setting up SSH on servers
- Practical exercise: Configuring Zookeeper as both a team and a service
- Utilizing the Zookeeper Command Line Interface (CLI)
- Practical exercise: Configuring the Zookeeper Quorum
- Understanding the Zookeeper internal file system
- Performance factors influencing Zookeeper
- Demonstration of management tools for Zookeeper and Zoonavigator
Module 3: Configuring the Kafka Cluster
- Fundamental Kafka concepts
- General Kafka configuration
- Practical exercise: Configuring a Kafka broker
- Practical exercise: Running Kafka commands
- Practical exercise: Setting up a Kafka Multi-Broker Cluster
- Practical exercise: Testing the Kafka cluster
- Verifying connectivity to the Kafka cluster
- The critical Advertised.listeners configuration
- Topic configuration details
- Configuring the download and ingestion of messages into topics
- Practical exercise: Demonstrating Kafka resilience
- Kafka performance: I/O optimization
- Kafka performance: Network (RED method)
- Kafka performance: RAM usage
- Kafka performance: CPU efficiency
- Kafka performance: Operating System (OS) considerations
- Kafka performance: Other factors
- Practical exercise: Modifying Kafka broker configurations
Module 4: Advanced Kafka Configuration
- Configuring Landoop Kafka topic UI, Confluent REST Proxy, and Confluent Schema Registry
- Sending and receiving messages via CLI, Java, and the Spring framework
- Monitoring metrics and utilizing tools such as Confluent Control Center and Elasticsearch
- Managing log files and offsets
- High availability and disaster recovery strategies
- Achieving high availability through replication
- Optimizing producer and consumer performance
- Formulating disaster recovery plans
- Controlling failover and managing data recovery
- Connector configuration
- Implementing Kafka Connect
- Implementing Kafka security features
Summary and Next Steps
Requirements
- Proficiency with distributed systems and messaging concepts
- Hands-on experience using the Linux command line
- Fundamental understanding of networking and system administration
Target Audience
- System administrators
- DevOps engineers
- Platform and infrastructure teams
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)