Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 16 hours
Course Outline
Module 1: Introduction to Confluent Apache Kafka Architecture and Cluster Configuration
- Overview of Apache Kafka and the Confluent Platform.
- Core concepts: Kafka brokers, producers, consumers, and topics.
- The role of Kafka in data streaming and messaging pipelines.
- Confluent extensions: REST Proxy, Schema Registry, and Control Center.
- Kafka cluster architecture: brokers, partitions, and replication.
Module 2: Zookeeper Quorum Configuration
- Introduction to Zookeeper.
- The function of Zookeeper within a Kafka cluster.
- Determining optimal Zookeeper quorum size.
- Zookeeper configuration best practices.
- Implementing SSH on servers for secure management.
- Hands-on: Configuring Zookeeper both as a team and as a service.
- Utilising the Zookeeper Command Line Interface (CLI).
- Hands-on: Setting up a Zookeeper quorum.
- Understanding Zookeeper’s internal file system.
- Performance factors influencing Zookeeper operation.
- Demo: Exploring Zookeeper management tools and Zoonavigator.
Module 3: Kafka Cluster Configuration
- Foundations of Kafka operation.
- Core Kafka configuration settings.
- Hands-on: Configuring Kafka on a single broker.
- Hands-on: Executing fundamental Kafka commands.
- Hands-on: Establishing a multi-broker Kafka cluster.
- Hands-on: Testing the stability of a Kafka cluster.
- Verifying connectivity to your Kafka cluster.
- Configuring Advertised.listeners: critical settings explained.
- Topic configuration strategies.
- Setting up message ingestion and delivery within topics.
- Hands-on: Demonstrating Kafka resilience under stress.
- Kafka performance considerations: I/O, network, RAM, CPU, and OS tuning.
- Kafka performance: additional influencing factors.
- Hands-on: Modifying broker configurations for optimisation.
Module 4: Advanced Kafka Configuration
- Configuration of Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry.
- Sending and receiving messages via CLI, Java, and the Spring Framework.
- Utilising metrics and monitoring tools (Confluent Control Center, Elasticsearch, etc.).
- Managing log files and offsets.
- Architecting for high availability and disaster recovery.
- Achieving high availability through replication.
- Performance tuning for producers and consumers.
- Formulating disaster recovery strategies.
- Controlling failover and managing data recovery.
- Setting up Kafka Connectors.
- Implementing Kafka Connect workflows.
- Enhancing security with Kafka’s built-in features.
Summary and Next Steps
Requirements
- Proficiency with Linux-based systems and command-line interfaces.
- Working knowledge of distributed systems concepts.
- Understanding of fundamental networking principles and system configuration.
Target Audience
- DevOps and SRE teams responsible for managing Kafka deployments.
- System administrators working with Confluent and Zookeeper.
- Kafka developers and architects tasked with designing scalable systems.
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)
