Get in Touch
 Duration 16 hours

Course Outline

Module 1: Introduction to Confluent Apache Kafka Architecture and Cluster Configuration

  • An overview of Apache Kafka and the Confluent Platform.
  • Fundamentals of Kafka brokers, producers, consumers, and topics.
  • The critical role of Kafka in data streaming and messaging pipelines.
  • Confluent extensions, including REST Proxy, Schema Registry, and Control Center.
  • Cluster architecture concepts: brokers, partitions, and replication.

Module 2: Zookeeper Quorum Configuration

  • Understanding Zookeeper.
  • The role of Zookeeper within a Kafka cluster.
  • Determining appropriate Zookeeper quorum size.
  • Configuring Zookeeper settings.
  • Implementing SSH on servers.
  • Hands-on: Configuring Zookeeper as both a team and a service.
  • Utilizing the Zookeeper Command Line Interface (CLI).
  • Hands-on: Setting up a Zookeeper quorum.
  • Zookeeper’s internal file system structure.
  • Performance factors that impact Zookeeper.
  • Demo: Exploring Zookeeper management tools and Zoonavigator.

Module 3: Kafka Cluster Configuration

  • Core Kafka basics.
  • General Kafka configuration settings.
  • Hands-on: Configuring Kafka on a single broker.
  • Hands-on: Executing essential Kafka commands.
  • Hands-on: Setting up a Kafka multi-broker (cluster) environment.
  • Hands-on: Testing Kafka cluster functionality.
  • Verifying connectivity to your Kafka cluster.
  • Configuring Advertised.listeners: a key setting.
  • Topic configuration best practices.
  • Setting up message ingestion and delivery within topics.
  • Hands-on: Demonstrating Kafka resilience.
  • Kafka performance optimization: I/O, network, RAM, CPU, and OS considerations.
  • Other factors influencing Kafka performance.
  • Hands-on: Modifying broker configurations.

Module 4: Advanced Kafka Configuration

  • Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry.
  • Sending and receiving messages via CLI, Java, and Spring Framework.
  • Using metrics and monitoring tools such as Confluent Control Center and Elasticsearch.
  • Managing log files and offsets.
  • Ensuring high availability and disaster recovery.
  • Achieving high availability through replication.
  • Performance tuning for producers and consumers.
  • Formulating disaster recovery strategies.
  • Controlling failover and managing data recovery.
  • Setting up connectors.
  • Implementing Kafka Connect.
  • Reviewing Kafka security features.

Summary and Next Steps

Requirements

  • Practical experience with Linux-based systems and command-line interfaces.
  • Familiarity with core distributed systems concepts.
  • A solid understanding of basic networking and system configuration.

Target Audience

  • DevOps and SRE teams responsible for managing Kafka deployments.
  • System administrators working with Confluent and Zookeeper.
  • Kafka developers and architects focused on building scalable systems.

Testimonials (2)

Upcoming Courses

Related Categories