Apache Kafka Fundamentals/Ecosystem + Basics of Kafka Stream...
Certificate ID:
659607
Authentication Code:
fbc9f
Certified Person Name:
Łukasz Latuch
Trainer Name:
Robert Fabisiak
Duration Days:
2
Duration Hours:
14
Course Name:
Apache Kafka Fundamentals/Ecosystem + Basics of Kafka Stream processing
Course Date:
17 November 2021 09:00 to 18 November 2021 16:00
Course Outline:
Module 1. Introducing Kafka and Kafka Use cases
Understanding the role of Kafka
Messaging
Website Activity Tracking
Metrics for operational monitoting data
Log Aggregation scenario
Stream Processing and Kafka Streams
Kafka support for Event Sourcing
Kafka as Commit Log
Module 2. Kafka and Microservices
What are Microservices
Key benefits
Splitting the monolith
The role of Kafka
Module 3. Understanding Kafka building blocks
The topic
The producer and consumer
The broker
Kafka installation
Module 4. Replication Architecture in Kafka
Leaders and Followers
Synchronous versus Asynchronous Replication
Problems with replication lag
Solutions for Replication lag
Multi-Leader replication
Leaderless replication
Module 5. The role of Partitioning in Kafka
Partitioning and Replication
Partitioning of Key-Value Data
Partitioning by key range
Partitioning by hash of key
Rebalancing Partitions
Strategies for rebalancing
Module 6. Reliable Data Delivery in Kafka
Reliability Guarantees
Broker configuration
The Replication factor
The case of Unclean leader election
Minimum in-sync replicas
Using Producers in a Reliable System
Send Acknowledgments
Configuring Producer Retries
Additional Error Handling
Using Consumers in a Reliable System
Explicitly committing offsets in Consumers
Module 7. Planning Data formats
Encoding and Evolution
Formats for Encoding Data
Language-Specific Formats
Serializers and Deserializers
Custom Serializers
Serializing using Apache Avro
The Merits of Schema
Module 8. Building Data Pipelines
Considerations when building data pipelines
Timeliness and Reliability
High and Varying Throughtput
Data Formats
Transformations
Failure Handling
Introducing Kafka Connect
Distributed and Standalone modes
Module 9. Stream Processing and Kafka
What Is Stream Processing?
Stream-Processing Concepts
The role of Time
Maitaning the State
Stream-Table Duality
Stream-Processing Design Patterns
Single-Event Processing
Processing with Local State
Multiphase Processing/Repartitioning
Processing with External Lookup: Stream-Table Join
Streaming join
Out-of-Sequence Events
Kakfka Streams: Architecture Overview
Building a Topology
Scaling the Topology
Surviving Failures
Streaming Processing Use Cases
Module 10. Cross-Cluster Data Mirroring
Use Cases of Cross-Cluster Mirroging
Multicluster architectures
Some Realities of Cross Datacenter Communication
Hub-and-spoke Architecture
Active-Active Architecture
Active Standby Architecture
Apache Kafka's MirrorMaker
Course Name Eng:
Bespoke Apache Kafka