Certificate Authentication

Apache Kafka Fundamentals/Ecosystem + Basics of Kafka Stream...

Add to LinkedIn

Certificate ID: 
659607
Authentication Code: 
fbc9f
Certified Person Name: 
Łukasz Latuch
Trainer Name: 
Robert Fabisiak
Duration Days: 
2
Duration Hours: 
14
Course Name: 
Apache Kafka Fundamentals/Ecosystem + Basics of Kafka Stream processing
Course Date: 
17 November 2021 09:00 to 18 November 2021 16:00
Course Outline: 

Module 1. Introducing Kafka and Kafka Use cases 

Understanding the role of Kafka 
Messaging 
Website Activity Tracking 
Metrics for operational monitoting data 
Log Aggregation scenario 
Stream Processing and Kafka Streams 
Kafka support for Event Sourcing 
Kafka as Commit Log

 

Module 2. Kafka and Microservices 

What are Microservices 
Key benefits 
Splitting the monolith 
The role of Kafka

 

Module 3. Understanding Kafka building blocks 

The topic 
The producer and consumer 
The broker 
Kafka installation

 

Module 4. Replication Architecture in Kafka 

Leaders and Followers 
Synchronous versus Asynchronous Replication 
Problems with replication lag 
Solutions for Replication lag 
Multi-Leader replication 
Leaderless replication

 

Module 5. The role of Partitioning in Kafka 

Partitioning and Replication 
Partitioning of Key-Value Data 
Partitioning by key range 
Partitioning by hash of key 
Rebalancing Partitions 
Strategies for rebalancing

 

Module 6. Reliable Data Delivery in Kafka 

Reliability Guarantees 
Broker configuration 
The Replication factor 
The case of Unclean leader election 
Minimum in-sync replicas 
Using Producers in a Reliable System 
Send Acknowledgments 
Configuring Producer Retries 
Additional Error Handling 
Using Consumers in a Reliable System 
Explicitly committing offsets in Consumers

 

Module 7. Planning Data formats 

Encoding and Evolution 
Formats for Encoding Data 
Language-Specific Formats 
Serializers and Deserializers 
Custom Serializers 
Serializing using Apache Avro 
The Merits of Schema

 

Module 8. Building Data Pipelines 

Considerations when building data pipelines 
Timeliness and Reliability 
High and Varying Throughtput 
Data Formats 
Transformations 
Failure Handling 
Introducing Kafka Connect 
Distributed and Standalone modes

 

Module 9. Stream Processing and Kafka 

What Is Stream Processing? 
Stream-Processing Concepts 
The role of Time 
Maitaning the State 
Stream-Table Duality 
Stream-Processing Design Patterns 
Single-Event Processing 
Processing with Local State 
Multiphase Processing/Repartitioning 
Processing with External Lookup: Stream-Table Join 
Streaming join 
Out-of-Sequence Events 
Kakfka Streams: Architecture Overview 
Building a Topology 
Scaling the Topology 
Surviving Failures 
Streaming Processing Use Cases

 

Module 10. Cross-Cluster Data Mirroring 

Use Cases of Cross-Cluster Mirroging 
Multicluster architectures 
Some Realities of Cross Datacenter Communication 
Hub-and-spoke Architecture 
Active-Active Architecture 
Active Standby Architecture 
Apache Kafka's MirrorMaker

Course Name Eng: 
Bespoke Apache Kafka