KSML Documentation

Welcome to the KSML documentation. KSML allows you to build powerful Kafka Streams applications using YAML and Python, without writing Java code.

What is KSML?

KSML is a declarative language that makes stream processing accessible to data analysts, data engineers, and other professionals - no Java expertise required.

Simply define your data processing pipelines in easy-to-read YAML files and write custom logic using Python. KSML handles all the complexity of Kafka Streams behind the scenes, translating your definitions into production-ready streaming applications.

Whether you're filtering data, transforming events, performing aggregations, or building real-time analytics, KSML lets you focus on your business logic without worrying about Java code, compilation, or complex build pipelines.

1. Getting Started

• Quick Start
• Understanding KSML
• Schema Validation Setup

2. Tutorials

• Overview
• KSML Basics Tutorial
• Beginner Tutorials
  • Filtering and Transforming
  • Different Data Formats
  • Logging and Monitoring
• Intermediate Tutorials
  • Branching
  • Aggregations
  • Joins
  • Windowing
  • Error Handling
  • State Stores
• Advanced Tutorials
  • Complex Event Processing
  • Custom State Stores
  • Performance Optimization
  • Integration with External Systems

3. Use Case Guides

• Overview
• Data Transformation
• Event-Driven Applications
• IoT Data Processing
• Real-time Analytics
• Fraud Detection

4. References

• Overview
• KSML Definition Reference
• Pipelines
• Function Reference
• Operation Reference
• Data Types and Notations Reference
• State Store Reference
• Configuration Reference

Latest Release

• Release Notes