confluent modernization tutorial

[joshuajnoble]

Checklist

• Code follows style guidelines
• Pre-commit hooks pass
• Tutorial/code has been tested
• Documentation is updated
• Commit messages are clear
• Commits are signed with verified signature
• No merge conflicts
• No hardcoded secrets

[Copilot]

Pull request overview

Adds a new “Confluent modernization” tutorial under tutorials/17-data-streaming/, including a Jupyter notebook walkthrough, a Streamlit dashboard for live ksqlDB streaming results, and a pinned Python dependency set to run the tutorial.

Changes:

• Added a Streamlit dashboard that concurrently streams and visualizes two ksqlDB query streams (“high value claims” and “provider claim spikes”).
• Added an end-to-end notebook that walks through Confluent Cloud setup, schema registry usage, ksqlDB stream/table creation, and Tableflow/Iceberg querying.
• Added a tutorial-scoped requirements.txt for the tutorial’s Python environment.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 15 comments.

File	Description
tutorials/17-data-streaming/confluent-modernization/requirements.txt	Adds Python dependencies needed to run the notebook/dashboard (currently missing a couple required packages).
tutorials/17-data-streaming/confluent-modernization/dashboard_two_stream.py	Streamlit app that streams two ksqlDB queries and renders metrics/tables.
tutorials/17-data-streaming/confluent-modernization/confluent_modernization_notebook.ipynb	Tutorial notebook covering Confluent setup, ksqlDB, and Tableflow/Iceberg + dashboard instructions.

Comments suppressed due to low confidence (1)

tutorials/17-data-streaming/confluent-modernization/requirements.txt:52

• python-dotenv (used by from dotenv import load_dotenv) and pyiceberg (used in the notebook) are missing from this requirements file, so a fresh install will fail with ModuleNotFoundError when running the tutorial.

websockets==16.0

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.