[FAQ Bot] NEW: Why does the PyFlink streaming job fail with a JSON deserialization erro

[github-actions]

✨ FAQ NEW

Course: data-engineering-zoomcamp
Section: module-7 (This topic concerns streaming with Kafka in Module 7 and addresses JSON deserialization errors due to NaN values, so it belongs in module-7.)
Related Issue: #244

Question

Why does the PyFlink streaming job fail with a JSON deserialization error when consuming records from the Kafka/Redpanda topic?

Decision Rationale

The proposal describes a new PyFlink streaming JSON deserialization issue caused by NaN values in Kafka/Redpanda messages, along with a recommended fix. This scenario is not covered by existing module-7 FAQs, so a new entry is warranted.

Placement Details

• Section ID: module-7
• Sort Order: End of section
• Filename Slug: pyflink-json-nan-fix

⚠️ Warnings

• Add producer-side data validation to catch NaN values before JSON serialization.
• Test with a sample payload to ensure json.loads(json_str) succeeds before deployment.

---

🤖 Generated by FAQ Bot

Closes #244