fix: escape special characters in SchemaTransformProcessor JSON templates#250
Merged
andreatgretel merged 2 commits intomainfrom Jan 28, 2026
Merged
fix: escape special characters in SchemaTransformProcessor JSON templates#250andreatgretel merged 2 commits intomainfrom
andreatgretel merged 2 commits intomainfrom
Conversation
fcb7d6b to
5ee0fcb
Compare
824d8ed to
177d38d
Compare
5ee0fcb to
5f8a1bb
Compare
…ates Fixes GitHub issue #227 where SchemaTransformProcessor fails with JSONDecodeError when LLM-generated content contains quotes, backslashes, newlines, or other special characters that break JSON parsing. The fix properly escapes all string values before template rendering using json.dumps to handle all JSON-special characters.
5f8a1bb to
27571cc
Compare
johnnygreco
approved these changes
Jan 28, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
📋 Summary
Fixes GitHub issue #227 where
SchemaTransformProcessorfails intermittently withJSONDecodeErrorwhen LLM-generated content contains quotes, backslashes, newlines, or other special characters that break JSON parsing.🔄 Changes
🐛 Fixed
_json_escape_record()function inschema_transform.pythat properly escapes all string values before template rendering usingjson.dumps🧪 Tests
test_process_with_special_characters_in_llm_output- tests quotes, newlines, backslashes, tabstest_process_with_mixed_special_characters- tests complex mixed contenttest_process_with_json_serialized_valuesto expect proper JSON serialization🔍 Attention Areas
schema_transform.py#L23-L40- The_json_escape_record()function handles the escaping logic🤖 Generated with AI