A Scalable Architecture for Text Correction and Normalization
-
Updated
Dec 21, 2025 - Python
#
chunk-processing
Here are 6 public repositories matching this topic...
Spring Batch Training Code Samples
-
Updated
Sep 17, 2017 - Java
A professional, web-based application designed specifically for handling and analyzing large CSV and text files that are too massive for conventional spreadsheet software. Built with Python and Flask, it provides a robust, browser-based interface for searching, previewing, and exporting data from files that can exceed several gigabytes in size.
big-data rest-api data-visualization self-hosted file-handling data-analysis data-tools text-processing data-management data-search data-processing data-exploration csv-parser large-files file-search data-export csv-viewer local-server chunk-processing large-datasets
-
Updated
Sep 27, 2025 - Python
Leadership Coach AI Agent with Youtube knowledge base and Web Search
ffmpeg logging chatbot tts knowledge-base ai-engine youtube-extractor chunk-processing rag grammar-correction vector-embedding transcribe-audio-files streamlit-webapp openai-api yt-dlp ai-agent llm whisper-ai vector-store web-search-agent
-
Updated
Mar 11, 2025 - Python
Efficiently import very large CSV files into a database using Laravel 12 seeders. This project demonstrates memory-safe CSV streaming, chunked inserts, and optimized performance for handling millions of records without timeouts.
mysql php laravel performance data-import laravel-framework laravel-tutorial csv-import database-seeder chunk-processing laravel-example laravel-seeder laravel-seed bulk-insert large-csv laravel-12
-
Updated
Jan 24, 2026 - Hack
A high-performance Change Data Capture (CDC) tool for comparing CSV files and detecting differences. Built with Python and optimized for speed using Polars, NumPy, and xxHash.
python csv etl numpy bigdata xxhash data-engineering data-processing data-migration cdc data-audit chunk-processing polars data-diff data-comparision
-
Updated
Jun 3, 2025 - Python
Improve this page
Add a description, image, and links to the chunk-processing topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the chunk-processing topic, visit your repo's landing page and select "manage topics."