Update DuckDB queries and parquet file loading #24

Merged

wumpus merged 8 commits intomainfrom

feature/luca/update-duckdb

Apr 10, 2026

Commits on Feb 12, 2026

fix: load the parquet files recursively and use the query of duckdb to select the crawl and the subset, as was done in the Java Tour
lfoppiano
committed
chore(docs): update documentation with instruction on how to download the crawl data with and without the AWS CLI
lfoppiano
committed
fix: parametrize the crawl name
lfoppiano
committed

Commits on Feb 16, 2026

fix: remove scripts and AWS in favour of cc-downloader
lfoppiano
committed

Commits on Feb 17, 2026

fix: refer to the cc-downloader repo in case cargo is not available
lfoppiano
committed

Commits on Apr 1, 2026