Skip to content

minor: Track Parquet rows and pages matched when the page index is skipped#22085

Open
nuno-faria wants to merge 4 commits intoapache:mainfrom
nuno-faria:fix_parquet_page_index
Open

minor: Track Parquet rows and pages matched when the page index is skipped#22085
nuno-faria wants to merge 4 commits intoapache:mainfrom
nuno-faria:fix_parquet_page_index

Conversation

@nuno-faria
Copy link
Copy Markdown
Contributor

Which issue does this PR close?

Rationale for this change

If page index pruning is attempted but fails, report that all rows/pages have matched, instead of returning 0 (see #22031 (comment)).

What changes are included in this PR?

  • Track the number of matched rows and pages independently of the result of the predicate pruning.

Are these changes tested?

Existing tests. I'm not sure how to generate Parquet files that trigger this directly.

Are there any user-facing changes?

No.

cc: @adriangb @2010YOUY01

@github-actions github-actions Bot added the datasource Changes to the datasource crate label May 9, 2026
Comment thread datafusion/datasource-parquet/src/page_filter.rs Outdated
nuno-faria and others added 2 commits May 11, 2026 08:33
Co-authored-by: xudong.w <wxd963996380@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

datasource Changes to the datasource crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants