Lazy pagination iterator for catalog list methods

[GayathriSrividya]

Closes #3365

This PR builds on @jayceslesar's earlier work in #2172 and has been restructured to credit the original author.

Changes

Commit 1 — by @jayceslesar (rebased from #2172):

• Changed abstract method signatures: list_tables, list_namespaces, list_views return types from list[Identifier] to Iterator[Identifier]
• All non-REST catalogs (SQL, DynamoDB, Glue, Hive, BigQuery, NoOp) return iter() of their results
• CLI and output updated to work with iterators
• Tests updated accordingly

Commit 2 — by @GayathriSrividya:

• REST catalog uses true generators with per-page HTTP fetch helpers (_fetch_tables_page, _fetch_namespaces_page, _fetch_views_page) decorated with @retry so auth retry logic works correctly per page

[Fokko]

@GayathriSrividya To credit the original author, it would be good to cherry-pick his work

[GayathriSrividya]

Addressed the CI failures with follow-up commits and pushed fixes to this PR branch.
All required checks are now passing on the latest commit (aa88377).
Ready for review. Thanks!

[rambleraptor]

@GayathriSrividya was this based off of #2172? If it was, we should cherry-pick in the commits so that the original author shows up in this PR as well.

[GayathriSrividya]

Hi @rambleraptor and @Fokko — yes, PR #3416 was based on @jayceslesar's work from #2172. I've restructured the branch to credit them properly:

• Commit 1 (authored by @jayceslesar): Changes abstract method signatures and adds iter() wrapping for all non-REST catalogs (BigQuery, DynamoDB, Glue, Hive, NoOp, SQL)
• Commit 2 (authored by me): Implements proper lazy pagination generators for the REST catalog with per-page @retry-decorated helpers

All checks are passing on the latest push. Ready for review. Thanks!