Updated the PyArrow concatenation of tables to use promote_options as default

[jprakash-db]

Updated the PyArrow concatenation of tables to use promote_options as default

Resolves this issue - #418

[github-actions]

Thanks for your contribution! To satisfy the DCO policy in our contributing guide every commit message must include a sign-off message. One or more of your commits is missing this message. You can reword previous commit messages with an interactive rebase (git rebase -i main).

[Copilot]

Pull request overview

This PR makes PyArrow table concatenation behavior explicit by passing promote_options="default" to pyarrow.concat_tables, helping keep concatenation semantics stable across PyArrow versions in the connector’s Arrow result handling.

Changes:

• Update concat_table_chunks() to call pyarrow.concat_tables(..., promote_options="default").
• Update relevant unit tests to assert against the new explicit concat_tables behavior.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 1 comment.

File	Description
src/databricks/sql/utils.py	Explicitly sets promote_options="default" when concatenating PyArrow table chunks.
tests/unit/test_cloud_fetch_queue.py	Updates concat_tables-based expectations to include promote_options="default".

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.