Skip to content

Native c2r bugs #3482

@andygrove

Description

@andygrove

Describe the bug

2026-02-10T20:15:33.1911771Z - select column with default value (native shuffle) *** FAILED *** (4 seconds, 701 milliseconds)
2026-02-10T20:15:33.1915918Z   org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 92.0 failed 1 times, most recent failure: Lost task 0.0 in stage 92.0 (TID 162) (localhost executor driver): org.apache.comet.CometNativeException: Comet Internal Error: Failed to downcast to Date32Array, actual type: Int32
2026-02-10T20:15:33.1921615Z 	at org.apache.comet.Native.columnarToRowConvert(Native Method)
2026-02-10T20:15:33.1924692Z 	at org.apache.comet.NativeColumnarToRowConverter.convert(NativeColumnarToRowConverter.scala:93)
2026-02-10T20:15:33.1927116Z 	at org.apache.spark.sql.comet.CometNativeColumnarToRowExec.$anonfun$doExecute$3(CometNativeColumnarToRowExec.scala:211)
2026-02-10T20:15:33.1928952Z 	at scala.collection.Iterator$$anon$11.nextCur(Iterator.scala:486)
2026-02-10T20:15:33.1911771Z - select column with default value (native shuffle) *** FAILED *** (4 seconds, 701 milliseconds)
2026-02-10T20:15:33.1915918Z   org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 92.0 failed 1 times, most recent failure: Lost task 0.0 in stage 92.0 (TID 162) (localhost executor driver): org.apache.comet.CometNativeException: Comet Internal Error: Failed to downcast to Date32Array, actual type: Int32
2026-02-10T20:15:33.1921615Z 	at org.apache.comet.Native.columnarToRowConvert(Native Method)
2026-02-10T20:15:33.1924692Z 	at org.apache.comet.NativeColumnarToRowConverter.convert(NativeColumnarToRowConverter.scala:93)

Steps to reproduce

No response

Expected behavior

No response

Additional context

No response

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions