Skip to content

Null-named attribute fails Arrow export with "field name cannot be null" #6802

Open

Description

@andygrove

Found while enabling spark.comet.exec.localTableScan.enabled by default in draft PR #6780 (Spark 4.1 SQL tests and [scans] job). Part of #4347.

SPARK-57725 "resolve columns when the input plan has a null-named attribute". StructVectorLoader NPE during exportVectorSchemaRoot from CometLocalTableScan.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

area:ffiArrow FFI / JNI boundarybugSomething isn't workingpriority:mediumFunctional bugs, performance regressions, broken featuresspark sql testsSpark SQL test failures

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions