Skip to content

Arbalister not working with .parquet containing uppercase column names #65

Description

@Pizzo97

When a parquet file has columns with uppercase names, routes.py give error.
This is caused by the extension considering all the columns lowercase (even if they are not), so Datafusion answers with "column_example" not found.

Activity

  1. changed the title [-]Arbalister not working with .parquet uppercare column names[/-] [+]Arbalister not working with .parquet containing uppercase column names[/+] on Sep 9, 2026
  2. AntoinePrv commented on Sep 9, 2026

    @AntoinePrv
    Member

    Good catch, thanks! I can reproduce this.

  3. Pizzo97 commented on Sep 9, 2026

    @Pizzo97
    Author

    Thank you! Do you know when will be released on pypi?

  4. AntoinePrv commented on Sep 9, 2026

    @AntoinePrv
    Member

    I just did, this was pretty bad.

  5. PizzoUnicredit commented on Sep 18, 2026

    @PizzoUnicredit

    HI @AntoinePrv , despite update (0.2.2) the error is still present:

    Error

    Exception: DataFusion error: Schema error: No field named blpartnr. Valid fields are "?table?"."BLPARTNR", "?table?"."BLMDTSL", "?table?"."BLUNTDAT".......

    DataFusion is expecting always column names in lower case, while the file has upper case column names.
    Thank you

  6. AntoinePrv commented on Sep 18, 2026

    @AntoinePrv
    Member

    Silly me, I fixed it only for Sqlite...

  7. AntoinePrv commented on Sep 18, 2026

    @AntoinePrv
    Member

    Re-released again

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions