Skip to content

Sink shouldn't read tables from all databases on start-up #85

@YaroShkvorets

Description

@YaroShkvorets

Noticed that the sink loads all tables from all schemas/databases on start-up, not just the specified database.
So in case of Clickhouse for example, if there is a table in an unrelated database with a valid schema that upstream library doesn't support, it throws an error:

{"severity":"ERROR","timestamp":"2025-03-25T16:14:59.243438056Z","logger":"sink-sql","message":"new db loader: load psql table: retrieving table and schema: clickhouse: unsupported column type \"AggregateFunction(argMin, Float64, Date)\"","logging.googleapis.com/labels":{},"serviceContext":{"service":"unknown"}}

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions