Skip to main content

DeltaLake Table Engine

This engine provides a read-only integration with existing Delta Lake tables in Amazon S3.

Create Table​

Note that the Delta Lake table must already exist in S3, this command does not take DDL parameters to create a new table.

CREATE TABLE deltalake
    ENGINE = DeltaLake(url, [aws_access_key_id, aws_secret_access_key,])

Engine parameters

  • url — Bucket url with path to the existing Delta Lake table.
  • aws_access_key_id, aws_secret_access_key - Long-term credentials for the AWS account user. You can use these to authenticate your requests. Parameter is optional. If credentials are not specified, they are used from the configuration file.

Engine parameters can be specified using Named Collections.

Example

CREATE TABLE deltalake ENGINE=DeltaLake('http://mars-doc-test.s3.amazonaws.com/clickhouse-bucket-3/test_table/', 'ABC123', 'Abc+123')

Using named collections:

<clickhouse>
    <named_collections>
        <deltalake_conf>
            <url>http://mars-doc-test.s3.amazonaws.com/clickhouse-bucket-3/</url>
            <access_key_id>ABC123<access_key_id>
            <secret_access_key>Abc+123</secret_access_key>
        </deltalake_conf>
    </named_collections>
</clickhouse>
CREATE TABLE deltalake ENGINE=DeltaLake(deltalake_conf, filename = 'test_table')

Data cache​

Iceberg table engine and table function support data caching same as S3, AzureBlobStorage, HDFS storages. See here.

See also​