Release 470 (5 Feb 2025)

General

• Add DuckDB connector. (#18031)
• Add Loki connector. (#23053)
• Add support for the SELECT to set per-query session properties with SELECT queries. (#24889)
• Improve compatibility of fault-tolerant exchange storage with S3-compliant object stores. (#24822)
• Allow skipping directory schema validation to improve compatibility of fault-tolerant exchange storage with HDFS-like file systems. This can be configured with the exchange.hdfs.skip-directory-scheme-validation property. (#24627)
• Export JMX metric for blockedQueries. (#24907)
• ⚠️ Breaking change: Remove support for the optimize_hash_generation session property and the optimizer.optimize-hash-generation configuration option. (#24792)
• Fix failure when using upper-case variable names in SQL user-defined functions. (#24460)
• Prevent failures of the array_histogram() function when the input contains null values. (#24765)

JDBC driver

• ⚠️ Breaking change: Raise minimum runtime requirement to Java 11. (#23639)

CLI

• ⚠️ Breaking change: Raise minimum runtime requirement to Java 11. (#23639)

Delta Lake connector

• Prevent connection leakage when using the Azure Storage file system. (#24116)
• Deprecate use of the legacy file system support for Azure Storage, Google Cloud Storage, IBM Cloud Object Storage, S3 and S3-compatible object storage systems. Use the migration guides for Azure Storage, Google Cloud Storage, and S3 to assist if you have not switched from legacy support. (#24878)
• Fix potential table corruption when using the vacuum procedure. (#24872)

Faker connector

• Derive constraints from source data when using CREATE TABLE ... AS SELECT. (#24585)

Hive connector

• Deprecate use of the legacy file system support for Azure Storage, Google Cloud Storage, IBM Cloud Object Storage, S3 and S3-compatible object storage systems. Use the migration guides for Azure Storage, Google Cloud Storage, and S3 to assist if you have not switched from legacy support. (#24878)
• Prevent connection leakage when using the Azure Storage file system. (#24116)
• Fix NullPointerException when listing tables on Glue. (#24834)

Hudi connector

• Deprecate use of the legacy file system support for Azure Storage, Google Cloud Storage, IBM Cloud Object Storage, S3 and S3-compatible object storage systems. Use the migration guides for Azure Storage, Google Cloud Storage, and S3 to assist if you have not switched from legacy support. (#24878)
• Prevent connection leakage when using the Azure Storage file system. (#24116)

Iceberg connector

• Add the optimize_manifests table procedure. (#14821)
• Allow configuration of the number of commit retries with the max_commit_retry table property. (#22672)
• Allow caching of table metadata when using the Hive metastore. (#13115)
• Deprecate use of the legacy file system support for Azure Storage, Google Cloud Storage, IBM Cloud Object Storage, S3 and S3-compatible object storage systems. Use the migration guides for Azure Storage, Google Cloud Storage, and S3 to assist if you have not switched from legacy support. (#24878)
• Prevent connection leakage when using the Azure Storage file system. (#24116)
• Fix failure when adding a new column with a name containing a dot. (#24813)
• Fix failure when reading from tables with equality deletes with nested fields. (#18625)
• Fix failure when reading $entries and $all_entries tables using equality deletes. (#24775)

JMX connector

• Prevent missing metrics values when MBeans in coordinator and workers do not match. (#24908)

Kinesis connector

• ⚠️ Breaking change: Remove the Kinesis connector. (#23923)

MySQL connector

• Add support for MERGE statement. (#24428)
• Prevent writing of invalid, negative date values. (#24809)

PostgreSQL connector

• Raise minimum required version to PostgreSQL 12. (#24836)