Skip to main content

Release 376 (7 Apr 2022)

General

  • Add table redirection awareness for RENAME table operations. (#11277)
  • Deny adding column with comment if the connector does not support this feature. (#11486)
  • Improve performance for queries that contain inequality expressions. (#11518)
  • Consider null values as identical values in array_except, array_union, map_concat, map_from_entries, multimap_from_entries, and multimap_agg functions. (#560)
  • Fix failure of DISTINCT .. LIMIT operator when input data is dictionary encoded. (#11776)
  • Fix returning of invalid results for distinct aggregation when input data is dictionary encoded. (#11776)
  • Fix query failure when performing joins with connectors that support index lookups. (#11758)
  • Fix incorrect stage memory statistics reporting for queries running with retry-policy set to TASK. (#11801)

Security

  • Add support to use two-way TLS/SSL certificate validation with LDAP authentication. Additionally ldap.ssl-trust-certificate config is replaced by ldap.ssl.truststore.path. (#11070).
  • Fix failures in information schema role tables for catalogs using system roles. (#11694)

Web UI

  • Add new page to display the runtime information of all workers in the cluster. (#11653)

JDBC driver

  • Add support for using the system truststore with the SSLUseSystemTrustStore parameter. (#10482)
  • Add support for ResultSet.getAsciiStream() and ResultSet.getBinaryStream(). (#11753)
  • Remove user property requirement. (#11350)

CLI

  • Add support for using the system truststore with the --use-system-truststore option. (#10482)

Accumulo connector

  • Add support for adding and dropping schemas. (#11808)
  • Disallow creating tables in a schema that doesn't exist. (#11808)

ClickHouse connector

  • Add support for column comments when creating new tables. (#11606)
  • Add support for column comments when adding new columns. (#11606)

Delta Lake connector

  • Add support for INSERT, UPDATE, and DELETE queries on Delta Lake tables with fault-tolerant execution. (#11591)
  • Allow setting duration for completion of dynamic filtering with the delta.dynamic-filtering.wait-timeout configuration property. (#11600)
  • Improve query planning time after ALTER TABLE ... EXECUTE optimize by always creating a transaction log checkpoint. (#11721)
  • Add support for reading Delta Lake tables in with auto-commit mode disabled. (#11792)

Hive connector

  • Store file min/max ORC statistics for string columns even when actual min or max value exceeds 64 bytes. This improves query performance when filtering on such column. (#11652)
  • Improve performance when reading Parquet data. (#11675)
  • Improve query performance when the same table is referenced multiple times within a query. (#11650)

Iceberg connector

  • Add support for views when using Iceberg Glue catalog. (#11499)
  • Add support for reading Iceberg v2 tables containing deletion files. (#11642)
  • Add support for table redirections to the Hive connector. (#11356)
  • Include non-Iceberg tables when listing tables from Hive catalogs. (#11617)
  • Expose nan_count in the $partitions metadata table. (#10709)
  • Store file min/max ORC statistics for string columns even when actual min or max value exceeds 64 bytes. This improves query performance when filtering on such column. (#11652)
  • Improve performance when reading Parquet data. (#11675)
  • Fix NPE when an Iceberg data file is missing null count statistics. (#11832)

Kudu connector

  • Add support for adding columns with comment. (#11486)

MySQL connector

  • Improve performance of queries involving joins by pushing computation to the MySQL database. (#11638)

Oracle connector

  • Improve query performance of queries involving aggregation by pushing aggregation computation to the Oracle database. (#11657)

SPI

  • Add support for table procedures that execute on the coordinator only. (#11750)