Skip to main content

Release 471 (19 Feb 2025)

General​

  • Add AI functions for textual tasks on data using OpenAI, Anthropic, or other LLMs using Ollama as backend. (#24963)
  • Include split count and total split distribution time in the EXPLAIN ANALYZE output. (#25028)
  • Add support for JSON logging format to console with log.console-format=JSON. (#25081)
  • Support additional Python libraries for use with Python user-defined functions. (#25058)
  • Improve performance for Python user-defined functions. (#25058)
  • Improve performance for queries involving ORDER BY ... LIMIT. (#24937)
  • Prevent failures when fault-tolerant execution is configured with an exchange manager that uses Azure storage with workload identity. (#25063)

Server RPM​

Security​

  • Ensure that custom XML configuration files specified in the access-control.properties file are used during Ranger access control plugin initialization. (#24887)

Delta Lake connector​

Hive connector​

  • Add Local file system support. (#25006)
  • Add support for configuring s3.storage-class when writing objects to S3. (#24698)
  • Fix reading restored S3 glacier objects when the configuration property hive.s3.storage-class-filter is set to READ_NON_GLACIER_AND_RESTORED. (#24947)

Hudi connector​

Iceberg connector​

  • Add Local file system support. (#25006)
  • Add support for S3 Tables. (#24815)
  • Add support for configuring s3.storage-class when writing objects to S3. (#24698)
  • Improve conflict detection to avoid failures from concurrent MERGE queries on Iceberg tables. (#24470)
  • Ensure that the task.max-writer-count configuration is respected for write operations on partitioned tables. (#25068)

MongoDB connector​

  • Fix failures caused by tables with case-sensitive name conflicts. (#24998)

SPI​

  • Remove Connector.getInitialMemoryRequirement(). (#25055)