5.24.2023 Release Notes

These are the release notes for May 24, 2023

:gift: PREVIEWS :gift:

  • Data Shares - Private Preview (Gen2 environments only):
    • :rocket: Scheduled Data Shares - another exciting enhancement!
      • Customize the refresh schedule for materialized Data Share Connectors (the subscribing side of a Data Share).
      • You can also choose "Continuous" scheduling mode so that Data Share Connectors (subscriber) will refresh automatically when the upstream Data Share (publisher) changes!
    • Enable easy and secure sharing of data products across all supported Data Planes:
      • Key enabler of an Ascend for Data Mesh strategy.
      • Contact your Ascend representative to request early access!

:sparkles: ENHANCEMENTS :sparkles:

  • We now offer enhanced, detailed billing reports in our Observe functionality:
    • Supports per cluster & warehouse usage, helping you identify your most expensive use cases! 💸
  • Add support for Databricks Unity Catalog:
    • Users can configure which catalog to ingest from (Read Connectors) or write to (Write Connectors).
    • On Databricks Data Planes, you can configure the catalog in the Data Plane Configuration to persist Read Connectors and Transforms into the specified catalog.
  • Ascend Hosted Cloud:
    • Users with access to multiple Cloud Cells can choose from a menu of authorized cells during the login process.
    • Improve button navigation user experience in the Ascend Cloud onboarding workflow.

:wrench: BUGFIXES :wrench:

  • All environments (Gen1/Gen2):
    • Prevent a race condition that could impact certain Read Connectors, particularly those with incremental ingest strategies. This condition could cause a Read Connector to sporadically become stuck and unable to ingest new data.
    • Fix two internal issues that caused the component error "java.util.NoSuchElementException: None.get":
      • Fix race condition affecting statistics computation during evaluation of partition filters.
      • Handle empty input partitions during evaluation of partition filters.
    • Fix UI for partition join when upstream is a Data Feed Connector.
  • Gen2 environments:
    • BigQuery Data Plane:
      • Fix a bug where a Transform would fail downstream from a non-materialized BigQuery Read Connector (registered through "My Tables") when the upstream table contained a DATETIME column.
    • Snowflake Data Plane:
      • Add a mechanism to help recover job processing in rare cases of encountering a deadlock while connecting to Snowflake using the official vendor-supported Snowflake Python Connector.