03.14.2024 Release Notes

These are the release notes for March 14, 2024.

ENHANCEMENTS

• All environments (Gen1/Gen2)
  • Queryable Data Flow UI now provides immediate feedback upon initiating a query.
  • Add support for accessing raw billing data via the System Usage Read Connector by selecting "Billing" as the Usage Type.
  • Enable Ascend OAuth feature for Microsoft Ads Read Connector (connector is in Private Preview).
  • Ascend SDK
    • Add support for HTTP/S proxies and custom CA certificate bundles (v0.2.63).
    • Add a new SDK endpoint that allows users to initiate the refresh of scheduled Data Share Connectors (pre-release version v0.2.64a0 - GA release coming soon).
• Gen2 environments
  • All Data Planes
    • Add the ability to directly reference and return data quality results in SQL Transforms using the component reference syntax {{my_component_id.test}}, allowing integration of these results into your dataflow.
    • Introduce an option to select an Ascend Cluster Pool for executing queries via the Query Panel - applicable only for the "Spark SQL" query dialect.

BUGFIXES

• All environments (Gen1/Gen2)
  • Fix a bug in the Query window where the default SQL dialect was not automatically selected.
    • Running queries without manually selecting a default SQL dialect (e.g. "Spark SQL") could result in an error.
  • Resolve an issue with loading data from Microsoft SQL Server using Spark 3.4.
  • Fix a bug in the SFTP Read Connector to ensure pattern matches perform partial matches on directories and full matches on files.
    • This addresses an issue where some files were not able to be ingested using the SFTP Read Connector when using glob syntax.