11.09.2022 Release Notes

Here are the release notes for Nov 09, 2022.

:rocket: FEATURES :rocket:

  • Add 3 new Read Connectors for all Data Planes:
    • Marketo
    • Shopify
    • Google Analytics 4
  • Snowflake Data Plane: add data cleanup strategy with the following actions for Snowflake tables when an associated component is deleted:
    • delete all tables related to a component (default setting)
    • keep tables related to a component unaltered
    • rename tables related to a component to <table_name>_archive_<ts>
  • Custom timezone support for Cron refresh schedule of Read Connector

:wrench: BUGFIXES :wrench:

  • Google PubSub Read Connector: fix a bug where a limit on the number of ingested messages per refresh interval increased backlog by running unlimited ingestion. Fix includes implementing a recovery mode that performs best-effort ingestion of unacknowledged messages when a snapshot is no longer available.
  • Snowflake Data Plane: fix a bug causing a collision of query CTE alias names for identical component ids from different Dataflows
  • SDK: pin backoff library dependency to >=1.10.0 <2.0.0