MariaDB
Learn the required and optional properties of creating a MariaDB Connection, Credential, Read Connector, and Write Connector.
Prerequisites
- MariaDB server
- Hostname of IP address
- Database name
Connection Properties
The following table describes the fields available when creating a new MariaDB Connection. Create a connection using the information below and these step-by-step instructions.
| Field | Required | Description |
|---|---|---|
| Access Type | Required | This connection type is Read-Only, Write-Only, or Read-Write. |
| Connection Name | Required | Input your desired name. |
| Host | Required | Hostname or IP address of the MariaDB server. |
| Port | Optional | Input a port number. If left blank, the default value is 3306. |
| Database Name | Required | The name of the MariaDB database you want to connect to. |
| Requires Credentials | Optional | Choose from existing credentials or create new credential for connecting to MariaDB if 'Requires Credentials' checkbox is selected. |
Credential Properties
The following table describes the fields available when creating a new MariaDB credential.
| Field Name | Required | Description |
|---|---|---|
| Credential Name | Required | The name to identify this credential with. This credential will be available as a selection for future use. |
| Credential Type | Required | This field will automatically populate with MariaDB. |
| User | Required | Login username for MariaDB. |
| Password | Optional | Password if configured for the user |
Read Connector Properties
The following table describes the fields available when creating a new MariaDB Read Connector. Create a new Read Connector using the information below and these step-by-step instructions.
| Field Name | Required | Description |
|---|---|---|
| Name | Required | Provide a name for your connector. We recommend using lowercase with underscores in place of spaces. |
| Description | Optional | Describes the connector. We recommend providing a description if you are ingesting information from the same source multiple times for different reasons. |
| Table Name | Required | Name of the table being ingested. This can either be supplied manually or selected in Step 2 of Create a Read Connector. |
| Schema Name | Optional | The name of the schema of the table entered above that you wish to use specifically. |
| Replication Strategy | Optional | Full Resync, Filter by column range, or Incremental column name, Table Snapshot, Table Snapshot in Parallel, and Change Data Capture.* See Database Reading Strategies for more information. |
Change Data Capture (CDC) with MariaDB and Ascend
The default binary logging format for MariaDB is [mixed logging] (https://mariadb.com/kb/en/binary-log-formats/#mixed-logging). However, Ascend currently requires row-based logging in order to utilize CDC. See MariaDB Binary Log Formats for how to configure the log format for row-based logging.
Write Connector Properties
The following table describes the fields available when creating a new MariaDB Write Connector. Create a new Write Connector using the information below and these step-by-step instructions.
| Field Name | Required | Description |
|---|---|---|
| Name | Required | Provide a name for your connector. We recommend using lowercase with underscores in place of spaces. |
| Description | Optional | Describes the connector. We recommend providing a description if you are ingesting information from the same source multiple times for different reasons. |
| Upstream | Required | The name of the previous connector the Write Connector will pull data from. |
| Table Name | Required | The name of the table that will be written to MariaDB. |
| Write Strategy | Required | The strategy to copy data into MariaDB. The Full Load strategy will replace the entire table's contents each time that the upstream transform has changed. If the upstream data set contains multiple Ascend partitions and not all partitions are expected to change on each update, then the Incremental By Partition strategy allows for Ascend to only update/insert/delete the partitions of the MariaDB table that have changed in Ascend. |
| Max Number of Parallel Ascend Partitions | Optional | Ascend can write partitions in parallel. Ex.: If a transform has 2000 partitions and you set the max parallel to 100, Ascend will write partitions 100 at a time. |
| A SQL Statement for Ascend to Execute Before Writing | Optional | Here, the user has the option to execute a pre-processing script before writing to final table. |
| A SQL Statement for Ascend to Execute After Writing | Optional | Here, the user has the option to execute a pre-processing script after writing to final table. |
| Schema Name | Optional | The name of the schema to match. |
| On Schema Mismatch | Optional | Options are as follows: - Skip schema check - Stop and display error - Recreate table - Alter table |
Updated 9 months ago