Hive Server 2

Learn the required and optional properties of creating an Hive Server 2 Connection, Credential, Read Connector, and Write Connector.

Azure Synapse Analytics

Prerequisites

  • Access credentials
  • Database name

Connection Properties

The following table describes the fields available when creating a new Hive Server 2 Connection. Create a connection using the information below and these step-by-step instructions.

FieldRequiredDescription
Access TypeRequiredThis connection type is Read-Only, Write-Only, or Read-Write.
Connection NameRequiredInput your desired name.
HostRequiredIP or the hostname of the Hive Server 2 Server.
PortRequiredHost server port number.
Database NameRequiredName of the database.
Requires CredentialsOptionalCheck this box to create a new credential or select an existing credential.

Credential Properties

The following table describes the fields available when creating a new Hive Server 2 credential.

FieldRequiredDescription
Credential NameRequiredThe name to identify this credential with. This credential will be available as a selection for future use.
Credential TypeRequiredThis field will automatically populate with Hive Server 2.
UserRequiredHive Server 2 data warehouse username to connect with.
PasswordOptionalHive Server 2 data warehouse password to connect with. Not required if you are connecting to a public database.

Read Connector Properties

The following table describes the fields available when creating a new Hive Server 2 Read Connector. Create a new Read Connector using the information below and these step-by-step instructions.

FieldRequiredDescription
NameRequiredProvide a name for your connector. We recommend using lowercase with underscores in place of spaces.
DescriptionOptionalDescribes the connector. We recommend providing a description if you are ingesting information from the same source multiple times for different reasons.
Table NameRequiredName of the table being ingested. This can either be supplied manually or selected in Step 2 of Create a Read Connector.
Schema NameOptionalThe name of the schema of the table entered above that you wish to use specifically.
Replication StrategyOptionalFull Resync, Full Resync in Parallel, Incremental Column, Table Snapshot, or Table Snapshot in Parallel. See Database Reading Strategies for more information.
Data VersionOptionalAssign a Data Version. A change to Data Version results in no longer using data previously ingested by this Connector, and a complete ingest of new data.

Write Connector Properties

The following table describes the fields available when creating a new Hive Server 2 Write Connector. Create a new Write Connector using the information below and these step-by-step instructions.

Field NameRequiredDescription
NameRequiredProvide a name for your connector. We recommend using lowercase with underscores in place of spaces.
DescriptionOptionalDescribes the connector. We recommend providing a description if you are ingesting information from the same source multiple times for different reasons.
UpstreamRequiredThe name of the previous connector the Write Connector will pull data from.
Table NameRequiredThe name of the table that will be written to Hive Server 2.
Write StrategyRequiredThe strategy to copy data into Hive Server 2.

The Full Load strategy will replace the entire table's contents each time that the upstream transform has changed.

If the upstream data set contains multiple Ascend partitions and not all partitions are expected to change on each update, then the Incremental By Partition strategy allows for Ascend to only update/insert/delete the partitions of the table that have changed in Ascend.
Max Number of Parallel Ascend PartitionsOptionalAscend can write partitions in parallel. Ex.: If a transform has 2000 partitions and you set the max parallel to 100, Ascend will write partitions 100 at a time.
A SQL Statement for Ascend to Execute Before WritingOptionalHere, the user has the option to execute a pre-processing script before writing to final table.
A SQL Statement for Ascend to Execute After WritingOptionalHere, the user has the option to execute a pre-processing script after writing to final table.
Schema NameOptionalThe name of the schema to match.
Data VersionOptionalAssign a Data Version. A change to Data Version results in no longer using data previously ingested by this Connector, and a complete ingest of new data.

© Ascension Labs Inc. | All Rights Reserved