Kafka

📘

If your Kafka is in a private subnet or VPC and not accessible from the public internet. Please contact [email protected] to set up networking.

Prerequisites

• Access credentials
• Kafka topic
• Consumer configurations

Connection Properties

The following table describes the fields available when creating a new Kafka Connection. Create a connection using the information below and these step-by-step instructions.

Credential Properties

The following table describes the fields available when creating a new Kafka credential.

🚧

Format of the SASL.JAAS.CONFIG Credential

The sample below shows how the sasl.jaas.config key/value pair looks in an actual Kafka config file.

sasl.jaas.config=org.apache.kafka.common.security.plain.PlainLoginModule required \
    username="alice" \
    password="alice-secret";

When entering the credential into the Ascend SASL.JAAS.CONFIG credential entry box (Figure 3), you must enter it without the preceding sasl.jaas.config= text. Only enter what comes after that text as the actual value in the credential (seen as obfuscated dots in Figure 3).

If you fail to format the credential correctly, you will likely see error messages about a missing LoginModule or other similar errors when testing the connection.

The correct format should look like this:

org.apache.kafka.common.security.plain.PlainLoginModule required  
    username="alice"  
    password="alice-secret";

Read Connector Properties

The following table describes the fields available when creating a new Kafka Read Connector. Create a new Read Connector using the information below and these step-by-step instructions.

Write Connector Properties

The following table describes the fields available when creating a new {connection type name} Write Connector. Create a new Write Connector using the information below and these step-by-step instructions.