- Access credentials
- Data location on Snowflake
Click the READ icon for Snowflake on the Connectors panel
Use the default code for the Snowflake Read Connector or modify as necessary. Specify any PIP packages to be installed.
The ability to test the code locally can be extremely helpful and expedite the connector development process.
Data formats currently available are: Avro, Grok, JSON, Parquet and XSV. However, you can create your own parser functions or define a UDP (User Defined Parser) to process a file format.
For custom read connectors (e.g. Snowflake) you will need to create the schema with column names and data types as well as specifying default values etc.
Updated about a year ago