Write Connector

Create New Write Connector

Figure 1Figure 1

Figure 1

Connection Options

  • Upstream (required): Pick upstream component from which data will be written.
  • Browse and Select Data: Select location withing S3 bucket to write data. This will automatically fille in the Bucket and Output Directory fields.
  • Bucket (required): Bucket which output data will be written to.
  • Output Directory (required): Directory within bucket to write the data. If the folder does not exist, it will be created.
  • Partition Interpolation Template: Include a value from the partition profile as part of the output directory naming. For example, to create Hive style partitioning on dataset daily partitioned on timestamp 'event_ts', specify the pattern as dt={{event_ts(yyyy-MM-dd)}}/.
  • Output File Suffix: A suffix to attach to each file name. By default, Ascend will include the extension of the file format, but you may optionally choose a different suffix.
  • Format (required): Pick the format for the output files:
    • Avro
    • CSV
    • JSON
    • ORC
    • Parquet
    • Text
  • Path Delimiter: The delimiter to use in joining path segments, defaults to '/'.
  • Manifest File: Specify a manifest file which will be updated with the list of files every time they are updated.

Updated a day ago

Write Connector

Suggested Edits are limited on API Reference Pages

You can only suggest edits to Markdown body content, but not to the API spec.