Jump to Content
Ascend Developer Hub
HomeDocumentationRecipesRelease Notes
Developer HubDocsSDKCommunityFree TrialAscend Developer Hub
Developer HubDocsSDKCommunityFree Trial
HomeDocumentationRecipesRelease Notes

Introduction

  • Getting Started
  • Quickstart Guides
    • Create a Taxi Domain
    • Create a Weather Domain
    • Create a Data Mesh
  • Set Up Your Dev Tier Account
    • Dev Tier with Snowflake
    • Dev Tier with BigQuery
    • Dev Tier with Databricks
  • Videos
  • Support
  • Ascend 101
  • Free Ingest on Snowflake

Concepts

  • Data Planes
    • Databricks Data Plane
    • Snowflake Data Plane
    • Google BigQuery Data Plane
  • Data Services
  • Declarative Orchestration
  • Dataflows
  • Components
  • Data Quality

Connecting Data

  • Connections
    • Create a Connection
  • Read Connectors
    • Replication Strategies
    • Create a Read Connector
    • Blob Storage Read Connector Parsers
    • Object Aggregation for Blob Storage
  • Write Connectors
    • Create a Write Connector
    • Blob Storage Write Connector Formats
  • Connection Types
    • Amazon Kinesis
    • Amazon Redshift
    • Amazon S3
    • Azure Data Lake
    • Azure Event Hubs
    • Azure Event Hubs Read Connector
    • CockroachDB
    • Delta Lake
    • Dynamo DB
    • Google Analytics
    • Google BigQuery
    • Google Cloud Pub/Sub
    • Google Cloud Storage
    • IBM DB2 on iSeries/AS400
    • Marketo
    • Google Sheets
    • Hubspot
    • Kafka
    • MariaDB
    • Microsoft SQL Server
    • MongoDB
    • MySQL
    • PostgreSQL
    • Salesforce
    • SFTP
    • Shopify
    • Snowflake
    • Vertica
    • Oracle DB
    • Rest API
  • Custom Python Connections
    • Create a Python Connection
    • Developing Your Custom Python Connector
    • Partitioning with a Python Connector
    • Create a Python Read Connector
    • Bytes Connector Code Properties
    • Pandas DataFrame Properties
    • Spark DataFrame Properties
  • Data Shares
    • Create a Data Share

Build

  • Transforms
    • Spark SQL Transforms
    • SQL Transforms
    • PySpark Transforms
    • Scala & Java Transforms
    • Data Partitioning
    • Recursive Transforms
    • Advanced Settings (Transform)
    • D-SHAs
    • Supported Spark Versions
  • Snowflake Merge Transform
    • Create a Snowflake Merge Transform

Run

  • The System Dashboard
  • Monitoring and Notifications
    • Airtable
    • OpsGenie
    • PagerDuty
    • Slack
    • Google Workspace Chat
    • Webhook Notification Event Variable
  • Component Logs

Integrate

  • Overview
  • File-Based Access
    • Apache Spark
    • Zeppelin File-Based Access
  • JDBC / ODBC Connection
    • Tableau
    • Tutorial of Creating a Looker Connection to Ascend
    • PowerBI
    • Querying from DataGrip
    • Python Examples for Querying through JDBC/ODBC
    • Superset

Working with Ascend

  • Building Dataflows
    • SQL Builder & PySpark Editor
    • Copying/Pasting Components
    • Queryable Dataflows
    • Spark Query Driver UI
    • Minimap
    • Groups
    • Spark UI
  • Ascend CLI
  • Python SDK
    • SDK Definition Files
    • SDK Client Reference
  • CI/CD with Ascend
  • Custom Docker Images
    • Preparing a Custom Image
    • Using a Custom Image
    • Pre-Installed Python Packages
  • Schema Inference

Administration

  • SSO Integration
    • Okta
    • OneLogin
    • Duo SSO Integration
    • Azure Active Directory (AD) Integration
  • Deploying in your Cloud Account
    • AWS
    • Azure
    • GCP
    • Internally Deployed Buckets
    • Enterprise Security
  • Permissions, Users, and Teams
    • Create and Manage a New User
    • Create and Manage a New Team
  • Security
    • Object Access and Visibility
    • Service Accounts
    • Developer Access Keys
    • Site Level Credential Management
    • Ascend IP addresses for whitelisting
  • Network Connectivity
    • Reverse SSH
    • SSH Gateway
  • Bring Your Own Network
    • AWS ByoVPC
    • Azure ByoVNet
    • GCP ByoVPC

Ascend Legacy

  • Legacy Read Connectors
    • AWS Redshift
    • AWS S3
    • Azure Blob
    • File Upload
    • Google BigQuery
    • Google Cloud Storage
    • Kafka
    • Microsoft SQL Server
    • Snowflake
    • MySQL
    • Twitter
  • Legacy Write Connectors
    • AWS S3
    • AWS Redshift
    • Azure Blob
    • Google BigQuery
    • Google Cloud Storage
    • Microsoft SQL Server
    • MySQL
    • Snowflake
    • Custom Write with Blob Stores
  • SQL Functions
  • Data Partitioning (Legacy SQL Transforms)
  • Data Feeds (Legacy)

Sample DataFlows

Suggest Edits

Please see below for Sample Dataflows

DataflowDescription
Weather Dataflow (Simple Dataflow)This shows how to build a workflow using a Read Connector, Transform and Write Connector
Taxi Dataflow (Advanced Dataflow)This shows how to build a more advanced workflow with multiple read connectors, write connectors and transform components.

Updated 24 days ago


More Reading

Navigate here for more information on DataFlows

  • Sample-Dataflows
© Ascension Labs Inc. | All Rights Reserved