A Data Feed is a mechanism by which Dataflows and Data Services can communicate live data with each other. You can create new Data Feed Connectors or connect to existing Data Feed Connectors.
To create a Data Feed Connector, click + ADD on the action bar, select Data Feed on the drop-down and then choose Create.
Provide a name for the Data Feed Connector. As a best practice this name should clearly describe the nature of the data.
As a best practice, add a description for the Data Feed. Please note that only the name will be visible to subscribers, but not the description.
Select the upstream transform for the Data Feed Connector. From the drop-down you'll see a list of all the transforms in your dataflow from which you can choose as the upstream. Alternatively, you can right-click the Transform you want to create a Data Feed Connector from, and select Create new data feed.
As the creator of this Data Feed Connector you control who can access it via permission settings. These permissions allow selected teams to connect and use your Data Feed in other dataflows.
There are two permissions options available:
- Allow all Teams in all Data Services to access this Data Feed: This will essentially allow every user in the system to see your Data Feed.
- Only selected teams in selected Data Services can access this Data feed
Once a Data Feed is created, users with the required permission are able to connect to it Connecting to an existing Data Feed Connector. The Data Feed Connector 'connected to' will have the exact same data, schema, state, and metrics as this Data Feed's upstream component.
If one or more Data Feed Connectors are subscribing to a Data Feed, you won't be able to delete the Data Feed until those Data Feed Connectors are all deleted first.
To connect to an existing Data Feed Connector, click + ADD on the action bar, select Data Feed on the drop-down and then choose Connect.
The Data Feed panel displays a variety of Data Feed Connectors that you can connect to. You can search by name and use Filter By to help narrow your search.
Select the Data Feed Connector that you want to connect to.
After selecting the Data Feed Connector you'll be presented with a preview of the dataset and be given a choice to subscribe to it.
Click Subscribe and provide
Click Subscribe and provide a name for your new Data Feed Connector. It's not required that your Data Feed Connector share the same name as the Data Feed Connector you just connected to, but it's a good practice to pair the names for convenience.
A Data Feed Connector is a direct mirror of the upstream transform and as such will be impacted by that transform. This implies that any transforms built upon the Data Feed Connector may become invalid if the schema of the upstream transform changes.
Updated 11 months ago