Pushing to Cloud Storage

Background

Redbird Cloud Data Storage Output offers a simple and flexible way to push data from Redbird into a cloud storage service. This can be accomplished through the Cloud Storage Output node which can be added as a step to the overall workflow. Supported destination platforms include Amazon S3, Google Drive, FTP, Google Cloud Storage and SharePoint.

📘

Connecting In Dataset or Collection Nodes

Note: You need to connect a Redbird dataset node on your canvas to the Cloud Storage Output node (by drawing a line between them) in order to push a dataset to your cloud storage platform.

Create a Configuration and Input Credentials

1. Double-click the node to enter configuration mode.
2. Name your data configuration by clicking the gray pencil at the top of your screen.
3. Select Dataset from the Source dropdown, then choose the dataset you want to push to cloud storage from the Select a Dataset dropdown. You can only select one dataset or collection per node.
4. You can choose whether to automatically append a timestamp of when the file is pushed to the uploaded file name (this is on by default) by using the toggle.

5. If credentials have already been added to Redbird, they will appear in the Selected Source dropdown. Simply choose the ones you want to use. (If only one set exists, it will be selected automatically.) To add new credentials or edit existing ones, click Add/Edit Credentials.

6. From the Sources modal, click Add credentials on the Cloud Data Storage Platform you wish to use.
7. You can refer to the guides below on the requirements needed for each of the specific platforms. The first step will always be to name your credentials so that you can reference them at the end of this process.
   • Amazon S3
   • Google Drive
   • FTP
   • Google Cloud Storage
   • SharePoint
8. Once credentials have been added, they will appear in a grey box beneath the Cloud Data Storage Platform name. You can edit them by clicking the pencil icon or delete them by clicking the minus icon.
9. Click Done to return to the main configuration screen.

Selecting The Destination For Your Dataset

1. Once connected, navigate your cloud folder structure and select the folder you wish to push the dataset to. You can use the search box to help you locate your folder if needed.

📘

Pushing to Google Sheets

Note: If using the Google Drive connector, you also have the option to select a Google Sheet instead of a folder. In this case, the dataset will be pushed into that Google Sheet, either appending or replacing the data each time depending on the Upload Method selected in the Advanced Settings section.

2. Make your selection under Available Files and click + Add to move your folder/Google Sheet into the Selected Folder/File pane.

3. To remove a folder/Google Sheet, click the red minus icon next to the individual folder/Google Sheet.

Advanced Settings

In the Advanced Settings section, if you are pushing data to Google Sheets, you’ll see options that let you control how your collection runs:

• Append keeps the historical data and adds future data pulls below it.
• Replace removes the historical data and writes the new data in its place.

If you are pushing data to a folder, a new file will be created each time the node runs.

Once you are finished, click Done.

Running a Configuration

1. Click the node to expose the right-side panel.
2. Click Run