Show Menu

Create an Azure Blob or Amazon S3 source connector in the UI

Source connectors in Adobe Experience Platform provide the ability to ingest externally sourced data on a scheduled basis. This tutorial provides steps for creating an Azure Blob (hereinafter referred to as "Blob") or Amazon S3 (hereinafter referred to as "S3") source connector using the Platform user interface.

Getting started

This tutorial requires a working understanding of the following components of Adobe Experience Platform:
If you already have a Blob or S3 base connection, you may skip the remainder of this document and proceed to the tutorial on configuring a dataflow .

Supported file formats

Experience Platform supports the following file formats to be ingested from external storages:
  • Delimiter-separated values (DSV): Support for DSV formatted data files is currently limited to comma-separated values. The value of field headers within DSV formatted files must only consist of alphanumeric characters and underscores. Support for general DSV files will be provided in the future.
  • JavaScript Object Notation (JSON): JSON formatted data files must be XDM compliant.
  • Apache Parquet: Parquet formatted data files must be XDM compliant.

Gather required credentials

In order to access your Blob storage on Platform, you must provide a valid value for the following credential:
The connection string required to access data in your Blob storage. The Blob connection string pattern is: DefaultEndpointsProtocol=https;AccountName={ACCOUNT_NAME};AccountKey={ACCOUNT_KEY} .
For more information on getting started, visit this Azure Blob document .
Similarly, accessing your S3 bucket on Platform requires you to provide your valid values for the following credentials:
The access key ID for your S3 storage.
The secret key ID for your S3 storage.
For more information on getting started, visit this AWS document .

Connect your Blob or S3 account

Once you have gathered your required credentials, you can follow the steps below to create a new Blob or S3 account to connect to Platform.
Log in to Adobe Experience Platform and then select Sources from the left navigation bar to access the Sources workspace. The Catalog screen displays a variety of sources for which you can create an inbound account with, and each source shows the number of existing accounts and dataflows associated with them.
You can select the appropriate category from the catalog on the left-hand side of your screen. Alternatively, you can find the specific source you wish to work with using the search option.
Under the Databases category, select Azure Blob Storage or Amazon S3 click on the + icon (+) to create a new Blob or S3 connector.
The Connect to Azure Blob Storage page appears. On this page, you can either use new credentials or existing credentials.

New account

If you are using new credentials, select New account . On the input form that appears, provide the connection with a name, an optional description, and your Blob or S3 credentials. When finished, select Connect and then allow some time for the new account to establish.

Existing account

To connect an existing account, select the Blob or S3 account you want to connect with, then select Next to proceed.

Next steps

By following this tutorial, you have established a connection to your Blob or S3 account. You can now continue on to the next tutorial and configure a dataflow to bring data from your cloud storage into Platform .