Create a Google Cloud Storage source connector in the UI
Source connectors in Adobe Experience Platform provide the ability to ingest externally sourced data on a scheduled basis. This tutorial provides steps for creating a Google Cloud Storage (hereinafter referred to as "GCS") source connector using the Platform user interface.
This tutorial requires a working understanding of the following components of Adobe Experience Platform:
- Experience Data Model (XDM) System : The standardized framework by which Experience Platform organizes customer experience data.
- Real-time Customer Profile : Provides a unified, real-time consumer profile based on aggregated data from multiple sources.
If you already have a GCS base connection, you may skip the remainder of this document and proceed to the tutorial on configuring a dataflow .
Supported file formats
Experience Platform supports the following file formats to be ingested from external storages:
- Delimiter-separated values (DSV): Support for DSV formatted data files is currently limited to comma-separated values. The value of field headers within DSV formatted files must only consist of alphanumeric characters and underscores. Support for general DSV files will be provided in the future.
- Apache Parquet: Parquet formatted data files must be XDM compliant.
Gather required credentials
In order to access your GCS data on Platform, you must provide a valid GCS Access Key ID and Secret . You can learn more about how to obtain these values by reading the production server-to-server authentication guide for Google Cloud.
Connect your GCS account
Once you have gathered your required credentials, you can follow the steps below to create a new inbound base connection to link your GCS account to Platform.
Log in to platform.adobe.com Adobe Experience Platform and then select Sources from the left navigation bar to access the Sources workspace. The Catalog screen displays a variety of sources for which you can create inbound base connections with, and each source shows the number of existing base connections associated to them.
Under the Cloud Storage category, select Google Cloud Storage to expose an information bar on the right-hand side of your screen. The information bar provides a brief description for the selected source as well as options to connect with the source view its documentation, or to connect with the source. To create a new inbound base connection, click Connect source .
The Connect to Google Cloud Storage dialog appears. On the input form, provide the base connection with a name, an optional description, and your GCS credentials. When finished, click Connect and then allow some time for the new base connection to establish.
Once a base connection is established, you can continue on to the next section and configure a dataflow to bring data into Platform.
By following this tutorial, you have established a base connection to your GCS account. You can now continue on to the next tutorial and configure a dataflow to bring data into Platform .