Show Menu
TOPICS×

Data Access developer guide

The Data Access API supports Adobe Experience Platform by providing users with a RESTful interface focused on the discoverability and accessibility of ingested datasets within Experience Platform.

API specification reference

The Swagger API reference documentation can be found here .

Terminology

A description of some commonly used terms throughout this document.
Term
Description
Dataset
A collection of data that includes schema and fields.
Batch
A set of data collected over a period of time and processed together as a single unit.

Retrieve list of files within a batch

By using a batch identifier (batchID), the Data Access API can retrieve a list of files belonging to that particular batch.
API format
GET /batches/{BATCH_ID}/files

Property
Description
{BATCH_ID}
The ID of the specified batch.
Request
curl -X GET https://platform.adobe.io/data/foundation/export/batches/{BATCH_ID}/files \
  -H 'Authorization: Bearer {ACCESS_TOKEN}' \
  -H 'x-api-key: {API_KEY}' \
  -H 'x-gw-ims-org-id: {IMS_ORG}' \
  -H 'x-sandbox-name: {SANDBOX_NAME}'

Response
{
  "data": [
    {
      "dataSetFileId": "{FILE_ID_1}",
      "dataSetViewId": "string",
      "version": "1.0.0",
      "created": "string",
      "updated": "string",
      "isValid": true,
      "_links": {
        "self": {
          "href": "https://platform.adobe.io/data/foundation/export/files/{FILE_ID_1}"
        }
      }
    },
    {
      "dataSetFileId": "{FILE_ID_2}",
      "dataSetViewId": "string",
      "version": "1.0.0",
      "created": "string",
      "updated": "string",
      "isValid": true,
      "_links": {
        "self": {
          "href": "https://platform.adobe.io/data/foundation/export/files/{FILE_ID_2}"
        }
      }
    },
  ],
  "_page": {
    "limit": 100,
    "count": 1
  }
}

The "data" array contains a list of all files within the specified batch. Each file returned has its own unique ID ( {FILE_ID} ) contained within the "dataSetFileId" field. This unique ID can then be used to access or download the file.
Property
Description
data.dataSetFileId
The file ID for each file in the specified batch.
data._links.self.href
The url to access the file.

Access and download files within a batch

By using a file identifier ( {FILE_ID} ), the Data Access API can be used to access specific details of a file, including its name, size in bytes, and a link to download.
The response will contain a data array. Depending on whether the file pointed to by the ID is an individual file or a directory, the data array returned may contain a single entry or a list of files belonging to that directory. Each file element will include the details of the file.
API format
GET /files/{FILE_ID}

Property
Description
{FILE_ID}
Equal to the "dataSetFileId" , the ID of the file to be accessed.
Request
curl -X GET https://platform.adobe.io/data/foundation/export/files/{FILE_ID} \
  -H 'Authorization: Bearer {ACCESS_TOKEN}' \
  -H 'x-api-key: {API_KEY}' \
  -H 'x-gw-ims-org-id: {IMS_ORG}' \
  -H 'x-sandbox-name: {SANDBOX_NAME}'

Single file response
{
  "data": [
    {
      "name": "{FILE_NAME}",
      "length": "{LENGTH}",
      "_links": {
        "self": {
          "href": "https://platform.adobe.io/data/foundation/export/files/{FILE_ID}?path={FILE_NAME}"
        }
      }
    }
  ],
  "_page": {
    "limit": 100,
    "count": 1
  }
}

Property
Description
data.name
Name of the file (e.g. profiles.csv).
data.length
Size of the file (in bytes).
data._links.self.href
The URL to download the file.
Directory response
{
  "data": [
    {
      "dataSetFileId": "{FILE_ID_1}",
      "dataSetViewId": "string",
      "version": "1.0.0",
      "created": "string",
      "updated": "string",
      "isValid": true,
      "_links": {
        "self": {
          "href": "https://platform.adobe.io/data/foundation/export/files/{FILE_ID_1}"
        }
      }
    },
    {
      "dataSetFileId": "{FILE_ID_2}",
      "dataSetViewId": "string",
      "version": "1.0.0",
      "created": "string",
      "updated": "string",
      "isValid": true,
      "_links": {
        "self": {
          "href": "https://platform.adobe.io/data/foundation/export/files/{FILE_ID_2}"
        }
      }
    }
  ],
  "_page": {
    "limit": 100,
    "count": 2
  }
}

When a directory is returned, it contains an array of all files within the directory.
Property
Description
data.name
Name of the file (e.g. profiles.csv).
data._links.self.href
The URL to download the file.

Access the contents of a file

The Data Access API can also be used to access the contents of a file. This can then be used to download the contents to an external source.
API format
GET /files/{dataSetFileId}?path={FILE_NAME}

Property
Description
{FILE_NAME}
The name of the file you are trying to access.
Request
curl -X GET https://platform.adobe.io/data/foundation/export/files/{FILE_ID}?path={FILE_NAME} \
  -H 'Authorization: Bearer {ACCESS_TOKEN}' \
  -H 'x-api-key: {API_KEY}' \
  -H 'x-gw-ims-org-id: {IMS_ORG}' \
  -H 'x-sandbox-name: {SANDBOX_NAME}'

Property
Description
{FILE_ID}
The ID of the file within a dataset.
{FILE_NAME}
The full name of the file (e.g. profiles.csv).
Response
Contents of the file

Additional code samples

For additional samples, please refer to the data access tutorial .

Subscribe to data ingestion events

Platform makes specific high-value events available for subscription through the Adobe Developer Console . For instance, you can subscribe to data ingestion events to be notified of potential delays and failures. See the tutorial on subscribing to data ingestion notifications for more information.