Show Menu
TOPICS×

Understand, apply, and curate Smart Tags

Organizations that deal with digital assets increasingly use taxonomy-controlled vocabulary in asset metadata. Essentially, it includes a list of keywords that employees, partners, and customers commonly use to refer to and search for digital assets of a particular class. Tagging assets with taxonomy-controlled vocabulary ensures that they can be easily identified and retrieved by tag-based searches.
Compared to natural language vocabularies, tagging digital assets based on business taxonomy helps align them with a company's business and ensures that the most relevant assets appear in searches.
For example, a car manufacturer can tag car images with model names so only relevant images appear when images of various models are searched to design a promotion campaign.
For the Smart Content Service to apply the right tags, you must train it to recognize your taxonomy. To train the service, first curate a set of assets and tags that best describe these assets. Apply these tags on the assets and run a training workflow to help the service learn.
Once a tag is trained and ready, the service can now apply these tags on assets through a tagging workflow.
In the background, the Smart Content Service uses Adobe Sensei AI framework to train its image recognition algorithm on your tag structure and business taxonomy. This content intelligence is then used to apply relevant tags on a different set of assets.
Smart Content Service is a cloud service that is hosted on Adobe I/O. To use it in Adobe Experience Manager, the system administrator must integrate your Experience Manager deployment with Adobe I/O.
In summary, here are the main steps to use the Smart Content Service:
  • Onboarding
  • Reviewing assets and tags (taxonomy definition)
  • Training the Smart Content Service
  • Automatic tagging

Prerequisites

Before you can use the Smart Content Service, ensure the following to create an integration on Adobe I/O:
  • An Adobe ID account that has administrator privileges for the organization.
  • The Smart Content Service service is enabled for your organization.
  • Smart Content Services Base Package may only be added to a deployment where a Sites Base Package and Assets add-on have been licensed.

Onboarding

The Smart Content Service is available for purchase as an add-on to Experience Manager. After you purchase, an email is sent to the administrator of your organization with a link to Adobe I/O.
The administrator can follow the link to integrate the Smart Content Service with Experience Manager. To integrate the service with Experience Manager Assets, see Configure Smart Tags .
The onboarding process is complete when the administrator configures the service and adds users in Experience Manager.
If you are using Experience Manager 6.3 or earlier version and require tagging service for your assets, see Smart Tags . Smart Tags do not use the latest AI capabilities and are hence less accurate than the enhanced smart tagging service.

Review assets and tags

After you are onboard, the first thing you want to do is identify a set of tags that best describe these images in the context of your business.
Next, review images to identify a set of images that best represent your product for a particular business requirement. Ensure that the assets in your curated set conform to Smart Content Service training guidelines .
Add the assets to a folder and apply the tags to each asset from the properties page. Then, run the training workflow on this folder. The curated set of assets enables the Smart Content Service to effectively train more assets using your taxonomy definitions.
  1. Training is an irrevocable process. Adobe recommends that you review the tags in the curated set of assets well before training the Smart Content Service on the tags.
  2. Before training for a tag, see Smart Content Service training guidelines .
  3. When you train the Smart Content Service for the first time, Adobe recommends that you train it on at least two distinct tags.

Understand Experience Manager search results with smart tags

By default, Experience Manager search combines the search terms with an AND clause. Using smart tags does not change this default behavior. Using smart tags adds an additional OR clause to find any of the search terms in the applies smart tags. For example, consider searching for woman running . Assets with just woman or just running keyword in the metadata do not appear in the search results by default. However, an asset tagged with either woman or running using smart tags appears in such a search query. So the search results are a combination of,
  • assets with woman and running keywords in the metadata.
  • assets smart tagged with either of the keywords.
The search results that match all search terms in metadata fields are displayed first, followed by the search results that match any of the search terms in the smart tags. In the above example, the approximate order of display of search results is:
  1. matches of woman running in the various metadata fields.
  2. matches of woman running in smart tags.
  3. matches of woman or of running in smart tags.
If the Lucene indexing is done out of Adobe Experience Manager then the search based on smart tags does not work as expected.

Automatically tag assets

After you have trained the Smart Content Service, you can trigger the tagging workflow to automatically apply appropriate tags on a different set of similar assets.
You can run the tagging workflow periodically or whenever required.
The tagging workflow runs on both assets and folders.

Periodic tagging

You can enable the Smart Content Service to periodically tag assets within a folder. Open the properties page of your asset folder, select Enable Smart Tags under the Details tab, and save the changes.
Once this option is selected for a folder, the Smart Content Service automatically tags the assets within the folder. By default, the tagging workflow runs every day at 12:00 AM.

On-demand tagging

You can trigger the tagging workflow from the workflow console or from the timeline to instantly tag your assets.
If you run the tagging workflow from the timeline, you can apply tags on a maximum of 15 assets at a time.

Tag assets from the workflow console

  1. In Experience Manager interface, go to Tools > Workflow > Models .
  2. From the Workflow Models page, select the DAM Smart Tags Assets workflow and then click Start Workflow from the toolbar.
  3. In the Run Workflow dialog, browse to the payload folder containing assets on which you want to apply your tags automatically.
  4. Specify a title for the workflow and an optional comment. Click Run .
    Navigate to the asset folder and review the tags to verify whether the Smart Content Service tagged your assets properly.

Tag assets from the timeline

  1. From the Assets user interface, select the folder containing assets or specific assets to which you want to apply smart tags.
  2. From upper-left corner, open the Timeline .
  3. Open actions from the bottom of the left sidebar and click Start Workflow .
  4. Select the DAM Smart Tag Assets workflow, and specify a title for the workflow.
  5. Click Start . The workflow applies your tags on assets. Navigate to the asset folder and review the tags to verify whether the Smart Content Service tagged your assets properly.
In the subsequent tagging cycles, only the modified assets are tagged again with newly-trained tags.However, even unaltered assets are tagged if the gap between the last and current tagging cycles for the tagging workflow exceeds 24 hours. For periodic tagging workflows, unaltered assets are tagged when the time gap exceeds 6 months.

Curate or moderate the applied smart tags

You can curate Smart tags to remove any inaccurate tags that may have been assigned to your brand images so only the most relevant tags are displayed.
Moderating Smart tags also helps refine tag-based searches for images by ensuring that your image appears in search results for the most relevant tags. Essentially, it helps eliminate the chances of unrelated images from showing up in search results.
You can also assign a higher rank to a tag to increase its relevance with respect to an image. Promoting a tag for an image increases the chances of the image appearing in search results when a search is performed based on the particular tag.
  1. In the Omnisearch box, search for assets based on a tag.
  2. Inspect the search results to identify an image that you don't find relevant to your search.
  3. Select the image, and click Manage Tags from the toolbar.
  4. From the Manage Tags page, inspect the tags. If you don't want the image to be searched based on a specific tag, select the tag and then click Delete from the toolbar. Alternatively, click x symbol that appears next to a tag.
  5. Optionally, to assign a higher rank to a tag, select the tag and click Promote from the toolbar. The tag you promote, is moved to the Tags section.
  6. Click Save and then click OK
  7. Navigate to the Properties page for the image. Observe that the tag you promoted is assigned more relevance and appears earlier in the search results.

Tips and limitations

  • Use of Smart Content Services is limited to up to 2 million tagged images per year. Any duplicate images that are processed and tagged are each counted as a tagged image.
  • If you run the tagging workflow from the timeline, you can apply tags on a maximum of 15 assets at a time.