Configure your CI/CD Pipeline
The following page explains how to configure the Pipeline. To review more conceptual information on how the pipeline works see the CI/CD pipeline overview.
Understanding the Flow
You can configure your pipeline from the Pipeline Settings tile in the Cloud Manager UI.
The Deployment Manager is responsible for setting up the pipeline. When doing so, you first select a branch from the Git Repository. Pipeline configuration consists of:
- defining the trigger that will start the pipeline.
- defining the parameters controlling the production deployment.
- configuring the performance test parameters.
Setting up the Pipeline
The pipeline cannot be setup until the Git repository has at least one branch and Program Setup is complete.
Before you start to deploy your code, you must configure your pipeline settings from the Cloud Manager.
You can change the pipeline settings after initial set up.
Configuring the Pipeline Settings from Cloud Manager
Once you have setup your program using Cloud Manager UI, you are ready to setup your pipeline.
Follow these steps to configure the behavior and preferences for your pipeline:
- Click Setup Pipeline to setup and configure your pipeline.
- The Setup Pipeline screen displays.The three-step wizard allows you to setup your Branch, Environments, and Testing environment. Select your Git branch and click Next.Branches found in the Git repository are linked to your program.
- Access the Environments tab to select Stage and Production options.You can define the trigger to start the pipeline:
During pipeline setup or edit, the Deployment Manager has the option of defining the behavior of the pipeline when an important failure is encountered in any of the quality gates such as Code Quality, Security Testing, and Performance Testing.This is useful for customers who have the desire for more automated processes. The available options are:
- On Git Changes - starts the CI/CD pipeline whenever there are commits added to the configured git branch. Even if you select this option, you can always start the pipeline manually.
- Manual - using the UI manually start the pipeline.
- Scheduled - this option will be coming soon in an upcoming release.
- Ask every time - This is the default setting and requires manual intervention on any Important failure.
- Fail immediately - If selected, the pipeline will be cancelled whenever an Important failure occurs. This is essentially emulating a user manually rejecting each failure.
- Continue immediately - If selected, the pipeline will proceed automatically whenever an Important failure occurs. This is essentially emulating a user manually approving each failure.Now you define the parameters controlling the production deployment. The three available options are as follows:
- Use Go Live Approval - A deployment must be manually approved by a business owner, project manager, or deployment manager via the Cloud Manager UI.
- Use CSE Oversight - A CSE is engaged to actually start the deployment. During pipeline setup or edit when CSE Oversight is enabled, the Deployment Manager has the option of selecting:
- Any CSE: refers to any available CSE
- My CSE: refers to a specific CSE assigned to the customer or their backup, if the CSE is out of the office
- Scheduled - This option allows the user to enable the scheduled production deployment.
If Scheduled option is selected, you can schedule your production deployment to the pipeline after the stage deployment (and Use GoLive Approval, if that has been enabled) to wait for a schedule to be set. The user can also choose to execute the production deployment immediately.
Please refer to Deploy your Code, to set the deployment schedule or execute the production immediately.
The Use CSE Oversight option is not available to all customers.
As a Deployment Manager, you have the opportunity to configure a set of paths which will either be invalidated or flushed from the AEM Dispatcher cache, while setting up or editing pipeline.
You can configure a separate set of paths for Stage and Production deployment. If configured, these cache actions will be performed as part of the deployment pipeline step, just after any content packages are deployed. These settings use standard AEM Dispatcher behavior - invalidate performs a cache invalidation, similar to when content is activated from author to publish; flush performs a cache deletion.
In general, the use of the invalidate action is preferable but there may be cases where flushing is required, especially when using AEM HTML Client Libraries.
Please refer to Dispatcher Overview get more information on Dispatcher caching.
Follow the steps below to configure Dispatcher Invalidations:
- Click Configure under the Dispatcher Configuration heading
- Enter the path, select the action from Type, and click Add. You can specify up to 100 paths per environment. Once you have added the paths, click Apply.
- Once you are back on the Pipeline Settings page, you will see an updated summary of the selections.Click Save to persist this configuration.
- Access the Testing tab to define your testing criteria for your program.Now, you can configure the performance test parameters.You can configure AEM Sites and AEM Assets Performance Testing, depending on which products you have licensed.AEM Sites:Cloud Manager executes performance testing for AEM Sites programs by requesting pages (as an unauthenticated user) on the stage publish server for a 30 minute test period and measuring the response time for each page as well as various system-level metrics.Pages are selected by three page sets; you can choose anywhere from one to all three sets. The distribution of traffic is based on the number of sets selected, that is, if all three are selected, 33% of the total page views are put toward each set; if two are selected, 50% goes to each set; if one is selected, 100% of the traffic goes to that set.For example, let us say that there is a 50%/50% split between the Popular Live Pages and New Pages set (in this example, Other Live Pages is not used) and the New Pages set contains 3000 pages. The page views per minute KPI is set to 200. Over the 30 minute test period:
AEM Assets:Cloud Manager executes performance testing for AEM Assets programs by uploading assets repeatedly for a 30 minute test period and measuring the processing time for each asset as well as various system-level metrics. This capability can upload both images and PDF documents. The distribution of how many assets of each type are uploaded per minute is set in the Pipeline Setup or Edit screen.For example, if a 70/30 split is used, as seen in the figure below. There are 10 assets uploaded per minute, 7 images will be uploaded per minute and 3 documents.There is a default image and PDF document, but in most cases, customers will want to upload their own assets. This can be done from the Pipeline Setup or Edit screen. Common image formats such as JPEG, PNG, GIF and BMP are supported along with Photoshop, Illustrator and Postscript files.
- Each of the 25 pages in the Popular Live Pages set will be hit 240 times – ((200 * 0.5) / 25) * 30 = 120
- Each of the 3000 pages in the New Pages set will be hit once - ((200 * 0.5) / 3000) * 30 = 1
- Click Save to complete the setup of pipeline process.Additionally, once you have setup the pipeline, you can still edit settings for the same using Pipeline Settings tile from the Cloud Manager UI.
Non-Production & Code Quality Only Pipelines
In addition to the main pipeline which deploys to stage and production, customers are able to set up additional pipelines, referred to as Non-Production Pipelines. These pipelines always execute the build and code quality steps. They can optionally also deploy to Adobe Managed Services environment.
On the home screen, these pipelines are listed in a new card:
- Access the Non-Production Pipelines tile from the the Cloud Manager home screen.
- Clicking on the Add button, to specify the Pipeline Name, Pipeline Type, and the Git Branch.Additionally, you can also set up Deployment Trigger and Important Failure Behavior from Pipeline Options.
- Click Save and the pipeline is shown on the card on the home screen with three actions:
While the pipeline is running, the current step is displayed and only the Details action is available.
- Edit - allows editing of the pipeline settings
- Detail - displays the last pipeline execution (if there is one)
- Build - navigates to the execution page, from which the pipeline can be executed
The Next Steps
Once you have configured the pipeline, you need to deploy your code.
Please see Deploy your Code for more details.