Release Process
This document is for Distro team maintainers. For contribution process, see the Maintainer Guide.
The charts are built, linted, and tested on every push to the main branch. The release process follows a 3-stage pipeline that ensures the exact artifact tested by QA is what gets publicly released — no rebuilding at release time.
Architecture Overview
┌─────────────────────┐ ┌─────────────────────┐ ┌─────────────────────┐ ┌─────────────────────┐
│ 1. DEV BUILD │ │ 2. RC PROMOTION │ │ 3. QA GATE │ │ 4. PUBLIC RELEASE │
│ (Every merge) │ ──► │ (Manual trigger) │ ──► │ (External) │ ──► │ (Manual trigger) │
├─────────────────────┤ ├─────────────────────┤ ├─────────────────────┤ ├─────────────────────┤
│ • Build dev package │ │ • Retag dev → RC │ │ • QA validates RC │ │ • Pull RC from │
│ • Push to Harbor │ │ • Create release- │ │ from Harbor │ │ Harbor │
│ • Cosign signing │ │ please PR │ │ • Sign-off required │ │ • Publish to GitHub │
└─────────────────────┘ └─────────────────────┘ │ before Stage 4 │ │ Releases │
↓ ↓ └─────────────────────┘ │ • Cosign signing │
Harbor (internal) Harbor (retag only) ↓ └─────────────────────┘
{version}-dev-{sha} {version}-rc QA approval required ↓
GitHub Releases
helm.camunda.io
Registries
| Registry | Purpose | Access |
|---|---|---|
Harbor (registry.camunda.cloud/team-distribution) | Internal dev/RC storage | Internal only |
GitHub Releases (helm.camunda.io) | Public releases | Public |
Release Pipeline
Stage 1: Dev Package Build
Workflow: chart-build-dev.yaml
Trigger: Automatic on every merge to main (for paths: charts/camunda-platform-*/**).
What happens:
- Builds dev packages for all chart versions selected by
chartAutomation.routineVersions. - Computes the release version using
release-please --dry-run. - Applies release transformations (removes dev comments, badges).
- Generates release notes using the
release-tools release-notescommand. - Packages the chart with the final release version in
Chart.yaml. - Pushes to Harbor with dev tags.
- Signs with Cosign.
Tagging scheme:
| Tag | Example | Purpose |
|---|---|---|
{version}-dev-{sha} | 13.4.0-dev-abc1234 | Immutable, traceable to commit |
{chart-major}-dev-latest | 13-dev-latest | Rolling, always points to latest |
Workflow summary shows:
- Package location and tags.
- All component image versions (from
values.yaml). - Cosign verification status.
Note: The
Chart.yamlinside the package contains the real release version (e.g.13.4.0), not the dev tag. This is computed viarelease-pleasedry-run at build time.
Stage 2: RC Promotion
Workflow: chart-promote-rc.yaml
Trigger: Manual workflow_dispatch with input:
dev-tag: The dev package to promote (e.g.13.4.0-dev-abc1234or13-dev-latest).
What happens:
- Resolves rolling tags to actual dev tags via the Harbor API.
- Validates the commit is on the
mainbranch. - Runs
release-please release-prto create/update the release PR. - Adds RC tags to the same artifact in Harbor (no rebuild!).
Tagging scheme:
| Tag | Example | Purpose |
|---|---|---|
{version}-rc | 13.4.0-rc | Immutable RC tag |
{chart-major}-rc-latest | 13-rc-latest | Rolling, always points to latest RC |
Release-Please PR:
- Updates
Chart.yamlversion and changelog annotations. - Updates
.release-please-manifest.json. - The promotion workflow generates the release files on the PR from the dev
package:
RELEASE-NOTES.md, theChart.yamlrelease annotations, and the version matrix files (component versions mapping + READMEs).
Stage 3: Public Release
Workflow: chart-release-public.yaml
Trigger: Manual workflow_dispatch with input:
rc-tag: The RC package to release (e.g.13.4.0-rcor13-rc-latest).
What happens:
- Resolves the RC tag to its immutable OCI digest and the
{version}-dev-{sha}source tag on the same Harbor artifact (release-tools harbor-tag source). A missing or ambiguous source tag fails the run before anything is published. - Resolves that SHA to a full commit on
mainand pulls the package by digest. - Extracts metadata (version, app version) from the packaged
Chart.yamland checks the package version against the RC version. - Selects the previous release on the chart line (
release-tools release-history) and checks that its source commit is an ancestor of the current one. - Uploads the unchanged package to GitHub Releases using
helm-cr upload --commit <source-sha>, so the release tag points at the build commit. An existing release fails the upload instead of being skipped. - Updates the Helm repo index (
gh-pagesbranch). - Signs with Cosign and uploads the bundle to the release.
- Labels shipped PRs and their linked issues from the
previous-source..sourcecommit range (scripts/set-prs-version-label.shrequireschartVersion,sourceSHAandpreviousSourceSHA). - Stamps the published release's date onto the chart's
version-matrix.jsonentry (release-tools stamp-release) and regenerates the matrix READMEs on therelease-pleasebranch — the single write ofrelease_date, taken from the GitHub release'spublishedAt. - Labels the
release-pleasePR withautorelease: published.
Release tag format: camunda-platform-{appVersion}-{version} (e.g. camunda-platform-8.8-13.4.0).
Source and artifact identity: the release tag marks the commit the package was built from, not an installable copy of the chart. Version bumps, generated release files and image overrides exist only in the package; publication never rebuilds it.
Release notes (release-tools release-notes --main) and shipped-PR labels use the same
previous-source..source range. release-history picks the highest release tag on the chart
line below the chart's version; a new chart line starts from its
camunda-platform-<minor>-<major>.0.0-alpha0 bootstrap tag. Tags that were created from a
later publishing checkout
(#7612 audit)
map to their recorded build commits in historicalReleaseSources; the tags themselves are not
moved. Note generation ignores tags inside the range, so such a tag cannot regroup commits into
an older release. Release-please still discovers history from the public tags on its own; its
version calculation is unchanged.
Locally: make release.generate-notes chartPath=charts/camunda-platform-8.9 [sourceSHA=<sha>]
(defaults to HEAD).
After public release:
- The workflow enables auto-merge on the
release-pleasePR, then shepherds it through the merge queue (re-enabling auto-merge after evictions). If it still does not merge within the timeout, a distinct Slack alert pings the distribution release manager to merge it manually — the release itself is not treated as failed. - Merging the
release-pleasePR records the released version inmainand triggerschart-public-files.yamlto update:- Version matrix (component versions for each chart release).
- Public values files at
helm.camunda.io/camunda-platform/values/.
Helm-Only Ad-Hoc Release
Use this process when a Helm Chart fix is needed (e.g. incorrect image tag, chart misconfiguration) and no application components need to be re-released. It requests an ad-hoc release train scoped to HC (Helm Chart) only, rather than a full multi-component train.
When to Use
- A released Helm Chart contains an error (e.g. wrong image tag, misconfigured value).
- The fix is limited to the Helm Chart — no new application component versions are involved.
- A full multi-component release train would be overkill.
Steps
-
Make sure the fix is merged to
mainand a dev package was built — the post-merge build is automatic; manually triggerchart-build-dev.yamlonly if it hasn't run yet, or if you need to pin specific component image versions rather than taking the latest. -
Request the ad-hoc release train — In
#top-c8-release-train, trigger the "Ad-Hoc Release Train Request" Slack workflow. Fill in:- Reason for the ad-hoc release (link the Jira/support ticket).
- Which minor version(s) are included (e.g.
8.9). - Due date.
- Released artifact — select HC (Helm Chart) only; do not select other components.
Submitting posts a formatted announcement in the channel that pings the release train manager. This is a request, not a self-service trigger: the release train manager makes the final call and coordinates whether other components join. RC promotion, QA testing, the public release, and the release-please PR merge are all automated on your side and require no further manual action once the train is kicked off.
Notes
- Chart versioning: the release version is determined by the workflows —
chart-build-dev.yamlderives the version from a release-please dry-run (falling back to the currentChart.yamlversion), andchart-promote-rc.yamlforces--release-asto the version parsed from the selected dev tag. - This process is for Self-Managed only — no SaaS rollout is involved.
Release Process Flowchart
Version Tagging Summary
| Stage | OCI Tag | Chart.yaml Version | Registry |
|---|---|---|---|
| Dev | {version}-dev-{sha} | {version} | Harbor |
| RC | {version}-rc | {version} | Harbor |
| Public | N/A (GitHub Release) | {version} | GitHub Releases |
Camunda version derivation: The Helm chart major version maps to a Camunda version:
11.x= Camunda 8.612.x= Camunda 8.713.x= Camunda 8.814.x= Camunda 8.915.x= Camunda 8.1016.x= Camunda 8.11
Routine Chart Automation
chartAutomation.routineVersions in charts/chart-versions.yaml selects routine CI, dev packaging, artifact verification, and maintenance chores. Lifecycle metadata is independent and controls the existing version-matrix display. An ESUP case requires routine Helm chart automation only when its agreed delivery scope includes that maintenance; component-only cases can use explicit ad-hoc validation without joining the routine list.
Minor Version Chores
A minor goes through two sets of chores at different times. The examples use 8.10 as the minor that becomes GA and 8.11 as the new alpha.
New alpha chart
Do these steps when you create the new alpha chart. The examples copy 8.10 to 8.11 as chart 16.0.0-alpha0. Copy the checklist into the tracking issue of the cut.
The chart-minor-cut skill has the commands and the check for each step. Its section numbers match the steps below.
- 1. State of the previous minor. Record if
8.10hasreleasedincharts/chart-versions.yaml. Step 7 needs it. - 2. Version-agnostic tooling. Search outside
charts/for hardcoded8.10lists. Change substring checks and fixed lists to numeric comparisons, or add8.11. Merge these fixes in a separate PR first. - 3. Copy. Copy the tracked files of
charts/camunda-platform-8.10withgit ls-files, not withcp -r. Check that both directories have the same number of tracked files. - 4. Chart metadata. Set
version: 16.0.0-alpha0andappVersion: 8.11.x. Addartifacthub.io/prerelease: "true". Resetartifacthub.io/changes,CHANGELOG.mdandRELEASE-NOTES.md. The dev build adds one to the alpha number, so the first release is-alpha1. - 5. Image tags. Replace every
8.10tag invalues.yaml,values-latest.yamlandvalues-digest.yaml. Use8.11-SNAPSHOTwhere Docker Hub has it, elseSNAPSHOT. Pin the digest of each selected tag. Set thevalues-latest.yamlheader toCamunda - Alpha. - 6. Audit the copy. Search the new chart for
8.10,8.9and old chart directory names. Keep history statements. Fix docs links, the release-highlights text, README directory names, the PlaywrightSM-8.11suite, test values headers, Hub cluster versions and registry paths. Remove the hooks of the8.9to8.10upgrade. - 7. Wiring. Add
8.11toroutineVersionsandcamundaSupportLifecycle(withoutreleased). Add the release-please package (with theversion/alphalabel) and the manifest entry (with the filler entry). Add8.11to the Renovate alpha and digest rules,pr-labeler.yaml,permitted-flows.yaml, thetest-chart-version.yamlchoices,inject_values.go,render-e2e-env.shand the version map above. Create theversion/8.11andforward-port-to-8.11labels. If8.10is not GA yet, also denyupgrade-minorfor8.11. When8.10becomes GA, follow skill step 7 to remove that deny and restore theupgrade-minorscenario entries removed during the cut. - 8. Regenerate. Run
helm.dependency-update,helm.readme-update,helm.schema-updateandgo.update-golden-onlyfor the new chart. - 9. Checks. Lint and unit tests pass for the new chart. The tooling tests pass.
release-tools release-versionreturns16.0.0-alpha1. The rendered images use the new tags. The8.10chart has no changes. The tier-1 scenarios pass. - 10. PR. Open
feat: create the Camunda 8.11 Helm chart line as 16.0.0-alpha0. Stack it on the tooling PR if that PR is not merged. - 11. After the merge. Push the annotated tag
camunda-platform-8.11-16.0.0-alpha0on the merge commit. Without it, the first alpha release fails. Check that the first dev build makes16.0.0-alpha1. Forward-port the8.10changes that merged after the copy, and add theforward-port-to-8.11label to open8.10PRs. Tell QA (theSM-8.11e2e suite) and the monorepo team (the preview-environment smoke test). - 12. Older minors. Check the end of standard maintenance and the ESUP cases of each older minor. Move or end them in separate PRs, not in the cut PR.
Minor becoming GA
The release train publishes the Helm chart before the official release date. Do steps 1–10 before the train starts the Helm chart build (chart-build-dev.yaml with chart-version: 8.10). The distribution release manager owns these steps and the checks after the public release.
- Label all open PRs with
backport-to-latestso that contributors know their PRs need updating. - In
charts/chart-versions.yaml, setreleasedandstdSupportUntilfor8.10. Use the "Minor release date" and "End of standard maintenance" dates from the 8.10 release announcements page in the docs. The presence ofreleasedswitches the release tooling from prerelease to stable versions. WithoutstdSupportUntil, the version matrix shows the minor in extended support. - Do not change the version in
Chart.yaml. The dev build computes the GA version fromchart-versions.yaml, and the release-please PR writes it toChart.yaml. If you setChart.yamlto the GA version by hand, the dev build takes the next version from release-please instead. - Remove
artifacthub.io/prerelease: "true"fromcharts/camunda-platform-8.10/Chart.yaml. A published chart cannot be changed, and Artifact Hub keeps the prerelease flag of a published version. - Set the GA image tags in
values.yaml,values-latest.yamlandvalues-digest.yaml, and change thevalues-latest.yamlheader fromCamunda - AlphatoCamunda Helm chart.. Renovate and CI read these files frommain, and the package shipsvalues-digest.yamlas it is onmain.- In
values-digest.yaml, pin each image to the digest of its GA tag. Docker Hub returns the digest in thedigestfield ofhttps://hub.docker.com/v2/repositories/<image>/tags/<tag>(for examplecamunda/camundaand8.10.0). - Remove the values of components that the GA chart does not ship (for 8.10, the Console block in
values-latest.yaml).
- In
- In
renovate.json5, move the8.10files from the alpha rules to the patch-onlycamunda-platform-imagesgroup. Keep the alpha rules. Leave theirmatchFileNamesempty until the next alpha chart exists. - Remove the
version/alphalabel from the8.10package in.github/config/release-please/release-please-config.json. - Point the release highlights in
templates/common/_helpers.tplat the versioned upgrade guide (https://docs.camunda.io/docs/8.10/self-managed/upgrade/helm/890-to-8100/). Remove "alpha" from parameter descriptions. - Regenerate the generated files with
make helm.readme-update,make helm.schema-updateandmake go.update-golden-only, each withchartPath=charts/camunda-platform-8.10. - Render the chart with
values.yamlonly, and again with-f values-digest.yaml. Check that every Camunda image uses the GA tag or its digest, and thatapp.kubernetes.io/versionshows the GA version. Withvalues-digest.yaml, the label shows the chartappVersionuntil #7440 is fixed. - Rehearse the release from the PR branch before you merge: run
chart-promote-rc.yamlwith--ref <branch>,dev-tag: 15-dev-latestanddry-run: true, thenchart-release-public.yamlwith--ref <branch>,rc-tag: 15-rc-dryrun-latestanddry-run: true. The workflows build the release tooling from the branch. The dev tag must point to a commit onmain. - After the merge, check that the next 8.10 dev build has no
-alphasuffix in its dev tag.
After the public release:
- Check that Artifact Hub does not show
15.0.0as a pre-release. - Check that the PRs in the release have the
version:8.10-15.0.0label. - Check the public values files and the version matrix on
helm.camunda.io.
Artifact Hub
The Camunda repo is configured on Artifact Hub. After a release, Artifact Hub automatically scans and indexes the new version.
Note: Charts may take up to 30 minutes to appear on Artifact Hub. After successful release, charts are immediately available via
helm.camunda.io.
Troubleshooting
Dev package not found
If RC promotion fails because the dev package doesn't exist:
- Check if the commit SHA is correct.
- Verify the dev build workflow succeeded for that commit.
- Check Harbor directly for available tags.
Release-Please PR not created
If the RC promotion workflow doesn't create a release-please PR:
- Check for existing unmerged
release-pleasePRs with theautorelease: pendinglabel. - Verify there are releasable commits (conventional commit format required).
- Check the
release-pleaselogs for errors.
Release already exists
If the public release fails because the release tag already exists:
- Delete the existing release:
gh release delete <tag> --yes. - Re-run the public release workflow.
Image version mismatch
Before promoting to RC, verify component image versions match the release train:
- Check the dev build workflow summary for image versions.
- Compare with the release train announcement (Slack/Tasklist).
- If there's a mismatch:
- Option A: Wait for the Renovatebot PR. The InfraEx dependency scanner approves it and adds it to the merge queue every 30 minutes, after its checks pass. A PR labelled
upgrade:major,securityorno mergeneeds a human approval. - Option B: Manually trigger
chart-build-dev.yamlwith specific image tag inputs (the workflow supports overriding individual component versions). - Option C: Manually create a PR to update
values.yaml.
- Option A: Wait for the Renovatebot PR. The InfraEx dependency scanner approves it and adds it to the merge queue every 30 minutes, after its checks pass. A PR labelled
Related Workflows
| Workflow | Purpose |
|---|---|
chart-build-dev.yaml | Stage 1: Build dev packages |
chart-promote-rc.yaml | Stage 2: Promote dev → RC |
chart-release-public.yaml | Stage 3: Publish to GitHub Releases |
chart-release-artifact-verify.yaml | Daily Cosign verification |
chart-public-files.yaml | Update public docs after PR merge |
Release Process Change Policy
Avoid surprises during releases by ensuring all release-affecting changes are communicated clearly and early.
Requirements:
- Communicate before the change goes live.
- Announce in
#top-c8-release-trainand CC:@monorepo-release-manager@qa-release-manager- Others if relevant