Add Jenkins pipeline for builder reimage by jitendrasahu1803 · Pull Request #2602 · ceph/ceph-build

jitendrasahu1803 · 2026-06-01T10:08:42Z

Introduces Jenkins pipeline for builder reimage and post-reimage configuration.

Uses inventory-driven OS detection from jenkins_builders.yml
Integrates MaaS reimage workflow
Runs Ansible playbooks for node setup
Supports multiple nodes with parallel execution

Signed-off-by: jitendrasahu1803 <jitendra.sahu1803@gmail.com>

djgalloway · 2026-06-02T14:41:50Z

+ANSIBLE_DIR="${WORK_DIR}/repos/ansible"
+MAIN_DIR="${WORK_DIR}/repos/main"


Can you add a comment above each of these saying what they're for?

djgalloway · 2026-06-02T14:50:02Z

+    SSH_USER="cloud-user"
+else
+    SSH_USER="ubuntu"
+fi


I'm confused why this is necessary. MaaS is supposed to take care of creating the cm user (https://github.com/ceph/ceph-cm-ansible/blob/main/roles/maas/tasks/config_maas.yml#L90) with these keys: https://github.com/ceph/ceph-sepia-secrets/blob/main/ansible/inventory/group_vars/all.yml#L40. And I see jenkins-build@soko04 has a pubkey in there.

We should be SSHing as the cm user.

I was informed that this should be the first command executed after reimage:

ansible-playbook ansible_managed.yml --limit="<all builders>" -e "ansible_ssh_user=ubuntu/cloud-user"

However, when I try running it using the 'cm' user (instead of 'ubuntu/cloud-user') immediately after the MaaS reimage, I encounter the following error:

❯ ansible-playbook ansible_managed.yml --limit="braggi16.front.sepia.ceph.com" -e "ansible_ssh_user=cm" PLAY [all] ************************************************************************************************************************************************************************************************************************************** TASK [Gathering Facts] ************************************************************************************************************************************************************************************************************************** [WARNING]: Host 'braggi16.front.sepia.ceph.com' is using the discovered Python interpreter at '/usr/bin/python3.12', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information. ok: [braggi16.front.sepia.ceph.com] TASK [ansible-managed : Create the sudo group.] ************************************************************************************************************************************************************************************************* ok: [braggi16.front.sepia.ceph.com] TASK [ansible-managed : Create the ansible user.] *********************************************************************************************************************************************************************************************** [ERROR]: Task failed: Module failed: usermod: user cm is currently used by process 2279 Origin: /Users/jitendra/git/ceph/ceph-cm-ansible/roles/ansible-managed/tasks/main.yml:9:3 7 - user 8 9 - name: Create the ansible user. ^ column 3 fatal: [braggi16.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "usermod: user cm is currently used by process 2279\n", "name": "cm", "rc": 8} PLAY RECAP ************************************************************************************************************************************************************************************************************************************** braggi16.front.sepia.ceph.com : ok=2 changed=0 unreachable=0 failed=1 skipped=0 rescued=0 ignored=0

On the other hand, the same playbook works successfully when executed with the 'ubuntu' user:

❯ ansible-playbook ansible_managed.yml --limit="braggi16.front.sepia.ceph.com" -e "ansible_ssh_user=ubuntu" PLAY [all] ************************************************************************************************************************************************************************************************************************************** TASK [Gathering Facts] ************************************************************************************************************************************************************************************************************************** [WARNING]: Host 'braggi16.front.sepia.ceph.com' is using the discovered Python interpreter at '/usr/bin/python3.12', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information. ok: [braggi16.front.sepia.ceph.com] TASK [ansible-managed : Create the sudo group.] ************************************************************************************************************************************************************************************************* ok: [braggi16.front.sepia.ceph.com] TASK [ansible-managed : Create the ansible user.] *********************************************************************************************************************************************************************************************** changed: [braggi16.front.sepia.ceph.com] TASK [ansible-managed : Delete the ansible users password.] ************************************************************************************************************************************************************************************* changed: [braggi16.front.sepia.ceph.com] TASK [ansible-managed : Ensure includedir is present in sudoers.] ******************************************************************************************************************************************************************************* changed: [braggi16.front.sepia.ceph.com] TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] ******************************************************************************************************************************************************************************** changed: [braggi16.front.sepia.ceph.com] TASK [ansible-managed : Add authorized keys for the ansible user.] ****************************************************************************************************************************************************************************** [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. changed: [braggi16.front.sepia.ceph.com] PLAY RECAP ************************************************************************************************************************************************************************************************************************************** braggi16.front.sepia.ceph.com : ok=7 changed=5 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0

This commit takes care of that. What branch of ceph-cm-ansible is being used?

Oh I see, Thank you for pointing this out. It uses main branch only, but the snippet I shared was tested from my old local branch. If needed, I'm happy to update my script to explicitly use the cm user. Please let me know how you would like it configured, and I will make the changes accordingly.

djgalloway · 2026-06-02T14:50:21Z

+# Admin user JSON builder
+ADMIN_USERS=(
+  "akraitma"
+  "dgalloway"
+  "dmick"
+  "falcocer"
+  "jitendra"
+  "zack"
+)
+
+build_admin_users_json() {
+    local json='{"managed_admin_users":['
+    for u in "${ADMIN_USERS[@]}"; do
+        json+="{\"name\":\"${u}\"},"
+    done
+    json="${json%,}]}"
+    echo "${json}"
+}


Same question as https://github.com/ceph/ceph-build/pull/2602/changes#r3342141274

djgalloway · 2026-06-02T14:51:32Z

+# -----------------------------------------------------------------------------
+# Script Name: bootstrap_env.sh
+# Description:
+#   Bootstraps the local Python environment for running the MAAS reimage script.
+#   - Installs MAAS CLI (Linux/macOS)
+#   - Creates Python virtual environment
+#   - Installs dependencies
+# -----------------------------------------------------------------------------


This is great

Signed-off-by: jitendrasahu1803 <jitendra.sahu1803@gmail.com>

djgalloway · 2026-06-02T20:32:53Z

@@ -0,0 +1,27 @@
+import yaml


Missing a shebang. If that's important. Please add a comment at the top showing usage and input/output.

sync_labels.py: file is removed as it's not being used Signed-off-by: jitendrasahu1803 <jitendra.sahu1803@gmail.com>

Signed-off-by: jitendrasahu1803 <jitendra.sahu1803@gmail.com>

jitendrasahu1803 added 6 commits June 1, 2026 15:35

Add Jenkins pipeline for builder reimage

ae4963f

Reorganise the builder-reimage directory structure

14a1e0e

Signed-off-by: jitendrasahu1803 <jitendra.sahu1803@gmail.com>

builder-reimage.yml: set to 'main' branch

33e81a2

Signed-off-by: jitendrasahu1803 <jitendra.sahu1803@gmail.com>

Finalise builder-reimage directory structure

de11c53

Signed-off-by: jitendrasahu1803 <jitendra.sahu1803@gmail.com>

builder-reimage.yml: s/preserve-builder-reimage/builder-reimage

4886e81

Signed-off-by: jitendrasahu1803 <jitendra.sahu1803@gmail.com>

Update README with corrected file paths

7c0a612

Signed-off-by: jitendrasahu1803 <jitendra.sahu1803@gmail.com>

djgalloway reviewed Jun 2, 2026

View reviewed changes

Comment thread builder-reimage/build/ansible_runner.sh Outdated

djgalloway reviewed Jun 2, 2026

View reviewed changes

ansible_runner.sh: update usage to include libvirt flag

4cb3d8a

Signed-off-by: jitendrasahu1803 <jitendra.sahu1803@gmail.com>

djgalloway reviewed Jun 2, 2026

View reviewed changes

jitendrasahu1803 added 2 commits June 3, 2026 10:41

get_node_os.py: Add a missing usage and description comments

d308004

sync_labels.py: file is removed as it's not being used Signed-off-by: jitendrasahu1803 <jitendra.sahu1803@gmail.com>

ansible_runner.sh: Add inline comments for variables

65209e4

Signed-off-by: jitendrasahu1803 <jitendra.sahu1803@gmail.com>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add Jenkins pipeline for builder reimage#2602

Add Jenkins pipeline for builder reimage#2602
jitendrasahu1803 wants to merge 9 commits into
mainfrom
builder-reimage-final

jitendrasahu1803 commented Jun 1, 2026

Uh oh!

Uh oh!

djgalloway Jun 2, 2026

Uh oh!

jitendrasahu1803 Jun 3, 2026

Uh oh!

djgalloway Jun 2, 2026

Uh oh!

jitendrasahu1803 Jun 3, 2026

Uh oh!

djgalloway Jun 3, 2026

Uh oh!

jitendrasahu1803 Jun 4, 2026

Uh oh!

djgalloway Jun 2, 2026

Uh oh!

djgalloway Jun 2, 2026

Uh oh!

djgalloway Jun 2, 2026

Uh oh!

jitendrasahu1803 Jun 3, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

		ANSIBLE_DIR="${WORK_DIR}/repos/ansible"
		MAIN_DIR="${WORK_DIR}/repos/main"

Conversation

jitendrasahu1803 commented Jun 1, 2026

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants