nixbot

1these 13 derivations will be built:2  /nix/store/8p7rab78crixv9by68m44v63vfrw76dh-python3.13-nixbot.drv3  /nix/store/6bsxmz0jjwcvjcdbjcln21k8rkf3fqn2-unit-nixbot.service.drv4  /nix/store/hzyq079p0p0agg23f069p55zl8j06fwn-system-units.drv5  /nix/store/49m51a3i847a2indkq64178a91acd0qd-etc.drv6  /nix/store/a1hhsz8rv298g6xhggxlkm82l29fjil1-activate.drv7  /nix/store/1l9mdyp4frkkzg5mdiph0by209lwc698-nixos-system-gitlab-test.drv8  /nix/store/6xnrpwq0mp40yv9vsxmm6y80kq5zjfgq-closure-info.drv9  /nix/store/56ccdiy2d6gny4xh2a7pjj6wc24zjw42-closure-info.drv10  /nix/store/q9asawq3n9y9kdfhxql4clgh0jj1br97-run-nixos-vm.drv11  /nix/store/9a80njijf9saj153628vqkxs0cmavak6-nixos-vm.drv12  /nix/store/4jqmrggkphagbp4nq3zzp3nzvvr52yv3-driverConfiguration.json.drv13  /nix/store/bfj8aglmfal8lralk2m6qng1vzfgi2g0-nixos-test-driver-nixbot-gitlab.drv14  /nix/store/mlzdphhbchzw8d3px7dzvsdwwbmc5pvd-vm-test-run-nixbot-gitlab.drv15building '/nix/store/8p7rab78crixv9by68m44v63vfrw76dh-python3.13-nixbot.drv' on 'ssh-ng://nix@eliza'16building '/nix/store/8p7rab78crixv9by68m44v63vfrw76dh-python3.13-nixbot.drv'17python3.13-nixbot> Sourcing python-remove-tests-dir-hook18python3.13-nixbot> Sourcing python-catch-conflicts-hook.sh19python3.13-nixbot> Sourcing python-remove-bin-bytecode-hook.sh20python3.13-nixbot> Sourcing pypa-build-hook21python3.13-nixbot> Using pypaBuildPhase22python3.13-nixbot> Sourcing python-runtime-deps-check-hook23python3.13-nixbot> Using pythonRuntimeDepsCheckHook24python3.13-nixbot> Sourcing pypa-install-hook25python3.13-nixbot> Using pypaInstallPhase26python3.13-nixbot> Sourcing python-imports-check-hook.sh27python3.13-nixbot> Using pythonImportsCheckPhase28python3.13-nixbot> Sourcing python-namespaces-hook29python3.13-nixbot> Sourcing python-catch-conflicts-hook.sh30python3.13-nixbot> Running phase: unpackPhase31python3.13-nixbot> unpacking source archive /nix/store/4zcvfbpvzcsyfslxj5b69kb8ccgby4c8-nixbot32python3.13-nixbot> source root is nixbot33python3.13-nixbot> setting SOURCE_DATE_EPOCH to timestamp 315619200 of file "nixbot/pyproject.toml"34python3.13-nixbot> Running phase: patchPhase35python3.13-nixbot> Running phase: updateAutotoolsGnuConfigScriptsPhase36python3.13-nixbot> Running phase: configurePhase37python3.13-nixbot> no configure script, doing nothing38python3.13-nixbot> Running phase: buildPhase39python3.13-nixbot> Executing pypaBuildPhase40python3.13-nixbot> Creating a wheel...41python3.13-nixbot> pypa build flags: --no-isolation --outdir dist/ --wheel42python3.13-nixbot> * Getting build dependencies for wheel...43python3.13-nixbot> * Building wheel...44python3.13-nixbot> Successfully built nixbot-0.0.1-py3-none-any.whl45python3.13-nixbot> Finished creating a wheel...46python3.13-nixbot> Finished executing pypaBuildPhase47python3.13-nixbot> Running phase: pythonRuntimeDepsCheckHook48python3.13-nixbot> Executing pythonRuntimeDepsCheck49python3.13-nixbot> Checking runtime dependencies for nixbot-0.0.1-py3-none-any.whl50python3.13-nixbot> Finished executing pythonRuntimeDepsCheck51python3.13-nixbot> Running phase: installPhase52python3.13-nixbot> Executing pypaInstallPhase53python3.13-nixbot> Successfully installed nixbot-0.0.1-py3-none-any.whl54python3.13-nixbot> Finished executing pypaInstallPhase55python3.13-nixbot> Running phase: pythonOutputDistPhase56python3.13-nixbot> Executing pythonOutputDistPhase57python3.13-nixbot> Finished executing pythonOutputDistPhase58python3.13-nixbot> Running phase: fixupPhase59python3.13-nixbot> shrinking RPATHs of ELF executables and libraries in /nix/store/xwyivyzrn9vj1yji0dkcapibs3k77ff4-python3.13-nixbot60python3.13-nixbot> checking for references to /build/ in /nix/store/xwyivyzrn9vj1yji0dkcapibs3k77ff4-python3.13-nixbot...61python3.13-nixbot> patching script interpreter paths in /nix/store/xwyivyzrn9vj1yji0dkcapibs3k77ff4-python3.13-nixbot62python3.13-nixbot> stripping (with command strip and flags -S -p) in  /nix/store/xwyivyzrn9vj1yji0dkcapibs3k77ff4-python3.13-nixbot/lib /nix/store/xwyivyzrn9vj1yji0dkcapibs3k77ff4-python3.13-nixbot/bin63python3.13-nixbot> shrinking RPATHs of ELF executables and libraries in /nix/store/ig53lxhz0f54slhihqrjz2asq01m35ii-python3.13-nixbot-dist64python3.13-nixbot> checking for references to /build/ in /nix/store/ig53lxhz0f54slhihqrjz2asq01m35ii-python3.13-nixbot-dist...65python3.13-nixbot> patching script interpreter paths in /nix/store/ig53lxhz0f54slhihqrjz2asq01m35ii-python3.13-nixbot-dist66python3.13-nixbot> Rewriting #!/nix/store/lqn6mbgzzdrqq2qkwddcmxj9z6amdd86-python3-3.13.13/bin/python3.13 to #!/nix/store/lqn6mbgzzdrqq2qkwddcmxj9z6amdd86-python3-3.13.1367python3.13-nixbot> wrapping `/nix/store/xwyivyzrn9vj1yji0dkcapibs3k77ff4-python3.13-nixbot/bin/nixbot'...68python3.13-nixbot> Executing pythonRemoveTestsDir69python3.13-nixbot> Finished executing pythonRemoveTestsDir70python3.13-nixbot> Running phase: pythonCatchConflictsPhase71python3.13-nixbot> Running phase: pythonRemoveBinBytecodePhase72python3.13-nixbot> Running phase: pythonImportsCheckPhase73python3.13-nixbot> Executing pythonImportsCheckPhase74building '/nix/store/6bsxmz0jjwcvjcdbjcln21k8rkf3fqn2-unit-nixbot.service.drv' on 'ssh-ng://nix@eliza'75building '/nix/store/6bsxmz0jjwcvjcdbjcln21k8rkf3fqn2-unit-nixbot.service.drv'76building '/nix/store/hzyq079p0p0agg23f069p55zl8j06fwn-system-units.drv' on 'ssh-ng://nix@eliza'77building '/nix/store/hzyq079p0p0agg23f069p55zl8j06fwn-system-units.drv'78building '/nix/store/49m51a3i847a2indkq64178a91acd0qd-etc.drv' on 'ssh-ng://nix@eliza'79building '/nix/store/49m51a3i847a2indkq64178a91acd0qd-etc.drv'80building '/nix/store/a1hhsz8rv298g6xhggxlkm82l29fjil1-activate.drv' on 'ssh-ng://nix@eliza'81building '/nix/store/a1hhsz8rv298g6xhggxlkm82l29fjil1-activate.drv'82building '/nix/store/1l9mdyp4frkkzg5mdiph0by209lwc698-nixos-system-gitlab-test.drv' on 'ssh-ng://nix@eliza'83building '/nix/store/1l9mdyp4frkkzg5mdiph0by209lwc698-nixos-system-gitlab-test.drv'84nixos-system-gitlab-test> structuredAttrs is enabled85building '/nix/store/6xnrpwq0mp40yv9vsxmm6y80kq5zjfgq-closure-info.drv' on 'ssh-ng://nix@eliza'86building '/nix/store/6xnrpwq0mp40yv9vsxmm6y80kq5zjfgq-closure-info.drv'87closure-info> structuredAttrs is enabled88building '/nix/store/56ccdiy2d6gny4xh2a7pjj6wc24zjw42-closure-info.drv' on 'ssh-ng://nix@eliza'89building '/nix/store/56ccdiy2d6gny4xh2a7pjj6wc24zjw42-closure-info.drv'90closure-info> structuredAttrs is enabled91building '/nix/store/q9asawq3n9y9kdfhxql4clgh0jj1br97-run-nixos-vm.drv' on 'ssh-ng://nix@eliza'92building '/nix/store/q9asawq3n9y9kdfhxql4clgh0jj1br97-run-nixos-vm.drv'93building '/nix/store/9a80njijf9saj153628vqkxs0cmavak6-nixos-vm.drv' on 'ssh-ng://nix@eliza'94building '/nix/store/9a80njijf9saj153628vqkxs0cmavak6-nixos-vm.drv'95building '/nix/store/4jqmrggkphagbp4nq3zzp3nzvvr52yv3-driverConfiguration.json.drv' on 'ssh-ng://nix@eliza'96building '/nix/store/4jqmrggkphagbp4nq3zzp3nzvvr52yv3-driverConfiguration.json.drv'97driverConfiguration.json> structuredAttrs is enabled98building '/nix/store/bfj8aglmfal8lralk2m6qng1vzfgi2g0-nixos-test-driver-nixbot-gitlab.drv' on 'ssh-ng://nix@eliza'99building '/nix/store/bfj8aglmfal8lralk2m6qng1vzfgi2g0-nixos-test-driver-nixbot-gitlab.drv'100nixos-test-driver-nixbot-gitlab> Running type check (enable/disable: config.skipTypeCheck)101nixos-test-driver-nixbot-gitlab> See https://nixos.org/manual/nixos/stable/#test-opt-skipTypeCheck102nixos-test-driver-nixbot-gitlab> All checks passed!------------------------------------------------- 1/1 files 103nixos-test-driver-nixbot-gitlab> Linting test script (enable/disable: config.skipLint)104nixos-test-driver-nixbot-gitlab> See https://nixos.org/manual/nixos/stable/#test-opt-skipLint105nixos-test-driver-nixbot-gitlab> All checks passed!106building '/nix/store/mlzdphhbchzw8d3px7dzvsdwwbmc5pvd-vm-test-run-nixbot-gitlab.drv' on 'ssh-ng://nix@eliza'107building '/nix/store/mlzdphhbchzw8d3px7dzvsdwwbmc5pvd-vm-test-run-nixbot-gitlab.drv'108vm-test-run-nixbot-gitlab> Machine state will be reset. To keep it, pass --keep-machine-state109vm-test-run-nixbot-gitlab> start all VLans110vm-test-run-nixbot-gitlab> (finished: start all VLans, in 0.00 seconds)111vm-test-run-nixbot-gitlab> Test will time out and terminate in 3600 seconds112vm-test-run-nixbot-gitlab> run the VM test script113vm-test-run-nixbot-gitlab> additionally exposed symbols:114vm-test-run-nixbot-gitlab>     gitlab,115vm-test-run-nixbot-gitlab>     vlan1,116vm-test-run-nixbot-gitlab>     start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh117vm-test-run-nixbot-gitlab> start all VMs118vm-test-run-nixbot-gitlab> gitlab: starting vm119vm-test-run-nixbot-gitlab> gitlab: QEMU running (pid 13)120vm-test-run-nixbot-gitlab> gitlab # Disk image does not exist, creating the virtualisation disk image...121vm-test-run-nixbot-gitlab> gitlab # Formatting '/build/vm-state-gitlab/tmp.EiwMuy8GGX', fmt=raw size=1073741824122vm-test-run-nixbot-gitlab> gitlab # mke2fs 1.47.3 (8-Jul-2025)123vm-test-run-nixbot-gitlab> gitlab # Discarding device blocks:      0/262144             done124vm-test-run-nixbot-gitlab> gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes125vm-test-run-nixbot-gitlab> gitlab # Filesystem UUID: e2322789-1a56-439a-bb03-2f78fa48ecfe126vm-test-run-nixbot-gitlab> gitlab # Superblock backups stored on blocks:127vm-test-run-nixbot-gitlab> gitlab # 	32768, 98304, 163840, 229376128vm-test-run-nixbot-gitlab> gitlab # 129vm-test-run-nixbot-gitlab> gitlab # Allocating group tables: 0/8   done130vm-test-run-nixbot-gitlab> gitlab # Writing inode tables: 0/8   done131vm-test-run-nixbot-gitlab> gitlab # Creating journal (8192 blocks): done132vm-test-run-nixbot-gitlab> gitlab # Writing superblocks and filesystem accounting information: 0/8   done133vm-test-run-nixbot-gitlab> gitlab # 134vm-test-run-nixbot-gitlab> gitlab # Virtualisation disk image created.135vm-test-run-nixbot-gitlab> gitlab # Creating Nix store image...136vm-test-run-nixbot-gitlab> gitlab # Created Nix store image.137vm-test-run-nixbot-gitlab> (finished: start all VMs, in 63.11 seconds)138vm-test-run-nixbot-gitlab> gitlab: waiting for unit setup-gitlab.service139vm-test-run-nixbot-gitlab> gitlab: waiting for the VM to finish booting140vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]141vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Linux version 6.18.34 (nixbld@localhost) (gcc (GCC) 15.2.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Jun  1 15:51:08 UTC 2026142vm-test-run-nixbot-gitlab> gitlab # [    0.000000] KASLR enabled143vm-test-run-nixbot-gitlab> gitlab # [    0.000000] random: crng init done144vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Machine model: linux,dummy-virt145vm-test-run-nixbot-gitlab> gitlab # [    0.000000] efi: UEFI not found.146vm-test-run-nixbot-gitlab> gitlab # [    0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT147vm-test-run-nixbot-gitlab> gitlab # [    0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]148vm-test-run-nixbot-gitlab> gitlab # [    0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]149vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Zone ranges:150vm-test-run-nixbot-gitlab> gitlab # [    0.000000]   DMA      [mem 0x0000000040000000-0x00000000ffffffff]151vm-test-run-nixbot-gitlab> gitlab # [    0.000000]   DMA32    empty152vm-test-run-nixbot-gitlab> gitlab # [    0.000000]   Normal   [mem 0x0000000100000000-0x00000001bfffffff]153vm-test-run-nixbot-gitlab> gitlab # [    0.000000]   Device   empty154vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Movable zone start for each node155vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Early memory node ranges156vm-test-run-nixbot-gitlab> gitlab # [    0.000000]   node   0: [mem 0x0000000040000000-0x00000001bfffffff]157vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]158vm-test-run-nixbot-gitlab> gitlab # [    0.000000] cma: Reserved 32 MiB at 0x00000000fe000000159vm-test-run-nixbot-gitlab> gitlab # [    0.000000] psci: probing for conduit method from DT.160vm-test-run-nixbot-gitlab> gitlab # [    0.000000] psci: PSCIv1.3 detected in firmware.161vm-test-run-nixbot-gitlab> gitlab # [    0.000000] psci: Using standard PSCI v0.2 function IDs162vm-test-run-nixbot-gitlab> gitlab # [    0.000000] psci: Trusted OS migration not required163vm-test-run-nixbot-gitlab> gitlab # [    0.000000] psci: SMC Calling Convention v1.1164vm-test-run-nixbot-gitlab> gitlab # [    0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)165vm-test-run-nixbot-gitlab> gitlab # [    0.000000] percpu: Embedded 76 pages/cpu s185944 r8192 d117160 u311296166vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Detected PIPT I-cache on CPU0167vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)168vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: GICv3 CPU interface169vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: Spectre-v4170vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: Spectre-BHB171vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38172vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23173vm-test-run-nixbot-gitlab> gitlab # [    0.000000] alternatives: applying boot alternatives174vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/bby4xl7gl6wcc57f8k2n5arn3p3kszkn-nixos-system-gitlab-test/init regInfo=/nix/store/i9c7wc6rm8cg9sqzrw31yacw2csjgp8k-closure-info/registration console=ttyAMA0,115200n8 console=tty0175vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Unknown kernel command line parameters "regInfo=/nix/store/i9c7wc6rm8cg9sqzrw31yacw2csjgp8k-closure-info/registration", will be passed to user space.176vm-test-run-nixbot-gitlab> gitlab # [    0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes177vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)178vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)179vm-test-run-nixbot-gitlab> gitlab # [    0.000000] software IO TLB: area num 4.180vm-test-run-nixbot-gitlab> gitlab # [    0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)181vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Fallback order for Node 0: 0182vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 1572864183vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Policy zone: Normal184vm-test-run-nixbot-gitlab> gitlab # [    0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off185vm-test-run-nixbot-gitlab> gitlab # [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1186vm-test-run-nixbot-gitlab> gitlab # [    0.000000] allocated 12582912 bytes of page_ext187vm-test-run-nixbot-gitlab> gitlab # [    0.000000] ftrace: allocating 74648 entries in 292 pages188vm-test-run-nixbot-gitlab> gitlab # [    0.000000] ftrace: allocated 292 pages with 3 groups189vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: Hierarchical RCU implementation.190vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: 	RCU event tracing is enabled.191vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: 	RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.192vm-test-run-nixbot-gitlab> gitlab # [    0.000000] 	Trampoline variant of Tasks RCU enabled.193vm-test-run-nixbot-gitlab> gitlab # [    0.000000] 	Rude variant of Tasks RCU enabled.194vm-test-run-nixbot-gitlab> gitlab # [    0.000000] 	Tracing variant of Tasks RCU enabled.195vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.196vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4197vm-test-run-nixbot-gitlab> gitlab # [    0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.198vm-test-run-nixbot-gitlab> gitlab # [    0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.199vm-test-run-nixbot-gitlab> gitlab # [    0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.200vm-test-run-nixbot-gitlab> gitlab # [    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0201vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: 256 SPIs implemented202vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: 0 Extended SPIs implemented203vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Root IRQ handler: gic_handle_irq204vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI205vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0206vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000207vm-test-run-nixbot-gitlab> gitlab # [    0.000000] ITS [mem 0x08080000-0x0809ffff]208vm-test-run-nixbot-gitlab> gitlab # [    0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f00000 (indirect, esz 8, psz 64K, shr 1)209vm-test-run-nixbot-gitlab> gitlab # [    0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f10000 (flat, esz 8, psz 64K, shr 1)210vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: using LPI property table @0x0000000100f20000211vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000212vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.213vm-test-run-nixbot-gitlab> gitlab # [    0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).214vm-test-run-nixbot-gitlab> gitlab # [    0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns215vm-test-run-nixbot-gitlab> gitlab # [    0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns216vm-test-run-nixbot-gitlab> gitlab # [    0.000029] arm-pv: using stolen time PV217vm-test-run-nixbot-gitlab> gitlab # [    0.000383] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)218vm-test-run-nixbot-gitlab> gitlab # [    0.000575] Console: colour dummy device 80x25219vm-test-run-nixbot-gitlab> gitlab # [    0.000581] printk: legacy console [tty0] enabled220vm-test-run-nixbot-gitlab> gitlab # [    0.000754] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)221vm-test-run-nixbot-gitlab> gitlab # [    0.000761] pid_max: default: 32768 minimum: 301222vm-test-run-nixbot-gitlab> gitlab # [    0.000835] LSM: initializing lsm=capability,landlock,yama,bpf,ima223vm-test-run-nixbot-gitlab> gitlab # [    0.000968] landlock: Up and running.224vm-test-run-nixbot-gitlab> gitlab # [    0.000971] Yama: becoming mindful.225vm-test-run-nixbot-gitlab> gitlab # [    0.001396] LSM support for eBPF active226vm-test-run-nixbot-gitlab> gitlab # [    0.001583] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)227vm-test-run-nixbot-gitlab> gitlab # [    0.001688] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)228vm-test-run-nixbot-gitlab> gitlab # [    0.002798] cacheinfo: Unable to detect cache hierarchy for CPU 0229vm-test-run-nixbot-gitlab> gitlab # [    0.003441] rcu: Hierarchical SRCU implementation.230vm-test-run-nixbot-gitlab> gitlab # [    0.003445] rcu: 	Max phase no-delay instances is 1000.231vm-test-run-nixbot-gitlab> gitlab # [    0.003584] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level232vm-test-run-nixbot-gitlab> gitlab # [    0.004562] fsl-mc MSI: its@8080000 domain created233vm-test-run-nixbot-gitlab> gitlab # [    0.004655] EFI services will not be available.234vm-test-run-nixbot-gitlab> gitlab # [    0.004839] smp: Bringing up secondary CPUs ...235vm-test-run-nixbot-gitlab> gitlab # [    0.005422] Detected PIPT I-cache on CPU1236vm-test-run-nixbot-gitlab> gitlab # [    0.005525] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000237vm-test-run-nixbot-gitlab> gitlab # [    0.005660] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000238vm-test-run-nixbot-gitlab> gitlab # [    0.005786] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]239vm-test-run-nixbot-gitlab> gitlab # [    0.006810] Detected PIPT I-cache on CPU2240vm-test-run-nixbot-gitlab> gitlab # [    0.006965] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000241vm-test-run-nixbot-gitlab> gitlab # [    0.007084] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000242vm-test-run-nixbot-gitlab> gitlab # [    0.007209] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]243vm-test-run-nixbot-gitlab> gitlab # [    0.008130] Detected PIPT I-cache on CPU3244vm-test-run-nixbot-gitlab> gitlab # [    0.008240] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000245vm-test-run-nixbot-gitlab> gitlab # [    0.008359] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000246vm-test-run-nixbot-gitlab> gitlab # [    0.008483] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]247vm-test-run-nixbot-gitlab> gitlab # [    0.008959] smp: Brought up 1 node, 4 CPUs248vm-test-run-nixbot-gitlab> gitlab # [    0.008985] SMP: Total of 4 processors activated.249vm-test-run-nixbot-gitlab> gitlab # [    0.008988] CPU: All CPU(s) started at EL1250vm-test-run-nixbot-gitlab> gitlab # [    0.008996] CPU features: detected: Branch Target Identification251vm-test-run-nixbot-gitlab> gitlab # [    0.008999] CPU features: detected: ARMv8.4 Translation Table Level252vm-test-run-nixbot-gitlab> gitlab # [    0.009002] CPU features: detected: Instruction cache invalidation not required for I/D coherence253vm-test-run-nixbot-gitlab> gitlab # [    0.009005] CPU features: detected: Data cache clean to the PoU not required for I/D coherence254vm-test-run-nixbot-gitlab> gitlab # [    0.009008] CPU features: detected: Common not Private translations255vm-test-run-nixbot-gitlab> gitlab # [    0.009011] CPU features: detected: CRC32 instructions256vm-test-run-nixbot-gitlab> gitlab # [    0.009013] CPU features: detected: Data cache clean to Point of Deep Persistence257vm-test-run-nixbot-gitlab> gitlab # [    0.009016] CPU features: detected: Data cache clean to Point of Persistence258vm-test-run-nixbot-gitlab> gitlab # [    0.009019] CPU features: detected: Data independent timing control (DIT)259vm-test-run-nixbot-gitlab> gitlab # [    0.009022] CPU features: detected: E0PD260vm-test-run-nixbot-gitlab> gitlab # [    0.009024] CPU features: detected: Enhanced Counter Virtualization261vm-test-run-nixbot-gitlab> gitlab # [    0.009027] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)262vm-test-run-nixbot-gitlab> gitlab # [    0.009029] CPU features: detected: Enhanced Virtualization Traps263vm-test-run-nixbot-gitlab> gitlab # [    0.009032] CPU features: detected: Fine Grained Traps264vm-test-run-nixbot-gitlab> gitlab # [    0.009035] CPU features: detected: Generic authentication (architected QARMA5 algorithm)265vm-test-run-nixbot-gitlab> gitlab # [    0.009039] CPU features: detected: RCpc load-acquire (LDAPR)266vm-test-run-nixbot-gitlab> gitlab # [    0.009041] CPU features: detected: LSE atomic instructions267vm-test-run-nixbot-gitlab> gitlab # [    0.009044] CPU features: detected: Privileged Access Never268vm-test-run-nixbot-gitlab> gitlab # [    0.009046] CPU features: detected: PMUv3269vm-test-run-nixbot-gitlab> gitlab # [    0.009049] CPU features: detected: RAS Extension Support270vm-test-run-nixbot-gitlab> gitlab # [    0.009051] CPU features: detected: RASv1p1 Extension Support271vm-test-run-nixbot-gitlab> gitlab # [    0.009054] CPU features: detected: Random Number Generator272vm-test-run-nixbot-gitlab> gitlab # [    0.009056] CPU features: detected: Speculation barrier (SB)273vm-test-run-nixbot-gitlab> gitlab # [    0.009058] CPU features: detected: Stage-2 Force Write-Back274vm-test-run-nixbot-gitlab> gitlab # [    0.009061] CPU features: detected: TLB range maintenance instructions275vm-test-run-nixbot-gitlab> gitlab # [    0.009065] CPU features: detected: Speculative Store Bypassing Safe (SSBS)276vm-test-run-nixbot-gitlab> gitlab # [    0.009193] alternatives: applying system-wide alternatives277vm-test-run-nixbot-gitlab> gitlab # [    0.012051] CPU features: detected: BBM Level 2 without TLB conflict abort278vm-test-run-nixbot-gitlab> gitlab # [    0.012221] Memory: 5965792K/6291456K available (24320K kernel code, 7086K rwdata, 26308K rodata, 4736K init, 1102K bss, 270904K reserved, 32768K cma-reserved)279vm-test-run-nixbot-gitlab> gitlab # [    0.013549] devtmpfs: initialized280vm-test-run-nixbot-gitlab> gitlab # [    0.017309] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns281vm-test-run-nixbot-gitlab> gitlab # [    0.017355] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)282vm-test-run-nixbot-gitlab> gitlab # [    0.017413] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).283vm-test-run-nixbot-gitlab> gitlab # [    0.017609] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL284vm-test-run-nixbot-gitlab> gitlab # [    0.017613] 0 pages in range for non-PLT usage285vm-test-run-nixbot-gitlab> gitlab # [    0.017615] 508336 pages in range for PLT usage286vm-test-run-nixbot-gitlab> gitlab # [    0.017745] pinctrl core: initialized pinctrl subsystem287vm-test-run-nixbot-gitlab> gitlab # [    0.018540] DMI not present or invalid.288vm-test-run-nixbot-gitlab> gitlab # [    0.021594] NET: Registered PF_NETLINK/PF_ROUTE protocol family289vm-test-run-nixbot-gitlab> gitlab # [    0.024023] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations290vm-test-run-nixbot-gitlab> gitlab # [    0.024309] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations291vm-test-run-nixbot-gitlab> gitlab # [    0.025919] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations292vm-test-run-nixbot-gitlab> gitlab # [    0.025942] audit: initializing netlink subsys (disabled)293vm-test-run-nixbot-gitlab> gitlab # [    0.026256] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1294vm-test-run-nixbot-gitlab> gitlab # [    0.026729] thermal_sys: Registered thermal governor 'fair_share'295vm-test-run-nixbot-gitlab> gitlab # [    0.026732] thermal_sys: Registered thermal governor 'bang_bang'296vm-test-run-nixbot-gitlab> gitlab # [    0.026736] thermal_sys: Registered thermal governor 'step_wise'297vm-test-run-nixbot-gitlab> gitlab # [    0.026739] thermal_sys: Registered thermal governor 'user_space'298vm-test-run-nixbot-gitlab> gitlab # [    0.026741] thermal_sys: Registered thermal governor 'power_allocator'299vm-test-run-nixbot-gitlab> gitlab # [    0.026830] cpuidle: using governor ladder300vm-test-run-nixbot-gitlab> gitlab # [    0.026854] cpuidle: using governor menu301vm-test-run-nixbot-gitlab> gitlab # [    0.027047] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.302vm-test-run-nixbot-gitlab> gitlab # [    0.027266] ASID allocator initialised with 65536 entries303vm-test-run-nixbot-gitlab> gitlab # [    0.028430] Serial: AMBA PL011 UART driver304vm-test-run-nixbot-gitlab> gitlab # [    0.033413] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1305vm-test-run-nixbot-gitlab> gitlab # [    0.033723] printk: console [ttyAMA0] enabled306vm-test-run-nixbot-gitlab> gitlab # [    0.043196] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages307vm-test-run-nixbot-gitlab> gitlab # [    0.043217] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page308vm-test-run-nixbot-gitlab> gitlab # [    0.043226] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages309vm-test-run-nixbot-gitlab> gitlab # [    0.043235] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page310vm-test-run-nixbot-gitlab> gitlab # [    0.043243] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages311vm-test-run-nixbot-gitlab> gitlab # [    0.043251] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page312vm-test-run-nixbot-gitlab> gitlab # [    0.043259] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages313vm-test-run-nixbot-gitlab> gitlab # [    0.043267] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page314vm-test-run-nixbot-gitlab> gitlab # [    0.056181] fbcon: Taking over console315vm-test-run-nixbot-gitlab> gitlab # [    0.056191] ACPI: Interpreter disabled.316vm-test-run-nixbot-gitlab> gitlab # [    0.057206] iommu: Default domain type: Translated317vm-test-run-nixbot-gitlab> gitlab # [    0.057222] iommu: DMA domain TLB invalidation policy: strict mode318vm-test-run-nixbot-gitlab> gitlab # [    0.071772] SCSI subsystem initialized319vm-test-run-nixbot-gitlab> gitlab # [    0.072183] usbcore: registered new interface driver usbfs320vm-test-run-nixbot-gitlab> gitlab # [    0.072208] usbcore: registered new interface driver hub321vm-test-run-nixbot-gitlab> gitlab # [    0.072226] usbcore: registered new device driver usb322vm-test-run-nixbot-gitlab> gitlab # [    0.072516] pps_core: LinuxPPS API ver. 1 registered323vm-test-run-nixbot-gitlab> gitlab # [    0.072520] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>324vm-test-run-nixbot-gitlab> gitlab # [    0.072537] PTP clock support registered325vm-test-run-nixbot-gitlab> gitlab # [    0.072584] EDAC MC: Ver: 3.0.0326vm-test-run-nixbot-gitlab> gitlab # [    0.073035] scmi_core: SCMI protocol bus registered327vm-test-run-nixbot-gitlab> gitlab # [    0.074021] FPGA manager framework328vm-test-run-nixbot-gitlab> gitlab # [    0.074702] vgaarb: loaded329vm-test-run-nixbot-gitlab> gitlab # [    0.075677] clocksource: Switched to clocksource arch_sys_counter330vm-test-run-nixbot-gitlab> gitlab # [    0.086897] VFS: Disk quotas dquot_6.6.0331vm-test-run-nixbot-gitlab> gitlab # [    0.086956] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)332vm-test-run-nixbot-gitlab> gitlab # [    0.087775] netfs: FS-Cache loaded333vm-test-run-nixbot-gitlab> gitlab # [    0.088048] pnp: PnP ACPI: disabled334vm-test-run-nixbot-gitlab> gitlab # [    0.098621] NET: Registered PF_INET protocol family335vm-test-run-nixbot-gitlab> gitlab # [    0.100797] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)336vm-test-run-nixbot-gitlab> gitlab # [    0.160455] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)337vm-test-run-nixbot-gitlab> gitlab # [    0.160533] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)338vm-test-run-nixbot-gitlab> gitlab # [    0.160597] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)339vm-test-run-nixbot-gitlab> gitlab # [    0.161070] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)340vm-test-run-nixbot-gitlab> gitlab # [    0.162077] TCP: Hash tables configured (established 65536 bind 65536)341vm-test-run-nixbot-gitlab> gitlab # [    0.162225] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)342vm-test-run-nixbot-gitlab> gitlab # [    0.162297] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)343vm-test-run-nixbot-gitlab> gitlab # [    0.162478] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)344vm-test-run-nixbot-gitlab> gitlab # [    0.162753] NET: Registered PF_UNIX/PF_LOCAL protocol family345vm-test-run-nixbot-gitlab> gitlab # [    0.162777] NET: Registered PF_XDP protocol family346vm-test-run-nixbot-gitlab> gitlab # [    0.162797] PCI: CLS 0 bytes, default 64347vm-test-run-nixbot-gitlab> gitlab # [    0.163137] Trying to unpack rootfs image as initramfs...348vm-test-run-nixbot-gitlab> gitlab # [    0.180240] kvm [1]: HYP mode not available349vm-test-run-nixbot-gitlab> gitlab # [    0.257631] Initialise system trusted keyrings350vm-test-run-nixbot-gitlab> gitlab # [    0.257869] workingset: timestamp_bits=42 max_order=21 bucket_order=0351vm-test-run-nixbot-gitlab> gitlab # [    0.258617] squashfs: version 4.0 (2009/01/31) Phillip Lougher352vm-test-run-nixbot-gitlab> gitlab # [    0.258800] 9p: Installing v9fs 9p2000 file system support353vm-test-run-nixbot-gitlab> gitlab # [    0.274187] Key type asymmetric registered354vm-test-run-nixbot-gitlab> gitlab # [    0.274204] Asymmetric key parser 'x509' registered355vm-test-run-nixbot-gitlab> gitlab # [    0.274258] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)356vm-test-run-nixbot-gitlab> gitlab # [    0.274452] io scheduler mq-deadline registered357vm-test-run-nixbot-gitlab> gitlab # [    0.274462] io scheduler kyber registered358vm-test-run-nixbot-gitlab> gitlab # [    0.290848] pl061_gpio 9030000.pl061: PL061 GPIO chip registered359vm-test-run-nixbot-gitlab> gitlab # [    0.295845] ledtrig-cpu: registered to indicate activity on CPUs360vm-test-run-nixbot-gitlab> gitlab # [    0.296635] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:361vm-test-run-nixbot-gitlab> gitlab # [    0.296662] pci-host-generic 4010000000.pcie:       IO 0x003eff0000..0x003effffff -> 0x0000000000362vm-test-run-nixbot-gitlab> gitlab # [    0.296697] pci-host-generic 4010000000.pcie:      MEM 0x0010000000..0x003efeffff -> 0x0010000000363vm-test-run-nixbot-gitlab> gitlab # [    0.296711] pci-host-generic 4010000000.pcie:      MEM 0x8000000000..0xffffffffff -> 0x8000000000364vm-test-run-nixbot-gitlab> gitlab # [    0.296755] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits365vm-test-run-nixbot-gitlab> gitlab # [    0.296794] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]366vm-test-run-nixbot-gitlab> gitlab # [    0.296927] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00367vm-test-run-nixbot-gitlab> gitlab # [    0.296941] pci_bus 0000:00: root bus resource [bus 00-ff]368vm-test-run-nixbot-gitlab> gitlab # [    0.296950] pci_bus 0000:00: root bus resource [io  0x0000-0xffff]369vm-test-run-nixbot-gitlab> gitlab # [    0.296956] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]370vm-test-run-nixbot-gitlab> gitlab # [    0.296963] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]371vm-test-run-nixbot-gitlab> gitlab # [    0.297140] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint372vm-test-run-nixbot-gitlab> gitlab # [    0.298234] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint373vm-test-run-nixbot-gitlab> gitlab # [    0.298712] pci 0000:00:01.0: BAR 0 [io  0x0000-0x001f]374vm-test-run-nixbot-gitlab> gitlab # [    0.298737] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]375vm-test-run-nixbot-gitlab> gitlab # [    0.298791] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]376vm-test-run-nixbot-gitlab> gitlab # [    0.298815] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]377vm-test-run-nixbot-gitlab> gitlab # [    0.299905] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint378vm-test-run-nixbot-gitlab> gitlab # [    0.300363] pci 0000:00:02.0: BAR 0 [io  0x0000-0x001f]379vm-test-run-nixbot-gitlab> gitlab # [    0.300388] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]380vm-test-run-nixbot-gitlab> gitlab # [    0.300443] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]381vm-test-run-nixbot-gitlab> gitlab # [    0.301550] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint382vm-test-run-nixbot-gitlab> gitlab # [    0.302020] pci 0000:00:03.0: BAR 0 [io  0x0000-0x001f]383vm-test-run-nixbot-gitlab> gitlab # [    0.302044] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]384vm-test-run-nixbot-gitlab> gitlab # [    0.302098] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]385vm-test-run-nixbot-gitlab> gitlab # [    0.303186] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint386vm-test-run-nixbot-gitlab> gitlab # [    0.303643] pci 0000:00:04.0: BAR 0 [io  0x0000-0x001f]387vm-test-run-nixbot-gitlab> gitlab # [    0.303666] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]388vm-test-run-nixbot-gitlab> gitlab # [    0.303762] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]389vm-test-run-nixbot-gitlab> gitlab # [    0.304819] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint390vm-test-run-nixbot-gitlab> gitlab # [    0.305257] pci 0000:00:05.0: BAR 0 [io  0x0000-0x007f]391vm-test-run-nixbot-gitlab> gitlab # [    0.305281] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]392vm-test-run-nixbot-gitlab> gitlab # [    0.305335] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]393vm-test-run-nixbot-gitlab> gitlab # [    0.306430] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint394vm-test-run-nixbot-gitlab> gitlab # [    0.306860] pci 0000:00:06.0: BAR 0 [io  0x0000-0x007f]395vm-test-run-nixbot-gitlab> gitlab # [    0.306884] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]396vm-test-run-nixbot-gitlab> gitlab # [    0.306938] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]397vm-test-run-nixbot-gitlab> gitlab # [    0.308031] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint398vm-test-run-nixbot-gitlab> gitlab # [    0.308448] pci 0000:00:07.0: BAR 0 [io  0x0000-0x001f]399vm-test-run-nixbot-gitlab> gitlab # [    0.308473] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]400vm-test-run-nixbot-gitlab> gitlab # [    0.308526] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]401vm-test-run-nixbot-gitlab> gitlab # [    0.308551] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]402vm-test-run-nixbot-gitlab> gitlab # [    0.309695] pci 0000:00:08.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint403vm-test-run-nixbot-gitlab> gitlab # [    0.310147] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]404vm-test-run-nixbot-gitlab> gitlab # [    0.310201] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]405vm-test-run-nixbot-gitlab> gitlab # [    0.311284] pci 0000:00:09.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint406vm-test-run-nixbot-gitlab> gitlab # [    0.311753] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]407vm-test-run-nixbot-gitlab> gitlab # [    0.311816] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]408vm-test-run-nixbot-gitlab> gitlab # [    0.312711] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint409vm-test-run-nixbot-gitlab> gitlab # [    0.313168] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]410vm-test-run-nixbot-gitlab> gitlab # [    0.313731] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint411vm-test-run-nixbot-gitlab> gitlab # [    0.314250] pci 0000:00:0b.0: BAR 0 [io  0x0000-0x003f]412vm-test-run-nixbot-gitlab> gitlab # [    0.314274] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]413vm-test-run-nixbot-gitlab> gitlab # [    0.314327] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]414vm-test-run-nixbot-gitlab> gitlab # [    0.315454] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint415vm-test-run-nixbot-gitlab> gitlab # [    0.315934] pci 0000:00:0c.0: BAR 0 [io  0x0000-0x001f]416vm-test-run-nixbot-gitlab> gitlab # [    0.315959] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]417vm-test-run-nixbot-gitlab> gitlab # [    0.316013] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]418vm-test-run-nixbot-gitlab> gitlab # [    0.317387] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned419vm-test-run-nixbot-gitlab> gitlab # [    0.317400] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned420vm-test-run-nixbot-gitlab> gitlab # [    0.317408] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned421vm-test-run-nixbot-gitlab> gitlab # [    0.317505] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned422vm-test-run-nixbot-gitlab> gitlab # [    0.317602] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned423vm-test-run-nixbot-gitlab> gitlab # [    0.317703] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned424vm-test-run-nixbot-gitlab> gitlab # [    0.317794] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned425vm-test-run-nixbot-gitlab> gitlab # [    0.317898] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned426vm-test-run-nixbot-gitlab> gitlab # [    0.317995] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned427vm-test-run-nixbot-gitlab> gitlab # [    0.318096] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned428vm-test-run-nixbot-gitlab> gitlab # [    0.318187] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned429vm-test-run-nixbot-gitlab> gitlab # [    0.318277] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned430vm-test-run-nixbot-gitlab> gitlab # [    0.318412] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned431vm-test-run-nixbot-gitlab> gitlab # [    0.318509] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned432vm-test-run-nixbot-gitlab> gitlab # [    0.318547] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned433vm-test-run-nixbot-gitlab> gitlab # [    0.318593] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned434vm-test-run-nixbot-gitlab> gitlab # [    0.318630] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned435vm-test-run-nixbot-gitlab> gitlab # [    0.318674] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned436vm-test-run-nixbot-gitlab> gitlab # [    0.318720] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned437vm-test-run-nixbot-gitlab> gitlab # [    0.318759] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned438vm-test-run-nixbot-gitlab> gitlab # [    0.318805] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned439vm-test-run-nixbot-gitlab> gitlab # [    0.318851] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned440vm-test-run-nixbot-gitlab> gitlab # [    0.318890] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned441vm-test-run-nixbot-gitlab> gitlab # [    0.318928] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned442vm-test-run-nixbot-gitlab> gitlab # [    0.318967] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned443vm-test-run-nixbot-gitlab> gitlab # [    0.319004] pci 0000:00:05.0: BAR 0 [io  0x1000-0x107f]: assigned444vm-test-run-nixbot-gitlab> gitlab # [    0.319040] pci 0000:00:06.0: BAR 0 [io  0x1080-0x10ff]: assigned445vm-test-run-nixbot-gitlab> gitlab # [    0.319077] pci 0000:00:0b.0: BAR 0 [io  0x1100-0x113f]: assigned446vm-test-run-nixbot-gitlab> gitlab # [    0.319123] pci 0000:00:01.0: BAR 0 [io  0x1140-0x115f]: assigned447vm-test-run-nixbot-gitlab> gitlab # [    0.319160] pci 0000:00:02.0: BAR 0 [io  0x1160-0x117f]: assigned448vm-test-run-nixbot-gitlab> gitlab # [    0.319197] pci 0000:00:03.0: BAR 0 [io  0x1180-0x119f]: assigned449vm-test-run-nixbot-gitlab> gitlab # [    0.319234] pci 0000:00:04.0: BAR 0 [io  0x11a0-0x11bf]: assigned450vm-test-run-nixbot-gitlab> gitlab # [    0.319272] pci 0000:00:07.0: BAR 0 [io  0x11c0-0x11df]: assigned451vm-test-run-nixbot-gitlab> gitlab # [    0.319312] pci 0000:00:0c.0: BAR 0 [io  0x11e0-0x11ff]: assigned452vm-test-run-nixbot-gitlab> gitlab # [    0.319356] pci_bus 0000:00: resource 4 [io  0x0000-0xffff]453vm-test-run-nixbot-gitlab> gitlab # [    0.319367] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]454vm-test-run-nixbot-gitlab> gitlab # [    0.319374] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]455vm-test-run-nixbot-gitlab> gitlab # [    0.322387] pci 0000:00:0a.0: enabling device (0000 -> 0002)456vm-test-run-nixbot-gitlab> gitlab # [    0.354470] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)457vm-test-run-nixbot-gitlab> gitlab # [    0.359811] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)458vm-test-run-nixbot-gitlab> gitlab # [    0.365082] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)459vm-test-run-nixbot-gitlab> gitlab # [    0.371287] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)460vm-test-run-nixbot-gitlab> gitlab # [    0.376328] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)461vm-test-run-nixbot-gitlab> gitlab # [    0.382781] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)462vm-test-run-nixbot-gitlab> gitlab # [    0.387773] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)463vm-test-run-nixbot-gitlab> gitlab # [    0.392875] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)464vm-test-run-nixbot-gitlab> gitlab # [    0.398952] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)465vm-test-run-nixbot-gitlab> gitlab # [    0.404110] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)466vm-test-run-nixbot-gitlab> gitlab # [    0.411416] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)467vm-test-run-nixbot-gitlab> gitlab # [    0.425466] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled468vm-test-run-nixbot-gitlab> gitlab # [    0.430015] msm_serial: driver initialized469vm-test-run-nixbot-gitlab> gitlab # [    0.430361] SuperH (H)SCI(F) driver initialized470vm-test-run-nixbot-gitlab> gitlab # [    0.430480] STM32 USART driver initialized471vm-test-run-nixbot-gitlab> gitlab # [    0.480703] loop: module loaded472vm-test-run-nixbot-gitlab> gitlab # [    0.481294] virtio_blk virtio4: 4/0/0 default/read/poll queues473vm-test-run-nixbot-gitlab> gitlab # [    0.485942] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)474vm-test-run-nixbot-gitlab> gitlab # [    0.490106] virtio_blk virtio5: 4/0/0 default/read/poll queues475vm-test-run-nixbot-gitlab> gitlab # [    0.494690] virtio_blk virtio5: [vdb] 11846144 512-byte logical blocks (6.07 GB/5.65 GiB)476vm-test-run-nixbot-gitlab> gitlab # [    0.499502] megasas: 07.734.00.00-rc1477vm-test-run-nixbot-gitlab> gitlab # [    0.501492] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]478vm-test-run-nixbot-gitlab> gitlab # [    0.509706] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000479vm-test-run-nixbot-gitlab> gitlab # [    0.509743] Intel/Sharp Extended Query Table at 0x0031480vm-test-run-nixbot-gitlab> gitlab # [    0.514799] Using buffer write method481vm-test-run-nixbot-gitlab> gitlab # [    0.514865] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]482vm-test-run-nixbot-gitlab> gitlab # [    0.518961] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000483vm-test-run-nixbot-gitlab> gitlab # [    0.519029] Intel/Sharp Extended Query Table at 0x0031484vm-test-run-nixbot-gitlab> gitlab # [    0.523908] Using buffer write method485vm-test-run-nixbot-gitlab> gitlab # [    0.523940] Concatenating MTD devices:486vm-test-run-nixbot-gitlab> gitlab # [    0.523946] (0): "0.flash"487vm-test-run-nixbot-gitlab> gitlab # [    0.523952] (1): "0.flash"488vm-test-run-nixbot-gitlab> gitlab # [    0.523958] into device "0.flash"489vm-test-run-nixbot-gitlab> gitlab # [    0.680086] Freeing initrd memory: 25372K490vm-test-run-nixbot-gitlab> gitlab # [    0.698810] tun: Universal TUN/TAP device driver, 1.6491vm-test-run-nixbot-gitlab> gitlab # [    0.706824] thunder_xcv, ver 1.0492vm-test-run-nixbot-gitlab> gitlab # [    0.706930] thunder_bgx, ver 1.0493vm-test-run-nixbot-gitlab> gitlab # [    0.707012] nicpf, ver 1.0494vm-test-run-nixbot-gitlab> gitlab # [    0.708722] e1000: Intel(R) PRO/1000 Network Driver495vm-test-run-nixbot-gitlab> gitlab # [    0.708735] e1000: Copyright (c) 1999-2006 Intel Corporation.496vm-test-run-nixbot-gitlab> gitlab # [    0.708824] e1000e: Intel(R) PRO/1000 Network Driver497vm-test-run-nixbot-gitlab> gitlab # [    0.708838] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.498vm-test-run-nixbot-gitlab> gitlab # [    0.708935] igb: Intel(R) Gigabit Ethernet Network Driver499vm-test-run-nixbot-gitlab> gitlab # [    0.708945] igb: Copyright (c) 2007-2014 Intel Corporation.500vm-test-run-nixbot-gitlab> gitlab # [    0.709027] igbvf: Intel(R) Gigabit Virtual Function Network Driver501vm-test-run-nixbot-gitlab> gitlab # [    0.709038] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.502vm-test-run-nixbot-gitlab> gitlab # [    0.709427] sky2: driver version 1.30503vm-test-run-nixbot-gitlab> gitlab # [    0.714373] usbcore: registered new interface driver usb-storage504vm-test-run-nixbot-gitlab> gitlab # [    0.714732] ehci-pci 0000:00:0a.0: EHCI Host Controller505vm-test-run-nixbot-gitlab> gitlab # [    0.714739] usbcore: registered new interface driver usbserial_generic506vm-test-run-nixbot-gitlab> gitlab # [    0.714780] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1507vm-test-run-nixbot-gitlab> gitlab # [    0.714818] usbserial: USB Serial support registered for generic508vm-test-run-nixbot-gitlab> gitlab # [    0.715306] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000509vm-test-run-nixbot-gitlab> gitlab # [    0.716691] hv_vmbus: registering driver hyperv_keyboard510vm-test-run-nixbot-gitlab> gitlab # [    0.719384] rtc-pl031 9010000.pl031: registered as rtc0511vm-test-run-nixbot-gitlab> gitlab # [    0.719444] rtc-pl031 9010000.pl031: setting system clock to 2026-06-08T13:14:37 UTC (1780924477)512vm-test-run-nixbot-gitlab> gitlab # [    0.720383] i2c_dev: i2c /dev entries driver513vm-test-run-nixbot-gitlab> gitlab # [    0.727789] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00514vm-test-run-nixbot-gitlab> gitlab # [    0.728766] hub 1-0:1.0: USB hub found515vm-test-run-nixbot-gitlab> gitlab # [    0.728784] sdhci: Secure Digital Host Controller Interface driver516vm-test-run-nixbot-gitlab> gitlab # [    0.728804] sdhci: Copyright(c) Pierre Ossman517vm-test-run-nixbot-gitlab> gitlab # [    0.728811] hub 1-0:1.0: 6 ports detected518vm-test-run-nixbot-gitlab> gitlab # [    0.729678] Synopsys Designware Multimedia Card Interface Driver519vm-test-run-nixbot-gitlab> gitlab # [    0.730821] sdhci-pltfm: SDHCI platform and OF driver helper520vm-test-run-nixbot-gitlab> gitlab # [    0.735812] hid: raw HID events driver (C) Jiri Kosina521vm-test-run-nixbot-gitlab> gitlab # [    0.736653] usbcore: registered new interface driver usbhid522vm-test-run-nixbot-gitlab> gitlab # [    0.736664] usbhid: USB HID core driver523vm-test-run-nixbot-gitlab> gitlab # [    0.745299] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available524vm-test-run-nixbot-gitlab> gitlab # [    0.749644] drop_monitor: Initializing network drop monitor service525vm-test-run-nixbot-gitlab> gitlab # [    0.750000] NET: Registered PF_INET6 protocol family526vm-test-run-nixbot-gitlab> gitlab # [    0.751708] Segment Routing with IPv6527vm-test-run-nixbot-gitlab> gitlab # [    0.751744] In-situ OAM (IOAM) with IPv6528vm-test-run-nixbot-gitlab> gitlab # [    0.751808] NET: Registered PF_PACKET protocol family529vm-test-run-nixbot-gitlab> gitlab # [    0.752208] 9pnet: Installing 9P2000 support530vm-test-run-nixbot-gitlab> gitlab # [    0.756088] Key type dns_resolver registered531vm-test-run-nixbot-gitlab> gitlab # [    0.773176] registered taskstats version 1532vm-test-run-nixbot-gitlab> gitlab # [    0.773633] Loading compiled-in X.509 certificates533vm-test-run-nixbot-gitlab> gitlab # [    0.794141] Demotion targets for Node 0: null534vm-test-run-nixbot-gitlab> gitlab # [    0.794367] Key type .fscrypt registered535vm-test-run-nixbot-gitlab> gitlab # [    0.794375] Key type fscrypt-provisioning registered536vm-test-run-nixbot-gitlab> gitlab # [    0.794584] ima: No TPM chip found, activating TPM-bypass!537vm-test-run-nixbot-gitlab> gitlab # [    0.794608] ima: Allocated hash algorithm: sha1538vm-test-run-nixbot-gitlab> gitlab # [    0.794635] ima: No architecture policies found539vm-test-run-nixbot-gitlab> gitlab # [    0.795817] input: gpio-keys as /devices/platform/gpio-keys/input/input0540vm-test-run-nixbot-gitlab> gitlab # [    0.819599] clk: Disabling unused clocks541vm-test-run-nixbot-gitlab> gitlab # [    0.819624] PM: genpd: Disabling unused power domains542vm-test-run-nixbot-gitlab> gitlab # [    0.823962] Freeing unused kernel memory: 4736K543vm-test-run-nixbot-gitlab> gitlab # [    0.824171] Run /init as init process544vm-test-run-nixbot-gitlab> gitlab # [    0.850101] systemd[1]: Successfully made /usr/ read-only.545vm-test-run-nixbot-gitlab> gitlab # [    0.975751] usb 1-1: new high-speed USB device number 2 using ehci-pci546vm-test-run-nixbot-gitlab> gitlab # [    1.128135] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1547vm-test-run-nixbot-gitlab> gitlab # [    1.184527] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)548vm-test-run-nixbot-gitlab> gitlab # [    1.184587] systemd[1]: Detected virtualization qemu.549vm-test-run-nixbot-gitlab> gitlab # [    1.184639] systemd[1]: Detected architecture arm64.550vm-test-run-nixbot-gitlab> gitlab # [    1.184655] systemd[1]: Running in initrd.551vm-test-run-nixbot-gitlab> gitlab # [    1.185566] systemd[1]: Initializing machine ID from random generator.552vm-test-run-nixbot-gitlab> gitlab # [    1.185827] systemd[1]: Hostname set to <gitlab>.553vm-test-run-nixbot-gitlab> gitlab # [    1.268281] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0554vm-test-run-nixbot-gitlab> gitlab # [    1.327918] systemd[1]: Queued start job for default target Initrd Default Target.555vm-test-run-nixbot-gitlab> gitlab # [    1.387777] usb 1-2: new high-speed USB device number 3 using ehci-pci556vm-test-run-nixbot-gitlab> gitlab # [    1.548009] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2557vm-test-run-nixbot-gitlab> gitlab # [    1.548607] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0558vm-test-run-nixbot-gitlab> gitlab # [    1.569238] systemd[1]: Created slice Slice /system/modprobe.559vm-test-run-nixbot-gitlab> gitlab # [    1.569766] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.560vm-test-run-nixbot-gitlab> gitlab # [    1.569834] systemd[1]: Expecting device /dev/disk/by-label/nix-store...561vm-test-run-nixbot-gitlab> gitlab # [    1.569865] systemd[1]: Expecting device /dev/disk/by-label/nixos...562vm-test-run-nixbot-gitlab> gitlab # [    1.569920] systemd[1]: Reached target Path Units.563vm-test-run-nixbot-gitlab> gitlab # [    1.569958] systemd[1]: Reached target Slice Units.564vm-test-run-nixbot-gitlab> gitlab # [    1.570000] systemd[1]: Reached target Swaps.565vm-test-run-nixbot-gitlab> gitlab # [    1.570047] systemd[1]: Reached target Timer Units.566vm-test-run-nixbot-gitlab> gitlab # [    1.570463] systemd[1]: Listening on D-Bus System Message Bus Socket.567vm-test-run-nixbot-gitlab> gitlab # [    1.570810] systemd[1]: Listening on Journal Socket (/dev/log).568vm-test-run-nixbot-gitlab> gitlab # [    1.571138] systemd[1]: Listening on Journal Sockets.569vm-test-run-nixbot-gitlab> gitlab # [    1.571448] systemd[1]: Listening on udev Control Socket.570vm-test-run-nixbot-gitlab> gitlab # [    1.571728] systemd[1]: Listening on udev Kernel Socket.571vm-test-run-nixbot-gitlab> gitlab # [    1.571777] systemd[1]: Reached target Socket Units.572vm-test-run-nixbot-gitlab> gitlab # [    1.578815] systemd[1]: Starting Create List of Static Device Nodes...573vm-test-run-nixbot-gitlab> gitlab # [    1.586289] systemd[1]: Starting Load Kernel Module 9pnet_virtio...574vm-test-run-nixbot-gitlab> gitlab # [    1.586464] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs575vm-test-run-nixbot-gitlab> gitlab # [    1.594367] systemd[1]: Mounting Kernel Configuration File System...576vm-test-run-nixbot-gitlab> gitlab # [    1.615508] systemd[1]: Starting Journal Service...577vm-test-run-nixbot-gitlab> gitlab # [    1.624019] systemd[1]: Starting Load Kernel Modules...578vm-test-run-nixbot-gitlab> gitlab # [    1.624189] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki579vm-test-run-nixbot-gitlab> gitlab # [    1.631885] systemd[1]: Starting Coldplug All udev Devices...580vm-test-run-nixbot-gitlab> gitlab # [    1.650981] systemd[1]: Finished Create List of Static Device Nodes.581vm-test-run-nixbot-gitlab> gitlab # [    1.653139] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.582vm-test-run-nixbot-gitlab> gitlab # [    1.660471] systemd[1]: Finished Load Kernel Module 9pnet_virtio.583vm-test-run-nixbot-gitlab> gitlab # [    1.670854] systemd-journald[155]: Collecting audit messages is disabled.584vm-test-run-nixbot-gitlab> gitlab # [    1.671929] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.585vm-test-run-nixbot-gitlab> gitlab # [    1.672226] systemd[1]: Mounted Kernel Configuration File System.586vm-test-run-nixbot-gitlab> gitlab # [    1.677964] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev587vm-test-run-nixbot-gitlab> gitlab # [    1.683510] [drm] pci: virtio-gpu-pci detected at 0000:00:09.0588vm-test-run-nixbot-gitlab> gitlab # [    1.683836] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...589vm-test-run-nixbot-gitlab> gitlab # [    1.683985] [drm] features: -virgl +edid -resource_blob -host_visible590vm-test-run-nixbot-gitlab> gitlab # [    1.683993] [drm] features: -context_init591vm-test-run-nixbot-gitlab> gitlab # [    1.685484] [drm] number of scanouts: 1592vm-test-run-nixbot-gitlab> gitlab # [    1.685506] [drm] number of cap sets: 0593vm-test-run-nixbot-gitlab> gitlab # [    1.690158] virtio-pci 0000:00:09.0: [drm] Registered 1 planes with drm panic594vm-test-run-nixbot-gitlab> gitlab # [    1.690171] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:09.0 on minor 0595vm-test-run-nixbot-gitlab> gitlab # [    1.705306] Console: switching to colour frame buffer device 160x50596vm-test-run-nixbot-gitlab> gitlab # [    1.711174] virtio-pci 0000:00:09.0: [drm] fb0: virtio_gpudrmfb frame buffer device597vm-test-run-nixbot-gitlab> gitlab # [    1.725980] systemd[1]: Finished Load Kernel Modules.598vm-test-run-nixbot-gitlab> gitlab # [    1.731042] systemd[1]: Starting Apply Kernel Variables...599vm-test-run-nixbot-gitlab> gitlab # [    1.752495] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.600vm-test-run-nixbot-gitlab> gitlab # [    1.753879] systemd[1]: Started Journal Service.601vm-test-run-nixbot-gitlab> gitlab # [    1.748726] systemd-modules-load[157]: Using 4 probe threads602vm-test-run-nixbot-gitlab> gitlab # [    1.752891] systemd-modules-load[157]: Module 'virtio_balloon' is built in603vm-test-run-nixbot-gitlab> gitlab # [    1.754069] systemd-modules-load[157]: Module 'virtio_console' is built in604vm-test-run-nixbot-gitlab> gitlab # [    1.755217] systemd-modules-load[157]: Module 'virtio_rng' is built in605vm-test-run-nixbot-gitlab> gitlab # [    1.756266] systemd-modules-load[157]: Inserted module 'dm_mod'606vm-test-run-nixbot-gitlab> gitlab # [    1.757226] systemd-modules-load[157]: Inserted module 'virtio_gpu'607vm-test-run-nixbot-gitlab> gitlab # [    1.758202] systemd[1]: Starting Create Static Device Nodes in /dev...608vm-test-run-nixbot-gitlab> gitlab # [    1.813060] systemd[1]: Finished Apply Kernel Variables.609vm-test-run-nixbot-gitlab> gitlab # [    1.833247] systemd[1]: Finished Create Static Device Nodes in /dev.610vm-test-run-nixbot-gitlab> gitlab # [    1.835842] systemd[1]: Reached target Preparation for Local File Systems.611vm-test-run-nixbot-gitlab> gitlab # [    1.838743] systemd[1]: Reached target Local File Systems.612vm-test-run-nixbot-gitlab> gitlab # [    1.841584] systemd[1]: Starting Create System Files and Directories...613vm-test-run-nixbot-gitlab> gitlab # [    1.850905] systemd[1]: Starting Rule-based Manager for Device Events and Files...614vm-test-run-nixbot-gitlab> gitlab # [    1.885335] systemd[1]: Finished Create System Files and Directories.615vm-test-run-nixbot-gitlab> gitlab # [    1.905129] systemd-udevd[192]: Using default interface naming scheme 'v260'.616vm-test-run-nixbot-gitlab> gitlab # [    1.929228] systemd[1]: Started Rule-based Manager for Device Events and Files.617vm-test-run-nixbot-gitlab> gitlab # [    1.967506] systemd[1]: Starting Virtual Console Setup...618vm-test-run-nixbot-gitlab> gitlab # [    2.035596] systemd-vconsole-setup[209]: Configuration of first virtual console was skipped, ignoring remaining ones.619vm-test-run-nixbot-gitlab> gitlab # [    2.041796] systemd[1]: Finished Virtual Console Setup.620vm-test-run-nixbot-gitlab> gitlab # [    2.354073] systemd[1]: Finished Coldplug All udev Devices.621vm-test-run-nixbot-gitlab> gitlab # [    2.356514] systemd[1]: Reached target System Initialization.622vm-test-run-nixbot-gitlab> gitlab # [    2.358817] systemd[1]: Reached target Basic System.623vm-test-run-nixbot-gitlab> gitlab # [    2.568440] (udev-worker)[228]: Network interface NamePolicy= disabled on kernel command line.624vm-test-run-nixbot-gitlab> gitlab # [    2.607476] systemd[1]: Found device /dev/disk/by-label/nixos.625vm-test-run-nixbot-gitlab> gitlab # [    2.609277] systemd[1]: Reached target Initrd Root Device.626vm-test-run-nixbot-gitlab> gitlab # [    2.616120] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...627vm-test-run-nixbot-gitlab> gitlab # [    2.618459] (udev-worker)[223]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.628vm-test-run-nixbot-gitlab> gitlab # [    2.624279] (udev-worker)[223]: Network interface NamePolicy= disabled on kernel command line.629vm-test-run-nixbot-gitlab> gitlab # [    2.627464] systemd[1]: Found device /dev/disk/by-label/nix-store.630vm-test-run-nixbot-gitlab> gitlab # [    2.657209] systemd-fsck[234]: nixos: clean, 12/65536 files, 13019/262144 blocks631vm-test-run-nixbot-gitlab> gitlab # [    2.665514] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.632vm-test-run-nixbot-gitlab> gitlab # [    2.672646] systemd[1]: Mounting /sysroot...633vm-test-run-nixbot-gitlab> gitlab # [    2.712867] EXT4-fs (vda): mounted filesystem e2322789-1a56-439a-bb03-2f78fa48ecfe r/w with ordered data mode. Quota mode: none.634vm-test-run-nixbot-gitlab> gitlab # [    2.713013] systemd[1]: Mounted /sysroot.635vm-test-run-nixbot-gitlab> gitlab # [    2.714336] systemd[1]: Reached target Initrd Root File System.636vm-test-run-nixbot-gitlab> gitlab # [    2.718196] systemd[1]: Mounting /sysroot/nix/.ro-store...637vm-test-run-nixbot-gitlab> gitlab # [    2.723351] systemd[1]: Mounting /sysroot/nix/.rw-store...638vm-test-run-nixbot-gitlab> gitlab # [    2.737628] systemd[1]: Mounting /sysroot/run...639vm-test-run-nixbot-gitlab> gitlab # [    2.746881] systemd[1]: Mounting /sysroot/tmp/shared...640vm-test-run-nixbot-gitlab> gitlab # [    2.755405] systemd[1]: Mounting /sysroot/tmp/xchg...641vm-test-run-nixbot-gitlab> gitlab # [    2.761925] erofs (device vdb): mounted with root inode @ nid 128.642vm-test-run-nixbot-gitlab> gitlab # [    2.761763] systemd[1]: Starting Mountpoints Configured in the Real Root...643vm-test-run-nixbot-gitlab> gitlab # [    2.769472] systemd[1]: Mounted /sysroot/nix/.ro-store.644vm-test-run-nixbot-gitlab> gitlab # [    2.770637] systemd[1]: Mounted /sysroot/nix/.rw-store.645vm-test-run-nixbot-gitlab> gitlab # [    2.773281] systemd[1]: Mounted /sysroot/run.646vm-test-run-nixbot-gitlab> gitlab # [    2.774254] systemd[1]: Mounted /sysroot/tmp/shared.647vm-test-run-nixbot-gitlab> gitlab # [    2.776117] systemd[1]: Starting rw-sysroot-nix-store.service...648vm-test-run-nixbot-gitlab> gitlab # [    2.778000] systemd-sysroot-fstab-check[257]: /sysroot should be mounted in the initrd, will request daemon-reload.649vm-test-run-nixbot-gitlab> gitlab # [    2.781197] systemd[1]: Mounted /sysroot/tmp/xchg.650vm-test-run-nixbot-gitlab> gitlab # [    2.784934] systemd[1]: Reload requested from client PID 257 ('systemd-sysroot') (unit initrd-parse-etc.service)...651vm-test-run-nixbot-gitlab> gitlab # [    2.786814] systemd[1]: Reloading...652vm-test-run-nixbot-gitlab> gitlab # [    3.082767] systemd[1]: Reloading finished in 297 ms.653vm-test-run-nixbot-gitlab> gitlab # [    3.135274] systemd-sysroot-fstab-check[257]: Requesting initrd-fs.target/start/replace...654vm-test-run-nixbot-gitlab> gitlab # [    3.225373] (udev-worker)[223]: mtd0ro: Failed to find and pin callout binary "/nix/store/3x4plcsrj2r4mmzis46wrmyka8g4jhi8-systemd-260.1/lib/udev/mtd_probe": No such file or directory655vm-test-run-nixbot-gitlab> gitlab # [    3.229003] (udev-worker)[223]: mtd0ro: /nix/store/3x4plcsrj2r4mmzis46wrmyka8g4jhi8-systemd-260.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory656vm-test-run-nixbot-gitlab> gitlab # [    3.234277] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.657vm-test-run-nixbot-gitlab> gitlab # [    3.235740] systemd[1]: Finished rw-sysroot-nix-store.service.658vm-test-run-nixbot-gitlab> gitlab # [    3.240312] systemd-sysroot-fstab-check[257]: Requesting swap.target/start/replace...659vm-test-run-nixbot-gitlab> gitlab # [    3.245260] systemd[1]: initrd-parse-etc.service: Deactivated successfully.660vm-test-run-nixbot-gitlab> gitlab # [    3.247063] systemd[1]: Finished Mountpoints Configured in the Real Root.661vm-test-run-nixbot-gitlab> gitlab # [    3.247943] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.662vm-test-run-nixbot-gitlab> gitlab # [    3.257864] systemd[1]: Starting rw-sysroot-nix-store.service...663vm-test-run-nixbot-gitlab> gitlab # [    3.258707] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.664vm-test-run-nixbot-gitlab> gitlab # [    3.259646] systemd[1]: Stopped Virtual Console Setup.665vm-test-run-nixbot-gitlab> gitlab # [    3.263354] systemd[1]: Stopping Virtual Console Setup...666vm-test-run-nixbot-gitlab> gitlab # [    3.284810] systemd[1]: Starting Virtual Console Setup...667vm-test-run-nixbot-gitlab> gitlab # [    3.287880] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.668vm-test-run-nixbot-gitlab> gitlab # [    3.290349] systemd[1]: Finished rw-sysroot-nix-store.service.669vm-test-run-nixbot-gitlab> gitlab # [    3.307751] systemd-vconsole-setup[486]: Configuration of first virtual console was skipped, ignoring remaining ones.670vm-test-run-nixbot-gitlab> gitlab # [    3.311885] systemd[1]: Finished Virtual Console Setup.671vm-test-run-nixbot-gitlab> gitlab # [    3.652677] systemd[1]: Mounting /sysroot/nix/store...672vm-test-run-nixbot-gitlab> gitlab # [    3.717740] systemd[1]: Mounted /sysroot/nix/store.673vm-test-run-nixbot-gitlab> gitlab # [    3.720113] systemd[1]: Reached target Initrd File Systems.674vm-test-run-nixbot-gitlab> gitlab # [    3.726022] systemd[1]: Starting Find NixOS closure...675vm-test-run-nixbot-gitlab> gitlab # [    3.733542] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...676vm-test-run-nixbot-gitlab> gitlab # [    3.779890] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.677vm-test-run-nixbot-gitlab> gitlab # [    3.783808] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.678vm-test-run-nixbot-gitlab> gitlab # [    3.807371] systemd[1]: Finished Find NixOS closure.679vm-test-run-nixbot-gitlab> gitlab # [    3.809820] systemd[1]: Reached target Initrd Default Target.680vm-test-run-nixbot-gitlab> gitlab # [    3.817234] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...681vm-test-run-nixbot-gitlab> gitlab # [    3.878152] systemd[1]: Stopped target Initrd Default Target.682vm-test-run-nixbot-gitlab> gitlab # [    3.880581] systemd[1]: Stopped target Basic System.683vm-test-run-nixbot-gitlab> gitlab # [    3.882626] systemd[1]: Stopped target Initrd Root Device.684vm-test-run-nixbot-gitlab> gitlab # [    3.885039] systemd[1]: Stopped target Path Units.685vm-test-run-nixbot-gitlab> gitlab # [    3.887077] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.686vm-test-run-nixbot-gitlab> gitlab # [    3.890241] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.687vm-test-run-nixbot-gitlab> gitlab # [    3.893373] systemd[1]: Stopped target Slice Units.688vm-test-run-nixbot-gitlab> gitlab # [    3.895399] systemd[1]: Stopped target Socket Units.689vm-test-run-nixbot-gitlab> gitlab # [    3.897557] systemd[1]: Stopped target System Initialization.690vm-test-run-nixbot-gitlab> gitlab # [    3.899905] systemd[1]: Stopped target Swaps.691vm-test-run-nixbot-gitlab> gitlab # [    3.901824] systemd[1]: Stopped target Timer Units.692vm-test-run-nixbot-gitlab> gitlab # [    3.903883] systemd[1]: dbus.socket: Deactivated successfully.693vm-test-run-nixbot-gitlab> gitlab # [    3.906399] systemd[1]: Closed D-Bus System Message Bus Socket.694vm-test-run-nixbot-gitlab> gitlab # [    3.908806] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.695vm-test-run-nixbot-gitlab> gitlab # [    3.911790] systemd[1]: Stopped Find NixOS closure.696vm-test-run-nixbot-gitlab> gitlab # [    3.914006] systemd[1]: Starting Load Kernel Module 9pnet_virtio...697vm-test-run-nixbot-gitlab> gitlab # [    3.916999] systemd[1]: Starting rw-sysroot-nix-store.service...698vm-test-run-nixbot-gitlab> gitlab # [    3.919524] systemd[1]: systemd-sysctl.service: Deactivated successfully.699vm-test-run-nixbot-gitlab> gitlab # [    3.922444] systemd[1]: Stopped Apply Kernel Variables.700vm-test-run-nixbot-gitlab> gitlab # [    3.927204] systemd[1]: systemd-modules-load.service: Deactivated successfully.701vm-test-run-nixbot-gitlab> gitlab # [    3.930244] systemd[1]: Stopped Load Kernel Modules.702vm-test-run-nixbot-gitlab> gitlab # [    3.936596] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.703vm-test-run-nixbot-gitlab> gitlab # [    3.939878] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.704vm-test-run-nixbot-gitlab> gitlab # [    3.948424] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.705vm-test-run-nixbot-gitlab> gitlab # [    3.951349] systemd[1]: Stopped Create System Files and Directories.706vm-test-run-nixbot-gitlab> gitlab # [    3.957825] systemd[1]: Stopped target Local File Systems.707vm-test-run-nixbot-gitlab> gitlab # [    3.960105] systemd[1]: Stopped target Preparation for Local File Systems.708vm-test-run-nixbot-gitlab> gitlab # [    3.962796] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.709vm-test-run-nixbot-gitlab> gitlab # [    3.965780] systemd[1]: Stopped Coldplug All udev Devices.710vm-test-run-nixbot-gitlab> gitlab # [    3.968078] systemd[1]: Stopping Rule-based Manager for Device Events and Files...711vm-test-run-nixbot-gitlab> gitlab # [    3.971041] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.712vm-test-run-nixbot-gitlab> gitlab # [    3.974102] systemd[1]: Stopped Virtual Console Setup.713vm-test-run-nixbot-gitlab> gitlab # [    3.989595] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.714vm-test-run-nixbot-gitlab> gitlab # [    3.994791] systemd[1]: Finished Load Kernel Module 9pnet_virtio.715vm-test-run-nixbot-gitlab> gitlab # [    4.005098] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.716vm-test-run-nixbot-gitlab> gitlab # [    4.009776] systemd[1]: Finished rw-sysroot-nix-store.service.717vm-test-run-nixbot-gitlab> gitlab # [    4.019364] systemd[1]: systemd-udevd.service: Deactivated successfully.718vm-test-run-nixbot-gitlab> gitlab # [    4.024195] systemd[1]: Stopped Rule-based Manager for Device Events and Files.719vm-test-run-nixbot-gitlab> gitlab # [    4.027031] systemd[1]: systemd-udevd.service: Consumed 2.433s CPU time over 2.169s wall clock time, 32.9M memory peak.720vm-test-run-nixbot-gitlab> gitlab # [    4.043718] systemd[1]: initrd-cleanup.service: Deactivated successfully.721vm-test-run-nixbot-gitlab> gitlab # [    4.048765] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.722vm-test-run-nixbot-gitlab> gitlab # [    4.062291] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.723vm-test-run-nixbot-gitlab> gitlab # [    4.065378] systemd[1]: Closed udev Control Socket.724vm-test-run-nixbot-gitlab> gitlab # [    4.078018] systemd[1]: Starting Cleanup udev Database...725vm-test-run-nixbot-gitlab> gitlab # [    4.080319] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.726vm-test-run-nixbot-gitlab> gitlab # [    4.083401] systemd[1]: Stopped Create Static Device Nodes in /dev.727vm-test-run-nixbot-gitlab> gitlab # [    4.086861] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.728vm-test-run-nixbot-gitlab> gitlab # [    4.090264] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.729vm-test-run-nixbot-gitlab> gitlab # [    4.094601] systemd[1]: kmod-static-nodes.service: Deactivated successfully.730vm-test-run-nixbot-gitlab> gitlab # [    4.097511] systemd[1]: Stopped Create List of Static Device Nodes.731vm-test-run-nixbot-gitlab> gitlab # [    4.195290] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.732vm-test-run-nixbot-gitlab> gitlab # [    4.198540] systemd[1]: Finished Cleanup udev Database.733vm-test-run-nixbot-gitlab> gitlab # [    4.205900] systemd[1]: Reached target Switch Root.734vm-test-run-nixbot-gitlab> gitlab # [    4.212794] systemd[1]: Starting NixOS Activation...735vm-test-run-nixbot-gitlab> gitlab # [    4.401649] initrd-nixos-activation-start[571]: booting system configuration /nix/store/bby4xl7gl6wcc57f8k2n5arn3p3kszkn-nixos-system-gitlab-test736vm-test-run-nixbot-gitlab> gitlab # [    4.466653] initrd-nixos-activation-start[571]: running activation script...737vm-test-run-nixbot-gitlab> gitlab # [    4.787850] initrd-nixos-activation-start[594]: setting up /etc...738vm-test-run-nixbot-gitlab> gitlab # [    4.951607] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.739vm-test-run-nixbot-gitlab> gitlab # [    4.956393] systemd[1]: Finished NixOS Activation.740vm-test-run-nixbot-gitlab> gitlab # [    4.973223] systemd[1]: Starting Switch Root...741vm-test-run-nixbot-gitlab> gitlab # [    5.024784] systemd[1]: Switching root.742vm-test-run-nixbot-gitlab> gitlab # [    5.605638] systemd-journald[155]: Received SIGTERM from PID 1 (systemd).743vm-test-run-nixbot-gitlab> gitlab # [    6.333526] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)744vm-test-run-nixbot-gitlab> gitlab # [    6.333681] systemd[1]: Detected virtualization qemu.745vm-test-run-nixbot-gitlab> gitlab # [    6.333769] systemd[1]: Detected architecture arm64.746vm-test-run-nixbot-gitlab> gitlab # [    6.333943] systemd[1]: Detected first boot.747vm-test-run-nixbot-gitlab> gitlab # [    6.335474] systemd[1]: Initializing machine ID from random generator.748vm-test-run-nixbot-gitlab> gitlab # [    6.569237] systemd[1]: bpf-restrict-fs: LSM BPF program attached749vm-test-run-nixbot-gitlab> gitlab # [    6.669794] systemd[1]: Applying preset policy.750vm-test-run-nixbot-gitlab> gitlab # [    6.912595] systemd[1]: Populated /etc with preset unit settings.751vm-test-run-nixbot-gitlab> gitlab # [    7.070300] systemd[1]: initrd-switch-root.service: Deactivated successfully.752vm-test-run-nixbot-gitlab> gitlab # [    7.070669] systemd[1]: Stopped initrd-switch-root.service.753vm-test-run-nixbot-gitlab> gitlab # [    7.072763] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.754vm-test-run-nixbot-gitlab> gitlab # [    7.078111] systemd[1]: Created slice Slice /system/getty.755vm-test-run-nixbot-gitlab> gitlab # [    7.084248] systemd[1]: Created slice GitLab DevOps Platform Slice.756vm-test-run-nixbot-gitlab> gitlab # [    7.088030] systemd[1]: Created slice User and Session Slice.757vm-test-run-nixbot-gitlab> gitlab # [    7.088241] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.758vm-test-run-nixbot-gitlab> gitlab # [    7.089161] systemd[1]: Started Forward Password Requests to Wall Directory Watch.759vm-test-run-nixbot-gitlab> gitlab # [    7.090039] systemd[1]: Expecting device /dev/hvc0...760vm-test-run-nixbot-gitlab> gitlab # [    7.090908] systemd[1]: Expecting device /dev/ttyAMA0...761vm-test-run-nixbot-gitlab> gitlab # [    7.091820] systemd[1]: Reached target Local Encrypted Volumes.762vm-test-run-nixbot-gitlab> gitlab # [    7.092665] systemd[1]: Stopped target initrd-fs.target.763vm-test-run-nixbot-gitlab> gitlab # [    7.093491] systemd[1]: Stopped target initrd-root-fs.target.764vm-test-run-nixbot-gitlab> gitlab # [    7.094347] systemd[1]: Stopped target initrd-switch-root.target.765vm-test-run-nixbot-gitlab> gitlab # [    7.095187] systemd[1]: Reached target Virtual Machines and Containers.766vm-test-run-nixbot-gitlab> gitlab # [    7.096060] systemd[1]: Reached target Path Units.767vm-test-run-nixbot-gitlab> gitlab # [    7.096867] systemd[1]: Reached target Remote File Systems.768vm-test-run-nixbot-gitlab> gitlab # [    7.097751] systemd[1]: Reached target Slice Units.769vm-test-run-nixbot-gitlab> gitlab # [    7.098806] systemd[1]: Reached target Swaps.770vm-test-run-nixbot-gitlab> gitlab # [    7.102923] systemd[1]: Listening on Process Core Dump Socket.771vm-test-run-nixbot-gitlab> gitlab # [    7.106027] systemd[1]: Listening on Credential Encryption/Decryption.772vm-test-run-nixbot-gitlab> gitlab # [    7.114371] systemd[1]: Starting Journal Log Access Socket...773vm-test-run-nixbot-gitlab> gitlab # [    7.116584] systemd[1]: Listening on Journal Audit Socket.774vm-test-run-nixbot-gitlab> gitlab # [    7.118061] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.775vm-test-run-nixbot-gitlab> gitlab # [    7.118743] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki776vm-test-run-nixbot-gitlab> gitlab # [    7.119593] systemd[1]: Listening on udev Control Socket.777vm-test-run-nixbot-gitlab> gitlab # [    7.127945] systemd[1]: Mounting Huge Pages File System...778vm-test-run-nixbot-gitlab> gitlab # [    7.135788] systemd[1]: Mounting POSIX Message Queue File System...779vm-test-run-nixbot-gitlab> gitlab # [    7.147151] systemd[1]: Mounting Kernel Debug File System...780vm-test-run-nixbot-gitlab> gitlab # [    7.156607] systemd[1]: Mounting Kernel Trace File System...781vm-test-run-nixbot-gitlab> gitlab # [    7.164424] systemd[1]: Starting Create List of Static Device Nodes...782vm-test-run-nixbot-gitlab> gitlab # [    7.175917] systemd[1]: Starting Load Kernel Module 9pnet_virtio...783vm-test-run-nixbot-gitlab> gitlab # [    7.176701] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs784vm-test-run-nixbot-gitlab> gitlab # [    7.190114] systemd[1]: Mounting Kernel Configuration File System...785vm-test-run-nixbot-gitlab> gitlab # [    7.190939] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm786vm-test-run-nixbot-gitlab> gitlab # [    7.191640] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore787vm-test-run-nixbot-gitlab> gitlab # [    7.201346] systemd[1]: Starting Load Kernel Module fuse...788vm-test-run-nixbot-gitlab> gitlab # [    7.202247] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67789vm-test-run-nixbot-gitlab> gitlab # [    7.212218] systemd[1]: Starting Journal Service...790vm-test-run-nixbot-gitlab> gitlab # [    7.216295] systemd[1]: Starting Load Kernel Modules...791vm-test-run-nixbot-gitlab> gitlab # [    7.228117] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...792vm-test-run-nixbot-gitlab> gitlab # [    7.230496] fuse: init (API version 7.45)793vm-test-run-nixbot-gitlab> gitlab # [    7.239903] systemd[1]: Starting Remount Root and Kernel File Systems...794vm-test-run-nixbot-gitlab> gitlab # [    7.240569] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki795vm-test-run-nixbot-gitlab> gitlab # [    7.252112] systemd[1]: Starting Coldplug All udev Devices...796vm-test-run-nixbot-gitlab> gitlab # [    7.256879] systemd-journald[803]: Collecting audit messages is enabled.797vm-test-run-nixbot-gitlab> gitlab # [    7.265215] systemd[1]: Listening on Journal Log Access Socket.798vm-test-run-nixbot-gitlab> gitlab # [    7.261641] systemd[1]: Queued start job for default target Multi-User System.799vm-test-run-nixbot-gitlab> gitlab # [    7.265560] systemd[1]: Unnecessary job was removed for /dev/vdb.[    7.270024] systemd[1]: Started Journal Service.800vm-test-run-nixbot-gitlab> gitlab # 801vm-test-run-nixbot-gitlab> gitlab # [    7.268864] systemd[1]: systemd-journald.service: Deactivated successfully.802vm-test-run-nixbot-gitlab> gitlab # [    7.270481] systemd-modules-load[804]: Using 3 probe threads803vm-test-run-nixbot-gitlab> gitlab # [    7.271585] systemd-modules-load[804]: Module 'atkbd' is built in[    7.276020] EXT4-fs (vda): re-mounted e2322789-1a56-439a-bb03-2f78fa48ecfe.804vm-test-run-nixbot-gitlab> gitlab # 805vm-test-run-nixbot-gitlab> gitlab # [    7.275451] systemd-modules-load[804]: Module 'loop' is built in806vm-test-run-nixbot-gitlab> gitlab # [    7.276622] systemd-modules-load[804]: Inserted module 'tls'807vm-test-run-nixbot-gitlab> gitlab # [    7.277671] systemd[1]: Mounted Huge Pages File System.808vm-test-run-nixbot-gitlab> gitlab # [    7.278699] systemd[1]: Mounted POSIX Message Queue File System.809vm-test-run-nixbot-gitlab> gitlab # [    7.279863] systemd[1]: Mounted Kernel Debug File System.810vm-test-run-nixbot-gitlab> gitlab # [    7.281008] systemd[1]: Mounted Kernel Trace File System.811vm-test-run-nixbot-gitlab> gitlab # [    7.282011] systemd[1]: Finished Create List of Static Device Nodes.812vm-test-run-nixbot-gitlab> gitlab # [    7.283182] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.813vm-test-run-nixbot-gitlab> gitlab # [    7.284389] systemd[1]: Finished Load Kernel Module 9pnet_virtio.814vm-test-run-nixbot-gitlab> gitlab # [    7.285442] systemd[1]: Mounted Kernel Configuration File System.815vm-test-run-nixbot-gitlab> gitlab # [    7.286452] systemd[1]: modprobe@fuse.service: Deactivated successfully.816vm-test-run-nixbot-gitlab> gitlab # [    7.287537] systemd[1]: Finished Load Kernel Module fuse.817vm-test-run-nixbot-gitlab> gitlab # [    7.288496] systemd[1]: Finished Load Kernel Modules.818vm-test-run-nixbot-gitlab> gitlab # [    7.289982] systemd[1]: Finished Remount Root and Kernel File Systems.819vm-test-run-nixbot-gitlab> gitlab # [    7.302285] systemd[1]: Mounting FUSE Control File System...820vm-test-run-nixbot-gitlab> gitlab # [    7.304375] systemd-oomd[806]: No swap; memory pressure usage will be degraded821vm-test-run-nixbot-gitlab> gitlab # [    7.307084] systemd[1]: Starting Firewall...822vm-test-run-nixbot-gitlab> gitlab # [    7.342454] systemd[1]: Starting Flush Journal to Persistent Storage...823vm-test-run-nixbot-gitlab> gitlab # [    7.343999] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore824vm-test-run-nixbot-gitlab> gitlab # [    7.348166] systemd[1]: Starting Load/Save OS Random Seed...825vm-test-run-nixbot-gitlab> gitlab # [    7.351303] systemd[1]: Starting Apply Kernel Variables...826vm-test-run-nixbot-gitlab> gitlab # [    7.364114] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...827vm-test-run-nixbot-gitlab> gitlab # [    7.365874] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki828vm-test-run-nixbot-gitlab> gitlab # [    7.367749] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.829vm-test-run-nixbot-gitlab> gitlab # [    7.373292] systemd-journald[803]: Received client request to flush runtime journal.830vm-test-run-nixbot-gitlab> gitlab # [    7.406903] systemd[1]: Mounted FUSE Control File System.831vm-test-run-nixbot-gitlab> gitlab # [    7.408743] systemd[1]: Finished Load/Save OS Random Seed.832vm-test-run-nixbot-gitlab> gitlab # [    7.409905] systemd[1]: Reached target First Boot Complete.833vm-test-run-nixbot-gitlab> gitlab # [    7.411068] systemd[1]: Finished Apply Kernel Variables.834vm-test-run-nixbot-gitlab> gitlab # [    7.414634] systemd[1]: Finished Flush Journal to Persistent Storage.835vm-test-run-nixbot-gitlab> gitlab # [    7.415942] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.836vm-test-run-nixbot-gitlab> gitlab # [    7.420276] systemd[1]: Starting Create Static Device Nodes in /dev...837vm-test-run-nixbot-gitlab> gitlab # [    7.460528] systemd[1]: Finished Create Static Device Nodes in /dev.838vm-test-run-nixbot-gitlab> gitlab # [    7.461838] systemd[1]: Reached target Preparation for Local File Systems.839vm-test-run-nixbot-gitlab> gitlab # [    7.464635] systemd[1]: Starting Rule-based Manager for Device Events and Files...840vm-test-run-nixbot-gitlab> gitlab # [    7.529591] systemd-udevd[861]: Using default interface naming scheme 'v260'.841vm-test-run-nixbot-gitlab> gitlab # [    7.576622] systemd[1]: Started Rule-based Manager for Device Events and Files.842vm-test-run-nixbot-gitlab> gitlab # [    7.812173] systemd[1]: Finished Firewall.843vm-test-run-nixbot-gitlab> gitlab # [    8.018435] systemd[1]: Finished Coldplug All udev Devices.844vm-test-run-nixbot-gitlab> gitlab # [    8.073938] systemd[1]: Mounting /run/wrappers...845vm-test-run-nixbot-gitlab> gitlab # [    8.095980] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs846vm-test-run-nixbot-gitlab> gitlab # [    8.125181] systemd[1]: Mounted /run/wrappers.847vm-test-run-nixbot-gitlab> gitlab # [    8.131696] systemd[1]: Reached target Local File Systems.848vm-test-run-nixbot-gitlab> gitlab # [    8.133326] systemd[1]: Listening on Boot Loader Control Service Socket.849vm-test-run-nixbot-gitlab> gitlab # [    8.135493] systemd[1]: Starting register-nix-paths.service...850vm-test-run-nixbot-gitlab> gitlab # [    8.137533] systemd[1]: Starting Create SUID/SGID Wrappers...851vm-test-run-nixbot-gitlab> gitlab # [    8.138830] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.852vm-test-run-nixbot-gitlab> gitlab # [    8.144215] systemd[1]: Starting Save Transient machine-id to Disk...853vm-test-run-nixbot-gitlab> gitlab # [    8.150097] systemd[1]: Starting Create System Files and Directories...854vm-test-run-nixbot-gitlab> gitlab # [    8.228875] (udev-worker)[906]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.855vm-test-run-nixbot-gitlab> gitlab # [    8.232762] (udev-worker)[906]: Network interface NamePolicy= disabled on kernel command line.856vm-test-run-nixbot-gitlab> gitlab # [    8.234846] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.857vm-test-run-nixbot-gitlab> gitlab # [    8.237755] systemd[1]: Finished Save Transient machine-id to Disk.858vm-test-run-nixbot-gitlab> gitlab # [    8.238838] systemd[1]: Finished Create System Files and Directories.859vm-test-run-nixbot-gitlab> gitlab # [    8.249278] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.860vm-test-run-nixbot-gitlab> gitlab # [    8.258046] (udev-worker)[954]: Network interface NamePolicy= disabled on kernel command line.861vm-test-run-nixbot-gitlab> gitlab # [    8.260642] systemd[1]: Condition check resulted in Virtio network device being skipped.862vm-test-run-nixbot-gitlab> gitlab # [    8.268375] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.863vm-test-run-nixbot-gitlab> gitlab # [    8.270049] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore864vm-test-run-nixbot-gitlab> gitlab # [    8.273388] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.865vm-test-run-nixbot-gitlab> gitlab # [    8.278022] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67866vm-test-run-nixbot-gitlab> gitlab # [    8.284265] systemd[1]: Starting Rebuild Journal Catalog...867vm-test-run-nixbot-gitlab> gitlab # [    8.285544] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore868vm-test-run-nixbot-gitlab> gitlab # [    8.292161] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki869vm-test-run-nixbot-gitlab> gitlab # [    8.294498] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki870vm-test-run-nixbot-gitlab> gitlab # [    8.296527] systemd[1]: Starting Record System Boot/Shutdown in UTMP...871vm-test-run-nixbot-gitlab> gitlab # [    8.319946] systemd[1]: Finished Record System Boot/Shutdown in UTMP.872vm-test-run-nixbot-gitlab> gitlab # [    8.334854] systemd[1]: Finished Rebuild Journal Catalog.873vm-test-run-nixbot-gitlab> gitlab # [    8.339385] systemd[1]: Starting Update is Completed...874vm-test-run-nixbot-gitlab> gitlab # [    8.375043] systemd[1]: Finished Update is Completed.875vm-test-run-nixbot-gitlab> gitlab # [    8.406298] mousedev: PS/2 mouse device common for all mice876vm-test-run-nixbot-gitlab> gitlab # [    8.412829] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.877vm-test-run-nixbot-gitlab> gitlab # [    8.413951] systemd[1]: Finished Create SUID/SGID Wrappers.878vm-test-run-nixbot-gitlab> gitlab # [    8.414708] systemd[1]: suid-sgid-wrappers.service: Consumed 181ms CPU time over 275ms wall clock time, 7.5M memory peak, 2.2M read from disk.879vm-test-run-nixbot-gitlab> gitlab # [    8.684607] systemd[1]: Finished register-nix-paths.service.880vm-test-run-nixbot-gitlab> gitlab # [    8.685522] systemd[1]: Reached target System Initialization.881vm-test-run-nixbot-gitlab> gitlab # [    8.686385] systemd[1]: Started Discard unused filesystem blocks once a week.882vm-test-run-nixbot-gitlab> gitlab # [    8.687874] systemd[1]: Started logrotate.timer.883vm-test-run-nixbot-gitlab> gitlab # [    8.688690] systemd[1]: Started Daily Cleanup of Temporary Directories.884vm-test-run-nixbot-gitlab> gitlab # [    8.689903] systemd[1]: Reached target Timer Units.885vm-test-run-nixbot-gitlab> gitlab # [    8.690943] systemd[1]: Listening on D-Bus System Message Bus Socket.886vm-test-run-nixbot-gitlab> gitlab # [    8.692068] systemd[1]: Listening on Nix Daemon Socket.887vm-test-run-nixbot-gitlab> gitlab # [    8.692900] systemd[1]: Listening on Hostname Service Socket.888vm-test-run-nixbot-gitlab> gitlab # [    8.693738] systemd[1]: Reached target Socket Units.889vm-test-run-nixbot-gitlab> gitlab # [    8.694478] systemd[1]: Reached target Basic System.890vm-test-run-nixbot-gitlab> gitlab # [    8.695203] systemd[1]: Started backdoor.service.891vm-test-run-nixbot-gitlab> gitlab # [    8.695905] systemd[1]: Starting gitlab-config.service...892vm-test-run-nixbot-gitlab> gitlab # [    8.698541] systemd[1]: Starting Import lastlog data into lastlog2 database...893vm-test-run-nixbot-gitlab> gitlab # [    8.700525] systemd[1]: Starting Logrotate configuration check...894vm-test-run-nixbot-gitlab> gitlab # [    8.724904] systemd[1]: Starting Name Service Cache Daemon (nsncd)...895vm-test-run-nixbot-gitlab> gitlab # [    8.739925] systemd[1]: Starting Post-Boot Actions...896vm-test-run-nixbot-gitlab> gitlab # [    8.740955] systemd[1]: Started Reset console on configuration changes.897vm-test-run-nixbot-gitlab> gitlab # [    8.745500] logrotate[1053]: warning: logrotate in debug mode does nothing except printing debug messages!  Consider using verbose mode (-v) instead if this is not what you want.898vm-test-run-nixbot-gitlab> gitlab # connecting to host...899vm-test-run-nixbot-gitlab> gitlab # [    8.758508] logrotate[1053]: reading config file /nix/store/hk6ay5j24mh4h8mpr5rxlxxxp8v61fnj-logrotate.conf900vm-test-run-nixbot-gitlab> gitlab # [    8.760083] logrotate[1053]: note: 'monthly' overrides previously specified 'weekly'901vm-test-run-nixbot-gitlab> gitlab # [    8.761119] logrotate[1053]: Reading state from file: /var/lib/logrotate.status902vm-test-run-nixbot-gitlab> gitlab # [    8.764328] logrotate[1053]: state file /var/lib/logrotate.status does not exist903vm-test-run-nixbot-gitlab> gitlab: Guest shell says: b'Spawning backdoor root shell...\n'904vm-test-run-nixbot-gitlab> gitlab: connected to guest root shell905vm-test-run-nixbot-gitlab> gitlab: (connecting took 9.21 seconds)906vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for the VM to finish booting, in 9.21 seconds)907vm-test-run-nixbot-gitlab> gitlab # [    8.768340] logrotate[1053]: Allocating hash table for state file, size 64 entries908vm-test-run-nixbot-gitlab> gitlab # [    8.769337] logrotate[1053]: Handling 4 logs909vm-test-run-nixbot-gitlab> gitlab # [    8.769860] logrotate[1053]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed910vm-test-run-nixbot-gitlab> gitlab # [    8.774019] logrotate[1053]: considering log /var/log/btmp911vm-test-run-nixbot-gitlab> gitlab # [    8.774689] logrotate[1053]: Creating new state912vm-test-run-nixbot-gitlab> gitlab # [    8.775221] logrotate[1053]:   Now: 2026-06-08 13:14913vm-test-run-nixbot-gitlab> gitlab # [    8.775817] logrotate[1053]:   Last rotated at 2026-06-08 13:00914vm-test-run-nixbot-gitlab> gitlab # [    8.777036] logrotate[1053]:   log does not need rotating (log has already been rotated)915vm-test-run-nixbot-gitlab> gitlab # [    8.778858] logrotate[1053]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed916vm-test-run-nixbot-gitlab> gitlab # [    8.780758] logrotate[1053]: considering log /var/log/wtmp917vm-test-run-nixbot-gitlab> gitlab # [    8.781393] logrotate[1053]: Creating new state918vm-test-run-nixbot-gitlab> gitlab # [    8.781939] logrotate[1053]:   Now: 2026-06-08 13:14919vm-test-run-nixbot-gitlab> gitlab # [    8.782524] logrotate[1053]:   Last rotated at 2026-06-08 13:00920vm-test-run-nixbot-gitlab> gitlab # [    8.783837] logrotate[1053]:   log does not need rotating (log has already been rotated)921vm-test-run-nixbot-gitlab> gitlab # [    8.789751] logrotate[1053]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed922vm-test-run-nixbot-gitlab> gitlab # [    8.791451] logrotate[1053]: switching euid from 0 to 165 and egid from 0 to 165 (pid 1053)923vm-test-run-nixbot-gitlab> gitlab # [    8.792936] logrotate[1053]: considering log /var/gitlab/state/log/*.log924vm-test-run-nixbot-gitlab> gitlab # [    8.797073] logrotate[1053]:   log /var/gitlab/state/log/*.log does not exist -- skipping925vm-test-run-nixbot-gitlab> gitlab # [    8.798193] logrotate[1053]: Creating new state926vm-test-run-nixbot-gitlab> gitlab # [    8.798771] logrotate[1053]: switching euid from 165 to 0 and egid from 165 to 0 (pid 1053)927vm-test-run-nixbot-gitlab> gitlab # [    8.799776] logrotate[1053]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed928vm-test-run-nixbot-gitlab> gitlab # [    8.807164] logrotate[1053]: switching euid from 0 to 60 and egid from 0 to 60 (pid 1053)929vm-test-run-nixbot-gitlab> gitlab # [    8.808289] logrotate[1053]: considering log /var/log/nginx/*.log930vm-test-run-nixbot-gitlab> gitlab # [    8.809093] logrotate[1053]:   log /var/log/nginx/*.log does not exist -- skipping931vm-test-run-nixbot-gitlab> gitlab # [    8.810052] logrotate[1053]: Creating new state932vm-test-run-nixbot-gitlab> gitlab # [    8.810628] logrotate[1053]: switching euid from 60 to 0 and egid from 60 to 0 (pid 1053)933vm-test-run-nixbot-gitlab> gitlab # [    8.811749] systemd[1]: Starting resolvconf update...934vm-test-run-nixbot-gitlab> gitlab # [    8.815373] nsncd[1054]: Jun 08 13:14:45.586 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"935vm-test-run-nixbot-gitlab> gitlab # [    8.819504] systemd[1]: Finished Logrotate configuration check.936vm-test-run-nixbot-gitlab> gitlab # [    8.821682] systemd[1]: Finished Post-Boot Actions.937vm-test-run-nixbot-gitlab> gitlab # [    8.822735] systemd[1]: Finished Import lastlog data into lastlog2 database.938vm-test-run-nixbot-gitlab> gitlab # [    8.823814] systemd[1]: Starting D-Bus System Message Bus...939vm-test-run-nixbot-gitlab> gitlab # [    8.828695] systemd[1]: Started Name Service Cache Daemon (nsncd).940vm-test-run-nixbot-gitlab> gitlab # [    8.830891] systemd[1]: Reached target Host and Network Name Lookups.941vm-test-run-nixbot-gitlab> gitlab # [    8.836210] systemd[1]: Reached target User and Group Name Lookups.942vm-test-run-nixbot-gitlab> gitlab # [    8.837195] systemd[1]: Starting User Login Management...943vm-test-run-nixbot-gitlab> gitlab # [    8.844921] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:08.0/virtio7/input/input3944vm-test-run-nixbot-gitlab> gitlab # [    8.858787] dbus-broker-launch[1070]: Looking up NSS user entry for 'systemd-timesync'...945vm-test-run-nixbot-gitlab> gitlab # [    8.861983] dbus-broker-launch[1070]: NSS returned no entry for 'systemd-timesync'946vm-test-run-nixbot-gitlab> gitlab # [    8.863487] dbus-broker-launch[1070]: Invalid user-name in /nix/store/ifm9k575wb3j66gvjx1xkdmmknzqr8v8-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"947vm-test-run-nixbot-gitlab> gitlab # [    8.870123] systemd[1]: Started D-Bus System Message Bus.948vm-test-run-nixbot-gitlab> gitlab # [    8.890076] dbus-broker-launch[1070]: Ready949vm-test-run-nixbot-gitlab> gitlab # [    8.894203] systemd[1]: Stopped target Host and Network Name Lookups.950vm-test-run-nixbot-gitlab> gitlab # [    8.895112] systemd[1]: Stopping Host and Network Name Lookups...951vm-test-run-nixbot-gitlab> gitlab # [    8.895963] systemd[1]: Stopped target User and Group Name Lookups.952vm-test-run-nixbot-gitlab> gitlab # [    8.900356] systemd[1]: Stopping User and Group Name Lookups...953vm-test-run-nixbot-gitlab> gitlab # [    8.901320] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...954vm-test-run-nixbot-gitlab> gitlab # [    8.902154] systemd[1]: nscd.service: Deactivated successfully.955vm-test-run-nixbot-gitlab> gitlab # [    8.902958] systemd[1]: Stopped Name Service Cache Daemon (nsncd).956vm-test-run-nixbot-gitlab> gitlab # [    8.903740] systemd[1]: nscd.service: Consumed 29ms CPU time over 173ms wall clock time, 8.2M memory peak, 5.9M read from disk.957vm-test-run-nixbot-gitlab> gitlab # [    8.915333] systemd[1]: Starting Name Service Cache Daemon (nsncd)...958vm-test-run-nixbot-gitlab> gitlab # [    8.953702] systemd[1]: Started Name Service Cache Daemon (nsncd).959vm-test-run-nixbot-gitlab> gitlab # [    8.954620] systemd[1]: Reached target Host and Network Name Lookups.960vm-test-run-nixbot-gitlab> gitlab # [    8.955559] systemd[1]: Reached target User and Group Name Lookups.961vm-test-run-nixbot-gitlab> gitlab # [    8.957163] systemd-logind[1091]: New seat seat0.962vm-test-run-nixbot-gitlab> gitlab # [    8.957812] systemd-logind[1091]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)963vm-test-run-nixbot-gitlab> gitlab # [    8.959240] nsncd[1142]: Jun 08 13:14:45.741 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"964vm-test-run-nixbot-gitlab> gitlab # [    8.962466] systemd-logind[1091]: Watching system buttons on /dev/input/event0 (gpio-keys)965vm-test-run-nixbot-gitlab> gitlab # [    8.963605] systemd[1]: Started User Login Management.966vm-test-run-nixbot-gitlab> gitlab # [    8.971446] systemd[1]: Starting linger-users.service...967vm-test-run-nixbot-gitlab> gitlab # [    8.988714] systemd[1]: Finished resolvconf update.968vm-test-run-nixbot-gitlab> gitlab # [    8.990528] systemd[1]: Reached target Preparation for Network.969vm-test-run-nixbot-gitlab> gitlab # [    8.997499] systemd[1]: Starting DHCP Client...970vm-test-run-nixbot-gitlab> gitlab # [    9.001352] systemd[1]: Starting Address configuration of eth1...971vm-test-run-nixbot-gitlab> gitlab # [    9.008128] systemd[1]: Starting Extra networking commands....972vm-test-run-nixbot-gitlab> gitlab # [    9.016577] systemd[1]: linger-users.service: Deactivated successfully.973vm-test-run-nixbot-gitlab> gitlab # [    9.018088] systemd[1]: Finished linger-users.service.974vm-test-run-nixbot-gitlab> gitlab # [    9.049764] network-addresses-eth1-start[1169]: adding address 192.168.1.1/24... done975vm-test-run-nixbot-gitlab> gitlab # [    9.061161] network-addresses-eth1-start[1169]: adding address 2001:db8:1::1/64... done976vm-test-run-nixbot-gitlab> gitlab # [    9.071949] systemd[1]: Finished Address configuration of eth1.977vm-test-run-nixbot-gitlab> gitlab # [    9.091583] systemd[1]: Starting Virtual Console Setup...978vm-test-run-nixbot-gitlab> gitlab # [    9.099166] dhcpcd[1181]: dhcpcd-10.3.2 starting979vm-test-run-nixbot-gitlab> gitlab # [    9.108086] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.980vm-test-run-nixbot-gitlab> gitlab # [    9.109092] systemd[1]: Stopped Virtual Console Setup.981vm-test-run-nixbot-gitlab> gitlab # [    9.110575] systemd[1]: Starting Virtual Console Setup...982vm-test-run-nixbot-gitlab> gitlab # [    9.123664] dhcpcd[1213]: dev: loaded udev983vm-test-run-nixbot-gitlab> gitlab # [    9.139256] 8021q: 802.1Q VLAN Support v1.8984vm-test-run-nixbot-gitlab> gitlab # [    9.139637] 8021q: adding VLAN 0 to HW filter on device eth1985vm-test-run-nixbot-gitlab> gitlab # [    9.152683] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.986vm-test-run-nixbot-gitlab> gitlab # [    9.154594] systemd-logind[1091]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)987vm-test-run-nixbot-gitlab> gitlab # [    9.166837] systemd[1]: Finished Extra networking commands..988vm-test-run-nixbot-gitlab> gitlab # [    9.168125] systemd[1]: Reached target Network.989vm-test-run-nixbot-gitlab> gitlab # [    9.173035] systemd[1]: Starting gitlab-workhorse.service...990vm-test-run-nixbot-gitlab> gitlab # [    9.176489] systemd[1]: Starting Nginx Web Server...991vm-test-run-nixbot-gitlab> gitlab # [    9.183296] cfg80211: Loading compiled-in X.509 certificates for regulatory database992vm-test-run-nixbot-gitlab> gitlab # [    9.184790] systemd[1]: Starting PostgreSQL Server...993vm-test-run-nixbot-gitlab> gitlab # [    9.188503] systemd[1]: Starting Redis Server - redis-gitlab...994vm-test-run-nixbot-gitlab> gitlab # [    9.195979] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'995vm-test-run-nixbot-gitlab> gitlab # [    9.196496] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'996vm-test-run-nixbot-gitlab> gitlab # [    9.196582] systemd[1]: Starting Permit User Sessions...[    9.198223] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2997vm-test-run-nixbot-gitlab> gitlab # 998vm-test-run-nixbot-gitlab> gitlab # [    9.198525] cfg80211: failed to load regulatory.db999vm-test-run-nixbot-gitlab> gitlab # [    9.203503] systemd-vconsole-setup[1208]: Configuration of first virtual console was skipped, ignoring remaining ones.1000vm-test-run-nixbot-gitlab> gitlab # [    9.212878] systemd[1]: Finished Virtual Console Setup.1001vm-test-run-nixbot-gitlab> gitlab # [    9.226088] systemd[1]: Finished Permit User Sessions.1002vm-test-run-nixbot-gitlab> gitlab # [    9.237161] dhcpcd[1213]: eth0: waiting for carrier[    9.240020] 8021q: adding VLAN 0 to HW filter on device eth01003vm-test-run-nixbot-gitlab> gitlab # 1004vm-test-run-nixbot-gitlab> gitlab # [    9.242451] dhcpcd[1213]: eth0: carrier acquired1005vm-test-run-nixbot-gitlab> gitlab # [    9.243766] systemd[1]: Started Getty on tty1.1006vm-test-run-nixbot-gitlab> gitlab # [    9.244515] systemd[1]: Reached target Login Prompts.1007vm-test-run-nixbot-gitlab> gitlab # [    9.247839] dhcpcd[1213]: DUID 00:01:00:01:31:b9:7c:c6:52:54:00:12:34:561008vm-test-run-nixbot-gitlab> gitlab # [    9.249443] dhcpcd[1213]: eth0: IAID 00:12:34:561009vm-test-run-nixbot-gitlab> gitlab # [    9.250089] dhcpcd[1213]: eth0: adding address fe80::5054:ff:fe12:34561010vm-test-run-nixbot-gitlab> gitlab # [    9.359996] redis-server[1271]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.1011vm-test-run-nixbot-gitlab> gitlab # [    9.362116] redis-server[1271]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1012vm-test-run-nixbot-gitlab> gitlab # [    9.364640] redis-server[1271]: Redis version=8.8.0, bits=64, commit=00000000, modified=0, pid=1271, just started1013vm-test-run-nixbot-gitlab> gitlab # [    9.367282] systemd[1]: Started Redis Server - redis-gitlab.1014vm-test-run-nixbot-gitlab> gitlab # [    9.369115] nginx-pre-start[1272]: nginx: the configuration file /nix/store/2526shpjv0bzachwf4qi968gxiiyv4kq-nginx.conf syntax is ok1015vm-test-run-nixbot-gitlab> gitlab # [    9.371442] nginx-pre-start[1272]: nginx: configuration file /nix/store/2526shpjv0bzachwf4qi968gxiiyv4kq-nginx.conf test is successful1016vm-test-run-nixbot-gitlab> gitlab # [    9.374436] redis-server[1271]: Configuration loaded1017vm-test-run-nixbot-gitlab> gitlab # [    9.375354] systemd[1]: Started Nginx Web Server.1018vm-test-run-nixbot-gitlab> gitlab # [    9.376226] redis[1271]: monotonic clock: ARM CNTVCT @ 1000 ticks/us1019vm-test-run-nixbot-gitlab> gitlab # [    9.377213] redis[1271]: Running mode=standalone, port=0.1020vm-test-run-nixbot-gitlab> gitlab # [    9.378074] redis[1271]: Server initialized1021vm-test-run-nixbot-gitlab> gitlab # [    9.378795] redis[1271]: Ready to accept connections unix1022vm-test-run-nixbot-gitlab> gitlab # [    9.379801] redis[1271]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1023vm-test-run-nixbot-gitlab> gitlab # [    9.382574] postgresql-pre-start[1276]: The files belonging to this database system will be owned by user "postgres".1024vm-test-run-nixbot-gitlab> gitlab # [    9.384694] postgresql-pre-start[1276]: This user must also own the server process.1025vm-test-run-nixbot-gitlab> gitlab # [    9.386305] postgresql-pre-start[1276]: The database cluster will be initialized with locale "en_US.UTF-8".1026vm-test-run-nixbot-gitlab> gitlab # [    9.387674] postgresql-pre-start[1276]: The default database encoding has accordingly been set to "UTF8".1027vm-test-run-nixbot-gitlab> gitlab # [    9.389411] postgresql-pre-start[1276]: The default text search configuration will be set to "english".1028vm-test-run-nixbot-gitlab> gitlab # [    9.390721] postgresql-pre-start[1276]: Data page checksums are disabled.1029vm-test-run-nixbot-gitlab> gitlab # [    9.391572] postgresql-pre-start[1276]: fixing permissions on existing directory /var/lib/postgresql/17 ... ok1030vm-test-run-nixbot-gitlab> gitlab # [    9.393250] postgresql-pre-start[1276]: creating subdirectories ... ok1031vm-test-run-nixbot-gitlab> gitlab # [    9.394217] postgresql-pre-start[1276]: selecting dynamic shared memory implementation ... posix1032vm-test-run-nixbot-gitlab> gitlab # [    9.422297] postgresql-pre-start[1276]: selecting default "max_connections" ... 1001033vm-test-run-nixbot-gitlab> gitlab # [    9.463382] postgresql-pre-start[1276]: selecting default "shared_buffers" ... 128MB1034vm-test-run-nixbot-gitlab> gitlab # [    9.688263] systemd[1]: Started gitlab-workhorse.service.1035vm-test-run-nixbot-gitlab> gitlab # [    9.889088] postgresql-pre-start[1276]: selecting default time zone ... UTC1036vm-test-run-nixbot-gitlab> gitlab # [    9.892535] postgresql-pre-start[1276]: creating configuration files ... ok1037vm-test-run-nixbot-gitlab> gitlab # [   10.100140] postgresql-pre-start[1276]: running bootstrap script ... ok1038vm-test-run-nixbot-gitlab> gitlab # [   10.138241] gitlab-workhorse[1297]: time="2026-06-08T13:14:46Z" level=info msg=Starting build_time=19700101.000000 version=18.11.41039vm-test-run-nixbot-gitlab> gitlab # [   10.139825] gitlab-workhorse[1297]: time="2026-06-08T13:14:46Z" level=info msg="Using redis/go-redis"1040vm-test-run-nixbot-gitlab> gitlab # [   10.141280] gitlab-workhorse[1297]: time="2026-06-08T13:14:46Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1041vm-test-run-nixbot-gitlab> gitlab # [   10.729586] dhcpcd[1213]: eth0: soliciting a DHCP lease1042vm-test-run-nixbot-gitlab> gitlab # [   10.745186] dhcpcd[1213]: eth0: offered 10.0.2.15 from 10.0.2.21043vm-test-run-nixbot-gitlab> gitlab # [   10.768488] dhcpcd[1213]: eth0: probing address 10.0.2.15/241044vm-test-run-nixbot-gitlab> gitlab # [   10.780325] postgresql-pre-start[1276]: performing post-bootstrap initialization ... ok1045vm-test-run-nixbot-gitlab> gitlab # [   11.117990] dhcpcd[1213]: eth0: soliciting an IPv6 router1046vm-test-run-nixbot-gitlab> gitlab # [   11.120975] dhcpcd[1213]: eth0: Router Advertisement from fe80::21047vm-test-run-nixbot-gitlab> gitlab # [   11.123832] dhcpcd[1213]: eth0: adding address fec0::5054:ff:fe12:3456/641048vm-test-run-nixbot-gitlab> gitlab # [   11.127147] dhcpcd[1213]: eth0: adding route to fec0::/641049vm-test-run-nixbot-gitlab> gitlab # [   11.129806] dhcpcd[1213]: eth0: adding default route via fe80::21050vm-test-run-nixbot-gitlab> gitlab # [   11.133685] postgresql-pre-start[1276]: syncing data to disk ... ok1051vm-test-run-nixbot-gitlab> gitlab # [   11.136142] postgresql-pre-start[1276]: initdb: warning: enabling "trust" authentication for local connections1052vm-test-run-nixbot-gitlab> gitlab # [   11.141029] postgresql-pre-start[1276]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1053vm-test-run-nixbot-gitlab> gitlab # [   11.147062] postgresql-pre-start[1276]: Success. You can now start the database server using:1054vm-test-run-nixbot-gitlab> gitlab # [   11.150487] postgresql-pre-start[1276]:     pg_ctl -D /var/lib/postgresql/17 -l logfile start1055vm-test-run-nixbot-gitlab> gitlab # [   11.333948] postgres[1332]: [1332] LOG:  starting PostgreSQL 17.10 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit1056vm-test-run-nixbot-gitlab> gitlab # [   11.339388] postgres[1332]: [1332] LOG:  listening on IPv6 address "::1", port 54321057vm-test-run-nixbot-gitlab> gitlab # [   11.343038] postgres[1332]: [1332] LOG:  listening on IPv4 address "127.0.0.1", port 54321058vm-test-run-nixbot-gitlab> gitlab # [   11.346943] postgres[1332]: [1332] LOG:  listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1059vm-test-run-nixbot-gitlab> gitlab # [   11.351625] postgres[1342]: [1342] LOG:  database system was shut down at 2026-06-08 13:14:47 GMT1060vm-test-run-nixbot-gitlab> gitlab # [   11.356279] postgres[1332]: [1332] LOG:  database system is ready to accept connections1061vm-test-run-nixbot-gitlab> gitlab # [   11.359819] systemd[1]: Started PostgreSQL Server.1062vm-test-run-nixbot-gitlab> gitlab # [   11.364935] systemd[1]: Starting PostgreSQL Setup Scripts...1063vm-test-run-nixbot-gitlab> gitlab # [   11.534700] c0sj6d459nhf3wg9pm6ziy71l4581qq8-gitlab-config[1339]: mkdir -p /var/gitlab/state/home/.ssh: OK1064vm-test-run-nixbot-gitlab> gitlab # [   11.538656] c0sj6d459nhf3wg9pm6ziy71l4581qq8-gitlab-config[1339]: chmod 700 /var/gitlab/state/home/.ssh: OK1065vm-test-run-nixbot-gitlab> gitlab # [   11.613890] postgresql-setup-start[1354]: CREATE DATABASE1066vm-test-run-nixbot-gitlab> gitlab # [   11.635950] systemd[1]: Finished gitlab-config.service.1067vm-test-run-nixbot-gitlab> gitlab # [   11.642722] systemd[1]: Started gitaly.service.1068vm-test-run-nixbot-gitlab> gitlab # [   11.670638] postgresql-setup-start[1372]: CREATE ROLE1069vm-test-run-nixbot-gitlab> gitlab # [   11.694838] postgresql-setup-start[1375]: ALTER DATABASE1070vm-test-run-nixbot-gitlab> gitlab # [   11.747793] postgresql-setup-start[1380]: CREATE ROLE1071vm-test-run-nixbot-gitlab> gitlab # [   11.752445] systemd[1]: Finished PostgreSQL Setup Scripts.1072vm-test-run-nixbot-gitlab> gitlab # [   11.754734] systemd[1]: Reached target PostgreSQL.1073vm-test-run-nixbot-gitlab> gitlab # [   11.759166] systemd[1]: Starting gitlab-db-config.service...1074vm-test-run-nixbot-gitlab> gitlab # [   11.764909] systemd[1]: Starting gitlab-postgresql.service...1075vm-test-run-nixbot-gitlab> gitlab # [   11.960512] gitlab-postgresql-start[1390]: CREATE DATABASE1076vm-test-run-nixbot-gitlab> gitlab # [   12.044660] gitlab-postgresql-start[1400]: CREATE EXTENSION1077vm-test-run-nixbot-gitlab> gitlab # [   12.108579] gitlab-postgresql-start[1402]: CREATE EXTENSION1078vm-test-run-nixbot-gitlab> gitlab # [   12.111122] systemd[1]: Finished gitlab-postgresql.service.1079vm-test-run-nixbot-gitlab> gitlab # [   12.400343] gitaly[1371]: time="2026-06-08T13:14:49.183Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/krygc3bmd623znp2pddh3fv21q5f3nz2-gitaly.toml' and fix the errors that are printed." pid=13711080vm-test-run-nixbot-gitlab> gitlab # [   12.416479] gitaly[1371]: time="2026-06-08T13:14:49.183Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=13711081vm-test-run-nixbot-gitlab> gitlab # [   12.424245] gitaly[1371]: time="2026-06-08T13:14:49.183Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=13711082vm-test-run-nixbot-gitlab> gitlab # [   12.430198] gitaly[1371]: time="2026-06-08T13:14:49.183Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=13711083vm-test-run-nixbot-gitlab> gitlab # [   12.435484] gitaly[1371]: time="2026-06-08T13:14:49.183Z" level=info msg="Starting Gitaly" pid=1371 version=18.11.41084vm-test-run-nixbot-gitlab> gitlab # [   12.652158] gitaly[1371]: time="2026-06-08T13:14:49.436Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=252 pid=13711085vm-test-run-nixbot-gitlab> gitlab # [   12.655834] gitaly[1371]: time="2026-06-08T13:14:49.436Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=13711086vm-test-run-nixbot-gitlab> gitlab # [   12.659170] gitaly[1371]: time="2026-06-08T13:14:49.436Z" level=info msg="finished initializing command factory" duration_ms=0 pid=13711087vm-test-run-nixbot-gitlab> gitlab # [   12.662461] gitaly[1371]: time="2026-06-08T13:14:49.436Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-1371/git-exec-2515991887.d/git pid=13711088vm-test-run-nixbot-gitlab> gitlab # [   12.666724] gitaly[1371]: time="2026-06-08T13:14:49.441Z" level=info msg="finished detecting git version" duration_ms=4 pid=13711089vm-test-run-nixbot-gitlab> gitlab # [   12.670258] gitaly[1371]: time="2026-06-08T13:14:49.441Z" level=info msg="using Git version" pid=1371 version=2.53.g1090vm-test-run-nixbot-gitlab> gitlab # [   12.673226] gitaly[1371]: time="2026-06-08T13:14:49.441Z" level=info msg="clearing disk cache object folder" pid=1371 storage=default1091vm-test-run-nixbot-gitlab> gitlab # [   12.676262] gitaly[1371]: time="2026-06-08T13:14:49.442Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3707009369 pid=1371 storage=default1092vm-test-run-nixbot-gitlab> gitlab # [   12.682168] gitaly[1371]: time="2026-06-08T13:14:49.442Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3707009369 pid=1371 storage=default1093vm-test-run-nixbot-gitlab> gitlab # [   12.687924] gitaly[1371]: time="2026-06-08T13:14:49.442Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=13711094vm-test-run-nixbot-gitlab> gitlab # [   12.693808] gitaly[1371]: time="2026-06-08T13:14:49.442Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=13711095vm-test-run-nixbot-gitlab> gitlab # [   12.699871] gitaly[1371]: time="2026-06-08T13:14:49.442Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3707009369 clear_duration_ms=0 pid=1371 storage=default1096vm-test-run-nixbot-gitlab> gitlab # [   12.705783] gitaly[1371]: time="2026-06-08T13:14:49.464Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=13711097vm-test-run-nixbot-gitlab> gitlab # [   12.710386] gitaly[1371]: time="2026-06-08T13:14:49.464Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=1371 schema=unix1098vm-test-run-nixbot-gitlab> gitlab # [   12.714701] gitaly[1371]: time="2026-06-08T13:14:49.464Z" level=info msg="listening at address" address=/run/gitaly/gitaly-1371/sock.d/intern pid=1371 schema=unix1099vm-test-run-nixbot-gitlab> gitlab # [   12.718583] gitaly[1371]: time="2026-06-08T13:14:49.464Z" level=info msg="finished tempdir cleaner walk" pid=1371 storage=default time_ms=01100vm-test-run-nixbot-gitlab> gitlab # [   12.722348] gitaly[1371]: time="2026-06-08T13:14:49.464Z" level=info msg="counting repositories" pid=13711101vm-test-run-nixbot-gitlab> gitlab # [   12.725372] gitaly[1371]: time="2026-06-08T13:14:49.465Z" level=info msg="starting to count repositories" pid=1371 storage_path=/var/gitlab/state/repositories1102vm-test-run-nixbot-gitlab> gitlab # [   12.729713] gitaly[1371]: time="2026-06-08T13:14:49.465Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=1371 storage_path=/var/gitlab/state/repositories1103vm-test-run-nixbot-gitlab> gitlab # [   12.734693] gitaly[1371]: time="2026-06-08T13:14:49.465Z" level=info msg="completed counting all repositories" counting_duration=0 pid=13711104vm-test-run-nixbot-gitlab> gitlab # [   12.738410] gitaly[1371]: time="2026-06-08T13:14:49.466Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=13711105vm-test-run-nixbot-gitlab> gitlab # [   12.742461] gitaly[1371]: time="2026-06-08T13:14:49.466Z" level=info msg="Started Gitaly" duration_ms=283 pid=13711106vm-test-run-nixbot-gitlab> gitlab # [   12.745610] gitaly[1371]: time="2026-06-08T13:14:49.467Z" level=info msg="maintenance: daily scheduled" pid=1371 scheduled="2026-06-09 12:00:00 +0000 UTC"1107vm-test-run-nixbot-gitlab> gitlab # [   13.093257] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1385]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1108vm-test-run-nixbot-gitlab> gitlab # [   13.101851] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1385]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1109vm-test-run-nixbot-gitlab> gitlab # [   13.111170] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1385]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1110vm-test-run-nixbot-gitlab> gitlab # [   16.076655] gitaly[1371]: time="2026-06-08T13:14:52.859Z" level=info msg="License database preloaded" duration_ms=3675 pid=13711111vm-test-run-nixbot-gitlab> gitlab # [   16.378820] dhcpcd[1213]: eth0: leased 10.0.2.15 for 86400 seconds1112vm-test-run-nixbot-gitlab> gitlab # [   16.381415] dhcpcd[1213]: eth0: adding route to 10.0.2.0/241113vm-test-run-nixbot-gitlab> gitlab # [   16.383606] dhcpcd[1213]: eth0: adding default route via 10.0.2.21114vm-test-run-nixbot-gitlab> gitlab # [   16.562663] systemd[1]: Started DHCP Client.1115vm-test-run-nixbot-gitlab> gitlab # [   16.565318] systemd[1]: Reached target Network is Online.1116vm-test-run-nixbot-gitlab> gitlab # [   55.285353] postgres[1846]: [1846] ERROR:  relation "feature_gates" does not exist at character 5231117vm-test-run-nixbot-gitlab> gitlab # [   55.286042] postgres[1846]: [1846] STATEMENT:  SELECT a.attname, format_type(a.atttypid, a.atttypmod),1118vm-test-run-nixbot-gitlab> gitlab # [   55.286171] postgres[1846]: 	       pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1119vm-test-run-nixbot-gitlab> gitlab # [   55.286269] postgres[1846]: 	       c.collname, col_description(a.attrelid, a.attnum) AS comment,1120vm-test-run-nixbot-gitlab> gitlab # [   55.286377] postgres[1846]: 	       attidentity AS identity,1121vm-test-run-nixbot-gitlab> gitlab # [   55.286489] postgres[1846]: 	       attgenerated as attgenerated1122vm-test-run-nixbot-gitlab> gitlab # [   55.286600] postgres[1846]: 	  FROM pg_attribute a1123vm-test-run-nixbot-gitlab> gitlab # [   55.286712] postgres[1846]: 	  LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1124vm-test-run-nixbot-gitlab> gitlab # [   55.286842] postgres[1846]: 	  LEFT JOIN pg_type t ON a.atttypid = t.oid1125vm-test-run-nixbot-gitlab> gitlab # [   55.286939] postgres[1846]: 	  LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1126vm-test-run-nixbot-gitlab> gitlab # [   55.287049] postgres[1846]: 	 WHERE a.attrelid = '"feature_gates"'::regclass1127vm-test-run-nixbot-gitlab> gitlab # [   55.287160] postgres[1846]: 	   AND a.attnum > 0 AND NOT a.attisdropped1128vm-test-run-nixbot-gitlab> gitlab # [   55.287271] postgres[1846]: 	 ORDER BY a.attnum1129vm-test-run-nixbot-gitlab> gitlab # [   55.287381] postgres[1846]:1130vm-test-run-nixbot-gitlab> gitlab # [   55.549865] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1385]: W, [2026-06-08T13:15:32.332784 #1385]  WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1131vm-test-run-nixbot-gitlab> gitlab # [   60.196271] gitlab-workhorse[1297]: time="2026-06-08T13:15:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1132vm-test-run-nixbot-gitlab> gitlab # [   63.463607] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1928]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE:  extension "btree_gist" already exists, skipping1133vm-test-run-nixbot-gitlab> gitlab # [   63.466113] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1928]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE:  extension "pg_trgm" already exists, skipping1134vm-test-run-nixbot-gitlab> gitlab # [   70.206548] gitlab-workhorse[1297]: time="2026-06-08T13:15:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1135vm-test-run-nixbot-gitlab> gitlab # [   80.217514] gitlab-workhorse[1297]: time="2026-06-08T13:15:57Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1136vm-test-run-nixbot-gitlab> gitlab # [   86.903312] postgres[2013]: [2013] ERROR:  relation "table_without_models" does not exist1137vm-test-run-nixbot-gitlab> gitlab # [   86.904679] postgres[2013]: [2013] STATEMENT:  SELECT pg_get_serial_sequence('table_without_models', 'id')1138vm-test-run-nixbot-gitlab> gitlab # [   90.226288] gitlab-workhorse[1297]: time="2026-06-08T13:16:07Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1139vm-test-run-nixbot-gitlab> gitlab # [  100.234539] gitlab-workhorse[1297]: time="2026-06-08T13:16:17Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1140vm-test-run-nixbot-gitlab> gitlab # [  110.244430] gitlab-workhorse[1297]: time="2026-06-08T13:16:27Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1141vm-test-run-nixbot-gitlab> gitlab # [  117.443790] systemd[1]: Finished gitlab-db-config.service.1142vm-test-run-nixbot-gitlab> gitlab # [  117.450512] systemd[1]: Started gitlab-sidekiq.service.1143vm-test-run-nixbot-gitlab> gitlab # [  117.457533] systemd[1]: Starting gitlab.service...1144vm-test-run-nixbot-gitlab> gitlab # [  117.975777] bundle[2388]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1145vm-test-run-nixbot-gitlab> gitlab # [  117.981931] bundle[2388]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1146vm-test-run-nixbot-gitlab> gitlab # [  117.987569] bundle[2388]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1147vm-test-run-nixbot-gitlab> gitlab # [  120.254202] gitlab-workhorse[1297]: time="2026-06-08T13:16:37Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1148vm-test-run-nixbot-gitlab> gitlab # [  122.662922] bundle[2388]: {"timestamp":"2026-06-08T13:16:39.417Z","pid":2388,"message":"* Enabling systemd notification integration"}1149vm-test-run-nixbot-gitlab> gitlab # [  122.663315] bundle[2388]: {"timestamp":"2026-06-08T13:16:39.446Z","pid":2388,"message":"Puma starting in cluster mode..."}1150vm-test-run-nixbot-gitlab> gitlab # [  122.663443] bundle[2388]: {"timestamp":"2026-06-08T13:16:39.446Z","pid":2388,"message":"* Puma version: 7.2.0 (\"On The Corner\")"}1151vm-test-run-nixbot-gitlab> gitlab # [  122.663559] bundle[2388]: {"timestamp":"2026-06-08T13:16:39.446Z","pid":2388,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1152vm-test-run-nixbot-gitlab> gitlab # [  122.663670] bundle[2388]: {"timestamp":"2026-06-08T13:16:39.446Z","pid":2388,"message":"*  Min threads: 0"}1153vm-test-run-nixbot-gitlab> gitlab # [  122.663787] bundle[2388]: {"timestamp":"2026-06-08T13:16:39.446Z","pid":2388,"message":"*  Max threads: 4"}1154vm-test-run-nixbot-gitlab> gitlab # [  122.663918] bundle[2388]: {"timestamp":"2026-06-08T13:16:39.446Z","pid":2388,"message":"*  Environment: production"}1155vm-test-run-nixbot-gitlab> gitlab # [  122.692324] bundle[2388]: {"timestamp":"2026-06-08T13:16:39.446Z","pid":2388,"message":"*   Master PID: 2388"}1156vm-test-run-nixbot-gitlab> gitlab # [  122.696061] bundle[2388]: {"timestamp":"2026-06-08T13:16:39.446Z","pid":2388,"message":"*      Workers: 2"}1157vm-test-run-nixbot-gitlab> gitlab # [  122.699739] bundle[2388]: {"timestamp":"2026-06-08T13:16:39.446Z","pid":2388,"message":"*     Restarts: (✔) hot (✖) phased (✖) refork"}1158vm-test-run-nixbot-gitlab> gitlab # [  122.704539] bundle[2388]: {"timestamp":"2026-06-08T13:16:39.446Z","pid":2388,"message":"* Preloading application"}1159vm-test-run-nixbot-gitlab> gitlab # [  122.714849] sidekiq-cluster[2387]: {"severity":"INFO","time":"2026-06-08T13:16:39.468Z","message":"Starting cluster with 1 processes"}1160vm-test-run-nixbot-gitlab> gitlab # [  130.259199] gitlab-workhorse[1297]: time="2026-06-08T13:16:47Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1161vm-test-run-nixbot-gitlab> gitlab # [  140.262811] gitlab-workhorse[1297]: time="2026-06-08T13:16:57Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1162vm-test-run-nixbot-gitlab> gitlab # [  150.264812] gitlab-workhorse[1297]: time="2026-06-08T13:17:07Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1163vm-test-run-nixbot-gitlab> gitlab # [  159.355345] bundle[2388]: W, [2026-06-08T13:17:16.138318 #2388]  WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1164vm-test-run-nixbot-gitlab> gitlab # [  160.267407] gitlab-workhorse[1297]: time="2026-06-08T13:17:17Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1165vm-test-run-nixbot-gitlab> gitlab # [  164.113484] sidekiq-cluster[2428]: 2026-06-08T13:17:20.896Z pid=2428 tid=ttg INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2428, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>451276800}1166vm-test-run-nixbot-gitlab> gitlab # [  164.410142] sidekiq-cluster[2428]: W, [2026-06-08T13:17:21.194025 #2428]  WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1167vm-test-run-nixbot-gitlab> gitlab # [  164.469172] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:21.253Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1168vm-test-run-nixbot-gitlab> gitlab # [  167.541507] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.324Z","message":"GitLab reliable fetch activated!"}1169vm-test-run-nixbot-gitlab> gitlab # [  167.543147] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.324Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1170vm-test-run-nixbot-gitlab> gitlab # [  167.601633] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.385Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1171vm-test-run-nixbot-gitlab> gitlab # [  167.608281] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.389Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1172vm-test-run-nixbot-gitlab> gitlab # [  167.614410] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.393Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1173vm-test-run-nixbot-gitlab> gitlab # [  167.621357] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.396Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1174vm-test-run-nixbot-gitlab> gitlab # [  167.627662] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.400Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1175vm-test-run-nixbot-gitlab> gitlab # [  167.634191] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.402Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1176vm-test-run-nixbot-gitlab> gitlab # [  167.639770] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.405Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1177vm-test-run-nixbot-gitlab> gitlab # [  167.645182] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.407Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1178vm-test-run-nixbot-gitlab> gitlab # [  167.649957] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.409Z","message":"Cron Jobs - added job with name expire_build_artifacts_worker in the namespace default"}1179vm-test-run-nixbot-gitlab> gitlab # [  167.654557] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.412Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1180vm-test-run-nixbot-gitlab> gitlab # [  167.659263] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.414Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1181vm-test-run-nixbot-gitlab> gitlab # [  167.663502] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.417Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1182vm-test-run-nixbot-gitlab> gitlab # [  167.667186] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.419Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1183vm-test-run-nixbot-gitlab> gitlab # [  167.670895] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.422Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1184vm-test-run-nixbot-gitlab> gitlab # [  167.674388] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.424Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1185vm-test-run-nixbot-gitlab> gitlab # [  167.677675] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.427Z","message":"Cron Jobs - added job with name environments_auto_delete_cron_worker in the namespace default"}1186vm-test-run-nixbot-gitlab> gitlab # [  167.680824] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.429Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1187vm-test-run-nixbot-gitlab> gitlab # [  167.683582] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.432Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1188vm-test-run-nixbot-gitlab> gitlab # [  167.686370] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.435Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1189vm-test-run-nixbot-gitlab> gitlab # [  167.689266] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.438Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1190vm-test-run-nixbot-gitlab> gitlab # [  167.691858] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.441Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1191vm-test-run-nixbot-gitlab> gitlab # [  167.694866] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.444Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1192vm-test-run-nixbot-gitlab> gitlab # [  167.697860] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.446Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1193vm-test-run-nixbot-gitlab> gitlab # [  167.700340] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.448Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1194vm-test-run-nixbot-gitlab> gitlab # [  167.702774] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.450Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1195vm-test-run-nixbot-gitlab> gitlab # [  167.705332] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.452Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1196vm-test-run-nixbot-gitlab> gitlab # [  167.707576] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.455Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1197vm-test-run-nixbot-gitlab> gitlab # [  167.709877] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.458Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1198vm-test-run-nixbot-gitlab> gitlab # [  167.712074] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.461Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1199vm-test-run-nixbot-gitlab> gitlab # [  167.714252] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.463Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1200vm-test-run-nixbot-gitlab> gitlab # [  167.716495] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.466Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1201vm-test-run-nixbot-gitlab> gitlab # [  167.718538] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.469Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1202vm-test-run-nixbot-gitlab> gitlab # [  167.720924] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.471Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1203vm-test-run-nixbot-gitlab> gitlab # [  167.722907] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.474Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1204vm-test-run-nixbot-gitlab> gitlab # [  167.725120] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.477Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1205vm-test-run-nixbot-gitlab> gitlab # [  167.727085] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.479Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1206vm-test-run-nixbot-gitlab> gitlab # [  167.729127] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.481Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1207vm-test-run-nixbot-gitlab> gitlab # [  167.731047] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.483Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1208vm-test-run-nixbot-gitlab> gitlab # [  167.732964] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.485Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1209vm-test-run-nixbot-gitlab> gitlab # [  167.734820] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.487Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1210vm-test-run-nixbot-gitlab> gitlab # [  167.736754] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.489Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1211vm-test-run-nixbot-gitlab> gitlab # [  167.738751] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.491Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1212vm-test-run-nixbot-gitlab> gitlab # [  167.740778] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.493Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1213vm-test-run-nixbot-gitlab> gitlab # [  167.742768] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.496Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1214vm-test-run-nixbot-gitlab> gitlab # [  167.744740] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.501Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1215vm-test-run-nixbot-gitlab> gitlab # [  167.746767] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.507Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1216vm-test-run-nixbot-gitlab> gitlab # [  167.748970] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.512Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1217vm-test-run-nixbot-gitlab> gitlab # [  167.750927] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.515Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1218vm-test-run-nixbot-gitlab> gitlab # [  167.752984] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.519Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1219vm-test-run-nixbot-gitlab> gitlab # [  167.754893] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.524Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1220vm-test-run-nixbot-gitlab> gitlab # [  167.756902] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.529Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1221vm-test-run-nixbot-gitlab> gitlab # [  167.758828] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.533Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1222vm-test-run-nixbot-gitlab> gitlab # [  167.760814] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.538Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1223vm-test-run-nixbot-gitlab> gitlab # [  167.822260] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.606Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1224vm-test-run-nixbot-gitlab> gitlab # [  167.829315] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.609Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1225vm-test-run-nixbot-gitlab> gitlab # [  167.835752] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.613Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1226vm-test-run-nixbot-gitlab> gitlab # [  167.842185] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.616Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1227vm-test-run-nixbot-gitlab> gitlab # [  167.848447] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.619Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1228vm-test-run-nixbot-gitlab> gitlab # [  167.855090] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.623Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1229vm-test-run-nixbot-gitlab> gitlab # [  167.861168] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.625Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1230vm-test-run-nixbot-gitlab> gitlab # [  167.866432] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.627Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1231vm-test-run-nixbot-gitlab> gitlab # [  167.870817] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.630Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1232vm-test-run-nixbot-gitlab> gitlab # [  167.874878] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.632Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1233vm-test-run-nixbot-gitlab> gitlab # [  167.878953] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.636Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1234vm-test-run-nixbot-gitlab> gitlab # [  167.882946] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.641Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1235vm-test-run-nixbot-gitlab> gitlab # [  167.886787] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.644Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1236vm-test-run-nixbot-gitlab> gitlab # [  167.890364] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.648Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1237vm-test-run-nixbot-gitlab> gitlab # [  167.893588] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.650Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1238vm-test-run-nixbot-gitlab> gitlab # [  167.896767] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.652Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1239vm-test-run-nixbot-gitlab> gitlab # [  167.899867] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.654Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1240vm-test-run-nixbot-gitlab> gitlab # [  167.903114] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.656Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1241vm-test-run-nixbot-gitlab> gitlab # [  167.906140] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.658Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1242vm-test-run-nixbot-gitlab> gitlab # [  167.908977] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.660Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1243vm-test-run-nixbot-gitlab> gitlab # [  167.911622] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.663Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1244vm-test-run-nixbot-gitlab> gitlab # [  167.914573] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.665Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1245vm-test-run-nixbot-gitlab> gitlab # [  167.917322] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.666Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1246vm-test-run-nixbot-gitlab> gitlab # [  167.919894] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.669Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1247vm-test-run-nixbot-gitlab> gitlab # [  167.922440] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.671Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1248vm-test-run-nixbot-gitlab> gitlab # [  167.925088] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.674Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1249vm-test-run-nixbot-gitlab> gitlab # [  167.927330] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.676Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1250vm-test-run-nixbot-gitlab> gitlab # [  167.929671] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.678Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1251vm-test-run-nixbot-gitlab> gitlab # [  167.932053] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.680Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1252vm-test-run-nixbot-gitlab> gitlab # [  167.934478] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.683Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1253vm-test-run-nixbot-gitlab> gitlab # [  167.936861] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.685Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1254vm-test-run-nixbot-gitlab> gitlab # [  167.939009] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.688Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1255vm-test-run-nixbot-gitlab> gitlab # [  167.941423] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.691Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1256vm-test-run-nixbot-gitlab> gitlab # [  167.943503] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.693Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1257vm-test-run-nixbot-gitlab> gitlab # [  167.945853] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.696Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1258vm-test-run-nixbot-gitlab> gitlab # [  167.947921] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.699Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1259vm-test-run-nixbot-gitlab> gitlab # [  167.950219] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.701Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1260vm-test-run-nixbot-gitlab> gitlab # [  167.952320] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.703Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1261vm-test-run-nixbot-gitlab> gitlab # [  167.954409] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.705Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1262vm-test-run-nixbot-gitlab> gitlab # [  167.956493] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.708Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1263vm-test-run-nixbot-gitlab> gitlab # [  167.958543] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.710Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1264vm-test-run-nixbot-gitlab> gitlab # [  167.960793] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.712Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1265vm-test-run-nixbot-gitlab> gitlab # [  167.962586] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.715Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1266vm-test-run-nixbot-gitlab> gitlab # [  167.964759] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.718Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1267vm-test-run-nixbot-gitlab> gitlab # [  167.966808] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.720Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1268vm-test-run-nixbot-gitlab> gitlab # [  167.968971] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.723Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1269vm-test-run-nixbot-gitlab> gitlab # [  167.971014] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.736Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1270vm-test-run-nixbot-gitlab> gitlab # [  167.973169] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.738Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1271vm-test-run-nixbot-gitlab> gitlab # [  167.975167] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.740Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1272vm-test-run-nixbot-gitlab> gitlab # [  167.978470] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.744Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1273vm-test-run-nixbot-gitlab> gitlab # [  167.980551] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.747Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1274vm-test-run-nixbot-gitlab> gitlab # [  167.982680] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.749Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1275vm-test-run-nixbot-gitlab> gitlab # [  167.985076] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.752Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1276vm-test-run-nixbot-gitlab> gitlab # [  167.987357] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.754Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1277vm-test-run-nixbot-gitlab> gitlab # [  167.989565] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.756Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1278vm-test-run-nixbot-gitlab> gitlab # [  167.991764] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.759Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1279vm-test-run-nixbot-gitlab> gitlab # [  167.994091] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:17:24.761Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1280vm-test-run-nixbot-gitlab> gitlab # [  170.268596] gitlab-workhorse[1297]: time="2026-06-08T13:17:27Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1281vm-test-run-nixbot-gitlab> gitlab # [  180.269662] gitlab-workhorse[1297]: time="2026-06-08T13:17:37Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1282vm-test-run-nixbot-gitlab> gitlab # [  190.278628] gitlab-workhorse[1297]: time="2026-06-08T13:17:47Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1283vm-test-run-nixbot-gitlab> gitlab # [  200.290270] gitlab-workhorse[1297]: time="2026-06-08T13:17:57Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1284vm-test-run-nixbot-gitlab> gitlab # [  205.766625] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:02.550Z","message":"Booted Rails 7.2.3 application in production environment"}1285vm-test-run-nixbot-gitlab> gitlab # [  205.768554] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:02.551Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1286vm-test-run-nixbot-gitlab> gitlab # [  205.774295] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:02.551Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1287vm-test-run-nixbot-gitlab> gitlab # [  205.779484] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:02.551Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1288vm-test-run-nixbot-gitlab> gitlab # [  205.785399] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:02.554Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1289vm-test-run-nixbot-gitlab> gitlab # [  208.246223] bundle[2388]: {"timestamp":"2026-06-08T13:18:05.029Z","pid":2388,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1290vm-test-run-nixbot-gitlab> gitlab # [  208.246562] bundle[2388]: {"timestamp":"2026-06-08T13:18:05.029Z","pid":2388,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1291vm-test-run-nixbot-gitlab> gitlab # [  208.246755] bundle[2388]: {"timestamp":"2026-06-08T13:18:05.029Z","pid":2388,"message":"! #\u003cThread:0x0000e70ec74fe3c8 /nix/store/09wikq0z4z0s8mkafl8f2b6yp0p78frd-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/09wikq0z4z0s8mkafl8f2b6yp0p78frd-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1292vm-test-run-nixbot-gitlab> gitlab # [  208.246881] bundle[2388]: {"timestamp":"2026-06-08T13:18:05.029Z","pid":2388,"message":"! #\u003cThread:0x0000e70ec7728248 /nix/store/q2bwpwxril8z19gq9b1nnv72drlwhhg8-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/q2bwpwxril8z19gq9b1nnv72drlwhhg8-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1293vm-test-run-nixbot-gitlab> gitlab # [  208.247018] bundle[2388]: {"timestamp":"2026-06-08T13:18:05.029Z","pid":2388,"message":"Use Ctrl-C to stop"}1294vm-test-run-nixbot-gitlab> gitlab # [  208.247131] bundle[2388]: {"timestamp":"2026-06-08T13:18:05.029Z","pid":2388,"message":"Sending status to systemd every 1.0 sec"}1295vm-test-run-nixbot-gitlab> gitlab # [  208.381077] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:05.163Z","message":"Cleaning working queues"}1296vm-test-run-nixbot-gitlab> gitlab # [  208.385136] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:05.165Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"929a98f9bb3dccd91fd2f1e4","created_at":"2026-06-08T13:16:33.226Z","trace_propagation_headers":{"sentry-trace":"273d6631154542a59cbe0f58af5f8183-0f0ce4400c944202","baggage":"sentry-trace_id=273d6631154542a59cbe0f58af5f8183,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"262a6ea1b77341aa17ec760ec50ddc8e","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-06-08T13:16:33.238Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-929a98f9bb3dccd91fd2f1e4: start","job_status":"start","queue_duration_s":91.92728,"scheduling_latency_s":91.927335}1297vm-test-run-nixbot-gitlab> gitlab # [  208.655003] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:05.438Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"929a98f9bb3dccd91fd2f1e4","created_at":"2026-06-08T13:16:33.226Z","trace_propagation_headers":{"sentry-trace":"273d6631154542a59cbe0f58af5f8183-0f0ce4400c944202","baggage":"sentry-trace_id=273d6631154542a59cbe0f58af5f8183,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"262a6ea1b77341aa17ec760ec50ddc8e","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-06-08T13:16:33.238Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-929a98f9bb3dccd91fd2f1e4: done: 0.273228 sec","job_status":"done","queue_duration_s":91.92728,"scheduling_latency_s":91.927335,"redis_calls":24,"redis_duration_s":0.007811,"redis_read_bytes":912,"redis_write_bytes":2622,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.003896,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002523,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001392,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.16042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.1594501,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.273228,"completed_at":"2026-06-08T13:18:05.438Z","load_balancing_strategy":"primary","db_duration_s":0.070702,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1298vm-test-run-nixbot-gitlab> gitlab # [  209.275448] bundle[2388]: {"timestamp":"2026-06-08T13:18:06.058Z","pid":2388,"message":"- Worker 0 (PID: 3201) booted in 0.96s, phase: 0"}1299vm-test-run-nixbot-gitlab> gitlab # [  209.324993] bundle[2388]: {"timestamp":"2026-06-08T13:18:06.108Z","pid":2388,"message":"- Worker 1 (PID: 3205) booted in 0.97s, phase: 0"}1300vm-test-run-nixbot-gitlab> gitlab # [  209.330614] systemd[1]: Started gitlab.service.1301vm-test-run-nixbot-gitlab> gitlab # [  209.332762] systemd[1]: Reached target Common target for all GitLab services..1302vm-test-run-nixbot-gitlab> gitlab # [  209.335567] systemd[1]: Starting setup-gitlab.service...1303vm-test-run-nixbot-gitlab> gitlab # [  209.375389] setup-gitlab-start[3245]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1304vm-test-run-nixbot-gitlab> gitlab # [  212.432784] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:18:09 +0000] "GET /users/sign_in HTTP/1.1" 200 10624 "" "curl/8.20.0" 30151305vm-test-run-nixbot-gitlab> gitlab # [  212.440709] setup-gitlab-start[3273]: ++ curl -fs -X POST -H 'Content-Type: application/json' -d '{"grant_type":"password","username":"root","password":"notproduction"}' http://gitlab/oauth/token1306vm-test-run-nixbot-gitlab> gitlab # [  212.443072] setup-gitlab-start[3274]: ++ jq -r .access_token1307vm-test-run-nixbot-gitlab> gitlab # [  213.448460] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:18:10 +0000] "POST /oauth/token HTTP/1.1" 200 244 "" "curl/8.20.0" 9811308vm-test-run-nixbot-gitlab> gitlab # [  213.455106] setup-gitlab-start[3245]: + BEARER=e62920817b304b4299f949d1ef5fdecd7690d72f30247bf3ce6d5b76dd4f01071309vm-test-run-nixbot-gitlab> gitlab # [  213.459116] setup-gitlab-start[3245]: + AUTH='Authorization: Bearer e62920817b304b4299f949d1ef5fdecd7690d72f30247bf3ce6d5b76dd4f0107'1310vm-test-run-nixbot-gitlab> gitlab # [  213.463786] setup-gitlab-start[3245]: + curl -fs -X PUT -H 'Authorization: Bearer e62920817b304b4299f949d1ef5fdecd7690d72f30247bf3ce6d5b76dd4f0107' 'http://gitlab/api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true'1311vm-test-run-nixbot-gitlab> gitlab # [  214.730423] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:18:11 +0000] "PUT /api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true HTTP/1.1" 200 17133 "" "curl/8.20.0" 12481312vm-test-run-nixbot-gitlab> gitlab # [  214.734873] setup-gitlab-start[3245]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner Rails.cache.clear1313vm-test-run-nixbot-gitlab> gitlab # [  214.751370] runuser[3294]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1314vm-test-run-nixbot-gitlab> gitlab # [  215.248582] setup-gitlab-start[3295]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1315vm-test-run-nixbot-gitlab> gitlab # [  215.254665] setup-gitlab-start[3295]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1316vm-test-run-nixbot-gitlab> gitlab # [  215.260677] setup-gitlab-start[3295]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1317vm-test-run-nixbot-gitlab> gitlab # [  216.012164] setup-gitlab-start[3295]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1318vm-test-run-nixbot-gitlab> gitlab # [  216.012468] setup-gitlab-start[3295]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1319vm-test-run-nixbot-gitlab> gitlab # [  216.017364] setup-gitlab-start[3295]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1320vm-test-run-nixbot-gitlab> gitlab # [  219.611653] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:16.393Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"53a8997a73c130e657292af7","created_at":"2026-06-08T13:18:16.343Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61683bd52a93f90baabffdf007e1ca7c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.390Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-53a8997a73c130e657292af7: start","job_status":"start","queue_duration_s":0.003371,"scheduling_latency_s":0.003432}1321vm-test-run-nixbot-gitlab> gitlab # [  219.763681] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:16.546Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"53a8997a73c130e657292af7","created_at":"2026-06-08T13:18:16.343Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61683bd52a93f90baabffdf007e1ca7c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.390Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-53a8997a73c130e657292af7: done: 0.152973 sec","job_status":"done","queue_duration_s":0.003371,"scheduling_latency_s":0.003432,"redis_calls":10,"redis_duration_s":0.019007,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002594,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.012518,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003895,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00134954,"duration_s":0.152973,"completed_at":"2026-06-08T13:18:16.546Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023508,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322vm-test-run-nixbot-gitlab> gitlab # [  219.845520] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:16.551Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"45933ee7c7e9633eecd0ea28","created_at":"2026-06-08T13:18:16.436Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b653fb0deb09a375eb380baf9df0287c","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.466Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-45933ee7c7e9633eecd0ea28: start","job_status":"start","queue_duration_s":0.084128,"scheduling_latency_s":0.084172}1323vm-test-run-nixbot-gitlab> gitlab # [  219.865602] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:16.639Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"45933ee7c7e9633eecd0ea28","created_at":"2026-06-08T13:18:16.436Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b653fb0deb09a375eb380baf9df0287c","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.466Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-45933ee7c7e9633eecd0ea28: done: 0.088952 sec","job_status":"done","queue_duration_s":0.084128,"scheduling_latency_s":0.084172,"redis_calls":10,"redis_duration_s":0.004711,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000839,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002813,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00065912,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.088952,"completed_at":"2026-06-08T13:18:16.639Z","load_balancing_strategy":"primary","db_duration_s":0.028377,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324vm-test-run-nixbot-gitlab> gitlab # [  219.911847] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:16.663Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"b4345d6ff38e2b5669ec6cb3","created_at":"2026-06-08T13:18:16.510Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec5f6eca8158d46d2958a56c3b671cd0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.651Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-b4345d6ff38e2b5669ec6cb3: start","job_status":"start","queue_duration_s":0.011973,"scheduling_latency_s":0.012018}1325vm-test-run-nixbot-gitlab> gitlab # [  219.942378] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:16.725Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"b4345d6ff38e2b5669ec6cb3","created_at":"2026-06-08T13:18:16.510Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec5f6eca8158d46d2958a56c3b671cd0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.651Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-b4345d6ff38e2b5669ec6cb3: done: 0.062457 sec","job_status":"done","queue_duration_s":0.011973,"scheduling_latency_s":0.012018,"redis_calls":12,"redis_duration_s":0.002502,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000841,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001192,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000469,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021377,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032754,"duration_s":0.062457,"completed_at":"2026-06-08T13:18:16.725Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013811,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326vm-test-run-nixbot-gitlab> gitlab # [  219.991029] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:16.727Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"1ab1aeb8502beccf63108e15","created_at":"2026-06-08T13:18:16.662Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"45d0cf70b0ddf4eb99e91d9d79984254","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.690Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-1ab1aeb8502beccf63108e15: start","job_status":"start","queue_duration_s":0.036561,"scheduling_latency_s":0.036582}1327vm-test-run-nixbot-gitlab> gitlab # [  220.733497] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:17.515Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"1ab1aeb8502beccf63108e15","created_at":"2026-06-08T13:18:16.662Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"45d0cf70b0ddf4eb99e91d9d79984254","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.690Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-1ab1aeb8502beccf63108e15: done: 0.788415 sec","job_status":"done","queue_duration_s":0.036561,"scheduling_latency_s":0.036582,"redis_calls":12,"redis_duration_s":0.008589,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002411,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004112,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002066,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.044,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.36082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0014689,"exclusive_lock_hold_duration_s":0.6097906,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.788415,"completed_at":"2026-06-08T13:18:17.515Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.058748,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328vm-test-run-nixbot-gitlab> gitlab # [  220.733976] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:17.517Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"f53f765ce295d5b1c0e0cca1","created_at":"2026-06-08T13:18:16.696Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ece78c3409af5a7ce0c400ec3667472b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.718Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-f53f765ce295d5b1c0e0cca1: start","job_status":"start","queue_duration_s":0.799381,"scheduling_latency_s":0.799403}1329vm-test-run-nixbot-gitlab> gitlab # [  220.823107] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:17.539Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"f53f765ce295d5b1c0e0cca1","created_at":"2026-06-08T13:18:16.696Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ece78c3409af5a7ce0c400ec3667472b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.718Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-f53f765ce295d5b1c0e0cca1: done: 0.022143 sec","job_status":"done","queue_duration_s":0.799381,"scheduling_latency_s":0.799403,"redis_calls":12,"redis_duration_s":0.0031899999999999997,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000605,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001437,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001148,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003257,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.022143,"completed_at":"2026-06-08T13:18:17.539Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000769,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330vm-test-run-nixbot-gitlab> gitlab # [  221.500483] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:17.541Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"9db288e949b31ccbd039f4af","created_at":"2026-06-08T13:18:16.728Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ffc360108d75906c4320dc441a4f9165","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-06-08T13:18:16.734Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-9db288e949b31ccbd039f4af: start","job_status":"start","queue_duration_s":0.807337,"scheduling_latency_s":0.807357}1331vm-test-run-nixbot-gitlab> gitlab # [  221.500577] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:17.553Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1332vm-test-run-nixbot-gitlab> gitlab # [  221.500701] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:17.561Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"9db288e949b31ccbd039f4af","created_at":"2026-06-08T13:18:16.728Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ffc360108d75906c4320dc441a4f9165","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-06-08T13:18:16.734Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-9db288e949b31ccbd039f4af: done: 0.019617 sec","job_status":"done","queue_duration_s":0.807337,"scheduling_latency_s":0.807357,"redis_calls":10,"redis_duration_s":0.002376,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000491,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0014,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000485,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032706,"duration_s":0.019617,"completed_at":"2026-06-08T13:18:17.561Z","load_balancing_strategy":"primary","db_duration_s":0.000627,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333vm-test-run-nixbot-gitlab> gitlab # [  222.112300] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:17.563Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"04b2eb9cd7cd39169d37fd7a","created_at":"2026-06-08T13:18:16.765Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"03dbfa0467539cd92cc18a3c6f8a691f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.771Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-04b2eb9cd7cd39169d37fd7a: start","job_status":"start","queue_duration_s":0.791724,"scheduling_latency_s":0.791741}1334vm-test-run-nixbot-gitlab> gitlab # [  222.112425] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:17.575Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1335vm-test-run-nixbot-gitlab> gitlab # [  222.112582] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:17.582Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"04b2eb9cd7cd39169d37fd7a","created_at":"2026-06-08T13:18:16.765Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"03dbfa0467539cd92cc18a3c6f8a691f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.771Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-04b2eb9cd7cd39169d37fd7a: done: 0.019468 sec","job_status":"done","queue_duration_s":0.791724,"scheduling_latency_s":0.791741,"redis_calls":10,"redis_duration_s":0.0023769999999999998,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000492,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001385,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0005,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031606,"duration_s":0.019468,"completed_at":"2026-06-08T13:18:17.582Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000628,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336vm-test-run-nixbot-gitlab> gitlab # [  222.815150] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:17.584Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"fded85f76f544e1e6ffd8bfa","created_at":"2026-06-08T13:18:16.776Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b8fb4b1f11e5e927f8bd648acbee1ff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.783Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-fded85f76f544e1e6ffd8bfa: start","job_status":"start","queue_duration_s":0.800669,"scheduling_latency_s":0.800686}1337vm-test-run-nixbot-gitlab> gitlab # [  222.867721] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:17.596Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1338vm-test-run-nixbot-gitlab> gitlab # [  222.871338] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:17.603Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"fded85f76f544e1e6ffd8bfa","created_at":"2026-06-08T13:18:16.776Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b8fb4b1f11e5e927f8bd648acbee1ff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.783Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-fded85f76f544e1e6ffd8bfa: done: 0.019684 sec","job_status":"done","queue_duration_s":0.800669,"scheduling_latency_s":0.800686,"redis_calls":10,"redis_duration_s":0.002547,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000507,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001422,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000618,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031812,"duration_s":0.019684,"completed_at":"2026-06-08T13:18:17.603Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000572,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339vm-test-run-nixbot-gitlab> gitlab # [  222.910659] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:17.605Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"0c28d8c48ff731e6209b511d","created_at":"2026-06-08T13:18:16.786Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6fa6f50f660445e7b82378844d974b5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.793Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-0c28d8c48ff731e6209b511d: start","job_status":"start","queue_duration_s":0.811995,"scheduling_latency_s":0.812011}1340vm-test-run-nixbot-gitlab> gitlab # [  222.924153] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:17.625Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"0c28d8c48ff731e6209b511d","created_at":"2026-06-08T13:18:16.786Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6fa6f50f660445e7b82378844d974b5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.793Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-0c28d8c48ff731e6209b511d: done: 0.019978 sec","job_status":"done","queue_duration_s":0.811995,"scheduling_latency_s":0.812011,"redis_calls":10,"redis_duration_s":0.002297,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00048,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00134,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000477,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029988,"duration_s":0.019978,"completed_at":"2026-06-08T13:18:17.624Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000562,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341vm-test-run-nixbot-gitlab> gitlab # [  222.964285] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:17.626Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"ad300ab26555fb0819aec4ef","created_at":"2026-06-08T13:18:16.801Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"64624245078a4e36ab2f5893b3c93f5a","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.807Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-ad300ab26555fb0819aec4ef: start","job_status":"start","queue_duration_s":0.81916,"scheduling_latency_s":0.819177}1342vm-test-run-nixbot-gitlab> gitlab # [  222.977212] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:17.664Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"ad300ab26555fb0819aec4ef","created_at":"2026-06-08T13:18:16.801Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"64624245078a4e36ab2f5893b3c93f5a","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.807Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-ad300ab26555fb0819aec4ef: done: 0.037587 sec","job_status":"done","queue_duration_s":0.81916,"scheduling_latency_s":0.819177,"redis_calls":16,"redis_duration_s":0.003661,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001892,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001253,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000516,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031736,"duration_s":0.037587,"completed_at":"2026-06-08T13:18:17.664Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009854,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343vm-test-run-nixbot-gitlab> gitlab # [  223.016235] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:17.665Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"22151181be3204083e6b5837","created_at":"2026-06-08T13:18:16.831Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a6b51d15bdcfdaf76dd5ab118fc04ece","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.856Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-22151181be3204083e6b5837: start","job_status":"start","queue_duration_s":0.80896,"scheduling_latency_s":0.808978}1344vm-test-run-nixbot-gitlab> gitlab # [  223.029647] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:17.691Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"22151181be3204083e6b5837","created_at":"2026-06-08T13:18:16.831Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a6b51d15bdcfdaf76dd5ab118fc04ece","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.856Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-22151181be3204083e6b5837: done: 0.026222 sec","job_status":"done","queue_duration_s":0.80896,"scheduling_latency_s":0.808978,"redis_calls":12,"redis_duration_s":0.003385,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000462,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00176,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001163,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005333,"exclusive_lock_hold_duration_s":0.00633702,"duration_s":0.026222,"completed_at":"2026-06-08T13:18:17.691Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00428,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345vm-test-run-nixbot-gitlab> gitlab # [  223.069063] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:17.693Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"9737ef8c631343cfb275f24a","created_at":"2026-06-08T13:18:16.862Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a81722a4365f81a987bcbf2457cbab8a","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.879Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-9737ef8c631343cfb275f24a: start","job_status":"start","queue_duration_s":0.813817,"scheduling_latency_s":0.813834}1346vm-test-run-nixbot-gitlab> gitlab # [  223.082437] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:17.720Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"9737ef8c631343cfb275f24a","created_at":"2026-06-08T13:18:16.862Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a81722a4365f81a987bcbf2457cbab8a","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.879Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-9737ef8c631343cfb275f24a: done: 0.026524 sec","job_status":"done","queue_duration_s":0.813817,"scheduling_latency_s":0.813834,"redis_calls":12,"redis_duration_s":0.00294,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000443,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00143,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001067,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005234,"exclusive_lock_hold_duration_s":0.00699366,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.026524,"completed_at":"2026-06-08T13:18:17.720Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004636,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347vm-test-run-nixbot-gitlab> gitlab # [  223.123068] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:17.721Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"31c6e39aed96c1e6aee33104","created_at":"2026-06-08T13:18:16.891Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"233a32222b7120fdd9a476e6fa6baa02","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.932Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-31c6e39aed96c1e6aee33104: start","job_status":"start","queue_duration_s":0.788958,"scheduling_latency_s":0.788975}1348vm-test-run-nixbot-gitlab> gitlab # [  223.136380] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.027Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"31c6e39aed96c1e6aee33104","created_at":"2026-06-08T13:18:16.891Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"233a32222b7120fdd9a476e6fa6baa02","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.932Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-31c6e39aed96c1e6aee33104: done: 0.305443 sec","job_status":"done","queue_duration_s":0.788958,"scheduling_latency_s":0.788975,"redis_calls":574,"redis_duration_s":0.06902100000000001,"redis_read_bytes":573,"redis_write_bytes":49866,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000475,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001141,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.067405,"redis_shared_state_read_bytes":567,"redis_shared_state_write_bytes":49017,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.267937,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024276,"duration_s":0.305443,"completed_at":"2026-06-08T13:18:18.027Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000597,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349vm-test-run-nixbot-gitlab> gitlab # [  223.176385] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.028Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"6f7968a883ff305433ae5299","created_at":"2026-06-08T13:18:16.963Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.976Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-6f7968a883ff305433ae5299: start","job_status":"start","queue_duration_s":1.051925,"scheduling_latency_s":1.051941}1350vm-test-run-nixbot-gitlab> gitlab # [  223.188777] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.189Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"6f7968a883ff305433ae5299","created_at":"2026-06-08T13:18:16.963Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.976Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-6f7968a883ff305433ae5299: done: 0.161038 sec","job_status":"done","queue_duration_s":1.051925,"scheduling_latency_s":1.051941,"redis_calls":71,"redis_duration_s":0.020974,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002859,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001267,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.016289,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000559,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.141786,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038452,"duration_s":0.161038,"completed_at":"2026-06-08T13:18:18.189Z","load_balancing_strategy":"primary","db_duration_s":0.002844,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351vm-test-run-nixbot-gitlab> gitlab # [  223.228374] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.190Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"bbeebebcf9f6f966fad5f880","created_at":"2026-06-08T13:18:16.986Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e72e705065a120ddf6ef0af59b018b1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.999Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-bbeebebcf9f6f966fad5f880: start","job_status":"start","queue_duration_s":1.19162,"scheduling_latency_s":1.191638}1352vm-test-run-nixbot-gitlab> gitlab # [  223.241694] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.279Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"bbeebebcf9f6f966fad5f880","created_at":"2026-06-08T13:18:16.986Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e72e705065a120ddf6ef0af59b018b1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:16.999Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-bbeebebcf9f6f966fad5f880: done: 0.08899 sec","job_status":"done","queue_duration_s":1.19162,"scheduling_latency_s":1.191638,"redis_calls":14,"redis_duration_s":0.005101,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000962,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00242,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001719,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.025,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047349,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00059668,"exclusive_lock_hold_duration_s":0.05274504,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.08899,"completed_at":"2026-06-08T13:18:18.279Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028667,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353vm-test-run-nixbot-gitlab> gitlab # [  223.283201] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.283Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"5c9aaa968686adf69aaf138a","created_at":"2026-06-08T13:18:17.016Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1737a5cf821064ea5d3c5b757a8e11f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:17.030Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-5c9aaa968686adf69aaf138a: start","job_status":"start","queue_duration_s":1.252405,"scheduling_latency_s":1.252447}1354vm-test-run-nixbot-gitlab> gitlab # [  223.296946] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.308Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1355vm-test-run-nixbot-gitlab> gitlab # [  223.300403] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.325Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"5c9aaa968686adf69aaf138a","created_at":"2026-06-08T13:18:17.016Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1737a5cf821064ea5d3c5b757a8e11f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:17.030Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-5c9aaa968686adf69aaf138a: done: 0.042562 sec","job_status":"done","queue_duration_s":1.252405,"scheduling_latency_s":1.252447,"redis_calls":10,"redis_duration_s":0.003607,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000799,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002024,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000784,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024136,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00082488,"duration_s":0.042562,"completed_at":"2026-06-08T13:18:18.325Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000812,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356vm-test-run-nixbot-gitlab> gitlab # [  223.339807] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.329Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c68acf8c3326a2799e2a4a73","created_at":"2026-06-08T13:18:17.042Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c21c91aa976769de8dcca3842084deb2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-06-08T13:18:17.055Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c68acf8c3326a2799e2a4a73: start","job_status":"start","queue_duration_s":1.274196,"scheduling_latency_s":1.274229}1357vm-test-run-nixbot-gitlab> gitlab # [  223.353253] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.387Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c68acf8c3326a2799e2a4a73","created_at":"2026-06-08T13:18:17.042Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c21c91aa976769de8dcca3842084deb2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-06-08T13:18:17.055Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c68acf8c3326a2799e2a4a73: done: 0.058013 sec","job_status":"done","queue_duration_s":1.274196,"scheduling_latency_s":1.274229,"redis_calls":10,"redis_duration_s":0.0048909999999999995,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000651,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00246,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00178,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00063788,"duration_s":0.058013,"completed_at":"2026-06-08T13:18:18.387Z","load_balancing_strategy":"primary","db_duration_s":0.006749,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358vm-test-run-nixbot-gitlab> gitlab # [  223.391229] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.390Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"67b15c24303ce030aef542fe","created_at":"2026-06-08T13:18:17.064Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7fbc64d5328549221bfe293c80912644","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:17.075Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-67b15c24303ce030aef542fe: start","job_status":"start","queue_duration_s":1.314363,"scheduling_latency_s":1.314391}1359vm-test-run-nixbot-gitlab> gitlab # [  223.404988] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.441Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"67b15c24303ce030aef542fe","created_at":"2026-06-08T13:18:17.064Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7fbc64d5328549221bfe293c80912644","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:17.075Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-67b15c24303ce030aef542fe: done: 0.051759 sec","job_status":"done","queue_duration_s":1.314363,"scheduling_latency_s":1.314391,"redis_calls":13,"redis_duration_s":0.003875,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000526,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002043,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001306,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01756724,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.051759,"completed_at":"2026-06-08T13:18:18.441Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007064,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1360vm-test-run-nixbot-gitlab> gitlab # [  223.447085] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.443Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"b336af128d6e4db03c4f2dba","created_at":"2026-06-08T13:18:17.082Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4e3f95484d985bdd2a30cd8d569fe31","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:17.091Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-b336af128d6e4db03c4f2dba: start","job_status":"start","queue_duration_s":1.352395,"scheduling_latency_s":1.352418}1361vm-test-run-nixbot-gitlab> gitlab # [  223.461048] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.478Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"b336af128d6e4db03c4f2dba","created_at":"2026-06-08T13:18:17.082Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4e3f95484d985bdd2a30cd8d569fe31","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:17.091Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-b336af128d6e4db03c4f2dba: done: 0.034776 sec","job_status":"done","queue_duration_s":1.352395,"scheduling_latency_s":1.352418,"redis_calls":10,"redis_duration_s":0.0026620000000000003,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000482,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0016,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00058,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003692,"duration_s":0.034776,"completed_at":"2026-06-08T13:18:18.478Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005168,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362vm-test-run-nixbot-gitlab> gitlab # [  223.501553] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.480Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c4441b25576faab2202eb717","created_at":"2026-06-08T13:18:17.108Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f48ee58edfbced84fa7a63a5cd6fb767","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:17.117Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c4441b25576faab2202eb717: start","job_status":"start","queue_duration_s":1.363095,"scheduling_latency_s":1.363143}1363vm-test-run-nixbot-gitlab> gitlab # [  223.514500] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.511Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c4441b25576faab2202eb717","created_at":"2026-06-08T13:18:17.108Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f48ee58edfbced84fa7a63a5cd6fb767","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:17.117Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c4441b25576faab2202eb717: done: 0.031638 sec","job_status":"done","queue_duration_s":1.363095,"scheduling_latency_s":1.363143,"redis_calls":12,"redis_duration_s":0.003043,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000483,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001452,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001108,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00058112,"exclusive_lock_hold_duration_s":0.00869882,"duration_s":0.031638,"completed_at":"2026-06-08T13:18:18.511Z","load_balancing_strategy":"primary","db_duration_s":0.004997,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364vm-test-run-nixbot-gitlab> gitlab # [  223.555051] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.513Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"315c01709b06b1bf91b51700","created_at":"2026-06-08T13:18:17.143Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9386bfcf1f49a01b7f7ae4c2a01894d1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:17.149Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-315c01709b06b1bf91b51700: start","job_status":"start","queue_duration_s":1.363779,"scheduling_latency_s":1.363798}1365vm-test-run-nixbot-gitlab> gitlab # [  223.568936] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.526Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1366vm-test-run-nixbot-gitlab> gitlab # [  223.571858] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.534Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"315c01709b06b1bf91b51700","created_at":"2026-06-08T13:18:17.143Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9386bfcf1f49a01b7f7ae4c2a01894d1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:17.149Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-315c01709b06b1bf91b51700: done: 0.020785 sec","job_status":"done","queue_duration_s":1.363779,"scheduling_latency_s":1.363798,"redis_calls":10,"redis_duration_s":0.002418,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000483,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001429,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000506,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003277,"duration_s":0.020785,"completed_at":"2026-06-08T13:18:18.534Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000703,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367vm-test-run-nixbot-gitlab> gitlab # [  223.612988] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.535Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"fab04ad60364f412c435b06e","created_at":"2026-06-08T13:18:17.156Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"521819a4cc7c2f065fefa018be0b56e9","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:17.163Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-fab04ad60364f412c435b06e: start","job_status":"start","queue_duration_s":1.37225,"scheduling_latency_s":1.372267}1368vm-test-run-nixbot-gitlab> gitlab # [  223.625651] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.556Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"fab04ad60364f412c435b06e","created_at":"2026-06-08T13:18:17.156Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"521819a4cc7c2f065fefa018be0b56e9","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:17.163Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-fab04ad60364f412c435b06e: done: 0.020617 sec","job_status":"done","queue_duration_s":1.37225,"scheduling_latency_s":1.372267,"redis_calls":12,"redis_duration_s":0.0030039999999999997,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000643,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000525,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001352,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000484,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031156,"duration_s":0.020617,"completed_at":"2026-06-08T13:18:18.556Z","load_balancing_strategy":"primary","db_duration_s":0.000484,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369vm-test-run-nixbot-gitlab> gitlab # [  223.666445] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.557Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"addaef507b568425aeea63a9","created_at":"2026-06-08T13:18:17.168Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"89b64883a4374f210002be6511848a3c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:17.175Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-addaef507b568425aeea63a9: start","job_status":"start","queue_duration_s":1.382618,"scheduling_latency_s":1.382635}1370vm-test-run-nixbot-gitlab> gitlab # [  223.679936] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.798Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"addaef507b568425aeea63a9","created_at":"2026-06-08T13:18:17.168Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"89b64883a4374f210002be6511848a3c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:17.175Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-addaef507b568425aeea63a9: done: 0.241007 sec","job_status":"done","queue_duration_s":1.382618,"scheduling_latency_s":1.382635,"redis_calls":14,"redis_duration_s":0.003302,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000877,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001367,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001058,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":125,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":125,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":125,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":80,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.045,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.177671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00055076,"exclusive_lock_hold_duration_s":0.2188773,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.241007,"completed_at":"2026-06-08T13:18:18.798Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.067941,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371vm-test-run-nixbot-gitlab> gitlab # [  223.722272] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.800Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"c96a4ac7f6ddeb901c156cec","created_at":"2026-06-08T13:18:17.180Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a142e0182f8ef36c0608ad5f5e4d6c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:17.186Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-c96a4ac7f6ddeb901c156cec: start","job_status":"start","queue_duration_s":1.613915,"scheduling_latency_s":1.613933}1372vm-test-run-nixbot-gitlab> gitlab # [  223.735080] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.873Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"c96a4ac7f6ddeb901c156cec","created_at":"2026-06-08T13:18:17.180Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a142e0182f8ef36c0608ad5f5e4d6c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-06-08T13:18:17.186Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-c96a4ac7f6ddeb901c156cec: done: 0.07248 sec","job_status":"done","queue_duration_s":1.613915,"scheduling_latency_s":1.613933,"redis_calls":19,"redis_duration_s":0.004881,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001098,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000434,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002546,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000803,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00053902,"duration_s":0.07248,"completed_at":"2026-06-08T13:18:18.873Z","load_balancing_strategy":"primary","db_duration_s":0.024432,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373vm-test-run-nixbot-gitlab> gitlab # [  223.776532] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.874Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"8cd6ff221928e8fdebcf991f","created_at":"2026-06-08T13:18:17.195Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dac5698906881cb43d5ae218974b9396","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-06-08T13:18:17.206Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-8cd6ff221928e8fdebcf991f: start","job_status":"start","queue_duration_s":1.667958,"scheduling_latency_s":1.667975}1374vm-test-run-nixbot-gitlab> gitlab # [  223.789093] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.887Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1375vm-test-run-nixbot-gitlab> gitlab # [  223.792449] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.894Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"8cd6ff221928e8fdebcf991f","created_at":"2026-06-08T13:18:17.195Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dac5698906881cb43d5ae218974b9396","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-06-08T13:18:17.206Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-8cd6ff221928e8fdebcf991f: done: 0.019382 sec","job_status":"done","queue_duration_s":1.667958,"scheduling_latency_s":1.667975,"redis_calls":10,"redis_duration_s":0.00239,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000537,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0014,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000453,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031272,"duration_s":0.019382,"completed_at":"2026-06-08T13:18:18.894Z","load_balancing_strategy":"primary","db_duration_s":0.000881,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376vm-test-run-nixbot-gitlab> gitlab # [  223.831636] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1c4dc03c6b378875bfb7a03","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1c4dc03c6b378875bfb7a03: start","job_status":"start","queue_duration_s":0.715945,"scheduling_latency_s":0.715962}1377vm-test-run-nixbot-gitlab> gitlab # [  223.866709] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1c4dc03c6b378875bfb7a03","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1c4dc03c6b378875bfb7a03: done: 0.022089 sec","job_status":"done","queue_duration_s":0.715945,"scheduling_latency_s":0.715962,"redis_calls":16,"redis_duration_s":0.00378,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000482,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000989,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002309,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030374,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022089,"completed_at":"2026-06-08T13:18:18.917Z","load_balancing_strategy":"primary","db_duration_s":0.000671,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378vm-test-run-nixbot-gitlab> gitlab # [  223.936043] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17505c863a4c53625b8ea4db","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17505c863a4c53625b8ea4db: start","job_status":"start","queue_duration_s":0.739303,"scheduling_latency_s":0.73932}1379vm-test-run-nixbot-gitlab> gitlab # [  223.949270] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.934Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17505c863a4c53625b8ea4db","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17505c863a4c53625b8ea4db: done: 0.016013 sec","job_status":"done","queue_duration_s":0.739303,"scheduling_latency_s":0.73932,"redis_calls":13,"redis_duration_s":0.002601,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001659,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016013,"completed_at":"2026-06-08T13:18:18.934Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380vm-test-run-nixbot-gitlab> gitlab # [  223.989945] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.936Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ce9ae4cf86af9cc10450c70","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ce9ae4cf86af9cc10450c70: start","job_status":"start","queue_duration_s":0.756636,"scheduling_latency_s":0.756653}1381vm-test-run-nixbot-gitlab> gitlab # [  224.003462] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ce9ae4cf86af9cc10450c70","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ce9ae4cf86af9cc10450c70: done: 0.015478 sec","job_status":"done","queue_duration_s":0.756636,"scheduling_latency_s":0.756653,"redis_calls":13,"redis_duration_s":0.002722,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001801,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009656,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015478,"completed_at":"2026-06-08T13:18:18.951Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382vm-test-run-nixbot-gitlab> gitlab # [  224.044163] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.953Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"daeb98d2c3e5265aee7d0756","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-daeb98d2c3e5265aee7d0756: start","job_status":"start","queue_duration_s":0.773746,"scheduling_latency_s":0.773762}1383vm-test-run-nixbot-gitlab> gitlab # [  224.055464] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"daeb98d2c3e5265aee7d0756","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-daeb98d2c3e5265aee7d0756: done: 0.01597 sec","job_status":"done","queue_duration_s":0.773746,"scheduling_latency_s":0.773762,"redis_calls":13,"redis_duration_s":0.003029,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002125,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01597,"completed_at":"2026-06-08T13:18:18.969Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384vm-test-run-nixbot-gitlab> gitlab # [  224.091887] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22ba441e900f0a6b37b17797","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22ba441e900f0a6b37b17797: start","job_status":"start","queue_duration_s":0.791297,"scheduling_latency_s":0.791315}1385vm-test-run-nixbot-gitlab> gitlab # [  224.104047] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.986Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22ba441e900f0a6b37b17797","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22ba441e900f0a6b37b17797: done: 0.015733 sec","job_status":"done","queue_duration_s":0.791297,"scheduling_latency_s":0.791315,"redis_calls":13,"redis_duration_s":0.0027749999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000975,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015733,"completed_at":"2026-06-08T13:18:18.986Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386vm-test-run-nixbot-gitlab> gitlab # [  224.141364] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:18.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b326f5d22919438fc4dd127","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b326f5d22919438fc4dd127: start","job_status":"start","queue_duration_s":0.808497,"scheduling_latency_s":0.808513}1387vm-test-run-nixbot-gitlab> gitlab # [  224.153000] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b326f5d22919438fc4dd127","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b326f5d22919438fc4dd127: done: 0.015547 sec","job_status":"done","queue_duration_s":0.808497,"scheduling_latency_s":0.808513,"redis_calls":13,"redis_duration_s":0.00276,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001833,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015547,"completed_at":"2026-06-08T13:18:19.003Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388vm-test-run-nixbot-gitlab> gitlab # [  224.190847] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcf7ab5cd2011525e2b0694f","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcf7ab5cd2011525e2b0694f: start","job_status":"start","queue_duration_s":0.82561,"scheduling_latency_s":0.825627}1389vm-test-run-nixbot-gitlab> gitlab # [  224.202529] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.020Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcf7ab5cd2011525e2b0694f","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcf7ab5cd2011525e2b0694f: done: 0.015582 sec","job_status":"done","queue_duration_s":0.82561,"scheduling_latency_s":0.825627,"redis_calls":13,"redis_duration_s":0.002649,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001725,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015582,"completed_at":"2026-06-08T13:18:19.020Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390vm-test-run-nixbot-gitlab> gitlab # [  224.239436] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.022Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b37204dbffcea44308d625e9","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b37204dbffcea44308d625e9: start","job_status":"start","queue_duration_s":0.842723,"scheduling_latency_s":0.842738}1391vm-test-run-nixbot-gitlab> gitlab # [  224.251375] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.037Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b37204dbffcea44308d625e9","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b37204dbffcea44308d625e9: done: 0.015356 sec","job_status":"done","queue_duration_s":0.842723,"scheduling_latency_s":0.842738,"redis_calls":13,"redis_duration_s":0.002666,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000947,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001719,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015356,"completed_at":"2026-06-08T13:18:19.037Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392vm-test-run-nixbot-gitlab> gitlab # [  224.288300] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"296c5272fc390b8d2a642eb5","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-296c5272fc390b8d2a642eb5: start","job_status":"start","queue_duration_s":0.859484,"scheduling_latency_s":0.859499}1393vm-test-run-nixbot-gitlab> gitlab # [  224.299740] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.054Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"296c5272fc390b8d2a642eb5","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-296c5272fc390b8d2a642eb5: done: 0.015935 sec","job_status":"done","queue_duration_s":0.859484,"scheduling_latency_s":0.859499,"redis_calls":13,"redis_duration_s":0.002998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001138,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00186,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015935,"completed_at":"2026-06-08T13:18:19.054Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394vm-test-run-nixbot-gitlab> gitlab # [  224.336866] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.056Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea6367987f3b1e2e58678f43","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea6367987f3b1e2e58678f43: start","job_status":"start","queue_duration_s":0.876656,"scheduling_latency_s":0.876672}1395vm-test-run-nixbot-gitlab> gitlab # [  224.348306] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea6367987f3b1e2e58678f43","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea6367987f3b1e2e58678f43: done: 0.015734 sec","job_status":"done","queue_duration_s":0.876656,"scheduling_latency_s":0.876672,"redis_calls":13,"redis_duration_s":0.002702,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001782,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015734,"completed_at":"2026-06-08T13:18:19.071Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396vm-test-run-nixbot-gitlab> gitlab # [  224.385835] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7c644b0e06e7f8bc4f221d8","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7c644b0e06e7f8bc4f221d8: start","job_status":"start","queue_duration_s":0.894304,"scheduling_latency_s":0.89432}1397vm-test-run-nixbot-gitlab> gitlab # [  224.397644] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7c644b0e06e7f8bc4f221d8","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7c644b0e06e7f8bc4f221d8: done: 0.015338 sec","job_status":"done","queue_duration_s":0.894304,"scheduling_latency_s":0.89432,"redis_calls":13,"redis_duration_s":0.002513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000941,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001572,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015338,"completed_at":"2026-06-08T13:18:19.089Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398vm-test-run-nixbot-gitlab> gitlab # [  224.434428] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.090Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b5a53319dd62a1103aa8a35","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b5a53319dd62a1103aa8a35: start","job_status":"start","queue_duration_s":0.910999,"scheduling_latency_s":0.911015}1399vm-test-run-nixbot-gitlab> gitlab # [  224.446238] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b5a53319dd62a1103aa8a35","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b5a53319dd62a1103aa8a35: done: 0.015671 sec","job_status":"done","queue_duration_s":0.910999,"scheduling_latency_s":0.911015,"redis_calls":13,"redis_duration_s":0.0026750000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001745,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015671,"completed_at":"2026-06-08T13:18:19.106Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400vm-test-run-nixbot-gitlab> gitlab # [  224.483338] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.107Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9980e72042b971407d8927ac","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9980e72042b971407d8927ac: start","job_status":"start","queue_duration_s":0.927955,"scheduling_latency_s":0.927971}1401vm-test-run-nixbot-gitlab> gitlab # [  224.495013] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9980e72042b971407d8927ac","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9980e72042b971407d8927ac: done: 0.015544 sec","job_status":"done","queue_duration_s":0.927955,"scheduling_latency_s":0.927971,"redis_calls":13,"redis_duration_s":0.002643,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001701,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015544,"completed_at":"2026-06-08T13:18:19.123Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402vm-test-run-nixbot-gitlab> gitlab # [  224.531747] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1a47c62b0cbaac3ac8f8112","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1a47c62b0cbaac3ac8f8112: start","job_status":"start","queue_duration_s":0.944957,"scheduling_latency_s":0.944972}1403vm-test-run-nixbot-gitlab> gitlab # [  224.543740] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.139Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1a47c62b0cbaac3ac8f8112","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1a47c62b0cbaac3ac8f8112: done: 0.015406 sec","job_status":"done","queue_duration_s":0.944957,"scheduling_latency_s":0.944972,"redis_calls":13,"redis_duration_s":0.002628,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000888,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00174,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015406,"completed_at":"2026-06-08T13:18:19.139Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404vm-test-run-nixbot-gitlab> gitlab # [  224.581359] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"daabb38294367299a3fafebe","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-daabb38294367299a3fafebe: start","job_status":"start","queue_duration_s":0.961829,"scheduling_latency_s":0.961845}1405vm-test-run-nixbot-gitlab> gitlab # [  224.592891] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.157Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"daabb38294367299a3fafebe","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-daabb38294367299a3fafebe: done: 0.015646 sec","job_status":"done","queue_duration_s":0.961829,"scheduling_latency_s":0.961845,"redis_calls":13,"redis_duration_s":0.002673,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001761,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015646,"completed_at":"2026-06-08T13:18:19.156Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406vm-test-run-nixbot-gitlab> gitlab # [  224.629590] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.158Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12746f4efdeef6776fd55c12","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12746f4efdeef6776fd55c12: start","job_status":"start","queue_duration_s":0.978934,"scheduling_latency_s":0.97895}1407vm-test-run-nixbot-gitlab> gitlab # [  224.641626] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.174Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12746f4efdeef6776fd55c12","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12746f4efdeef6776fd55c12: done: 0.015694 sec","job_status":"done","queue_duration_s":0.978934,"scheduling_latency_s":0.97895,"redis_calls":13,"redis_duration_s":0.002992,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001068,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001924,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009896,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015694,"completed_at":"2026-06-08T13:18:19.174Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408vm-test-run-nixbot-gitlab> gitlab # [  224.678943] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.175Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ec65b84042d7a9911184c91","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ec65b84042d7a9911184c91: start","job_status":"start","queue_duration_s":0.996207,"scheduling_latency_s":0.996223}1409vm-test-run-nixbot-gitlab> gitlab # [  224.690860] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ec65b84042d7a9911184c91","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ec65b84042d7a9911184c91: done: 0.015381 sec","job_status":"done","queue_duration_s":0.996207,"scheduling_latency_s":0.996223,"redis_calls":13,"redis_duration_s":0.0028710000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001978,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015381,"completed_at":"2026-06-08T13:18:19.191Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410vm-test-run-nixbot-gitlab> gitlab # [  224.727554] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45ffc91913ab9b78bf70bff0","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45ffc91913ab9b78bf70bff0: start","job_status":"start","queue_duration_s":1.01319,"scheduling_latency_s":1.013207}1411vm-test-run-nixbot-gitlab> gitlab # [  224.739139] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.208Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45ffc91913ab9b78bf70bff0","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45ffc91913ab9b78bf70bff0: done: 0.015597 sec","job_status":"done","queue_duration_s":1.01319,"scheduling_latency_s":1.013207,"redis_calls":13,"redis_duration_s":0.002729,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001778,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009896,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015597,"completed_at":"2026-06-08T13:18:19.208Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412vm-test-run-nixbot-gitlab> gitlab # [  224.775655] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22c011c5f788e4d75e3c17e5","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22c011c5f788e4d75e3c17e5: start","job_status":"start","queue_duration_s":1.030101,"scheduling_latency_s":1.030117}1413vm-test-run-nixbot-gitlab> gitlab # [  224.788335] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22c011c5f788e4d75e3c17e5","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22c011c5f788e4d75e3c17e5: done: 0.015702 sec","job_status":"done","queue_duration_s":1.030101,"scheduling_latency_s":1.030117,"redis_calls":13,"redis_duration_s":0.002729,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00181,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015702,"completed_at":"2026-06-08T13:18:19.225Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414vm-test-run-nixbot-gitlab> gitlab # [  224.824756] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c83693d6b9ea3c5568ab3a7","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c83693d6b9ea3c5568ab3a7: start","job_status":"start","queue_duration_s":1.047098,"scheduling_latency_s":1.047114}1415vm-test-run-nixbot-gitlab> gitlab # [  224.836343] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c83693d6b9ea3c5568ab3a7","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c83693d6b9ea3c5568ab3a7: done: 0.015809 sec","job_status":"done","queue_duration_s":1.047098,"scheduling_latency_s":1.047114,"redis_calls":13,"redis_duration_s":0.00269,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001778,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015809,"completed_at":"2026-06-08T13:18:19.242Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416vm-test-run-nixbot-gitlab> gitlab # [  224.872544] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd0a9ffe3b671dab13c4fcd2","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd0a9ffe3b671dab13c4fcd2: start","job_status":"start","queue_duration_s":1.064252,"scheduling_latency_s":1.064267}1417vm-test-run-nixbot-gitlab> gitlab # [  224.883950] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd0a9ffe3b671dab13c4fcd2","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd0a9ffe3b671dab13c4fcd2: done: 0.015808 sec","job_status":"done","queue_duration_s":1.064252,"scheduling_latency_s":1.064267,"redis_calls":13,"redis_duration_s":0.002789,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001869,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015808,"completed_at":"2026-06-08T13:18:19.259Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418vm-test-run-nixbot-gitlab> gitlab # [  224.920584] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.261Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffc416a35e75aaec1cc78764","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffc416a35e75aaec1cc78764: start","job_status":"start","queue_duration_s":1.081495,"scheduling_latency_s":1.081511}1419vm-test-run-nixbot-gitlab> gitlab # [  224.931975] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.276Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffc416a35e75aaec1cc78764","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffc416a35e75aaec1cc78764: done: 0.015774 sec","job_status":"done","queue_duration_s":1.081495,"scheduling_latency_s":1.081511,"redis_calls":13,"redis_duration_s":0.002721,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001808,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015774,"completed_at":"2026-06-08T13:18:19.276Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420vm-test-run-nixbot-gitlab> gitlab # [  224.969171] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.278Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06ff5206d671eefb47f7f478","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06ff5206d671eefb47f7f478: start","job_status":"start","queue_duration_s":1.098607,"scheduling_latency_s":1.098621}1421vm-test-run-nixbot-gitlab> gitlab # [  224.980912] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06ff5206d671eefb47f7f478","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06ff5206d671eefb47f7f478: done: 0.015902 sec","job_status":"done","queue_duration_s":1.098607,"scheduling_latency_s":1.098621,"redis_calls":13,"redis_duration_s":0.002907,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015902,"completed_at":"2026-06-08T13:18:19.294Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422vm-test-run-nixbot-gitlab> gitlab # [  225.018910] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"377a2ad923e5c157800aaaea","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-377a2ad923e5c157800aaaea: start","job_status":"start","queue_duration_s":1.115816,"scheduling_latency_s":1.115831}1423vm-test-run-nixbot-gitlab> gitlab # [  225.054221] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"377a2ad923e5c157800aaaea","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-377a2ad923e5c157800aaaea: done: 0.015463 sec","job_status":"done","queue_duration_s":1.115816,"scheduling_latency_s":1.115831,"redis_calls":13,"redis_duration_s":0.002738,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000911,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001827,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015463,"completed_at":"2026-06-08T13:18:19.310Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424vm-test-run-nixbot-gitlab> gitlab # [  225.124269] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.312Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"295ea2a3ca3cb11e64ef20b2","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-295ea2a3ca3cb11e64ef20b2: start","job_status":"start","queue_duration_s":1.13295,"scheduling_latency_s":1.132965}1425vm-test-run-nixbot-gitlab> gitlab # [  225.138386] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.328Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"295ea2a3ca3cb11e64ef20b2","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-295ea2a3ca3cb11e64ef20b2: done: 0.015637 sec","job_status":"done","queue_duration_s":1.13295,"scheduling_latency_s":1.132965,"redis_calls":13,"redis_duration_s":0.002758,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000941,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001817,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015637,"completed_at":"2026-06-08T13:18:19.328Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426vm-test-run-nixbot-gitlab> gitlab # [  225.177315] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0eaf169b0110863cd18264d6","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0eaf169b0110863cd18264d6: start","job_status":"start","queue_duration_s":1.150142,"scheduling_latency_s":1.150158}1427vm-test-run-nixbot-gitlab> gitlab # [  225.188989] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0eaf169b0110863cd18264d6","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0eaf169b0110863cd18264d6: done: 0.015592 sec","job_status":"done","queue_duration_s":1.150142,"scheduling_latency_s":1.150158,"redis_calls":13,"redis_duration_s":0.0026579999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001727,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009833,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015592,"completed_at":"2026-06-08T13:18:19.345Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428vm-test-run-nixbot-gitlab> gitlab # [  225.227454] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.351Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"077d9fc77b5133ef86d4bfcd","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-077d9fc77b5133ef86d4bfcd: start","job_status":"start","queue_duration_s":1.17142,"scheduling_latency_s":1.171465}1429vm-test-run-nixbot-gitlab> gitlab # [  225.239553] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"077d9fc77b5133ef86d4bfcd","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-077d9fc77b5133ef86d4bfcd: done: 0.036226 sec","job_status":"done","queue_duration_s":1.17142,"scheduling_latency_s":1.171465,"redis_calls":13,"redis_duration_s":0.007129,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001184,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036226,"completed_at":"2026-06-08T13:18:19.387Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430vm-test-run-nixbot-gitlab> gitlab # [  225.277125] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a09ce50200065b61db11c63f","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a09ce50200065b61db11c63f: start","job_status":"start","queue_duration_s":1.209151,"scheduling_latency_s":1.209171}1431vm-test-run-nixbot-gitlab> gitlab # [  225.288864] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a09ce50200065b61db11c63f","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a09ce50200065b61db11c63f: done: 0.015724 sec","job_status":"done","queue_duration_s":1.209151,"scheduling_latency_s":1.209171,"redis_calls":13,"redis_duration_s":0.002754,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001828,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015724,"completed_at":"2026-06-08T13:18:19.404Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432vm-test-run-nixbot-gitlab> gitlab # [  225.326235] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f58134b7aa0c311ba1b252c","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f58134b7aa0c311ba1b252c: start","job_status":"start","queue_duration_s":1.226326,"scheduling_latency_s":1.226342}1433vm-test-run-nixbot-gitlab> gitlab # [  225.338126] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.420Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f58134b7aa0c311ba1b252c","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f58134b7aa0c311ba1b252c: done: 0.015038 sec","job_status":"done","queue_duration_s":1.226326,"scheduling_latency_s":1.226342,"redis_calls":13,"redis_duration_s":0.002651,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001747,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015038,"completed_at":"2026-06-08T13:18:19.420Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434vm-test-run-nixbot-gitlab> gitlab # [  225.375848] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85a70c65f1c707c64036ca1f","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85a70c65f1c707c64036ca1f: start","job_status":"start","queue_duration_s":1.242834,"scheduling_latency_s":1.24285}1435vm-test-run-nixbot-gitlab> gitlab # [  225.388125] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85a70c65f1c707c64036ca1f","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85a70c65f1c707c64036ca1f: done: 0.01514 sec","job_status":"done","queue_duration_s":1.242834,"scheduling_latency_s":1.24285,"redis_calls":13,"redis_duration_s":0.00275,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001836,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009308,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01514,"completed_at":"2026-06-08T13:18:19.437Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436vm-test-run-nixbot-gitlab> gitlab # [  225.426399] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1290f479358a0b248e64899","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1290f479358a0b248e64899: start","job_status":"start","queue_duration_s":1.259251,"scheduling_latency_s":1.259267}1437vm-test-run-nixbot-gitlab> gitlab # [  225.438289] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.453Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1290f479358a0b248e64899","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1290f479358a0b248e64899: done: 0.01513 sec","job_status":"done","queue_duration_s":1.259251,"scheduling_latency_s":1.259267,"redis_calls":13,"redis_duration_s":0.002755,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000967,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001788,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01513,"completed_at":"2026-06-08T13:18:19.453Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438vm-test-run-nixbot-gitlab> gitlab # [  225.475685] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4e0bb3c073a72ad72d5f36e","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4e0bb3c073a72ad72d5f36e: start","job_status":"start","queue_duration_s":1.275666,"scheduling_latency_s":1.275681}1439vm-test-run-nixbot-gitlab> gitlab # [  225.487979] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.499Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4e0bb3c073a72ad72d5f36e","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4e0bb3c073a72ad72d5f36e: done: 0.04412 sec","job_status":"done","queue_duration_s":1.275666,"scheduling_latency_s":1.275681,"redis_calls":13,"redis_duration_s":0.002903,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00196,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.04412,"completed_at":"2026-06-08T13:18:19.499Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440vm-test-run-nixbot-gitlab> gitlab # [  225.525439] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.500Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ebf255eab41729a62ed0bad","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ebf255eab41729a62ed0bad: start","job_status":"start","queue_duration_s":1.321171,"scheduling_latency_s":1.321187}1441vm-test-run-nixbot-gitlab> gitlab # [  225.537102] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ebf255eab41729a62ed0bad","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ebf255eab41729a62ed0bad: done: 0.016783 sec","job_status":"done","queue_duration_s":1.321171,"scheduling_latency_s":1.321187,"redis_calls":13,"redis_duration_s":0.003098,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001121,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016783,"completed_at":"2026-06-08T13:18:19.517Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442vm-test-run-nixbot-gitlab> gitlab # [  225.574826] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.518Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6977d00fc2769e3a72259571","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6977d00fc2769e3a72259571: start","job_status":"start","queue_duration_s":1.339311,"scheduling_latency_s":1.339326}1443vm-test-run-nixbot-gitlab> gitlab # [  225.586611] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6977d00fc2769e3a72259571","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6977d00fc2769e3a72259571: done: 0.015375 sec","job_status":"done","queue_duration_s":1.339311,"scheduling_latency_s":1.339326,"redis_calls":13,"redis_duration_s":0.002751,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001061,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00169,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009505,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015375,"completed_at":"2026-06-08T13:18:19.534Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444vm-test-run-nixbot-gitlab> gitlab # [  225.625123] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42e2bf96b69d1495ca679677","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42e2bf96b69d1495ca679677: start","job_status":"start","queue_duration_s":1.356101,"scheduling_latency_s":1.356117}1445vm-test-run-nixbot-gitlab> gitlab # [  225.636989] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42e2bf96b69d1495ca679677","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42e2bf96b69d1495ca679677: done: 0.015608 sec","job_status":"done","queue_duration_s":1.356101,"scheduling_latency_s":1.356117,"redis_calls":13,"redis_duration_s":0.0027860000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001884,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009812,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015608,"completed_at":"2026-06-08T13:18:19.551Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446vm-test-run-nixbot-gitlab> gitlab # [  225.674466] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.552Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37830acd265c72c626e0888f","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37830acd265c72c626e0888f: start","job_status":"start","queue_duration_s":1.37321,"scheduling_latency_s":1.373226}1447vm-test-run-nixbot-gitlab> gitlab # [  225.686540] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.568Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37830acd265c72c626e0888f","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37830acd265c72c626e0888f: done: 0.015812 sec","job_status":"done","queue_duration_s":1.37321,"scheduling_latency_s":1.373226,"redis_calls":13,"redis_duration_s":0.002671,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001742,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015812,"completed_at":"2026-06-08T13:18:19.568Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448vm-test-run-nixbot-gitlab> gitlab # [  225.724148] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.570Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9cdd10e8ba67bb6847572a5","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9cdd10e8ba67bb6847572a5: start","job_status":"start","queue_duration_s":1.390529,"scheduling_latency_s":1.390545}1449vm-test-run-nixbot-gitlab> gitlab # [  225.735903] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.585Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9cdd10e8ba67bb6847572a5","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9cdd10e8ba67bb6847572a5: done: 0.015367 sec","job_status":"done","queue_duration_s":1.390529,"scheduling_latency_s":1.390545,"redis_calls":13,"redis_duration_s":0.0025840000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000894,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00169,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015367,"completed_at":"2026-06-08T13:18:19.585Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450vm-test-run-nixbot-gitlab> gitlab # [  225.772583] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b20d57d8f4af0376001b4d7","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b20d57d8f4af0376001b4d7: start","job_status":"start","queue_duration_s":1.407394,"scheduling_latency_s":1.40741}1451vm-test-run-nixbot-gitlab> gitlab # [  225.783986] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.609Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b20d57d8f4af0376001b4d7","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b20d57d8f4af0376001b4d7: done: 0.022124 sec","job_status":"done","queue_duration_s":1.407394,"scheduling_latency_s":1.40741,"redis_calls":13,"redis_duration_s":0.004314,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001276,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003038,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022124,"completed_at":"2026-06-08T13:18:19.609Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452vm-test-run-nixbot-gitlab> gitlab # [  225.820778] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.612Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29c3e5ae49bf0934516f79d2","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29c3e5ae49bf0934516f79d2: start","job_status":"start","queue_duration_s":1.433311,"scheduling_latency_s":1.433352}1453vm-test-run-nixbot-gitlab> gitlab # [  225.832190] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.652Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29c3e5ae49bf0934516f79d2","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29c3e5ae49bf0934516f79d2: done: 0.039963 sec","job_status":"done","queue_duration_s":1.433311,"scheduling_latency_s":1.433352,"redis_calls":13,"redis_duration_s":0.005020999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002044,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.039963,"completed_at":"2026-06-08T13:18:19.652Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454vm-test-run-nixbot-gitlab> gitlab # [  225.868237] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80986e7d1236b14516c8d48d","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80986e7d1236b14516c8d48d: start","job_status":"start","queue_duration_s":1.477582,"scheduling_latency_s":1.477618}1455vm-test-run-nixbot-gitlab> gitlab # [  225.879535] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.692Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80986e7d1236b14516c8d48d","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80986e7d1236b14516c8d48d: done: 0.034917 sec","job_status":"done","queue_duration_s":1.477582,"scheduling_latency_s":1.477618,"redis_calls":13,"redis_duration_s":0.0046099999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001298,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003312,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034917,"completed_at":"2026-06-08T13:18:19.691Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456vm-test-run-nixbot-gitlab> gitlab # [  225.915966] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.694Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e19a3a84efad14ce5215d1c","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e19a3a84efad14ce5215d1c: start","job_status":"start","queue_duration_s":1.514871,"scheduling_latency_s":1.514904}1457vm-test-run-nixbot-gitlab> gitlab # [  225.927569] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e19a3a84efad14ce5215d1c","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e19a3a84efad14ce5215d1c: done: 0.027224 sec","job_status":"done","queue_duration_s":1.514871,"scheduling_latency_s":1.514904,"redis_calls":13,"redis_duration_s":0.0033870000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001181,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002206,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027224,"completed_at":"2026-06-08T13:18:19.721Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458vm-test-run-nixbot-gitlab> gitlab # [  225.963898] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.723Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc2a07b962bf066e88b682f3","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc2a07b962bf066e88b682f3: start","job_status":"start","queue_duration_s":1.543963,"scheduling_latency_s":1.543989}1459vm-test-run-nixbot-gitlab> gitlab # [  225.975665] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc2a07b962bf066e88b682f3","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc2a07b962bf066e88b682f3: done: 0.020213 sec","job_status":"done","queue_duration_s":1.543963,"scheduling_latency_s":1.543989,"redis_calls":13,"redis_duration_s":0.0030239999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001015,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020213,"completed_at":"2026-06-08T13:18:19.743Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460vm-test-run-nixbot-gitlab> gitlab # [  226.012896] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.745Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98c15363c907ca3fdf486215","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98c15363c907ca3fdf486215: start","job_status":"start","queue_duration_s":1.566068,"scheduling_latency_s":1.566088}1461vm-test-run-nixbot-gitlab> gitlab # [  226.024227] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98c15363c907ca3fdf486215","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98c15363c907ca3fdf486215: done: 0.018298 sec","job_status":"done","queue_duration_s":1.566068,"scheduling_latency_s":1.566088,"redis_calls":13,"redis_duration_s":0.002752,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000985,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001767,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011696,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018298,"completed_at":"2026-06-08T13:18:19.763Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462vm-test-run-nixbot-gitlab> gitlab # [  226.060678] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"558ee146738a1eb275a9434f","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-558ee146738a1eb275a9434f: start","job_status":"start","queue_duration_s":1.585888,"scheduling_latency_s":1.585907}1463vm-test-run-nixbot-gitlab> gitlab # [  226.072437] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"558ee146738a1eb275a9434f","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-558ee146738a1eb275a9434f: done: 0.018348 sec","job_status":"done","queue_duration_s":1.585888,"scheduling_latency_s":1.585907,"redis_calls":13,"redis_duration_s":0.002873,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018348,"completed_at":"2026-06-08T13:18:19.783Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464vm-test-run-nixbot-gitlab> gitlab # [  226.109483] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.785Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2316014e42b292f8d37a39fa","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2316014e42b292f8d37a39fa: start","job_status":"start","queue_duration_s":1.605912,"scheduling_latency_s":1.60593}1465vm-test-run-nixbot-gitlab> gitlab # [  226.121252] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2316014e42b292f8d37a39fa","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2316014e42b292f8d37a39fa: done: 0.017055 sec","job_status":"done","queue_duration_s":1.605912,"scheduling_latency_s":1.60593,"redis_calls":13,"redis_duration_s":0.002815,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000959,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001856,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017055,"completed_at":"2026-06-08T13:18:19.802Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466vm-test-run-nixbot-gitlab> gitlab # [  226.158120] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.804Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9cb1448610b9fa46c6121c05","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9cb1448610b9fa46c6121c05: start","job_status":"start","queue_duration_s":1.624537,"scheduling_latency_s":1.624554}1467vm-test-run-nixbot-gitlab> gitlab # [  226.169960] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9cb1448610b9fa46c6121c05","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9cb1448610b9fa46c6121c05: done: 0.016198 sec","job_status":"done","queue_duration_s":1.624537,"scheduling_latency_s":1.624554,"redis_calls":13,"redis_duration_s":0.0027730000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000949,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001824,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016198,"completed_at":"2026-06-08T13:18:19.820Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468vm-test-run-nixbot-gitlab> gitlab # [  226.207725] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.821Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a539df005494e7e77709fb7","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a539df005494e7e77709fb7: start","job_status":"start","queue_duration_s":1.642228,"scheduling_latency_s":1.642244}1469vm-test-run-nixbot-gitlab> gitlab # [  226.220864] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.837Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a539df005494e7e77709fb7","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a539df005494e7e77709fb7: done: 0.015637 sec","job_status":"done","queue_duration_s":1.642228,"scheduling_latency_s":1.642244,"redis_calls":13,"redis_duration_s":0.002611,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000896,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001715,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015637,"completed_at":"2026-06-08T13:18:19.837Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470vm-test-run-nixbot-gitlab> gitlab # [  226.257540] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.838Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e80f5efce00bb482f1a7c3f8","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e80f5efce00bb482f1a7c3f8: start","job_status":"start","queue_duration_s":1.659323,"scheduling_latency_s":1.659339}1471vm-test-run-nixbot-gitlab> gitlab # [  226.269054] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e80f5efce00bb482f1a7c3f8","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e80f5efce00bb482f1a7c3f8: done: 0.016085 sec","job_status":"done","queue_duration_s":1.659323,"scheduling_latency_s":1.659339,"redis_calls":13,"redis_duration_s":0.002794,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001852,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010315,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016085,"completed_at":"2026-06-08T13:18:19.854Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472vm-test-run-nixbot-gitlab> gitlab # [  226.305915] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.856Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b209648a1d38be2c3b2c18b9","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b209648a1d38be2c3b2c18b9: start","job_status":"start","queue_duration_s":1.677047,"scheduling_latency_s":1.677063}1473vm-test-run-nixbot-gitlab> gitlab # [  226.318116] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b209648a1d38be2c3b2c18b9","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b209648a1d38be2c3b2c18b9: done: 0.015941 sec","job_status":"done","queue_duration_s":1.677047,"scheduling_latency_s":1.677063,"redis_calls":13,"redis_duration_s":0.002682,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001758,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015941,"completed_at":"2026-06-08T13:18:19.872Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474vm-test-run-nixbot-gitlab> gitlab # [  226.355900] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.873Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbcbb1b88ceaad158e636fde","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbcbb1b88ceaad158e636fde: start","job_status":"start","queue_duration_s":1.694342,"scheduling_latency_s":1.694359}1475vm-test-run-nixbot-gitlab> gitlab # [  226.368091] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.890Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbcbb1b88ceaad158e636fde","created_at":"2026-06-08T13:18:18.054Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-0289814122ad4858","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"de72734c7d8f33856ebe688311bc07df","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.179Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbcbb1b88ceaad158e636fde: done: 0.016361 sec","job_status":"done","queue_duration_s":1.694342,"scheduling_latency_s":1.694359,"redis_calls":13,"redis_duration_s":0.003168,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001345,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001823,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016361,"completed_at":"2026-06-08T13:18:19.890Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476vm-test-run-nixbot-gitlab> gitlab # [  226.405350] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.891Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8abcadd662a9b16ad6d96118","created_at":"2026-06-08T13:18:18.816Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d214adfb40e44151","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7a142e0182f8ef36c0608ad5f5e4d6c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.865Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8abcadd662a9b16ad6d96118: start","job_status":"start","queue_duration_s":1.02621,"scheduling_latency_s":1.026226}1477vm-test-run-nixbot-gitlab> gitlab # [  226.417718] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.910Z","message":"No existing merge request to be cleaned up."}1478vm-test-run-nixbot-gitlab> gitlab # [  226.419270] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.925Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8abcadd662a9b16ad6d96118","created_at":"2026-06-08T13:18:18.816Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d214adfb40e44151","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7a142e0182f8ef36c0608ad5f5e4d6c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.865Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8abcadd662a9b16ad6d96118: done: 0.033926 sec","job_status":"done","queue_duration_s":1.02621,"scheduling_latency_s":1.026226,"redis_calls":13,"redis_duration_s":0.003716,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000562,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001598,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019865,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051036,"duration_s":0.033926,"completed_at":"2026-06-08T13:18:19.925Z","load_balancing_strategy":"primary","db_duration_s":0.006423,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479vm-test-run-nixbot-gitlab> gitlab # [  226.457748] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.927Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9ed26728df058d9c16893458","created_at":"2026-06-08T13:18:18.816Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d214adfb40e44151","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7a142e0182f8ef36c0608ad5f5e4d6c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.865Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9ed26728df058d9c16893458: start","job_status":"start","queue_duration_s":1.06183,"scheduling_latency_s":1.061846}1480vm-test-run-nixbot-gitlab> gitlab # [  226.469470] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.938Z","message":"No existing merge request to be cleaned up."}1481vm-test-run-nixbot-gitlab> gitlab # [  226.471028] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.947Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9ed26728df058d9c16893458","created_at":"2026-06-08T13:18:18.816Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d214adfb40e44151","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7a142e0182f8ef36c0608ad5f5e4d6c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.865Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9ed26728df058d9c16893458: done: 0.020294 sec","job_status":"done","queue_duration_s":1.06183,"scheduling_latency_s":1.061846,"redis_calls":10,"redis_duration_s":0.0026160000000000003,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00111,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001506,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020294,"completed_at":"2026-06-08T13:18:19.947Z","load_balancing_strategy":"primary","db_duration_s":0.002654,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482vm-test-run-nixbot-gitlab> gitlab # [  226.508179] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.949Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"719d16c3ed0c956dd29a3566","created_at":"2026-06-08T13:18:18.816Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d214adfb40e44151","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7a142e0182f8ef36c0608ad5f5e4d6c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.865Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-719d16c3ed0c956dd29a3566: start","job_status":"start","queue_duration_s":1.083709,"scheduling_latency_s":1.083726}1483vm-test-run-nixbot-gitlab> gitlab # [  226.519691] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.960Z","message":"No existing merge request to be cleaned up."}1484vm-test-run-nixbot-gitlab> gitlab # [  226.521384] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.968Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"719d16c3ed0c956dd29a3566","created_at":"2026-06-08T13:18:18.816Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d214adfb40e44151","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7a142e0182f8ef36c0608ad5f5e4d6c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.865Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-719d16c3ed0c956dd29a3566: done: 0.019763 sec","job_status":"done","queue_duration_s":1.083709,"scheduling_latency_s":1.083726,"redis_calls":10,"redis_duration_s":0.002471,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001029,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001442,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019763,"completed_at":"2026-06-08T13:18:19.968Z","load_balancing_strategy":"primary","db_duration_s":0.002477,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485vm-test-run-nixbot-gitlab> gitlab # [  226.558496] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.970Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7a3d8cdc50c750dfa74d8e97","created_at":"2026-06-08T13:18:18.816Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d214adfb40e44151","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7a142e0182f8ef36c0608ad5f5e4d6c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.865Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7a3d8cdc50c750dfa74d8e97: start","job_status":"start","queue_duration_s":1.10496,"scheduling_latency_s":1.104977}1486vm-test-run-nixbot-gitlab> gitlab # [  226.570466] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:19.981Z","message":"No existing merge request to be cleaned up."}1487vm-test-run-nixbot-gitlab> gitlab # [  226.572064] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:18:20.339Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7a3d8cdc50c750dfa74d8e97","created_at":"2026-06-08T13:18:18.816Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d214adfb40e44151","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7a142e0182f8ef36c0608ad5f5e4d6c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:18:18.865Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7a3d8cdc50c750dfa74d8e97: done: 0.368928 sec","job_status":"done","queue_duration_s":1.10496,"scheduling_latency_s":1.104977,"redis_calls":10,"redis_duration_s":0.004576,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001587,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002989,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.328,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.328,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.368928,"completed_at":"2026-06-08T13:18:20.339Z","load_balancing_strategy":"primary","db_duration_s":0.328924,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488vm-test-run-nixbot-gitlab> gitlab # [  255.102117] setup-gitlab-start[3295]: W, [2026-06-08T13:18:51.885071 #3295]  WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1489vm-test-run-nixbot-gitlab> gitlab # [  266.897911] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:03.679Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"83e4476244d908e2af09a007","created_at":"2026-06-08T13:19:03.660Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b42f4a1d11b9ee9169b2424ed2ae764","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:03.676Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-83e4476244d908e2af09a007: start","job_status":"start","queue_duration_s":0.003516,"scheduling_latency_s":0.003589}1490vm-test-run-nixbot-gitlab> gitlab # [  267.014987] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:03.797Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"83e4476244d908e2af09a007","created_at":"2026-06-08T13:19:03.660Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b42f4a1d11b9ee9169b2424ed2ae764","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:03.676Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-83e4476244d908e2af09a007: done: 0.118275 sec","job_status":"done","queue_duration_s":0.003516,"scheduling_latency_s":0.003589,"redis_calls":7,"redis_duration_s":0.015598999999999998,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010863,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004736,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.118275,"completed_at":"2026-06-08T13:19:03.797Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020138,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491vm-test-run-nixbot-gitlab> gitlab # [  267.098373] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:03.801Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"4f0b679f6e84288cbbc8bd85","created_at":"2026-06-08T13:19:03.729Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca9f2a144658519e526235ebc5db3d5c","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:03.738Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-4f0b679f6e84288cbbc8bd85: start","job_status":"start","queue_duration_s":0.062672,"scheduling_latency_s":0.062722}1492vm-test-run-nixbot-gitlab> gitlab # [  267.225757] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.007Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"4f0b679f6e84288cbbc8bd85","created_at":"2026-06-08T13:19:03.729Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca9f2a144658519e526235ebc5db3d5c","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:03.738Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-4f0b679f6e84288cbbc8bd85: done: 0.205856 sec","job_status":"done","queue_duration_s":0.062672,"scheduling_latency_s":0.062722,"redis_calls":7,"redis_duration_s":0.0069559999999999995,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002887,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004069,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024293,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.205856,"completed_at":"2026-06-08T13:19:04.007Z","load_balancing_strategy":"primary","db_duration_s":0.017823,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493vm-test-run-nixbot-gitlab> gitlab # [  267.320760] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.040Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"afe4dfa1c06f46e3cd9d0ccb","created_at":"2026-06-08T13:19:03.771Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b3eedff63f4b60057ad26e25ba48114","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:03.852Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-afe4dfa1c06f46e3cd9d0ccb: start","job_status":"start","queue_duration_s":0.187604,"scheduling_latency_s":0.187652}1494vm-test-run-nixbot-gitlab> gitlab # [  267.537711] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.318Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"afe4dfa1c06f46e3cd9d0ccb","created_at":"2026-06-08T13:19:03.771Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b3eedff63f4b60057ad26e25ba48114","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:03.852Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-afe4dfa1c06f46e3cd9d0ccb: done: 0.27898 sec","job_status":"done","queue_duration_s":0.187604,"scheduling_latency_s":0.187652,"redis_calls":20,"redis_duration_s":0.088292,"redis_read_bytes":20,"redis_write_bytes":3247,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.063439,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1346,"redis_queues_calls":2,"redis_queues_duration_s":0.001786,"redis_queues_read_bytes":3,"redis_queues_write_bytes":817,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.016765,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":734,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.006302,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":350,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.06874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00183732,"duration_s":0.27898,"completed_at":"2026-06-08T13:19:04.318Z","load_balancing_strategy":"primary","db_duration_s":0.009804,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495vm-test-run-nixbot-gitlab> gitlab # [  267.628861] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.329Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"d31f9c8bfa0eccee3dba6165","created_at":"2026-06-08T13:19:03.867Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a208b7c328c66a3d9f7e3e37dc43990","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:03.873Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-d31f9c8bfa0eccee3dba6165: start","job_status":"start","queue_duration_s":0.455606,"scheduling_latency_s":0.455657}1496vm-test-run-nixbot-gitlab> gitlab # [  267.646373] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.416Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"d31f9c8bfa0eccee3dba6165","created_at":"2026-06-08T13:19:03.867Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a208b7c328c66a3d9f7e3e37dc43990","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:03.873Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-d31f9c8bfa0eccee3dba6165: done: 0.087193 sec","job_status":"done","queue_duration_s":0.455606,"scheduling_latency_s":0.455657,"redis_calls":8,"redis_duration_s":0.004982,"redis_read_bytes":133,"redis_write_bytes":901,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000338,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003777,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000867,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.087193,"completed_at":"2026-06-08T13:19:04.416Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497vm-test-run-nixbot-gitlab> gitlab # [  267.690190] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.419Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b6dde8239b85549b6d4a5377","created_at":"2026-06-08T13:19:03.882Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0d335e0bc98d5af528a3ab2c0ebb75a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:03.887Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b6dde8239b85549b6d4a5377: start","job_status":"start","queue_duration_s":0.532025,"scheduling_latency_s":0.532063}1498vm-test-run-nixbot-gitlab> gitlab # [  267.740681] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.523Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b6dde8239b85549b6d4a5377","created_at":"2026-06-08T13:19:03.882Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0d335e0bc98d5af528a3ab2c0ebb75a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:03.887Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b6dde8239b85549b6d4a5377: done: 0.104629 sec","job_status":"done","queue_duration_s":0.532025,"scheduling_latency_s":0.532063,"redis_calls":9,"redis_duration_s":0.004286,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001995,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002291,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00162064,"exclusive_lock_hold_duration_s":0.04760876,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.104629,"completed_at":"2026-06-08T13:19:04.523Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.044955,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499vm-test-run-nixbot-gitlab> gitlab # [  267.790029] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.527Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"8b3bbaf789815ec8fbca6c57","created_at":"2026-06-08T13:19:03.897Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43751ae7213942c4d579ccd3eeec7c2a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-06-08T13:19:03.901Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-8b3bbaf789815ec8fbca6c57: start","job_status":"start","queue_duration_s":0.625984,"scheduling_latency_s":0.626026}1500vm-test-run-nixbot-gitlab> gitlab # [  267.803189] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.544Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1501vm-test-run-nixbot-gitlab> gitlab # [  267.806478] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.554Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"8b3bbaf789815ec8fbca6c57","created_at":"2026-06-08T13:19:03.897Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43751ae7213942c4d579ccd3eeec7c2a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-06-08T13:19:03.901Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-8b3bbaf789815ec8fbca6c57: done: 0.027571 sec","job_status":"done","queue_duration_s":0.625984,"scheduling_latency_s":0.626026,"redis_calls":7,"redis_duration_s":0.002257,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001624,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000633,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017518,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027571,"completed_at":"2026-06-08T13:19:04.554Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502vm-test-run-nixbot-gitlab> gitlab # [  267.844397] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.557Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"6cd4467674179372f2b3e205","created_at":"2026-06-08T13:19:04.011Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e26fb424d990849a44b70389321a886","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.014Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-6cd4467674179372f2b3e205: start","job_status":"start","queue_duration_s":0.542708,"scheduling_latency_s":0.542736}1503vm-test-run-nixbot-gitlab> gitlab # [  267.858245] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.569Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1504vm-test-run-nixbot-gitlab> gitlab # [  267.861448] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.579Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"6cd4467674179372f2b3e205","created_at":"2026-06-08T13:19:04.011Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e26fb424d990849a44b70389321a886","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.014Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-6cd4467674179372f2b3e205: done: 0.022479 sec","job_status":"done","queue_duration_s":0.542708,"scheduling_latency_s":0.542736,"redis_calls":7,"redis_duration_s":0.002448,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00188,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000568,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022479,"completed_at":"2026-06-08T13:19:04.579Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505vm-test-run-nixbot-gitlab> gitlab # [  267.901684] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.581Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"47cbe2141bd9be35c07a6852","created_at":"2026-06-08T13:19:04.019Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0cb2f10bc2dcafc43d694fed1cc10390","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.023Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-47cbe2141bd9be35c07a6852: start","job_status":"start","queue_duration_s":0.558398,"scheduling_latency_s":0.558425}1506vm-test-run-nixbot-gitlab> gitlab # [  267.915312] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.595Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1507vm-test-run-nixbot-gitlab> gitlab # [  267.918868] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.602Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"47cbe2141bd9be35c07a6852","created_at":"2026-06-08T13:19:04.019Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0cb2f10bc2dcafc43d694fed1cc10390","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.023Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-47cbe2141bd9be35c07a6852: done: 0.020576 sec","job_status":"done","queue_duration_s":0.558398,"scheduling_latency_s":0.558425,"redis_calls":7,"redis_duration_s":0.001903,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001367,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000536,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020576,"completed_at":"2026-06-08T13:19:04.602Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508vm-test-run-nixbot-gitlab> gitlab # [  267.957463] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.603Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"90c292600c057aa5d8d88cb1","created_at":"2026-06-08T13:19:04.026Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"140f24efcebea8c29bc2abf2496b114e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.029Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-90c292600c057aa5d8d88cb1: start","job_status":"start","queue_duration_s":0.574347,"scheduling_latency_s":0.57437}1509vm-test-run-nixbot-gitlab> gitlab # [  267.971292] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.621Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"90c292600c057aa5d8d88cb1","created_at":"2026-06-08T13:19:04.026Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"140f24efcebea8c29bc2abf2496b114e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.029Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-90c292600c057aa5d8d88cb1: done: 0.017103 sec","job_status":"done","queue_duration_s":0.574347,"scheduling_latency_s":0.57437,"redis_calls":7,"redis_duration_s":0.0017079999999999999,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001228,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00048,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017103,"completed_at":"2026-06-08T13:19:04.620Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510vm-test-run-nixbot-gitlab> gitlab # [  268.010133] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.622Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"9797103d3b7a5e16146c70eb","created_at":"2026-06-08T13:19:04.039Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09f7366fe55fce2c375bc8bdd303b4a6","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.044Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-9797103d3b7a5e16146c70eb: start","job_status":"start","queue_duration_s":0.57832,"scheduling_latency_s":0.578338}1511vm-test-run-nixbot-gitlab> gitlab # [  268.023758] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.651Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"9797103d3b7a5e16146c70eb","created_at":"2026-06-08T13:19:04.039Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09f7366fe55fce2c375bc8bdd303b4a6","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.044Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-9797103d3b7a5e16146c70eb: done: 0.028983 sec","job_status":"done","queue_duration_s":0.57832,"scheduling_latency_s":0.578338,"redis_calls":7,"redis_duration_s":0.002069,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00151,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000559,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028983,"completed_at":"2026-06-08T13:19:04.651Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008397,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512vm-test-run-nixbot-gitlab> gitlab # [  268.062290] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.653Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b198005656029c67faceab2e","created_at":"2026-06-08T13:19:04.048Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6403f6c953bae8bfbd30e091a0e892e","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.052Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b198005656029c67faceab2e: start","job_status":"start","queue_duration_s":0.601186,"scheduling_latency_s":0.601207}1513vm-test-run-nixbot-gitlab> gitlab # [  268.076136] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.673Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b198005656029c67faceab2e","created_at":"2026-06-08T13:19:04.048Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6403f6c953bae8bfbd30e091a0e892e","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.052Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b198005656029c67faceab2e: done: 0.02039 sec","job_status":"done","queue_duration_s":0.601186,"scheduling_latency_s":0.601207,"redis_calls":9,"redis_duration_s":0.00251,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001315,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001195,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005859,"exclusive_lock_hold_duration_s":0.00436826,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.02039,"completed_at":"2026-06-08T13:19:04.673Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001889,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514vm-test-run-nixbot-gitlab> gitlab # [  268.117341] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.675Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"f484f97b3b8b474f94f3a46b","created_at":"2026-06-08T13:19:04.057Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"40da84e23ac559159bb6ac0209540b63","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-f484f97b3b8b474f94f3a46b: start","job_status":"start","queue_duration_s":0.614803,"scheduling_latency_s":0.614821}1515vm-test-run-nixbot-gitlab> gitlab # [  268.191126] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.974Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"f484f97b3b8b474f94f3a46b","created_at":"2026-06-08T13:19:04.057Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"40da84e23ac559159bb6ac0209540b63","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-f484f97b3b8b474f94f3a46b: done: 0.299617 sec","job_status":"done","queue_duration_s":0.614803,"scheduling_latency_s":0.614821,"redis_calls":571,"redis_duration_s":0.063033,"redis_read_bytes":569,"redis_write_bytes":49487,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001054,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.061979,"redis_shared_state_read_bytes":565,"redis_shared_state_write_bytes":49017,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.272607,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.299617,"completed_at":"2026-06-08T13:19:04.974Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516vm-test-run-nixbot-gitlab> gitlab # [  268.267434] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:04.976Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"f983dc919ea4fc1b93b160cd","created_at":"2026-06-08T13:19:04.073Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.076Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-f983dc919ea4fc1b93b160cd: start","job_status":"start","queue_duration_s":0.899663,"scheduling_latency_s":0.899685}1517vm-test-run-nixbot-gitlab> gitlab # [  268.283538] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.067Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"f983dc919ea4fc1b93b160cd","created_at":"2026-06-08T13:19:04.073Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.076Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-f983dc919ea4fc1b93b160cd: done: 0.091032 sec","job_status":"done","queue_duration_s":0.899663,"scheduling_latency_s":0.899685,"redis_calls":60,"redis_duration_s":0.012287000000000001,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000742,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.011034,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000511,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078558,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.091032,"completed_at":"2026-06-08T13:19:05.067Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518vm-test-run-nixbot-gitlab> gitlab # [  268.328344] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.068Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"9306822993ddb9f05c9f825a","created_at":"2026-06-08T13:19:04.080Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce761ef13a323d52460026d0298d4926","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.084Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-9306822993ddb9f05c9f825a: start","job_status":"start","queue_duration_s":0.984248,"scheduling_latency_s":0.984266}1519vm-test-run-nixbot-gitlab> gitlab # [  268.360503] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.144Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"9306822993ddb9f05c9f825a","created_at":"2026-06-08T13:19:04.080Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce761ef13a323d52460026d0298d4926","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.084Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-9306822993ddb9f05c9f825a: done: 0.075232 sec","job_status":"done","queue_duration_s":0.984248,"scheduling_latency_s":0.984266,"redis_calls":9,"redis_duration_s":0.0027429999999999998,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001476,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001267,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.03,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00056126,"exclusive_lock_hold_duration_s":0.05877262,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.075232,"completed_at":"2026-06-08T13:19:05.144Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.051789,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520vm-test-run-nixbot-gitlab> gitlab # [  268.407406] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.145Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"fb13c920b262d4f0977274ea","created_at":"2026-06-08T13:19:04.091Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9cd89a9df1871bda91a3c39aea2b6953","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.095Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-fb13c920b262d4f0977274ea: start","job_status":"start","queue_duration_s":1.05025,"scheduling_latency_s":1.050269}1521vm-test-run-nixbot-gitlab> gitlab # [  268.421444] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.154Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1522vm-test-run-nixbot-gitlab> gitlab # [  268.424925] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.160Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"fb13c920b262d4f0977274ea","created_at":"2026-06-08T13:19:04.091Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9cd89a9df1871bda91a3c39aea2b6953","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.095Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-fb13c920b262d4f0977274ea: done: 0.015112 sec","job_status":"done","queue_duration_s":1.05025,"scheduling_latency_s":1.050269,"redis_calls":7,"redis_duration_s":0.0017100000000000001,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001239,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000471,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015112,"completed_at":"2026-06-08T13:19:05.160Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523vm-test-run-nixbot-gitlab> gitlab # [  268.463044] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.162Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"30cf3ae0a7456e11b36e83ad","created_at":"2026-06-08T13:19:04.100Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48d98f9a605b9664a5d9db80866b1599","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-06-08T13:19:04.103Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-30cf3ae0a7456e11b36e83ad: start","job_status":"start","queue_duration_s":1.058934,"scheduling_latency_s":1.058951}1524vm-test-run-nixbot-gitlab> gitlab # [  268.475474] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.188Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"30cf3ae0a7456e11b36e83ad","created_at":"2026-06-08T13:19:04.100Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48d98f9a605b9664a5d9db80866b1599","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-06-08T13:19:04.103Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-30cf3ae0a7456e11b36e83ad: done: 0.025771 sec","job_status":"done","queue_duration_s":1.058934,"scheduling_latency_s":1.058951,"redis_calls":7,"redis_duration_s":0.001871,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001374,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000497,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025771,"completed_at":"2026-06-08T13:19:05.188Z","load_balancing_strategy":"primary","db_duration_s":0.004989,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525vm-test-run-nixbot-gitlab> gitlab # [  268.513680] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.189Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"8e4e3a009445152ef242c2e5","created_at":"2026-06-08T13:19:04.106Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7fe5b9a7cd411722253e0e8373ec9760","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.109Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-8e4e3a009445152ef242c2e5: start","job_status":"start","queue_duration_s":1.080458,"scheduling_latency_s":1.080476}1526vm-test-run-nixbot-gitlab> gitlab # [  268.527515] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.210Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"8e4e3a009445152ef242c2e5","created_at":"2026-06-08T13:19:04.106Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7fe5b9a7cd411722253e0e8373ec9760","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.109Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-8e4e3a009445152ef242c2e5: done: 0.020324 sec","job_status":"done","queue_duration_s":1.080458,"scheduling_latency_s":1.080476,"redis_calls":10,"redis_duration_s":0.002445,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001392,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013219,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00422084,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.020324,"completed_at":"2026-06-08T13:19:05.210Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001911,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1527vm-test-run-nixbot-gitlab> gitlab # [  268.567624] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.213Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c9c7c418bdaaf7d4a1ed9235","created_at":"2026-06-08T13:19:04.120Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2da0f7ac9c030e5c95c2864300baecba","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.124Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c9c7c418bdaaf7d4a1ed9235: start","job_status":"start","queue_duration_s":1.088905,"scheduling_latency_s":1.088924}1528vm-test-run-nixbot-gitlab> gitlab # [  268.580563] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.242Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c9c7c418bdaaf7d4a1ed9235","created_at":"2026-06-08T13:19:04.120Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2da0f7ac9c030e5c95c2864300baecba","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.124Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c9c7c418bdaaf7d4a1ed9235: done: 0.029074 sec","job_status":"done","queue_duration_s":1.088905,"scheduling_latency_s":1.088924,"redis_calls":10,"redis_duration_s":0.007659,"redis_read_bytes":135,"redis_write_bytes":1133,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.003338,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":61,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001383,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002938,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00070864,"exclusive_lock_hold_duration_s":0.00287902,"duration_s":0.029074,"completed_at":"2026-06-08T13:19:05.242Z","load_balancing_strategy":"primary","db_duration_s":0.000941,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529vm-test-run-nixbot-gitlab> gitlab # [  268.619643] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.243Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"8114d3665c6444bae6ef16dc","created_at":"2026-06-08T13:19:04.188Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"643e26cfdfc136c51c7f2fea17c5f435","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.198Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-8114d3665c6444bae6ef16dc: start","job_status":"start","queue_duration_s":1.045675,"scheduling_latency_s":1.04569}1530vm-test-run-nixbot-gitlab> gitlab # [  268.633266] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.254Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1531vm-test-run-nixbot-gitlab> gitlab # [  268.636182] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.259Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"8114d3665c6444bae6ef16dc","created_at":"2026-06-08T13:19:04.188Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"643e26cfdfc136c51c7f2fea17c5f435","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.198Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-8114d3665c6444bae6ef16dc: done: 0.015859 sec","job_status":"done","queue_duration_s":1.045675,"scheduling_latency_s":1.04569,"redis_calls":12,"redis_duration_s":0.0026279999999999997,"redis_read_bytes":645,"redis_write_bytes":1117,"redis_feature_flag_calls":5,"redis_feature_flag_duration_s":0.001035,"redis_feature_flag_read_bytes":640,"redis_feature_flag_write_bytes":346,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001145,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000448,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015859,"completed_at":"2026-06-08T13:19:05.259Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1532vm-test-run-nixbot-gitlab> gitlab # [  268.675780] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.261Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"e64746b7c62e77f39cd757dd","created_at":"2026-06-08T13:19:04.226Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b26b454c38efe997e1d1e908a48ca6b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.234Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-e64746b7c62e77f39cd757dd: start","job_status":"start","queue_duration_s":1.026765,"scheduling_latency_s":1.026781}1533vm-test-run-nixbot-gitlab> gitlab # [  268.732136] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.515Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"e64746b7c62e77f39cd757dd","created_at":"2026-06-08T13:19:04.226Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b26b454c38efe997e1d1e908a48ca6b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.234Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-e64746b7c62e77f39cd757dd: done: 0.253961 sec","job_status":"done","queue_duration_s":1.026765,"scheduling_latency_s":1.026781,"redis_calls":11,"redis_duration_s":0.002765,"redis_read_bytes":263,"redis_write_bytes":1119,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000472,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":132,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001185,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001108,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":123,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":123,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":123,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":80,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.045,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.193029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005222,"exclusive_lock_hold_duration_s":0.23695822,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.253961,"completed_at":"2026-06-08T13:19:05.515Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.06872,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534vm-test-run-nixbot-gitlab> gitlab # [  268.784158] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.520Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"f879b2bd105290efcd82f42d","created_at":"2026-06-08T13:19:04.236Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-844a0aacf93148aa","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"8b3eedff63f4b60057ad26e25ba48114","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.267Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-f879b2bd105290efcd82f42d: start","job_status":"start","queue_duration_s":1.252852,"scheduling_latency_s":1.252903}1535vm-test-run-nixbot-gitlab> gitlab # [  268.797712] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"f879b2bd105290efcd82f42d","created_at":"2026-06-08T13:19:04.236Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-844a0aacf93148aa","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"8b3eedff63f4b60057ad26e25ba48114","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.267Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-f879b2bd105290efcd82f42d: done: 0.055995 sec","job_status":"done","queue_duration_s":1.252852,"scheduling_latency_s":1.252903,"redis_calls":13,"redis_duration_s":0.004782,"redis_read_bytes":12,"redis_write_bytes":1665,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000805,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001416,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":519,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002561,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":801,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036386,"duration_s":0.055995,"completed_at":"2026-06-08T13:19:05.576Z","load_balancing_strategy":"primary","db_duration_s":0.005714,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536vm-test-run-nixbot-gitlab> gitlab # [  268.836808] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.577Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"96453bf542f3a444d51f6b89","created_at":"2026-06-08T13:19:04.269Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e05e3f622cb74749ac913df08e5fb340","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.282Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-96453bf542f3a444d51f6b89: start","job_status":"start","queue_duration_s":1.295285,"scheduling_latency_s":1.295302}1537vm-test-run-nixbot-gitlab> gitlab # [  268.849472] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.604Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"96453bf542f3a444d51f6b89","created_at":"2026-06-08T13:19:04.269Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e05e3f622cb74749ac913df08e5fb340","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:04.282Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-96453bf542f3a444d51f6b89: done: 0.026367 sec","job_status":"done","queue_duration_s":1.295285,"scheduling_latency_s":1.295302,"redis_calls":14,"redis_duration_s":0.003382,"redis_read_bytes":16,"redis_write_bytes":4026,"redis_queues_calls":2,"redis_queues_duration_s":0.000437,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002235,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00071,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026367,"completed_at":"2026-06-08T13:19:05.604Z","load_balancing_strategy":"primary","db_duration_s":0.000828,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538vm-test-run-nixbot-gitlab> gitlab # [  268.887921] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.605Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"fd7bb128d2f3380cafebe727","created_at":"2026-06-08T13:19:04.309Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d9237dd4eb2abcbae54dd0e4ac7052e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-06-08T13:19:04.315Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-fd7bb128d2f3380cafebe727: start","job_status":"start","queue_duration_s":1.289985,"scheduling_latency_s":1.290002}1539vm-test-run-nixbot-gitlab> gitlab # [  268.900566] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.613Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1540vm-test-run-nixbot-gitlab> gitlab # [  268.904327] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.618Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"fd7bb128d2f3380cafebe727","created_at":"2026-06-08T13:19:04.309Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-06c24cd72ae949f6","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d9237dd4eb2abcbae54dd0e4ac7052e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-06-08T13:19:04.315Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-fd7bb128d2f3380cafebe727: done: 0.012748 sec","job_status":"done","queue_duration_s":1.289985,"scheduling_latency_s":1.290002,"redis_calls":7,"redis_duration_s":0.00159,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001149,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000441,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012748,"completed_at":"2026-06-08T13:19:05.618Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541vm-test-run-nixbot-gitlab> gitlab # [  268.941570] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.619Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d02f8c3919a9fe037947ea1","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d02f8c3919a9fe037947ea1: start","job_status":"start","queue_duration_s":0.5595,"scheduling_latency_s":0.559517}1542vm-test-run-nixbot-gitlab> gitlab # [  268.953038] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d02f8c3919a9fe037947ea1","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d02f8c3919a9fe037947ea1: done: 0.015558 sec","job_status":"done","queue_duration_s":0.5595,"scheduling_latency_s":0.559517,"redis_calls":13,"redis_duration_s":0.0028640000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001928,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015558,"completed_at":"2026-06-08T13:19:05.635Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543vm-test-run-nixbot-gitlab> gitlab # [  268.989256] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.636Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f383181c7af5d270f64871b","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f383181c7af5d270f64871b: start","job_status":"start","queue_duration_s":0.576551,"scheduling_latency_s":0.576569}1544vm-test-run-nixbot-gitlab> gitlab # [  269.000485] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.652Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f383181c7af5d270f64871b","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f383181c7af5d270f64871b: done: 0.015718 sec","job_status":"done","queue_duration_s":0.576551,"scheduling_latency_s":0.576569,"redis_calls":13,"redis_duration_s":0.002709,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000896,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001813,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009568,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015718,"completed_at":"2026-06-08T13:19:05.652Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545vm-test-run-nixbot-gitlab> gitlab # [  269.036455] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4740aba4cb695900421f304","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4740aba4cb695900421f304: start","job_status":"start","queue_duration_s":0.593689,"scheduling_latency_s":0.593706}1546vm-test-run-nixbot-gitlab> gitlab # [  269.047748] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.668Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4740aba4cb695900421f304","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4740aba4cb695900421f304: done: 0.014986 sec","job_status":"done","queue_duration_s":0.593689,"scheduling_latency_s":0.593706,"redis_calls":13,"redis_duration_s":0.002689,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000873,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001816,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014986,"completed_at":"2026-06-08T13:19:05.668Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547vm-test-run-nixbot-gitlab> gitlab # [  269.083911] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.670Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bb2d0f7bf1d741a5d41e1bf","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bb2d0f7bf1d741a5d41e1bf: start","job_status":"start","queue_duration_s":0.609982,"scheduling_latency_s":0.609998}1548vm-test-run-nixbot-gitlab> gitlab # [  269.095609] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.685Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bb2d0f7bf1d741a5d41e1bf","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bb2d0f7bf1d741a5d41e1bf: done: 0.015694 sec","job_status":"done","queue_duration_s":0.609982,"scheduling_latency_s":0.609998,"redis_calls":13,"redis_duration_s":0.0030740000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002167,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015694,"completed_at":"2026-06-08T13:19:05.685Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549vm-test-run-nixbot-gitlab> gitlab # [  269.132987] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff282addcb2bccc8323b38d4","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff282addcb2bccc8323b38d4: start","job_status":"start","queue_duration_s":0.627007,"scheduling_latency_s":0.627023}1550vm-test-run-nixbot-gitlab> gitlab # [  269.144446] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff282addcb2bccc8323b38d4","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff282addcb2bccc8323b38d4: done: 0.014979 sec","job_status":"done","queue_duration_s":0.627007,"scheduling_latency_s":0.627023,"redis_calls":13,"redis_duration_s":0.0027730000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00185,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014979,"completed_at":"2026-06-08T13:19:05.702Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551vm-test-run-nixbot-gitlab> gitlab # [  269.180487] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.703Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"919d94121b62ad6e1336464c","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-919d94121b62ad6e1336464c: start","job_status":"start","queue_duration_s":0.643304,"scheduling_latency_s":0.643321}1552vm-test-run-nixbot-gitlab> gitlab # [  269.191837] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.718Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"919d94121b62ad6e1336464c","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-919d94121b62ad6e1336464c: done: 0.015457 sec","job_status":"done","queue_duration_s":0.643304,"scheduling_latency_s":0.643321,"redis_calls":13,"redis_duration_s":0.002868,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015457,"completed_at":"2026-06-08T13:19:05.718Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553vm-test-run-nixbot-gitlab> gitlab # [  269.228081] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1550089817bb46f64e43f5b","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1550089817bb46f64e43f5b: start","job_status":"start","queue_duration_s":0.660009,"scheduling_latency_s":0.660025}1554vm-test-run-nixbot-gitlab> gitlab # [  269.239376] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.734Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1550089817bb46f64e43f5b","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1550089817bb46f64e43f5b: done: 0.014738 sec","job_status":"done","queue_duration_s":0.660009,"scheduling_latency_s":0.660025,"redis_calls":13,"redis_duration_s":0.002483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000882,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001601,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014738,"completed_at":"2026-06-08T13:19:05.734Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555vm-test-run-nixbot-gitlab> gitlab # [  269.275730] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.736Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"76024c44e6a8c3d889969a09","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-76024c44e6a8c3d889969a09: start","job_status":"start","queue_duration_s":0.67617,"scheduling_latency_s":0.676187}1556vm-test-run-nixbot-gitlab> gitlab # [  269.287453] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"76024c44e6a8c3d889969a09","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-76024c44e6a8c3d889969a09: done: 0.015239 sec","job_status":"done","queue_duration_s":0.67617,"scheduling_latency_s":0.676187,"redis_calls":13,"redis_duration_s":0.002879,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000945,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009518,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015239,"completed_at":"2026-06-08T13:19:05.751Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557vm-test-run-nixbot-gitlab> gitlab # [  269.323705] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6142566fced96220738d45a","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6142566fced96220738d45a: start","job_status":"start","queue_duration_s":0.692752,"scheduling_latency_s":0.692769}1558vm-test-run-nixbot-gitlab> gitlab # [  269.335749] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6142566fced96220738d45a","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6142566fced96220738d45a: done: 0.01485 sec","job_status":"done","queue_duration_s":0.692752,"scheduling_latency_s":0.692769,"redis_calls":13,"redis_duration_s":0.002626,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001733,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01485,"completed_at":"2026-06-08T13:19:05.767Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559vm-test-run-nixbot-gitlab> gitlab # [  269.373517] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.770Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac3b6f1f44c16604a18995d6","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac3b6f1f44c16604a18995d6: start","job_status":"start","queue_duration_s":0.710186,"scheduling_latency_s":0.710231}1560vm-test-run-nixbot-gitlab> gitlab # [  269.385199] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.808Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac3b6f1f44c16604a18995d6","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac3b6f1f44c16604a18995d6: done: 0.037942 sec","job_status":"done","queue_duration_s":0.710186,"scheduling_latency_s":0.710231,"redis_calls":13,"redis_duration_s":0.0033699999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001119,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002251,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026173,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037942,"completed_at":"2026-06-08T13:19:05.808Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561vm-test-run-nixbot-gitlab> gitlab # [  269.421766] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a69948787dc93fc8b89334b6","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a69948787dc93fc8b89334b6: start","job_status":"start","queue_duration_s":0.751881,"scheduling_latency_s":0.751923}1562vm-test-run-nixbot-gitlab> gitlab # [  269.433489] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a69948787dc93fc8b89334b6","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a69948787dc93fc8b89334b6: done: 0.035504 sec","job_status":"done","queue_duration_s":0.751881,"scheduling_latency_s":0.751923,"redis_calls":13,"redis_duration_s":0.004117,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00133,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002787,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035504,"completed_at":"2026-06-08T13:19:05.847Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563vm-test-run-nixbot-gitlab> gitlab # [  269.470034] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.849Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"464270c8191ec5ab0afcbe83","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-464270c8191ec5ab0afcbe83: start","job_status":"start","queue_duration_s":0.78973,"scheduling_latency_s":0.789762}1564vm-test-run-nixbot-gitlab> gitlab # [  269.481751] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"464270c8191ec5ab0afcbe83","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-464270c8191ec5ab0afcbe83: done: 0.025251 sec","job_status":"done","queue_duration_s":0.78973,"scheduling_latency_s":0.789762,"redis_calls":13,"redis_duration_s":0.003208,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001109,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025251,"completed_at":"2026-06-08T13:19:05.875Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565vm-test-run-nixbot-gitlab> gitlab # [  269.518288] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31e4152fd45c46828305cc9c","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31e4152fd45c46828305cc9c: start","job_status":"start","queue_duration_s":0.81702,"scheduling_latency_s":0.817047}1566vm-test-run-nixbot-gitlab> gitlab # [  269.530003] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31e4152fd45c46828305cc9c","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31e4152fd45c46828305cc9c: done: 0.020716 sec","job_status":"done","queue_duration_s":0.81702,"scheduling_latency_s":0.817047,"redis_calls":13,"redis_duration_s":0.003058,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001015,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020716,"completed_at":"2026-06-08T13:19:05.897Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567vm-test-run-nixbot-gitlab> gitlab # [  269.567565] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.899Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbd174f0534db24bac32060c","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbd174f0534db24bac32060c: start","job_status":"start","queue_duration_s":0.839526,"scheduling_latency_s":0.839547}1568vm-test-run-nixbot-gitlab> gitlab # [  269.579329] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbd174f0534db24bac32060c","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbd174f0534db24bac32060c: done: 0.026822 sec","job_status":"done","queue_duration_s":0.839526,"scheduling_latency_s":0.839547,"redis_calls":13,"redis_duration_s":0.003471,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001283,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002188,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026822,"completed_at":"2026-06-08T13:19:05.926Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569vm-test-run-nixbot-gitlab> gitlab # [  269.616070] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5886426a6126b56b37819739","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5886426a6126b56b37819739: start","job_status":"start","queue_duration_s":0.868806,"scheduling_latency_s":0.868846}1570vm-test-run-nixbot-gitlab> gitlab # [  269.627554] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5886426a6126b56b37819739","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5886426a6126b56b37819739: done: 0.033222 sec","job_status":"done","queue_duration_s":0.868806,"scheduling_latency_s":0.868846,"redis_calls":13,"redis_duration_s":0.003832,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001261,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002571,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033222,"completed_at":"2026-06-08T13:19:05.962Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571vm-test-run-nixbot-gitlab> gitlab # [  269.664486] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.964Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfefdd3bc4f43e933e998757","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfefdd3bc4f43e933e998757: start","job_status":"start","queue_duration_s":0.904207,"scheduling_latency_s":0.904237}1572vm-test-run-nixbot-gitlab> gitlab # [  269.676150] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfefdd3bc4f43e933e998757","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfefdd3bc4f43e933e998757: done: 0.023856 sec","job_status":"done","queue_duration_s":0.904207,"scheduling_latency_s":0.904237,"redis_calls":13,"redis_duration_s":0.0032,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023856,"completed_at":"2026-06-08T13:19:05.988Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573vm-test-run-nixbot-gitlab> gitlab # [  269.712775] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:05.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ba05316ea3c22090538021a","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ba05316ea3c22090538021a: start","job_status":"start","queue_duration_s":0.929655,"scheduling_latency_s":0.929675}1574vm-test-run-nixbot-gitlab> gitlab # [  269.724382] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.008Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ba05316ea3c22090538021a","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ba05316ea3c22090538021a: done: 0.018438 sec","job_status":"done","queue_duration_s":0.929655,"scheduling_latency_s":0.929675,"redis_calls":13,"redis_duration_s":0.0029969999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000991,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018438,"completed_at":"2026-06-08T13:19:06.008Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575vm-test-run-nixbot-gitlab> gitlab # [  269.762412] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9ab45c8797173cdcf75fbc9","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9ab45c8797173cdcf75fbc9: start","job_status":"start","queue_duration_s":0.949802,"scheduling_latency_s":0.949819}1576vm-test-run-nixbot-gitlab> gitlab # [  269.774174] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.026Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9ab45c8797173cdcf75fbc9","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9ab45c8797173cdcf75fbc9: done: 0.01678 sec","job_status":"done","queue_duration_s":0.949802,"scheduling_latency_s":0.949819,"redis_calls":13,"redis_duration_s":0.0028510000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000998,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001853,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010794,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01678,"completed_at":"2026-06-08T13:19:06.026Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577vm-test-run-nixbot-gitlab> gitlab # [  269.810948] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"747a0f319faa3f32478d5bf1","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-747a0f319faa3f32478d5bf1: start","job_status":"start","queue_duration_s":0.967985,"scheduling_latency_s":0.968002}1578vm-test-run-nixbot-gitlab> gitlab # [  269.823216] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.044Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"747a0f319faa3f32478d5bf1","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-747a0f319faa3f32478d5bf1: done: 0.016301 sec","job_status":"done","queue_duration_s":0.967985,"scheduling_latency_s":0.968002,"redis_calls":13,"redis_duration_s":0.002767,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000908,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001859,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016301,"completed_at":"2026-06-08T13:19:06.044Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1579vm-test-run-nixbot-gitlab> gitlab # [  269.860211] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29ddb8b13ddbd18b06629872","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29ddb8b13ddbd18b06629872: start","job_status":"start","queue_duration_s":0.985679,"scheduling_latency_s":0.985696}1580vm-test-run-nixbot-gitlab> gitlab # [  269.871786] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29ddb8b13ddbd18b06629872","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29ddb8b13ddbd18b06629872: done: 0.016535 sec","job_status":"done","queue_duration_s":0.985679,"scheduling_latency_s":0.985696,"redis_calls":13,"redis_duration_s":0.0028599999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016535,"completed_at":"2026-06-08T13:19:06.062Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1581vm-test-run-nixbot-gitlab> gitlab # [  269.909156] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"872b456da7ba90570c2029e8","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-872b456da7ba90570c2029e8: start","job_status":"start","queue_duration_s":1.003696,"scheduling_latency_s":1.003713}1582vm-test-run-nixbot-gitlab> gitlab # [  269.920504] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.081Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"872b456da7ba90570c2029e8","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-872b456da7ba90570c2029e8: done: 0.017268 sec","job_status":"done","queue_duration_s":1.003696,"scheduling_latency_s":1.003713,"redis_calls":13,"redis_duration_s":0.002875,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017268,"completed_at":"2026-06-08T13:19:06.081Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583vm-test-run-nixbot-gitlab> gitlab # [  269.958069] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98860d953ae807bd00b727cd","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98860d953ae807bd00b727cd: start","job_status":"start","queue_duration_s":1.022333,"scheduling_latency_s":1.022348}1584vm-test-run-nixbot-gitlab> gitlab # [  269.969716] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98860d953ae807bd00b727cd","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98860d953ae807bd00b727cd: done: 0.015176 sec","job_status":"done","queue_duration_s":1.022333,"scheduling_latency_s":1.022348,"redis_calls":13,"redis_duration_s":0.002603,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001702,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015176,"completed_at":"2026-06-08T13:19:06.097Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1585vm-test-run-nixbot-gitlab> gitlab # [  270.006253] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80916d0c95df0bac3ff726cc","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80916d0c95df0bac3ff726cc: start","job_status":"start","queue_duration_s":1.038894,"scheduling_latency_s":1.03891}1586vm-test-run-nixbot-gitlab> gitlab # [  270.017977] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80916d0c95df0bac3ff726cc","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80916d0c95df0bac3ff726cc: done: 0.022543 sec","job_status":"done","queue_duration_s":1.038894,"scheduling_latency_s":1.03891,"redis_calls":13,"redis_duration_s":0.0030800000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001217,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001863,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022543,"completed_at":"2026-06-08T13:19:06.121Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1587vm-test-run-nixbot-gitlab> gitlab # [  270.054677] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fbf9a7e4c60209d5abf6e7f6","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fbf9a7e4c60209d5abf6e7f6: start","job_status":"start","queue_duration_s":1.064087,"scheduling_latency_s":1.064106}1588vm-test-run-nixbot-gitlab> gitlab # [  270.066448] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fbf9a7e4c60209d5abf6e7f6","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fbf9a7e4c60209d5abf6e7f6: done: 0.035867 sec","job_status":"done","queue_duration_s":1.064087,"scheduling_latency_s":1.064106,"redis_calls":13,"redis_duration_s":0.0036040000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001329,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002275,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035867,"completed_at":"2026-06-08T13:19:06.160Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589vm-test-run-nixbot-gitlab> gitlab # [  270.104132] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.163Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d5e2934cd0a26549a8b0161","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d5e2934cd0a26549a8b0161: start","job_status":"start","queue_duration_s":1.10314,"scheduling_latency_s":1.103178}1590vm-test-run-nixbot-gitlab> gitlab # [  270.115740] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d5e2934cd0a26549a8b0161","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d5e2934cd0a26549a8b0161: done: 0.029283 sec","job_status":"done","queue_duration_s":1.10314,"scheduling_latency_s":1.103178,"redis_calls":13,"redis_duration_s":0.003476,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001177,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002299,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019463,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029283,"completed_at":"2026-06-08T13:19:06.192Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591vm-test-run-nixbot-gitlab> gitlab # [  270.153393] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4acc261585e482e51751a1f0","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4acc261585e482e51751a1f0: start","job_status":"start","queue_duration_s":1.134537,"scheduling_latency_s":1.134566}1592vm-test-run-nixbot-gitlab> gitlab # [  270.166417] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.220Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4acc261585e482e51751a1f0","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4acc261585e482e51751a1f0: done: 0.025285 sec","job_status":"done","queue_duration_s":1.134537,"scheduling_latency_s":1.134566,"redis_calls":13,"redis_duration_s":0.0035059999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001168,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002338,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016661,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025285,"completed_at":"2026-06-08T13:19:06.219Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593vm-test-run-nixbot-gitlab> gitlab # [  270.204093] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f855d6ce7fefb8935b4eac9","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f855d6ce7fefb8935b4eac9: start","job_status":"start","queue_duration_s":1.161627,"scheduling_latency_s":1.161653}1594vm-test-run-nixbot-gitlab> gitlab # [  270.215976] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f855d6ce7fefb8935b4eac9","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f855d6ce7fefb8935b4eac9: done: 0.02214 sec","job_status":"done","queue_duration_s":1.161627,"scheduling_latency_s":1.161653,"redis_calls":13,"redis_duration_s":0.003196,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001043,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002153,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014593,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02214,"completed_at":"2026-06-08T13:19:06.243Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1595vm-test-run-nixbot-gitlab> gitlab # [  270.252761] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fb317a90b631d76a57f9c68","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fb317a90b631d76a57f9c68: start","job_status":"start","queue_duration_s":1.18538,"scheduling_latency_s":1.185402}1596vm-test-run-nixbot-gitlab> gitlab # [  270.264405] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fb317a90b631d76a57f9c68","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fb317a90b631d76a57f9c68: done: 0.019176 sec","job_status":"done","queue_duration_s":1.18538,"scheduling_latency_s":1.185402,"redis_calls":13,"redis_duration_s":0.002993,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001026,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019176,"completed_at":"2026-06-08T13:19:06.264Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1597vm-test-run-nixbot-gitlab> gitlab # [  270.301340] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"710e0fa4115f0df296154807","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-710e0fa4115f0df296154807: start","job_status":"start","queue_duration_s":1.206039,"scheduling_latency_s":1.206058}1598vm-test-run-nixbot-gitlab> gitlab # [  270.312988] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"710e0fa4115f0df296154807","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-710e0fa4115f0df296154807: done: 0.016527 sec","job_status":"done","queue_duration_s":1.206039,"scheduling_latency_s":1.206058,"redis_calls":13,"redis_duration_s":0.002734,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000947,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001787,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016527,"completed_at":"2026-06-08T13:19:06.282Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1599vm-test-run-nixbot-gitlab> gitlab # [  270.350081] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fb2f19476066cbeaf952184","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fb2f19476066cbeaf952184: start","job_status":"start","queue_duration_s":1.223936,"scheduling_latency_s":1.223952}1600vm-test-run-nixbot-gitlab> gitlab # [  270.362987] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fb2f19476066cbeaf952184","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fb2f19476066cbeaf952184: done: 0.01573 sec","job_status":"done","queue_duration_s":1.223936,"scheduling_latency_s":1.223952,"redis_calls":13,"redis_duration_s":0.002624,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001724,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01573,"completed_at":"2026-06-08T13:19:06.299Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1601vm-test-run-nixbot-gitlab> gitlab # [  270.400131] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.301Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e526051ee27029adcb2618da","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e526051ee27029adcb2618da: start","job_status":"start","queue_duration_s":1.241131,"scheduling_latency_s":1.241149}1602vm-test-run-nixbot-gitlab> gitlab # [  270.411545] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.317Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e526051ee27029adcb2618da","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e526051ee27029adcb2618da: done: 0.016 sec","job_status":"done","queue_duration_s":1.241131,"scheduling_latency_s":1.241149,"redis_calls":13,"redis_duration_s":0.002636,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001699,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016,"completed_at":"2026-06-08T13:19:06.317Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1603vm-test-run-nixbot-gitlab> gitlab # [  270.448084] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64a0df8ce3a90c41894f1762","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64a0df8ce3a90c41894f1762: start","job_status":"start","queue_duration_s":1.25847,"scheduling_latency_s":1.258487}1604vm-test-run-nixbot-gitlab> gitlab # [  270.459529] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64a0df8ce3a90c41894f1762","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64a0df8ce3a90c41894f1762: done: 0.01566 sec","job_status":"done","queue_duration_s":1.25847,"scheduling_latency_s":1.258487,"redis_calls":13,"redis_duration_s":0.002569,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001664,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01566,"completed_at":"2026-06-08T13:19:06.334Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1605vm-test-run-nixbot-gitlab> gitlab # [  270.496092] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"186cf31508d2c85371863afd","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-186cf31508d2c85371863afd: start","job_status":"start","queue_duration_s":1.275479,"scheduling_latency_s":1.275495}1606vm-test-run-nixbot-gitlab> gitlab # [  270.507622] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.351Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"186cf31508d2c85371863afd","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-186cf31508d2c85371863afd: done: 0.015718 sec","job_status":"done","queue_duration_s":1.275479,"scheduling_latency_s":1.275495,"redis_calls":13,"redis_duration_s":0.002874,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000974,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015718,"completed_at":"2026-06-08T13:19:06.351Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1607vm-test-run-nixbot-gitlab> gitlab # [  270.544047] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.352Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d016dc9aeb8f25eae7c21f4a","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d016dc9aeb8f25eae7c21f4a: start","job_status":"start","queue_duration_s":1.292596,"scheduling_latency_s":1.292613}1608vm-test-run-nixbot-gitlab> gitlab # [  270.555463] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.368Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d016dc9aeb8f25eae7c21f4a","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d016dc9aeb8f25eae7c21f4a: done: 0.015543 sec","job_status":"done","queue_duration_s":1.292596,"scheduling_latency_s":1.292613,"redis_calls":13,"redis_duration_s":0.002601,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000886,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001715,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009361,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015543,"completed_at":"2026-06-08T13:19:06.368Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1609vm-test-run-nixbot-gitlab> gitlab # [  270.593058] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39f81f40f309e7d37087a4bd","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39f81f40f309e7d37087a4bd: start","job_status":"start","queue_duration_s":1.309988,"scheduling_latency_s":1.310005}1610vm-test-run-nixbot-gitlab> gitlab # [  270.604695] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39f81f40f309e7d37087a4bd","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39f81f40f309e7d37087a4bd: done: 0.015591 sec","job_status":"done","queue_duration_s":1.309988,"scheduling_latency_s":1.310005,"redis_calls":13,"redis_duration_s":0.002748,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001824,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015591,"completed_at":"2026-06-08T13:19:06.385Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1611vm-test-run-nixbot-gitlab> gitlab # [  270.641046] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58caf7be5738d8cde9bc1638","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58caf7be5738d8cde9bc1638: start","job_status":"start","queue_duration_s":1.327432,"scheduling_latency_s":1.32745}1612vm-test-run-nixbot-gitlab> gitlab # [  270.652533] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.403Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58caf7be5738d8cde9bc1638","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58caf7be5738d8cde9bc1638: done: 0.016157 sec","job_status":"done","queue_duration_s":1.327432,"scheduling_latency_s":1.32745,"redis_calls":13,"redis_duration_s":0.002837,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016157,"completed_at":"2026-06-08T13:19:06.403Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1613vm-test-run-nixbot-gitlab> gitlab # [  270.688740] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"191488a2901f181aee9cb5e7","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-191488a2901f181aee9cb5e7: start","job_status":"start","queue_duration_s":1.344973,"scheduling_latency_s":1.344991}1614vm-test-run-nixbot-gitlab> gitlab # [  270.700263] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"191488a2901f181aee9cb5e7","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-191488a2901f181aee9cb5e7: done: 0.020684 sec","job_status":"done","queue_duration_s":1.344973,"scheduling_latency_s":1.344991,"redis_calls":13,"redis_duration_s":0.0029890000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000989,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020684,"completed_at":"2026-06-08T13:19:06.425Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1615vm-test-run-nixbot-gitlab> gitlab # [  270.736596] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f7a468fc069dbe4c7c0beb3","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f7a468fc069dbe4c7c0beb3: start","job_status":"start","queue_duration_s":1.367265,"scheduling_latency_s":1.367286}1616vm-test-run-nixbot-gitlab> gitlab # [  270.748139] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.445Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f7a468fc069dbe4c7c0beb3","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f7a468fc069dbe4c7c0beb3: done: 0.017904 sec","job_status":"done","queue_duration_s":1.367265,"scheduling_latency_s":1.367286,"redis_calls":13,"redis_duration_s":0.002953,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000987,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010668,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017904,"completed_at":"2026-06-08T13:19:06.445Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617vm-test-run-nixbot-gitlab> gitlab # [  270.785245] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.447Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9339ccfdac363bf8f408ad4","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9339ccfdac363bf8f408ad4: start","job_status":"start","queue_duration_s":1.387158,"scheduling_latency_s":1.387177}1618vm-test-run-nixbot-gitlab> gitlab # [  270.796737] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9339ccfdac363bf8f408ad4","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9339ccfdac363bf8f408ad4: done: 0.018128 sec","job_status":"done","queue_duration_s":1.387158,"scheduling_latency_s":1.387177,"redis_calls":13,"redis_duration_s":0.0029100000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001021,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001889,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018128,"completed_at":"2026-06-08T13:19:06.465Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1619vm-test-run-nixbot-gitlab> gitlab # [  270.833257] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.467Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"765848c2b67b6d325b0eb892","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-765848c2b67b6d325b0eb892: start","job_status":"start","queue_duration_s":1.406899,"scheduling_latency_s":1.40692}1620vm-test-run-nixbot-gitlab> gitlab # [  270.844857] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"765848c2b67b6d325b0eb892","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-765848c2b67b6d325b0eb892: done: 0.036326 sec","job_status":"done","queue_duration_s":1.406899,"scheduling_latency_s":1.40692,"redis_calls":13,"redis_duration_s":0.004898,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001696,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003202,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036326,"completed_at":"2026-06-08T13:19:06.503Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621vm-test-run-nixbot-gitlab> gitlab # [  270.881944] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.506Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5caa5608759d684dd5181fb1","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5caa5608759d684dd5181fb1: start","job_status":"start","queue_duration_s":1.446049,"scheduling_latency_s":1.446092}1622vm-test-run-nixbot-gitlab> gitlab # [  270.917377] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.539Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5caa5608759d684dd5181fb1","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5caa5608759d684dd5181fb1: done: 0.033027 sec","job_status":"done","queue_duration_s":1.446049,"scheduling_latency_s":1.446092,"redis_calls":13,"redis_duration_s":0.0031550000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001115,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00204,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033027,"completed_at":"2026-06-08T13:19:06.539Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623vm-test-run-nixbot-gitlab> gitlab # [  270.977301] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.542Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea5c4f95008908f0ca77a971","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea5c4f95008908f0ca77a971: start","job_status":"start","queue_duration_s":1.482029,"scheduling_latency_s":1.482063}1624vm-test-run-nixbot-gitlab> gitlab # [  270.991511] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea5c4f95008908f0ca77a971","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea5c4f95008908f0ca77a971: done: 0.030231 sec","job_status":"done","queue_duration_s":1.482029,"scheduling_latency_s":1.482063,"redis_calls":13,"redis_duration_s":0.008327,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.006212,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002115,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030231,"completed_at":"2026-06-08T13:19:06.572Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1625vm-test-run-nixbot-gitlab> gitlab # [  271.035265] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55cb781dbac2cc066790ff74","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55cb781dbac2cc066790ff74: start","job_status":"start","queue_duration_s":1.51441,"scheduling_latency_s":1.51444}1626vm-test-run-nixbot-gitlab> gitlab # [  271.047525] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55cb781dbac2cc066790ff74","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55cb781dbac2cc066790ff74: done: 0.028715 sec","job_status":"done","queue_duration_s":1.51441,"scheduling_latency_s":1.51444,"redis_calls":13,"redis_duration_s":0.004683,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001238,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003445,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019495,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028715,"completed_at":"2026-06-08T13:19:06.603Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1627vm-test-run-nixbot-gitlab> gitlab # [  271.084525] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a6bc079333237bf1d4cbfb3","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a6bc079333237bf1d4cbfb3: start","job_status":"start","queue_duration_s":1.546648,"scheduling_latency_s":1.546679}1628vm-test-run-nixbot-gitlab> gitlab # [  271.096172] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a6bc079333237bf1d4cbfb3","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a6bc079333237bf1d4cbfb3: done: 0.034322 sec","job_status":"done","queue_duration_s":1.546648,"scheduling_latency_s":1.546679,"redis_calls":13,"redis_duration_s":0.003236,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001087,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002149,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026173,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034322,"completed_at":"2026-06-08T13:19:06.641Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1629vm-test-run-nixbot-gitlab> gitlab # [  271.132843] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2caa6774a957474e2b1a208e","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2caa6774a957474e2b1a208e: start","job_status":"start","queue_duration_s":1.582774,"scheduling_latency_s":1.582799}1630vm-test-run-nixbot-gitlab> gitlab # [  271.144265] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2caa6774a957474e2b1a208e","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2caa6774a957474e2b1a208e: done: 0.018373 sec","job_status":"done","queue_duration_s":1.582774,"scheduling_latency_s":1.582799,"redis_calls":13,"redis_duration_s":0.0029170000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000969,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018373,"completed_at":"2026-06-08T13:19:06.661Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1631vm-test-run-nixbot-gitlab> gitlab # [  271.182250] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ff14f6a9ba8d9d7b1037997","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ff14f6a9ba8d9d7b1037997: start","job_status":"start","queue_duration_s":1.602725,"scheduling_latency_s":1.602749}1632vm-test-run-nixbot-gitlab> gitlab # [  271.194036] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ff14f6a9ba8d9d7b1037997","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ff14f6a9ba8d9d7b1037997: done: 0.016654 sec","job_status":"done","queue_duration_s":1.602725,"scheduling_latency_s":1.602749,"redis_calls":13,"redis_duration_s":0.002587,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001669,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016654,"completed_at":"2026-06-08T13:19:06.679Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1633vm-test-run-nixbot-gitlab> gitlab # [  271.230959] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.681Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e967cfd5168a983eef696941","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e967cfd5168a983eef696941: start","job_status":"start","queue_duration_s":1.620851,"scheduling_latency_s":1.62087}1634vm-test-run-nixbot-gitlab> gitlab # [  271.242813] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e967cfd5168a983eef696941","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e967cfd5168a983eef696941: done: 0.016216 sec","job_status":"done","queue_duration_s":1.620851,"scheduling_latency_s":1.62087,"redis_calls":13,"redis_duration_s":0.003267,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000976,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002291,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016216,"completed_at":"2026-06-08T13:19:06.697Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1635vm-test-run-nixbot-gitlab> gitlab # [  271.279698] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.698Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dceb0c148580d9289c6cfa56","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dceb0c148580d9289c6cfa56: start","job_status":"start","queue_duration_s":1.638541,"scheduling_latency_s":1.638559}1636vm-test-run-nixbot-gitlab> gitlab # [  271.291455] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.714Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dceb0c148580d9289c6cfa56","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dceb0c148580d9289c6cfa56: done: 0.015361 sec","job_status":"done","queue_duration_s":1.638541,"scheduling_latency_s":1.638559,"redis_calls":13,"redis_duration_s":0.0026939999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00179,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015361,"completed_at":"2026-06-08T13:19:06.714Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1637vm-test-run-nixbot-gitlab> gitlab # [  271.328503] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.715Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a5a0abac381330433afbb54","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a5a0abac381330433afbb54: start","job_status":"start","queue_duration_s":1.655417,"scheduling_latency_s":1.655435}1638vm-test-run-nixbot-gitlab> gitlab # [  271.340174] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a5a0abac381330433afbb54","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a5a0abac381330433afbb54: done: 0.015384 sec","job_status":"done","queue_duration_s":1.655417,"scheduling_latency_s":1.655435,"redis_calls":13,"redis_duration_s":0.0027689999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001854,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015384,"completed_at":"2026-06-08T13:19:06.730Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1639vm-test-run-nixbot-gitlab> gitlab # [  271.377042] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3114cec3a58e27889d830de6","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3114cec3a58e27889d830de6: start","job_status":"start","queue_duration_s":1.672192,"scheduling_latency_s":1.672208}1640vm-test-run-nixbot-gitlab> gitlab # [  271.389541] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.747Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3114cec3a58e27889d830de6","created_at":"2026-06-08T13:19:04.985Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-d7b5cb3f86df4a01","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"036879a3f221d21c39f8d48ce4501ff7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.060Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3114cec3a58e27889d830de6: done: 0.01489 sec","job_status":"done","queue_duration_s":1.672192,"scheduling_latency_s":1.672208,"redis_calls":13,"redis_duration_s":0.002502,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001604,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01489,"completed_at":"2026-06-08T13:19:06.747Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1641vm-test-run-nixbot-gitlab> gitlab # [  271.426735] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.748Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0b29e6f333e9b0e852072750","created_at":"2026-06-08T13:19:05.588Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-381499e423054724","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e05e3f622cb74749ac913df08e5fb340","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.598Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0b29e6f333e9b0e852072750: start","job_status":"start","queue_duration_s":1.150565,"scheduling_latency_s":1.150582}1642vm-test-run-nixbot-gitlab> gitlab # [  271.438456] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.762Z","message":"No existing merge request to be cleaned up."}1643vm-test-run-nixbot-gitlab> gitlab # [  271.439972] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.780Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0b29e6f333e9b0e852072750","created_at":"2026-06-08T13:19:05.588Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-381499e423054724","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e05e3f622cb74749ac913df08e5fb340","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.598Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0b29e6f333e9b0e852072750: done: 0.032258 sec","job_status":"done","queue_duration_s":1.150565,"scheduling_latency_s":1.150582,"redis_calls":10,"redis_duration_s":0.003185,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001269,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001916,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032258,"completed_at":"2026-06-08T13:19:06.780Z","load_balancing_strategy":"primary","db_duration_s":0.003688,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1644vm-test-run-nixbot-gitlab> gitlab # [  271.476345] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.783Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e575b091c57bf920573feb74","created_at":"2026-06-08T13:19:05.588Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-381499e423054724","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e05e3f622cb74749ac913df08e5fb340","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.598Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e575b091c57bf920573feb74: start","job_status":"start","queue_duration_s":1.185679,"scheduling_latency_s":1.18572}1645vm-test-run-nixbot-gitlab> gitlab # [  271.487858] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.807Z","message":"No existing merge request to be cleaned up."}1646vm-test-run-nixbot-gitlab> gitlab # [  271.489592] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.823Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e575b091c57bf920573feb74","created_at":"2026-06-08T13:19:05.588Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-381499e423054724","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e05e3f622cb74749ac913df08e5fb340","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.598Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e575b091c57bf920573feb74: done: 0.040255 sec","job_status":"done","queue_duration_s":1.185679,"scheduling_latency_s":1.18572,"redis_calls":10,"redis_duration_s":0.0040160000000000005,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001581,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002435,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026989,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040255,"completed_at":"2026-06-08T13:19:06.823Z","load_balancing_strategy":"primary","db_duration_s":0.003362,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1647vm-test-run-nixbot-gitlab> gitlab # [  271.526385] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.826Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"675565cd16b424a81f1f995c","created_at":"2026-06-08T13:19:05.588Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-381499e423054724","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e05e3f622cb74749ac913df08e5fb340","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.598Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-675565cd16b424a81f1f995c: start","job_status":"start","queue_duration_s":1.228204,"scheduling_latency_s":1.228231}1648vm-test-run-nixbot-gitlab> gitlab # [  271.538201] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.842Z","message":"No existing merge request to be cleaned up."}1649vm-test-run-nixbot-gitlab> gitlab # [  271.539770] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.861Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"675565cd16b424a81f1f995c","created_at":"2026-06-08T13:19:05.588Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-381499e423054724","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e05e3f622cb74749ac913df08e5fb340","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.598Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-675565cd16b424a81f1f995c: done: 0.03486 sec","job_status":"done","queue_duration_s":1.228204,"scheduling_latency_s":1.228231,"redis_calls":10,"redis_duration_s":0.003397,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00131,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002087,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03486,"completed_at":"2026-06-08T13:19:06.861Z","load_balancing_strategy":"primary","db_duration_s":0.003241,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1650vm-test-run-nixbot-gitlab> gitlab # [  271.575840] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.864Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"02b81be295ac14a509b82740","created_at":"2026-06-08T13:19:05.588Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-381499e423054724","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e05e3f622cb74749ac913df08e5fb340","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.598Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-02b81be295ac14a509b82740: start","job_status":"start","queue_duration_s":1.26592,"scheduling_latency_s":1.265963}1651vm-test-run-nixbot-gitlab> gitlab # [  271.588262] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.887Z","message":"No existing merge request to be cleaned up."}1652vm-test-run-nixbot-gitlab> gitlab # [  271.589802] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:06.907Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"02b81be295ac14a509b82740","created_at":"2026-06-08T13:19:05.588Z","trace_propagation_headers":{"sentry-trace":"f9ee7c6544614339a2c33107b40d242a-381499e423054724","baggage":"sentry-trace_id=f9ee7c6544614339a2c33107b40d242a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e05e3f622cb74749ac913df08e5fb340","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:05.598Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-02b81be295ac14a509b82740: done: 0.043606 sec","job_status":"done","queue_duration_s":1.26592,"scheduling_latency_s":1.265963,"redis_calls":10,"redis_duration_s":0.0038540000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001726,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002128,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043606,"completed_at":"2026-06-08T13:19:06.907Z","load_balancing_strategy":"primary","db_duration_s":0.003624,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1653vm-test-run-nixbot-gitlab> gitlab # [  294.622507] runuser[3294]: pam_unix(runuser:session): session closed for user gitlab1654vm-test-run-nixbot-gitlab> gitlab # [  294.627115] setup-gitlab-start[3630]: +++ date -d '+7 days' +%F1655vm-test-run-nixbot-gitlab> gitlab # [  294.630612] setup-gitlab-start[3629]: ++ jq -r .token1656vm-test-run-nixbot-gitlab> gitlab # [  294.633682] setup-gitlab-start[3628]: ++ curl -fs -X POST -H 'Authorization: Bearer e62920817b304b4299f949d1ef5fdecd7690d72f30247bf3ce6d5b76dd4f0107' -H 'Content-Type: application/json' -d '{"name":"nixbot","scopes":["api"],"expires_at":"2026-06-15"}' http://gitlab/api/v4/users/1/personal_access_tokens1657vm-test-run-nixbot-gitlab> gitlab # [  295.234583] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:32.016Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"0e6fc1f38b85c9469ea07b6c","created_at":"2026-06-08T13:19:31.980Z","trace_propagation_headers":{"sentry-trace":"9660894d3395424a8b0ce658efa5c955-4650a45fe0364f4b","baggage":"sentry-trace_id=9660894d3395424a8b0ce658efa5c955,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP6V32NBVCNB2N184D4H77","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:aebb6fb12be21d5be8019f1e4a8a3a4dcc833a5ea990141efd6d6bb07f3a24e3","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:32.011Z","job_size_bytes":451,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-0e6fc1f38b85c9469ea07b6c: start","job_status":"start","queue_duration_s":0.004959,"scheduling_latency_s":0.005031}1658vm-test-run-nixbot-gitlab> gitlab # [  295.281625] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:32 +0000] "POST /api/v4/users/1/personal_access_tokens HTTP/1.1" 201 267 "" "curl/8.20.0" 5971659vm-test-run-nixbot-gitlab> gitlab # [  295.288097] setup-gitlab-start[3245]: + TOKEN=glpat-SGfbzld7FpRq0-bCsEnxpW86MQp1OjEH.01.0w1hkor7k1660vm-test-run-nixbot-gitlab> gitlab # [  295.291106] setup-gitlab-start[3245]: + test -n glpat-SGfbzld7FpRq0-bCsEnxpW86MQp1OjEH.01.0w1hkor7k1661vm-test-run-nixbot-gitlab> gitlab # [  295.294105] setup-gitlab-start[3245]: + test glpat-SGfbzld7FpRq0-bCsEnxpW86MQp1OjEH.01.0w1hkor7k '!=' null1662vm-test-run-nixbot-gitlab> gitlab # [  295.297019] setup-gitlab-start[3245]: + mkdir -p /var/lib/secrets1663vm-test-run-nixbot-gitlab> gitlab # [  295.298767] setup-gitlab-start[3245]: + echo glpat-SGfbzld7FpRq0-bCsEnxpW86MQp1OjEH.01.0w1hkor7k1664vm-test-run-nixbot-gitlab> gitlab # [  295.301231] setup-gitlab-start[3245]: + chmod 644 /var/lib/secrets/gitlab-token1665vm-test-run-nixbot-gitlab> gitlab # [  295.303223] setup-gitlab-start[3245]: + curl -fs -X POST -H 'PRIVATE-TOKEN: glpat-SGfbzld7FpRq0-bCsEnxpW86MQp1OjEH.01.0w1hkor7k' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1666vm-test-run-nixbot-gitlab> gitlab # [  295.513879] sidekiq-cluster[2428]: {"severity":"WARN","time":"2026-06-08T13:19:32.295Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"0e6fc1f38b85c9469ea07b6c","created_at":"2026-06-08T13:19:31.980Z","trace_propagation_headers":{"sentry-trace":"9660894d3395424a8b0ce658efa5c955-4650a45fe0364f4b","baggage":"sentry-trace_id=9660894d3395424a8b0ce658efa5c955,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP6V32NBVCNB2N184D4H77","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:aebb6fb12be21d5be8019f1e4a8a3a4dcc833a5ea990141efd6d6bb07f3a24e3","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:32.011Z","job_size_bytes":451,"pid":2428,"sidekiq_tid":"lym0","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-0e6fc1f38b85c9469ea07b6c: fail: 0.27857 sec","job_status":"fail","queue_duration_s":0.004959,"scheduling_latency_s":0.005031,"redis_calls":11,"redis_duration_s":0.004986,"redis_read_bytes":137,"redis_write_bytes":1317,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001158,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002952,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000876,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.200636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00085892,"duration_s":0.27857,"completed_at":"2026-06-08T13:19:32.294Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/anil03slywxmk4rnhn17xdngk0v51799-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/anil03slywxmk4rnhn17xdngk0v51799-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/anil03slywxmk4rnhn17xdngk0v51799-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/profile.rb:99:in `access_token_created_email'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/w9mp1gyfs2qdv12r0ji70idzndmxwz2s-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/qr8jwlszzf80b9yy5410msfvxfhdlv3q-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/p8ylyr0sj9sxcknqcpja13nypqixk2dp-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/dmv1shq667w4j882d6hfknpqjgmsjk3d-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/dmv1shq667w4j882d6hfknpqjgmsjk3d-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/dndr7b4a17339dsm67vzb6nv4p2kp82q-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/qr8jwlszzf80b9yy5410msfvxfhdlv3q-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/zx6ndpscxs64hnidz69ab430ccms6rak-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.061102,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1667vm-test-run-nixbot-gitlab> gitlab # [  297.087321] gitaly[1371]: time="2026-06-08T13:19:33.870Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP6VPZFRBR63MR0JD93FGA error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-08T13:19:43.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:33.870" pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1668vm-test-run-nixbot-gitlab> gitlab # [  297.088648] gitaly[1371]: time="2026-06-08T13:19:33.871Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP6VPZFRBR63MR0JD93FGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-08T13:19:43.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:33.870" grpc.time_ms=0.968 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1669vm-test-run-nixbot-gitlab> gitlab # [  297.476185] gitaly[1371]: time="2026-06-08T13:19:34.260Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP6VPZFRBR63MR0JD93FGA error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-08T13:19:44.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:34.259" pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1670vm-test-run-nixbot-gitlab> gitlab # [  297.505274] gitaly[1371]: time="2026-06-08T13:19:34.260Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP6VPZFRBR63MR0JD93FGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-08T13:19:44.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:34.259" grpc.time_ms=0.41 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1671vm-test-run-nixbot-gitlab> gitlab # [  297.541407] gitaly[1371]: time="2026-06-08T13:19:34.325Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP6VPZFRBR63MR0JD93FGA diskcache=5fd4bba2-c8d5-4efc-bc30-ba067454b741 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-06-08T13:19:44.040" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:34.291" pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1672vm-test-run-nixbot-gitlab> gitlab # [  297.569274] gitaly[1371]: time="2026-06-08T13:19:34.325Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=299 command.oublock=32 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP6VPZFRBR63MR0JD93FGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-06-08T13:19:44.040" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:34.291" grpc.time_ms=34.085 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1673vm-test-run-nixbot-gitlab> gitlab # [  297.599947] gitaly[1371]: time="2026-06-08T13:19:34.383Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP6VPZFRBR63MR0JD93FGA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-08T13:19:44.132" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:34.382" pid=1371 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1674vm-test-run-nixbot-gitlab> gitlab # [  297.620844] gitaly[1371]: time="2026-06-08T13:19:34.384Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP6VPZFRBR63MR0JD93FGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-08T13:19:44.132" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:34.382" grpc.time_ms=1.366 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1675vm-test-run-nixbot-gitlab> gitlab # [  297.640140] gitaly[1371]: time="2026-06-08T13:19:34.422Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP6VPZFRBR63MR0JD93FGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-08T13:19:44.154" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:34.405" grpc.time_ms=16.761 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1676vm-test-run-nixbot-gitlab> gitlab # [  297.705452] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:34.487Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"46a045ead61efee7da19721d","created_at":"2026-06-08T13:19:34.445Z","trace_propagation_headers":{"sentry-trace":"ff018d2419c0426590c59a1d57a165c8-98a40447cfab4a43","baggage":"sentry-trace_id=ff018d2419c0426590c59a1d57a165c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP6VPZFRBR63MR0JD93FGA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:34.475Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-46a045ead61efee7da19721d: start","job_status":"start","queue_duration_s":0.011659,"scheduling_latency_s":0.01175}1677vm-test-run-nixbot-gitlab> gitlab # [  297.788765] gitaly[1371]: time="2026-06-08T13:19:34.572Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP6VPZFRBR63MR0JD93FGA error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-08T13:19:44.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:34.572" pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1678vm-test-run-nixbot-gitlab> gitlab # [  297.820010] gitaly[1371]: time="2026-06-08T13:19:34.573Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP6VPZFRBR63MR0JD93FGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-08T13:19:44.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:34.572" grpc.time_ms=0.593 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1679vm-test-run-nixbot-gitlab> gitlab # [  297.848982] gitaly[1371]: time="2026-06-08T13:19:34.600Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP6VPZFRBR63MR0JD93FGA diskcache=0c021c65-7b49-466a-82b3-e7f8aa4cb896 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-06-08T13:19:44.004" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:34.575" pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1680vm-test-run-nixbot-gitlab> gitlab # [  297.868607] gitaly[1371]: time="2026-06-08T13:19:34.600Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=300 command.oublock=32 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP6VPZFRBR63MR0JD93FGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-06-08T13:19:44.004" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:34.575" grpc.time_ms=25.018 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1681vm-test-run-nixbot-gitlab> gitlab # [  297.888493] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:34.605Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"46a045ead61efee7da19721d","created_at":"2026-06-08T13:19:34.445Z","trace_propagation_headers":{"sentry-trace":"ff018d2419c0426590c59a1d57a165c8-98a40447cfab4a43","baggage":"sentry-trace_id=ff018d2419c0426590c59a1d57a165c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP6VPZFRBR63MR0JD93FGA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:34.475Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-46a045ead61efee7da19721d: done: 0.117818 sec","job_status":"done","queue_duration_s":0.011659,"scheduling_latency_s":0.01175,"redis_calls":13,"redis_duration_s":0.006231,"redis_read_bytes":138,"redis_write_bytes":1593,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001398,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":428,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002311,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002522,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.088287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.06592016,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.117818,"completed_at":"2026-06-08T13:19:34.605Z","load_balancing_strategy":"primary","db_duration_s":0.016421,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1682vm-test-run-nixbot-gitlab> gitlab # [  297.935410] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:34.607Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"707885e65d923dae563129e8","created_at":"2026-06-08T13:19:34.531Z","trace_propagation_headers":{"sentry-trace":"ff018d2419c0426590c59a1d57a165c8-98a40447cfab4a43","baggage":"sentry-trace_id=ff018d2419c0426590c59a1d57a165c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP6VPZFRBR63MR0JD93FGA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:34.558Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-707885e65d923dae563129e8: start","job_status":"start","queue_duration_s":0.048956,"scheduling_latency_s":0.048989}1683vm-test-run-nixbot-gitlab> gitlab # [  297.949747] gitaly[1371]: time="2026-06-08T13:19:34.620Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP6VPZFRBR63MR0JD93FGA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-08T13:19:44.048" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:34.619" pid=1371 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1684vm-test-run-nixbot-gitlab> gitlab # [  297.960953] gitaly[1371]: time="2026-06-08T13:19:34.620Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP6VPZFRBR63MR0JD93FGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-08T13:19:44.048" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:34.619" grpc.time_ms=1.465 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1685vm-test-run-nixbot-gitlab> gitlab # [  297.971242] gitaly[1371]: time="2026-06-08T13:19:34.637Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP6VPZFRBR63MR0JD93FGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-08T13:19:44.057" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:34.628" grpc.time_ms=8.949 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1686vm-test-run-nixbot-gitlab> gitlab # [  297.984249] gitaly[1371]: time="2026-06-08T13:19:34.755Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP6VPZFRBR63MR0JD93FGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-08T13:19:44.183" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:34.754" grpc.time_ms=0.425 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1687vm-test-run-nixbot-gitlab> gitlab # [  298.021680] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:34.805Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"707885e65d923dae563129e8","created_at":"2026-06-08T13:19:34.531Z","trace_propagation_headers":{"sentry-trace":"ff018d2419c0426590c59a1d57a165c8-98a40447cfab4a43","baggage":"sentry-trace_id=ff018d2419c0426590c59a1d57a165c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP6VPZFRBR63MR0JD93FGA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:34.558Z","job_size_bytes":2,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-707885e65d923dae563129e8: done: 0.197533 sec","job_status":"done","queue_duration_s":0.048956,"scheduling_latency_s":0.048989,"redis_calls":14,"redis_duration_s":0.00533,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001547,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00203,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001753,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.147956,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.15196408,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.197533,"completed_at":"2026-06-08T13:19:34.805Z","load_balancing_strategy":"primary","db_duration_s":0.039785,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1688vm-test-run-nixbot-gitlab> gitlab # [  298.500754] gitaly[1371]: time="2026-06-08T13:19:35.283Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP6VPZFRBR63MR0JD93FGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-06-08T13:19:45.031" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:35.282" grpc.time_ms=0.699 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1689vm-test-run-nixbot-gitlab> gitlab # [  298.766238] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:35.548Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"1112635d2b78f1d5b3745dc9","created_at":"2026-06-08T13:19:35.539Z","trace_propagation_headers":{"sentry-trace":"ff018d2419c0426590c59a1d57a165c8-98a40447cfab4a43","baggage":"sentry-trace_id=ff018d2419c0426590c59a1d57a165c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP6VPZFRBR63MR0JD93FGA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:35.546Z","job_size_bytes":5,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-1112635d2b78f1d5b3745dc9: start","job_status":"start","queue_duration_s":0.0022,"scheduling_latency_s":0.002347}1690vm-test-run-nixbot-gitlab> gitlab # [  298.868575] gitaly[1371]: time="2026-06-08T13:19:35.652Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP6VPZFRBR63MR0JD93FGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-08T13:19:45.069" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:35.640" grpc.time_ms=12.217 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1691vm-test-run-nixbot-gitlab> gitlab # [  298.907899] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:35.690Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"1112635d2b78f1d5b3745dc9","created_at":"2026-06-08T13:19:35.539Z","trace_propagation_headers":{"sentry-trace":"ff018d2419c0426590c59a1d57a165c8-98a40447cfab4a43","baggage":"sentry-trace_id=ff018d2419c0426590c59a1d57a165c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP6VPZFRBR63MR0JD93FGA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:35.546Z","job_size_bytes":5,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-1112635d2b78f1d5b3745dc9: done: 0.142786 sec","job_status":"done","queue_duration_s":0.0022,"scheduling_latency_s":0.002347,"redis_calls":12,"redis_duration_s":0.004211,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001203,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002415,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000593,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.097465,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00057916,"duration_s":0.142786,"completed_at":"2026-06-08T13:19:35.690Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029737,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1692vm-test-run-nixbot-gitlab> gitlab # [  298.985611] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:35.694Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"e20e3623a7c7ffd422733265","created_at":"2026-06-08T13:19:35.576Z","trace_propagation_headers":{"sentry-trace":"ff018d2419c0426590c59a1d57a165c8-98a40447cfab4a43","baggage":"sentry-trace_id=ff018d2419c0426590c59a1d57a165c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP6VPZFRBR63MR0JD93FGA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:35.583Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-e20e3623a7c7ffd422733265: start","job_status":"start","queue_duration_s":0.110315,"scheduling_latency_s":0.110355}1693vm-test-run-nixbot-gitlab> gitlab # [  299.187443] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:35.969Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"e20e3623a7c7ffd422733265","created_at":"2026-06-08T13:19:35.576Z","trace_propagation_headers":{"sentry-trace":"ff018d2419c0426590c59a1d57a165c8-98a40447cfab4a43","baggage":"sentry-trace_id=ff018d2419c0426590c59a1d57a165c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP6VPZFRBR63MR0JD93FGA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:35.583Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-e20e3623a7c7ffd422733265: done: 0.275646 sec","job_status":"done","queue_duration_s":0.110315,"scheduling_latency_s":0.110355,"redis_calls":11,"redis_duration_s":0.003795,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000864,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002158,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000773,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.216,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.216,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.172141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045306,"duration_s":0.275646,"completed_at":"2026-06-08T13:19:35.969Z","load_balancing_strategy":"primary","db_duration_s":0.103088,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1694vm-test-run-nixbot-gitlab> gitlab # [  299.283706] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:35.972Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"bbcb4e34db429b46d376fa63","created_at":"2026-06-08T13:19:35.593Z","trace_propagation_headers":{"sentry-trace":"ff018d2419c0426590c59a1d57a165c8-98a40447cfab4a43","baggage":"sentry-trace_id=ff018d2419c0426590c59a1d57a165c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP6VPZFRBR63MR0JD93FGA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:35.604Z","job_size_bytes":89,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-bbcb4e34db429b46d376fa63: start","job_status":"start","queue_duration_s":0.367421,"scheduling_latency_s":0.367475}1695vm-test-run-nixbot-gitlab> gitlab # [  299.311314] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:36.073Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"bbcb4e34db429b46d376fa63","created_at":"2026-06-08T13:19:35.593Z","trace_propagation_headers":{"sentry-trace":"ff018d2419c0426590c59a1d57a165c8-98a40447cfab4a43","baggage":"sentry-trace_id=ff018d2419c0426590c59a1d57a165c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP6VPZFRBR63MR0JD93FGA","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:35.604Z","job_size_bytes":89,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-bbcb4e34db429b46d376fa63: done: 0.101688 sec","job_status":"done","queue_duration_s":0.367421,"scheduling_latency_s":0.367475,"redis_calls":11,"redis_duration_s":0.002205,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000632,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001143,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00043,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037022,"duration_s":0.101688,"completed_at":"2026-06-08T13:19:36.073Z","load_balancing_strategy":"primary","db_duration_s":0.045682,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1696vm-test-run-nixbot-gitlab> gitlab # [  299.476954] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:36 +0000] "POST /api/v4/projects HTTP/1.1" 201 4795 "" "curl/8.20.0" 41951697vm-test-run-nixbot-gitlab> gitlab # [  299.482630] setup-gitlab-start[3245]: + mkdir -p /tmp/test-flake1698vm-test-run-nixbot-gitlab> gitlab # [  299.485171] setup-gitlab-start[3245]: + cd /tmp/test-flake1699vm-test-run-nixbot-gitlab> gitlab # [  299.487328] setup-gitlab-start[3245]: + git init -b master1700vm-test-run-nixbot-gitlab> gitlab # [  299.510749] setup-gitlab-start[3681]: Initialized empty Git repository in /tmp/test-flake/.git/1701vm-test-run-nixbot-gitlab> gitlab # [  299.514085] setup-gitlab-start[3245]: + git config user.name test1702vm-test-run-nixbot-gitlab> gitlab # [  299.517588] setup-gitlab-start[3245]: + git config user.email test@example.com1703vm-test-run-nixbot-gitlab> gitlab # [  299.521402] setup-gitlab-start[3245]: + cat1704vm-test-run-nixbot-gitlab> gitlab # [  299.524845] setup-gitlab-start[3245]: + git add flake.nix1705vm-test-run-nixbot-gitlab> gitlab # [  299.533181] setup-gitlab-start[3245]: + git commit -m 'initial commit'1706vm-test-run-nixbot-gitlab> gitlab # [  299.547921] setup-gitlab-start[3686]: [master (root-commit) f0b6d6d] initial commit1707vm-test-run-nixbot-gitlab> gitlab # [  299.551036] setup-gitlab-start[3686]:  1 file changed, 10 insertions(+)1708vm-test-run-nixbot-gitlab> gitlab # [  299.553667] setup-gitlab-start[3686]:  create mode 100644 flake.nix1709vm-test-run-nixbot-gitlab> gitlab # [  299.556168] setup-gitlab-start[3245]: + git remote add origin http://oauth2:glpat-SGfbzld7FpRq0-bCsEnxpW86MQp1OjEH.01.0w1hkor7k@gitlab/root/test-flake.git1710vm-test-run-nixbot-gitlab> gitlab # [  299.561289] setup-gitlab-start[3245]: + git push -u origin master1711vm-test-run-nixbot-gitlab> gitlab # [  299.688814] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:36 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 841712vm-test-run-nixbot-gitlab> gitlab # [  299.887906] gitaly[1371]: time="2026-06-08T13:19:36.670Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTKP700TE950JEVE0C6EZXFX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:36.654" grpc.time_ms=16.716 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1713vm-test-run-nixbot-gitlab> gitlab # [  299.925661] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:36 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.54.0" 1971714vm-test-run-nixbot-gitlab> gitlab # [  300.577803] gitaly[1371]: time="2026-06-08T13:19:37.361Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-08T13:19:47.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:37.344" grpc.time_ms=17.333 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1715vm-test-run-nixbot-gitlab> gitlab # [  300.669490] gitaly[1371]: time="2026-06-08T13:19:37.453Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=5 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-06-08T13:20:07.032" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-06-08T13:19:37.432" grpc.time_ms=20.399 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1716vm-test-run-nixbot-gitlab> gitlab # [  300.840245] gitaly[1371]: time="2026-06-08T13:19:37.623Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV duration_ms=726ns method=POST pid=1371 status=200 url="http://unix/api/v4/internal/allowed"1717vm-test-run-nixbot-gitlab> gitlab # [  300.898719] gitaly[1371]: time="2026-06-08T13:19:37.681Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV duration_ms=47ns method=POST pid=1371 status=200 url="http://unix/api/v4/internal/pre_receive"1718vm-test-run-nixbot-gitlab> gitlab # [  300.902784] gitaly[1371]: time="2026-06-08T13:19:37.681Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5318 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:36.893" grpc.time_ms=787.812 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1719vm-test-run-nixbot-gitlab> gitlab # [  300.957324] gitaly[1371]: time="2026-06-08T13:19:37.741Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4788 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:37.739" grpc.time_ms=1.409 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1720vm-test-run-nixbot-gitlab> gitlab # [  301.036769] gitaly[1371]: time="2026-06-08T13:19:37.820Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:37.819" grpc.time_ms=1.616 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1721vm-test-run-nixbot-gitlab> gitlab # [  301.124340] gitaly[1371]: time="2026-06-08T13:19:37.907Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4789 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:37.906" grpc.time_ms=0.764 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1722vm-test-run-nixbot-gitlab> gitlab # [  301.250410] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:38.032Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 f0b6d6d46b23f23b011cbcd0741feac8d387b1a6 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"fe00aa4c4df47bcdcd87a5d3","created_at":"2026-06-08T13:19:38.021Z","trace_propagation_headers":{"sentry-trace":"511a2339374c41778739a4fb103745a2-f7c3f785139540e3","baggage":"sentry-trace_id=511a2339374c41778739a4fb103745a2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP707F2GY8JZ0EB9MP6SGV","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:38.028Z","job_size_bytes":185,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-fe00aa4c4df47bcdcd87a5d3: start","job_status":"start","queue_duration_s":0.004833,"scheduling_latency_s":0.004865}1723vm-test-run-nixbot-gitlab> gitlab # [  301.272199] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:38.056Z","message":"changes: \"0000000000000000000000000000000000000000 f0b6d6d46b23f23b011cbcd0741feac8d387b1a6 refs/heads/master\\n\""}1724vm-test-run-nixbot-gitlab> gitlab # [  301.292282] gitaly[1371]: time="2026-06-08T13:19:38.076Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=10 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-08T13:19:48.009" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:38.060" grpc.time_ms=15.837 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1725vm-test-run-nixbot-gitlab> gitlab # [  301.314861] gitaly[1371]: time="2026-06-08T13:19:38.098Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=6 command.system_time_ms=3 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-08T13:19:48.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:38.078" grpc.time_ms=20.081 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1726vm-test-run-nixbot-gitlab> gitlab # [  301.345529] gitaly[1371]: time="2026-06-08T13:19:38.119Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1437 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=15 command.system_time_ms=6 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-06-08T13:19:48.036" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:38.086" grpc.time_ms=33.033 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1727vm-test-run-nixbot-gitlab> gitlab # [  301.369789] gitaly[1371]: time="2026-06-08T13:19:38.142Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV duration_ms=169ns method=POST pid=1371 status=200 url="http://unix/api/v4/internal/post_receive"1728vm-test-run-nixbot-gitlab> gitlab # [  301.374668] gitaly[1371]: time="2026-06-08T13:19:38.143Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4812 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:37.972" grpc.time_ms=170.35 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1729vm-test-run-nixbot-gitlab> gitlab # [  301.390725] gitlab-workhorse[1297]: time="2026-06-08T13:19:38Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521730vm-test-run-nixbot-gitlab> gitlab # [  301.393554] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:38 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 14721731vm-test-run-nixbot-gitlab> gitlab # [  301.396664] systemd[1]: Finished setup-gitlab.service.1732vm-test-run-nixbot-gitlab> gitlab # [  301.397964] setup-gitlab-start[3690]: To http://gitlab/root/test-flake.git1733vm-test-run-nixbot-gitlab> gitlab # [  301.399262] setup-gitlab-start[3690]:  * [new branch]      master -> master1734vm-test-run-nixbot-gitlab> gitlab # [  301.400628] setup-gitlab-start[3690]: branch 'master' set up to track 'origin/master'.1735vm-test-run-nixbot-gitlab> gitlab # [  301.402092] gitaly[1371]: time="2026-06-08T13:19:38.152Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=5 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-08T13:19:48.072" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:38.142" grpc.time_ms=9.701 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1736vm-test-run-nixbot-gitlab> gitlab # [  301.418941] gitaly[1371]: time="2026-06-08T13:19:38.159Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV diskcache=b487e45f-2920-4539-8f97-8d41993cdf95 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:36.789" pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1737vm-test-run-nixbot-gitlab> gitlab # [  301.432179] systemd[1]: Starting nixbot CI service...1738vm-test-run-nixbot-gitlab> gitlab # [  301.433106] gitaly[1371]: time="2026-06-08T13:19:38.159Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=336 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13186 command.oublock=32 command.real_time_ms=1362 command.spawn_token_fork_ms=0 command.system_time_ms=194 command.user_time_ms=142 component=gitaly.StreamServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:36.789" grpc.time_ms=1370.144 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1739vm-test-run-nixbot-gitlab> gitlab # [  301.449318] gitaly[1371]: time="2026-06-08T13:19:38.196Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-06-08T13:19:48.117" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=226 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:38.188" grpc.time_ms=8.522 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1740vm-test-run-nixbot-gitlab> gitlab # [  301.467433] gitaly[1371]: time="2026-06-08T13:19:38.230Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3938 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:38.229" grpc.time_ms=1.068 pid=1371 span.kind=server system=grpc1741vm-test-run-nixbot-gitlab> gitlab # [  301.479630] gitaly[1371]: time="2026-06-08T13:19:38.256Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3940 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:38.255" grpc.time_ms=0.551 pid=1371 span.kind=server system=grpc1742vm-test-run-nixbot-gitlab> gitlab # [  301.490807] gitaly[1371]: time="2026-06-08T13:19:38.263Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV diskcache=4e146c16-efc8-47b8-9f2b-334a839821d9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-08T13:19:48.134" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:38.205" pid=1371 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1743vm-test-run-nixbot-gitlab> gitlab # [  301.502578] gitaly[1371]: time="2026-06-08T13:19:38.264Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=52 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4636 command.oublock=8 command.real_time_ms=53 command.spawn_token_fork_ms=0 command.system_time_ms=39 command.user_time_ms=13 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-08T13:19:48.134" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:38.205" grpc.time_ms=58.79 pid=1371 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1744vm-test-run-nixbot-gitlab> gitlab # [  301.516428] gitaly[1371]: time="2026-06-08T13:19:38.277Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-08T13:19:48.207" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:38.277" grpc.time_ms=0.16 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1745vm-test-run-nixbot-gitlab> gitlab # [  301.526400] gitaly[1371]: time="2026-06-08T13:19:38.292Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=860 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-06-08T13:19:48.211" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:38.281" grpc.time_ms=10.513 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1746vm-test-run-nixbot-gitlab> gitlab # [  301.595400] gitaly[1371]: time="2026-06-08T13:19:38.379Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=313 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-06-08T13:20:08.072" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:38.372" grpc.time_ms=6.504 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1747vm-test-run-nixbot-gitlab> gitlab # [  301.634842] gitaly[1371]: time="2026-06-08T13:19:38.418Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-06-08T13:19:48.008" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:38.418" grpc.time_ms=0.229 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1748vm-test-run-nixbot-gitlab> gitlab # [  301.651417] gitaly[1371]: time="2026-06-08T13:19:38.427Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=317 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-06-08T13:19:48.011" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-06-08T13:19:38.421" grpc.time_ms=5.843 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1749vm-test-run-nixbot-gitlab> gitlab # [  301.669985] gitaly[1371]: time="2026-06-08T13:19:38.453Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-08T13:19:48.036" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:38.446" grpc.time_ms=6.935 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1750vm-test-run-nixbot-gitlab> gitlab # [  301.686971] fj0frv30ydil94n6khrxhk59nkxqfqrc-nixbot-health[3825]: curl: (7) Failed to connect to 127.0.0.1 port 8010 after 0 ms: Could not connect to server1751vm-test-run-nixbot-gitlab> gitlab # [  301.689506] gitaly[1371]: time="2026-06-08T13:19:38.473Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-08T13:19:48.053" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:38.463" grpc.time_ms=9.592 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1752vm-test-run-nixbot-gitlab> gitlab # [  301.712703] gitaly[1371]: time="2026-06-08T13:19:38.496Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-06-08T13:20:08.185" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:38.485" grpc.time_ms=11.014 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1753vm-test-run-nixbot-gitlab> gitlab # [  302.110140] gitaly[1371]: time="2026-06-08T13:19:38.893Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-06-08T13:19:48.001" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:38.892" grpc.time_ms=1.408 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1754vm-test-run-nixbot-gitlab> gitlab # [  302.180326] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:38.963Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 f0b6d6d46b23f23b011cbcd0741feac8d387b1a6 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"fe00aa4c4df47bcdcd87a5d3","created_at":"2026-06-08T13:19:38.021Z","trace_propagation_headers":{"sentry-trace":"511a2339374c41778739a4fb103745a2-f7c3f785139540e3","baggage":"sentry-trace_id=511a2339374c41778739a4fb103745a2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP707F2GY8JZ0EB9MP6SGV","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:38.028Z","job_size_bytes":185,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-fe00aa4c4df47bcdcd87a5d3: done: 0.930338 sec","job_status":"done","queue_duration_s":0.004833,"scheduling_latency_s":0.004865,"gitaly_calls":13,"gitaly_duration_s":0.210579,"redis_calls":200,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.048715999999999995,"redis_read_bytes":941,"redis_write_bytes":19811,"redis_cache_calls":14,"redis_cache_duration_s":0.002817,"redis_cache_read_bytes":16,"redis_cache_write_bytes":884,"redis_feature_flag_calls":32,"redis_feature_flag_duration_s":0.008936,"redis_feature_flag_read_bytes":540,"redis_feature_flag_write_bytes":4279,"redis_queues_calls":8,"redis_queues_duration_s":0.00119,"redis_queues_read_bytes":8,"redis_queues_write_bytes":4935,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002906,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1259,"redis_repository_cache_calls":91,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.019457,"redis_repository_cache_read_bytes":233,"redis_repository_cache_write_bytes":6319,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.01341,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":51,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":51,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.058,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":51,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.29,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.314,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.058,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.611737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00058618,"exclusive_lock_hold_duration_s":0.02909228,"duration_s":0.930338,"completed_at":"2026-06-08T13:19:38.963Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.097317,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1755vm-test-run-nixbot-gitlab> gitlab # [  302.272795] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:38.966Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"e11592305b077303632ac436","created_at":"2026-06-08T13:19:38.157Z","trace_propagation_headers":{"sentry-trace":"511a2339374c41778739a4fb103745a2-9ea456107f2947dc","baggage":"sentry-trace_id=511a2339374c41778739a4fb103745a2,sentry-release=Unknown"},"correlation_id":"01KTKP707F2GY8JZ0EB9MP6SGV","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:38.162Z","job_size_bytes":46,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-e11592305b077303632ac436: start","job_status":"start","queue_duration_s":0.804009,"scheduling_latency_s":0.804051}1756vm-test-run-nixbot-gitlab> gitlab # [  302.289971] gitaly[1371]: time="2026-06-08T13:19:39.057Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-06-08T19:19:39.046" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:39.047" grpc.time_ms=9.018 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1757vm-test-run-nixbot-gitlab> gitlab # [  302.302760] gitaly[1371]: time="2026-06-08T13:19:39.086Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=593 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-06-08T13:20:09.068" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:39.068" grpc.time_ms=17.635 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1758vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for unit setup-gitlab.service, in 302.98 seconds)1759vm-test-run-nixbot-gitlab> gitlab # [  302.349887] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:39.133Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"e11592305b077303632ac436","created_at":"2026-06-08T13:19:38.157Z","trace_propagation_headers":{"sentry-trace":"511a2339374c41778739a4fb103745a2-9ea456107f2947dc","baggage":"sentry-trace_id=511a2339374c41778739a4fb103745a2,sentry-release=Unknown"},"correlation_id":"01KTKP707F2GY8JZ0EB9MP6SGV","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:38.162Z","job_size_bytes":46,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-e11592305b077303632ac436: done: 0.167167 sec","job_status":"done","queue_duration_s":0.804009,"scheduling_latency_s":0.804051,"gitaly_calls":2,"gitaly_duration_s":0.032913,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.015907,"redis_read_bytes":68,"redis_write_bytes":4887,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002102,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.001601,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.006459,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.003968,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":752,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001777,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.098032,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00108874,"duration_s":0.167167,"completed_at":"2026-06-08T13:19:39.133Z","load_balancing_strategy":"primary","db_duration_s":0.020822,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1760vm-test-run-nixbot-gitlab> gitlab: waiting for unit nixbot.service1761vm-test-run-nixbot-gitlab> gitlab # [  302.417399] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:39.135Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"628ad87b751117a6d2b9f8ca","created_at":"2026-06-08T13:19:38.178Z","trace_propagation_headers":{"sentry-trace":"511a2339374c41778739a4fb103745a2-9ea456107f2947dc","baggage":"sentry-trace_id=511a2339374c41778739a4fb103745a2,sentry-release=Unknown"},"correlation_id":"01KTKP707F2GY8JZ0EB9MP6SGV","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:38.184Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-628ad87b751117a6d2b9f8ca: start","job_status":"start","queue_duration_s":0.951133,"scheduling_latency_s":0.951153}1762vm-test-run-nixbot-gitlab> gitlab # [  302.434872] gitaly[1371]: time="2026-06-08T13:19:39.196Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV diskcache=8cd8c931-8969-41cb-bb85-53a8f3ecf68a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-06-08T19:19:39.161" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:39.161" pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1763vm-test-run-nixbot-gitlab> gitlab # [  302.446320] gitaly[1371]: time="2026-06-08T13:19:39.196Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1175 command.oublock=0 command.real_time_ms=39 command.spawn_token_fork_ms=4 command.system_time_ms=12 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-06-08T19:19:39.161" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:39.161" grpc.time_ms=34.395 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1764vm-test-run-nixbot-gitlab> gitlab # [  302.484492] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:39.267Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"628ad87b751117a6d2b9f8ca","created_at":"2026-06-08T13:19:38.178Z","trace_propagation_headers":{"sentry-trace":"511a2339374c41778739a4fb103745a2-9ea456107f2947dc","baggage":"sentry-trace_id=511a2339374c41778739a4fb103745a2,sentry-release=Unknown"},"correlation_id":"01KTKP707F2GY8JZ0EB9MP6SGV","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:38.184Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-628ad87b751117a6d2b9f8ca: done: 0.132315 sec","job_status":"done","queue_duration_s":0.951133,"scheduling_latency_s":0.951153,"gitaly_calls":1,"gitaly_duration_s":0.0376,"redis_calls":15,"redis_duration_s":0.0050089999999999996,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000494,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002264,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000532,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001719,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.019,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.036,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.09788178,"duration_s":0.132315,"completed_at":"2026-06-08T13:19:39.267Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02177,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1765vm-test-run-nixbot-gitlab> gitlab # [  302.577650] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:39.270Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"dad6daf6d00fafc2fd757c0e","created_at":"2026-06-08T13:19:38.273Z","trace_propagation_headers":{"sentry-trace":"511a2339374c41778739a4fb103745a2-9ea456107f2947dc","baggage":"sentry-trace_id=511a2339374c41778739a4fb103745a2,sentry-release=Unknown"},"correlation_id":"01KTKP707F2GY8JZ0EB9MP6SGV","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:38.275Z","job_size_bytes":23,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-dad6daf6d00fafc2fd757c0e: start","job_status":"start","queue_duration_s":0.994934,"scheduling_latency_s":0.99497}1766vm-test-run-nixbot-gitlab> gitlab # [  302.601715] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:39.352Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"dad6daf6d00fafc2fd757c0e","created_at":"2026-06-08T13:19:38.273Z","trace_propagation_headers":{"sentry-trace":"511a2339374c41778739a4fb103745a2-9ea456107f2947dc","baggage":"sentry-trace_id=511a2339374c41778739a4fb103745a2,sentry-release=Unknown"},"correlation_id":"01KTKP707F2GY8JZ0EB9MP6SGV","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:38.275Z","job_size_bytes":23,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-dad6daf6d00fafc2fd757c0e: done: 0.082659 sec","job_status":"done","queue_duration_s":0.994934,"scheduling_latency_s":0.99497,"gitaly_calls":1,"gitaly_duration_s":0.014093,"redis_calls":16,"redis_duration_s":0.007323,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000361,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001733,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001763,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.003466,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053867,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.082659,"completed_at":"2026-06-08T13:19:39.352Z","load_balancing_strategy":"primary","db_duration_s":0.004128,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1767vm-test-run-nixbot-gitlab> gitlab # [  302.659949] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:39.355Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"90deec26476e6673f998fb1e","created_at":"2026-06-08T13:19:38.840Z","trace_propagation_headers":{"sentry-trace":"511a2339374c41778739a4fb103745a2-9ea456107f2947dc","baggage":"sentry-trace_id=511a2339374c41778739a4fb103745a2,sentry-release=Unknown"},"correlation_id":"01KTKP707F2GY8JZ0EB9MP6SGV","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:021449a701d6784dac2aea375ec6c9c7098aa7503a81e937d7f801f6bb7e382f","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:38.845Z","job_size_bytes":467,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-90deec26476e6673f998fb1e: start","job_status":"start","queue_duration_s":0.509427,"scheduling_latency_s":0.509466}1768vm-test-run-nixbot-gitlab> gitlab # [  302.680421] gitaly[1371]: time="2026-06-08T13:19:39.335Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=592 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-06-08T13:20:09.323" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:39.323" grpc.time_ms=11.159 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1769vm-test-run-nixbot-gitlab> gitlab # [  302.701149] nixbot[3793]: {"ts": "2026-06-08T13:19:39.296Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1770vm-test-run-nixbot-gitlab> gitlab # [  302.704149] nixbot[3793]: {"ts": "2026-06-08T13:19:39.326Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1771vm-test-run-nixbot-gitlab> gitlab # [  302.706808] nixbot[3793]: {"ts": "2026-06-08T13:19:39.349Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1772vm-test-run-nixbot-gitlab> gitlab # [  302.709632] nixbot[3793]: {"ts": "2026-06-08T13:19:39.353Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1773vm-test-run-nixbot-gitlab> gitlab # [  302.712214] nixbot[3793]: {"ts": "2026-06-08T13:19:39.356Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1774vm-test-run-nixbot-gitlab> gitlab # [  302.714680] nixbot[3793]: {"ts": "2026-06-08T13:19:39.386Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1775vm-test-run-nixbot-gitlab> gitlab # [  302.717480] nixbot[3793]: {"ts": "2026-06-08T13:19:39.394Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1776vm-test-run-nixbot-gitlab> gitlab # [  302.720095] nixbot[3793]: {"ts": "2026-06-08T13:19:39.396Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1777vm-test-run-nixbot-gitlab> gitlab # [  302.722596] nixbot[3793]: {"ts": "2026-06-08T13:19:39.403Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1778vm-test-run-nixbot-gitlab> gitlab # [  302.725226] nixbot[3793]: {"ts": "2026-06-08T13:19:39.405Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1779vm-test-run-nixbot-gitlab> gitlab # [  302.727854] nixbot[3793]: {"ts": "2026-06-08T13:19:39.410Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1780vm-test-run-nixbot-gitlab> gitlab # [  302.730436] nixbot[3793]: {"ts": "2026-06-08T13:19:39.417Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1781vm-test-run-nixbot-gitlab> gitlab # [  302.733151] gitaly[1371]: time="2026-06-08T13:19:39.429Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:09.427" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:39.428" grpc.time_ms=0.807 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1782vm-test-run-nixbot-gitlab> gitlab # [  302.748540] fj0frv30ydil94n6khrxhk59nkxqfqrc-nixbot-health[3869]: curl: (7) Failed to connect to 127.0.0.1 port 8010 after 0 ms: Could not connect to server1783vm-test-run-nixbot-gitlab> gitlab # [  302.750464] nixbot[3793]: {"ts": "2026-06-08T13:19:39.421Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1784vm-test-run-nixbot-gitlab> gitlab # [  302.752792] nixbot[3793]: {"ts": "2026-06-08T13:19:39.423Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1785vm-test-run-nixbot-gitlab> gitlab # [  302.755057] nixbot[3793]: {"ts": "2026-06-08T13:19:39.427Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1786vm-test-run-nixbot-gitlab> gitlab # [  302.757411] gitaly[1371]: time="2026-06-08T13:19:39.447Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=5 command.system_time_ms=0 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-06-08T13:19:49.022" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:39.433" grpc.time_ms=13.868 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1787vm-test-run-nixbot-gitlab> gitlab # [  302.798447] gitaly[1371]: time="2026-06-08T13:19:39.582Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-08T13:20:09.581" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:39.581" grpc.time_ms=0.976 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1788vm-test-run-nixbot-gitlab> gitlab # [  302.823985] gitaly[1371]: time="2026-06-08T13:19:39.589Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=86 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-06-08T13:20:09.585" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:39.586" grpc.time_ms=2.84 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1789vm-test-run-nixbot-gitlab> gitlab # [  302.929257] gitaly[1371]: time="2026-06-08T13:19:39.713Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-08T13:19:49.285" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:39.695" grpc.time_ms=17.077 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1790vm-test-run-nixbot-gitlab> gitlab # [  303.047031] nixbot[3793]: INFO:     Started server process [3793]1791vm-test-run-nixbot-gitlab> gitlab # [  303.050615] nixbot[3793]: INFO:     Uvicorn running on http://0.0.0.0:8010 (Press CTRL+C to quit)1792vm-test-run-nixbot-gitlab> gitlab # [  303.725690] gitaly[1371]: time="2026-06-08T13:19:40.509Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=883 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01KTKP739TR15YS59TWGJ2S8M7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-06-08T13:20:10.089" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:40.490" grpc.time_ms=19.04 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1793vm-test-run-nixbot-gitlab> gitlab # [  303.740629] gitaly[1371]: time="2026-06-08T13:19:40.522Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=1 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=885 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-06-08T13:20:10.487" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:40.488" grpc.time_ms=33.816 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1794vm-test-run-nixbot-gitlab> gitlab # [  303.757796] nixbot[3793]: INFO:     127.0.0.1:41392 - "GET /health HTTP/1.1" 200 OK1795vm-test-run-nixbot-gitlab> gitlab # [  303.773590] gitaly[1371]: time="2026-06-08T13:19:40.553Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=7 command.system_time_ms=2 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01KTKP707F2GY8JZ0EB9MP6SGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-06-08T13:20:10.527" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:40.527" grpc.time_ms=25.322 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1796vm-test-run-nixbot-gitlab> gitlab # [  303.786930] systemd[1]: Started nixbot CI service.1797vm-test-run-nixbot-gitlab> gitlab # [  303.787648] systemd[1]: Reached target Multi-User System.1798vm-test-run-nixbot-gitlab> gitlab # [  303.788559] systemd[1]: Startup finished in 827ms (kernel) + 4.973s (initrd) + 4min 57.985s (userspace) = 5min 3.786s.1799vm-test-run-nixbot-gitlab> gitlab # [  303.854489] sidekiq-cluster[2428]: {"severity":"WARN","time":"2026-06-08T13:19:40.636Z","class":"CreatePipelineWorker","correlation_id":"01KTKP707F2GY8JZ0EB9MP6SGV","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"f0b6d6d46b23f23b011cbcd0741feac8d387b1a6","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"f0b6d6d46b23f23b011cbcd0741feac8d387b1a6","ref":"refs/heads/master"},"retry":0}1800vm-test-run-nixbot-gitlab> gitlab # [  303.869327] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:40.651Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"90deec26476e6673f998fb1e","created_at":"2026-06-08T13:19:38.840Z","trace_propagation_headers":{"sentry-trace":"511a2339374c41778739a4fb103745a2-9ea456107f2947dc","baggage":"sentry-trace_id=511a2339374c41778739a4fb103745a2,sentry-release=Unknown"},"correlation_id":"01KTKP707F2GY8JZ0EB9MP6SGV","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:021449a701d6784dac2aea375ec6c9c7098aa7503a81e937d7f801f6bb7e382f","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:38.845Z","job_size_bytes":467,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-90deec26476e6673f998fb1e: done: 1.29603 sec","job_status":"done","queue_duration_s":0.509427,"scheduling_latency_s":0.509466,"gitaly_calls":7,"gitaly_duration_s":0.120524,"redis_calls":53,"redis_duration_s":0.014676999999999999,"redis_read_bytes":171,"redis_write_bytes":4426,"redis_cache_calls":4,"redis_cache_duration_s":0.001078,"redis_cache_read_bytes":10,"redis_cache_write_bytes":342,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.006219,"redis_feature_flag_read_bytes":18,"redis_feature_flag_write_bytes":2433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002449,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002836,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002095,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":40,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":40,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.054,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.067694,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00071926,"duration_s":1.29603,"completed_at":"2026-06-08T13:19:40.651Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.101039,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1801vm-test-run-nixbot-gitlab> gitlab # [  303.941256] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:40.653Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"8fae51ca3951cec3757492e8","created_at":"2026-06-08T13:19:39.102Z","trace_propagation_headers":{"sentry-trace":"511a2339374c41778739a4fb103745a2-7497f3b354b446ae","baggage":"sentry-trace_id=511a2339374c41778739a4fb103745a2,sentry-release=Unknown"},"correlation_id":"01KTKP707F2GY8JZ0EB9MP6SGV","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:39.110Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-8fae51ca3951cec3757492e8: start","job_status":"start","queue_duration_s":1.542723,"scheduling_latency_s":1.542756}1802vm-test-run-nixbot-gitlab> gitlab # [  303.960095] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:40.734Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"8fae51ca3951cec3757492e8","created_at":"2026-06-08T13:19:39.102Z","trace_propagation_headers":{"sentry-trace":"511a2339374c41778739a4fb103745a2-7497f3b354b446ae","baggage":"sentry-trace_id=511a2339374c41778739a4fb103745a2,sentry-release=Unknown"},"correlation_id":"01KTKP707F2GY8JZ0EB9MP6SGV","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:39.110Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-8fae51ca3951cec3757492e8: done: 0.080532 sec","job_status":"done","queue_duration_s":1.542723,"scheduling_latency_s":1.542756,"redis_calls":19,"redis_duration_s":0.005743,"redis_read_bytes":21,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001211,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000803,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002695,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055465,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0124515,"duration_s":0.080532,"completed_at":"2026-06-08T13:19:40.734Z","load_balancing_strategy":"primary","db_duration_s":0.012181,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1803vm-test-run-nixbot-gitlab> gitlab # [  304.003938] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:40.736Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"af8a97d21ae996de10e1354f","created_at":"2026-06-08T13:19:40.711Z","trace_propagation_headers":{"sentry-trace":"511a2339374c41778739a4fb103745a2-373184ff8bdf445c","baggage":"sentry-trace_id=511a2339374c41778739a4fb103745a2,sentry-release=Unknown"},"correlation_id":"01KTKP707F2GY8JZ0EB9MP6SGV","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:40.720Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-af8a97d21ae996de10e1354f: start","job_status":"start","queue_duration_s":0.016146,"scheduling_latency_s":0.016173}1804vm-test-run-nixbot-gitlab> gitlab # [  304.076481] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:40.860Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"af8a97d21ae996de10e1354f","created_at":"2026-06-08T13:19:40.711Z","trace_propagation_headers":{"sentry-trace":"511a2339374c41778739a4fb103745a2-373184ff8bdf445c","baggage":"sentry-trace_id=511a2339374c41778739a4fb103745a2,sentry-release=Unknown"},"correlation_id":"01KTKP707F2GY8JZ0EB9MP6SGV","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:40.720Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-af8a97d21ae996de10e1354f: done: 0.123858 sec","job_status":"done","queue_duration_s":0.016146,"scheduling_latency_s":0.016173,"redis_calls":11,"redis_duration_s":0.003159,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000548,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001946,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000665,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.009,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029632,"duration_s":0.123858,"completed_at":"2026-06-08T13:19:40.859Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033258,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1805vm-test-run-nixbot-gitlab> gitlab # [  304.156844] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:40 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 10591806vm-test-run-nixbot-gitlab> gitlab # [  304.159200] nixbot[3793]: {"ts": "2026-06-08T13:19:40.897Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1807vm-test-run-nixbot-gitlab> gitlab # [  304.161913] nixbot[3793]: {"ts": "2026-06-08T13:19:40.911Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1808vm-test-run-nixbot-gitlab> gitlab # [  304.272789] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:41 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1331809vm-test-run-nixbot-gitlab> gitlab # [  304.278777] nixbot[3793]: {"ts": "2026-06-08T13:19:41.058Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1810vm-test-run-nixbot-gitlab> gitlab # [  304.285356] nixbot[3793]: {"ts": "2026-06-08T13:19:41.061Z", "level": "info", "logger": "nixbot.gitlab_hooks", "msg": "registering webhook", "repo": "root/test-flake"}1811vm-test-run-nixbot-gitlab> gitlab # [  304.457020] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:41 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 868 "" "python-httpx/0.28.1" 1741812vm-test-run-nixbot-gitlab> gitlab # [  304.459887] nixbot[3793]: {"ts": "2026-06-08T13:19:41.242Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1813vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for unit nixbot.service, in 2.18 seconds)1814vm-test-run-nixbot-gitlab> gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1815vm-test-run-nixbot-gitlab> gitlab # [  304.780331] nixbot[3793]: INFO:     127.0.0.1:41400 - "GET /health HTTP/1.1" 200 OK1816vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.05 seconds)1817vm-test-run-nixbot-gitlab> subtest: project discovered and webhook registered1818vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1819vm-test-run-nixbot-gitlab> gitlab # [  304.811279] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:41 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 3361820vm-test-run-nixbot-gitlab> gitlab # [  304.818460] nixbot[3793]: {"ts": "2026-06-08T13:19:41.596Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1821vm-test-run-nixbot-gitlab> gitlab # [  304.929719] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:41 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "python-httpx/0.28.1" 1061822vm-test-run-nixbot-gitlab> gitlab # [  304.935950] nixbot[3793]: {"ts": "2026-06-08T13:19:41.714Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1823vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.16 seconds)1824vm-test-run-nixbot-gitlab> [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-06-08T13:19:41.220Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]1825vm-test-run-nixbot-gitlab> (finished: subtest: project discovered and webhook registered, in 0.16 seconds)1826vm-test-run-nixbot-gitlab> subtest: push delivers the webhook1827vm-test-run-nixbot-gitlab> gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1828vm-test-run-nixbot-gitlab> gitlab # [  304.942580] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:41 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "curl/8.20.0" 1041829vm-test-run-nixbot-gitlab> gitlab # [  305.000874] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:41 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 868 "" "python-httpx/0.28.1" 671830vm-test-run-nixbot-gitlab> gitlab # [  305.003001] nixbot[3793]: {"ts": "2026-06-08T13:19:41.786Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1831vm-test-run-nixbot-gitlab> gitlab # [  305.087254] gitaly[1371]: time="2026-06-08T13:19:41.868Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7576GS4HVB34CK1TBMJH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-06-08T13:20:11.459" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:41.859" grpc.time_ms=8.47 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1832vm-test-run-nixbot-gitlab> gitlab # [  305.105098] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:41 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 561833vm-test-run-nixbot-gitlab> gitlab # [  305.115865] gitaly[1371]: time="2026-06-08T13:19:41.899Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7576GS4HVB34CK1TBMJH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:11.497" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:41.898" grpc.time_ms=1.077 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1834vm-test-run-nixbot-gitlab> gitlab # [  305.144080] gitaly[1371]: time="2026-06-08T13:19:41.927Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=0 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7576GS4HVB34CK1TBMJH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-06-08T13:19:51.004" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:41.914" grpc.time_ms=12.619 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1835vm-test-run-nixbot-gitlab> gitlab # [  305.234723] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:42 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 731 "" "python-httpx/0.28.1" 2191836vm-test-run-nixbot-gitlab> gitlab # [  305.237562] nixbot[3793]: {"ts": "2026-06-08T13:19:42.021Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1837vm-test-run-nixbot-gitlab> gitlab # [  305.243543] gitaly[1371]: time="2026-06-08T13:19:42.027Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KTKP759GK3N4K5XJT5BN4NGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:42.011" grpc.time_ms=16.25 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1838vm-test-run-nixbot-gitlab> gitlab # [  305.256326] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:42 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 201 "" "git/2.54.0" 1551839vm-test-run-nixbot-gitlab> gitlab # Enumerating objects: 5, done.1840vm-test-run-nixbot-gitlab> gitlab # Counting objects:  20% (1/5)Counting objects:  40% (2/5)Counting objects:  60% (3/5)Counting objects:  80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1841vm-test-run-nixbot-gitlab> gitlab # Delta compression using up to 4 threads1842vm-test-run-nixbot-gitlab> gitlab # Compressing objects:  50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1843vm-test-run-nixbot-gitlab> gitlab # Writing objects:  33% (1/3)Writing objects:  66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 91.00 KiB/s, done.1844vm-test-run-nixbot-gitlab> gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1845vm-test-run-nixbot-gitlab> gitlab # [  305.345469] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:42 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1021846vm-test-run-nixbot-gitlab> gitlab # [  305.354208] nixbot[3793]: {"ts": "2026-06-08T13:19:42.135Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1847vm-test-run-nixbot-gitlab> gitlab # [  305.361394] nixbot[3793]: {"ts": "2026-06-08T13:19:42.145Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1848vm-test-run-nixbot-gitlab> gitlab # [  305.503514] gitaly[1371]: time="2026-06-08T13:19:42.287Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KTKP75M0VRVF71Q9S5F3HR2B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=198 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:42.274" grpc.time_ms=13.004 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc1849vm-test-run-nixbot-gitlab> gitlab # [  305.520468] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:42 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 791850vm-test-run-nixbot-gitlab> gitlab # [  305.600189] gitaly[1371]: time="2026-06-08T13:19:42.384Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP75PHHCG9XSF0YQZSWXWH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:42.376" pid=1371 remote_ip="2001:db8:1::1" request_sha=083c43590fffa527704b32b8836424e8ed055017 response_bytes=149 span.kind=server system=grpc1851vm-test-run-nixbot-gitlab> gitlab # [  305.610557] gitaly[1371]: time="2026-06-08T13:19:42.384Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP75PHHCG9XSF0YQZSWXWH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:42.376" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc1852vm-test-run-nixbot-gitlab> gitlab # [  305.623377] gitlab-workhorse[1297]: time="2026-06-08T13:19:42Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1491853vm-test-run-nixbot-gitlab> gitlab # [  305.625285] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:42 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 149 "" "git/2.54.0" 951854vm-test-run-nixbot-gitlab> gitlab # [  305.627074] gitaly[1371]: time="2026-06-08T13:19:42.384Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP75PHHCG9XSF0YQZSWXWH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:42.376" grpc.time_ms=8.039 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc1855vm-test-run-nixbot-gitlab> gitlab # [  305.659835] gitaly[1371]: time="2026-06-08T13:19:42.443Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-06-08T13:19:52.094" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=253 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:42.435" grpc.time_ms=8.677 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1856vm-test-run-nixbot-gitlab> gitlab # [  305.677048] gitaly[1371]: time="2026-06-08T13:19:42.461Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP75SKA2NEX488YSD6HJRP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:42.443" pid=1371 remote_ip="2001:db8:1::1" request_sha=7c85acff4142327df6c721d98c63903cbf11f1cb response_bytes=378 span.kind=server system=grpc1857vm-test-run-nixbot-gitlab> gitlab # [  305.687739] gitaly[1371]: time="2026-06-08T13:19:42.461Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1163 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP75SKA2NEX488YSD6HJRP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:42.443" negotiation.command=fetch negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc1858vm-test-run-nixbot-gitlab> gitlab # [  305.701138] gitlab-workhorse[1297]: time="2026-06-08T13:19:42Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3781859vm-test-run-nixbot-gitlab> gitlab # [  305.703015] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:42 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 378 "" "git/2.54.0" 731860vm-test-run-nixbot-gitlab> gitlab # [  305.705023] gitaly[1371]: time="2026-06-08T13:19:42.461Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1163 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP75SKA2NEX488YSD6HJRP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=9 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:42.443" grpc.time_ms=18.223 negotiation.command=fetch negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc1861vm-test-run-nixbot-gitlab> gitlab # [  305.721344] gitaly[1371]: time="2026-06-08T13:19:42.505Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-06-08T13:20:12.086" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-06-08T13:19:42.486" grpc.time_ms=18.963 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1862vm-test-run-nixbot-gitlab> gitlab # [  305.740059] gitaly[1371]: time="2026-06-08T13:19:42.524Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C duration_ms=179ns method=POST pid=1371 status=200 url="http://unix/api/v4/internal/allowed"1863vm-test-run-nixbot-gitlab> gitlab # [  305.771612] gitaly[1371]: time="2026-06-08T13:19:42.555Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C duration_ms=30ns method=POST pid=1371 status=200 url="http://unix/api/v4/internal/pre_receive"1864vm-test-run-nixbot-gitlab> gitlab # [  305.775015] gitaly[1371]: time="2026-06-08T13:19:42.557Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5318 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:42.343" grpc.time_ms=213.19 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1865vm-test-run-nixbot-gitlab> gitlab # [  305.806144] gitaly[1371]: time="2026-06-08T13:19:42.590Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4788 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:42.589" grpc.time_ms=0.528 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1866vm-test-run-nixbot-gitlab> gitlab # [  305.822644] gitaly[1371]: time="2026-06-08T13:19:42.606Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KTKP75YNTHDBHKQG79D571BY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=198 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:42.596" grpc.time_ms=8.465 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc1867vm-test-run-nixbot-gitlab> gitlab # [  305.835292] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:42 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 591868vm-test-run-nixbot-gitlab> gitlab # [  305.865515] gitaly[1371]: time="2026-06-08T13:19:42.649Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:42.649" grpc.time_ms=0.402 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1869vm-test-run-nixbot-gitlab> gitlab # [  305.896908] gitaly[1371]: time="2026-06-08T13:19:42.681Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4789 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:42.680" grpc.time_ms=0.42 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1870vm-test-run-nixbot-gitlab> gitlab # [  305.961889] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:42.744Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","f0b6d6d46b23f23b011cbcd0741feac8d387b1a6 81313f96c272bc1a0bb41e3b39d9dc4949b6745d refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"899aea61c561e3794baec6d2","created_at":"2026-06-08T13:19:42.739Z","trace_propagation_headers":{"sentry-trace":"473c2f856fd34a1a84abe2f485566005-fce80e41028f4ea5","baggage":"sentry-trace_id=473c2f856fd34a1a84abe2f485566005,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP75FE5Z8X8K0PT1SZYN7C","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:42.742Z","job_size_bytes":185,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-899aea61c561e3794baec6d2: start","job_status":"start","queue_duration_s":0.002261,"scheduling_latency_s":0.002302}1871vm-test-run-nixbot-gitlab> gitlab # [  305.985407] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:42.769Z","message":"changes: \"f0b6d6d46b23f23b011cbcd0741feac8d387b1a6 81313f96c272bc1a0bb41e3b39d9dc4949b6745d refs/heads/master\\n\""}1872vm-test-run-nixbot-gitlab> gitlab # [  306.032390] gitaly[1371]: time="2026-06-08T13:19:42.816Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C duration_ms=100ns method=POST pid=1371 status=200 url="http://unix/api/v4/internal/post_receive"1873vm-test-run-nixbot-gitlab> gitlab # [  306.035398] gitaly[1371]: time="2026-06-08T13:19:42.817Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4812 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:42.715" grpc.time_ms=101.762 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1874vm-test-run-nixbot-gitlab> gitlab # [  306.052100] gitaly[1371]: time="2026-06-08T13:19:42.829Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=11 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-08T13:19:52.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:42.811" grpc.time_ms=17.52 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1875vm-test-run-nixbot-gitlab> gitlab # [  306.066312] gitaly[1371]: time="2026-06-08T13:19:42.847Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-08T13:19:52.025" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:42.835" grpc.time_ms=11.685 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1876vm-test-run-nixbot-gitlab> gitlab # To http://gitlab/root/test-flake.git1877vm-test-run-nixbot-gitlab> gitlab # [  306.079858] gitlab-workhorse[1297]: time="2026-06-08T13:19:42Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521878vm-test-run-nixbot-gitlab> gitlab #    f0b6d6d..81313f9  master -> master1879vm-test-run-nixbot-gitlab> gitlab # [  306.082277] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:42 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 7861880vm-test-run-nixbot-gitlab> gitlab # [  306.084669] gitaly[1371]: time="2026-06-08T13:19:42.848Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C diskcache=a0d563c0-3b8b-48b0-95c9-0b768b35d6b3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:42.263" pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1881vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.17 seconds)1882vm-test-run-nixbot-gitlab> gitlab: must succeed: git -C /tmp/test-flake rev-parse master1883vm-test-run-nixbot-gitlab> gitlab # [  306.094739] gitaly[1371]: time="2026-06-08T13:19:42.849Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=150 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13469 command.oublock=32 command.real_time_ms=566 command.spawn_token_fork_ms=4 command.system_time_ms=99 command.user_time_ms=51 component=gitaly.StreamServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:42.263" grpc.time_ms=585.686 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1884vm-test-run-nixbot-gitlab> gitlab # [  306.107292] gitaly[1371]: time="2026-06-08T13:19:42.884Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=587 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=7 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-06-08T13:19:52.062" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:42.872" grpc.time_ms=12.323 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1885vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds)1886vm-test-run-nixbot-gitlab> gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=81313f96c272bc1a0bb41e3b39d9dc4949b6745d'1887vm-test-run-nixbot-gitlab> gitlab # [  306.119816] gitaly[1371]: time="2026-06-08T13:19:42.901Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=598 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=6 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-06-08T13:20:12.888" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:42.889" grpc.time_ms=11.345 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1888vm-test-run-nixbot-gitlab> gitlab # [  306.137245] gitaly[1371]: time="2026-06-08T13:19:42.921Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=319 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-06-08T13:19:52.101" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-06-08T13:19:42.911" grpc.time_ms=9.966 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1889vm-test-run-nixbot-gitlab> gitlab # [  306.154341] gitaly[1371]: time="2026-06-08T13:19:42.938Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP760WYR7SXKG6BEKXKB4P grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:42.929" pid=1371 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc1890vm-test-run-nixbot-gitlab> gitlab # [  306.165244] gitaly[1371]: time="2026-06-08T13:19:42.938Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP760WYR7SXKG6BEKXKB4P grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:42.929" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc1891vm-test-run-nixbot-gitlab> gitlab # [  306.178094] gitlab-workhorse[1297]: time="2026-06-08T13:19:42Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671892vm-test-run-nixbot-gitlab> gitlab # [  306.179919] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:42 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 3181893vm-test-run-nixbot-gitlab> gitlab # [  306.181865] gitaly[1371]: time="2026-06-08T13:19:42.938Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP760WYR7SXKG6BEKXKB4P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:42.929" grpc.time_ms=9.29 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc1894vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=81313f96c272bc1a0bb41e3b39d9dc4949b6745d', in 0.07 seconds)1895vm-test-run-nixbot-gitlab> []1896vm-test-run-nixbot-gitlab> gitlab # [  306.196113] gitaly[1371]: time="2026-06-08T13:19:42.944Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-08T13:19:52.125" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:42.935" grpc.time_ms=8.751 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1897vm-test-run-nixbot-gitlab> gitlab # [  306.209000] nixbot[3793]: INFO:     127.0.0.1:41416 - "GET /api/repos/gitlab/root/test-flake/builds?commit=81313f96c272bc1a0bb41e3b39d9dc4949b6745d HTTP/1.1" 200 OK1898vm-test-run-nixbot-gitlab> gitlab # [  306.244586] gitaly[1371]: time="2026-06-08T13:19:43.028Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP76AXSWPS9AXFZT6TNCHJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:43.013" pid=1371 remote_ip="2001:db8:1::1" request_sha=3ed4ccb5fe6dde2f24047aaa0f2dc43dc0a2d64e response_bytes=383 span.kind=server system=grpc1899vm-test-run-nixbot-gitlab> gitlab # [  306.254226] gitaly[1371]: time="2026-06-08T13:19:43.028Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1141 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP76AXSWPS9AXFZT6TNCHJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:43.013" negotiation.command=fetch negotiation.haves=1 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc1900vm-test-run-nixbot-gitlab> gitlab # [  306.267382] gitlab-workhorse[1297]: time="2026-06-08T13:19:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3831901vm-test-run-nixbot-gitlab> gitlab # [  306.269236] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 383 "" "git/2.54.0" 871902vm-test-run-nixbot-gitlab> gitlab # [  306.271038] gitaly[1371]: time="2026-06-08T13:19:43.029Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1141 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP76AXSWPS9AXFZT6TNCHJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:43.013" grpc.time_ms=15.703 negotiation.command=fetch negotiation.haves=1 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc1903vm-test-run-nixbot-gitlab> gitlab # [  306.339173] gitaly[1371]: time="2026-06-08T13:19:43.123Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP76ES4SPH74YCP482DTA1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:13.021" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:43.122" grpc.time_ms=0.688 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1904vm-test-run-nixbot-gitlab> gitlab # [  306.390754] gitaly[1371]: time="2026-06-08T13:19:43.174Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=593 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTKP76ES4SPH74YCP482DTA1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-06-08T13:20:13.062" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:43.162" grpc.time_ms=12.07 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1905vm-test-run-nixbot-gitlab> gitlab # [  306.407236] gitaly[1371]: time="2026-06-08T13:19:43.187Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-06-08T13:19:53.005" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:43.185" grpc.time_ms=1.517 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1906vm-test-run-nixbot-gitlab> gitlab # [  306.423713] gitaly[1371]: time="2026-06-08T13:19:43.207Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=10 component=gitaly.StreamServerInterceptor correlation_id=01KTKP76ES4SPH74YCP482DTA1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-08T13:19:53.141" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:43.193" grpc.time_ms=14.474 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1907vm-test-run-nixbot-gitlab> gitlab # [  306.437235] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:43.211Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","f0b6d6d46b23f23b011cbcd0741feac8d387b1a6 81313f96c272bc1a0bb41e3b39d9dc4949b6745d refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"899aea61c561e3794baec6d2","created_at":"2026-06-08T13:19:42.739Z","trace_propagation_headers":{"sentry-trace":"473c2f856fd34a1a84abe2f485566005-fce80e41028f4ea5","baggage":"sentry-trace_id=473c2f856fd34a1a84abe2f485566005,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP75FE5Z8X8K0PT1SZYN7C","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-06-08T13:19:42.742Z","job_size_bytes":185,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-899aea61c561e3794baec6d2: done: 0.467274 sec","job_status":"done","queue_duration_s":0.002261,"scheduling_latency_s":0.002302,"gitaly_calls":7,"gitaly_duration_s":0.104452,"redis_calls":112,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.047114,"redis_read_bytes":350,"redis_write_bytes":13068,"redis_cache_calls":9,"redis_cache_duration_s":0.005813,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000457,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":323,"redis_queues_calls":8,"redis_queues_duration_s":0.000935,"redis_queues_read_bytes":8,"redis_queues_write_bytes":6768,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.004993,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1182,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.021843,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.013073,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":29,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":29,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.026,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.026,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.043,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.264703,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00463802,"exclusive_lock_hold_duration_s":0.03596392,"duration_s":0.467274,"completed_at":"2026-06-08T13:19:43.211Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.055995,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1908vm-test-run-nixbot-gitlab> gitlab # [  306.485847] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:43.213Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"96caa0550e36db32ccca67ca","created_at":"2026-06-08T13:19:42.853Z","trace_propagation_headers":{"sentry-trace":"473c2f856fd34a1a84abe2f485566005-d09eef57b3a54d51","baggage":"sentry-trace_id=473c2f856fd34a1a84abe2f485566005,sentry-release=Unknown"},"correlation_id":"01KTKP75FE5Z8X8K0PT1SZYN7C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:42.855Z","job_size_bytes":46,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-96caa0550e36db32ccca67ca: start","job_status":"start","queue_duration_s":0.357451,"scheduling_latency_s":0.357475}1909vm-test-run-nixbot-gitlab> gitlab # [  306.501048] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:43.235Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"96caa0550e36db32ccca67ca","created_at":"2026-06-08T13:19:42.853Z","trace_propagation_headers":{"sentry-trace":"473c2f856fd34a1a84abe2f485566005-d09eef57b3a54d51","baggage":"sentry-trace_id=473c2f856fd34a1a84abe2f485566005,sentry-release=Unknown"},"correlation_id":"01KTKP75FE5Z8X8K0PT1SZYN7C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:42.855Z","job_size_bytes":46,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-96caa0550e36db32ccca67ca: done: 0.022339 sec","job_status":"done","queue_duration_s":0.357451,"scheduling_latency_s":0.357475,"redis_calls":9,"redis_duration_s":0.0025,"redis_read_bytes":23,"redis_write_bytes":782,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001452,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000284,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000764,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":304,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022339,"completed_at":"2026-06-08T13:19:43.235Z","load_balancing_strategy":"primary","db_duration_s":0.002817,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1910vm-test-run-nixbot-gitlab> gitlab # [  306.543879] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:43.236Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"cd67edead0efbb743844236a","created_at":"2026-06-08T13:19:42.867Z","trace_propagation_headers":{"sentry-trace":"473c2f856fd34a1a84abe2f485566005-d09eef57b3a54d51","baggage":"sentry-trace_id=473c2f856fd34a1a84abe2f485566005,sentry-release=Unknown"},"correlation_id":"01KTKP75FE5Z8X8K0PT1SZYN7C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:42.869Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-cd67edead0efbb743844236a: start","job_status":"start","queue_duration_s":0.367652,"scheduling_latency_s":0.367674}1911vm-test-run-nixbot-gitlab> gitlab # [  306.559789] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:43.331Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"cd67edead0efbb743844236a","created_at":"2026-06-08T13:19:42.867Z","trace_propagation_headers":{"sentry-trace":"473c2f856fd34a1a84abe2f485566005-d09eef57b3a54d51","baggage":"sentry-trace_id=473c2f856fd34a1a84abe2f485566005,sentry-release=Unknown"},"correlation_id":"01KTKP75FE5Z8X8K0PT1SZYN7C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:42.869Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-cd67edead0efbb743844236a: done: 0.09425 sec","job_status":"done","queue_duration_s":0.367652,"scheduling_latency_s":0.367674,"gitaly_calls":1,"gitaly_duration_s":0.053697,"redis_calls":12,"redis_duration_s":0.0042120000000000005,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001673,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001384,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001155,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07204084,"duration_s":0.09425,"completed_at":"2026-06-08T13:19:43.331Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007723,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1912vm-test-run-nixbot-gitlab> gitlab # [  306.604521] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:43.333Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"4af3f178f0567fec23f84d49","created_at":"2026-06-08T13:19:43.026Z","trace_propagation_headers":{"sentry-trace":"473c2f856fd34a1a84abe2f485566005-d09eef57b3a54d51","baggage":"sentry-trace_id=473c2f856fd34a1a84abe2f485566005,sentry-release=Unknown"},"correlation_id":"01KTKP75FE5Z8X8K0PT1SZYN7C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ca370b6542356a108b8bd632d962629df271cff841dcc2c6c7328dd1ac9de087","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:43.028Z","job_size_bytes":467,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-4af3f178f0567fec23f84d49: start","job_status":"start","queue_duration_s":0.304416,"scheduling_latency_s":0.304445}1913vm-test-run-nixbot-gitlab> gitlab # [  306.620750] gitaly[1371]: time="2026-06-08T13:19:43.285Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP76ES4SPH74YCP482DTA1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-06-08T13:19:53.034" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:43.284" grpc.time_ms=0.293 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1914vm-test-run-nixbot-gitlab> gitlab # [  306.631488] gitaly[1371]: time="2026-06-08T13:19:43.306Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP76ES4SPH74YCP482DTA1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-06-08T13:19:53.044" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:43.294" grpc.time_ms=12.095 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1915vm-test-run-nixbot-gitlab> gitlab # [  306.644577] gitaly[1371]: time="2026-06-08T13:19:43.307Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C diskcache=5bcadc43-33d7-453f-955c-7d9a28932e96 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-06-08T19:19:43.256" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:43.256" pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1916vm-test-run-nixbot-gitlab> gitlab # [  306.653781] gitaly[1371]: time="2026-06-08T13:19:43.307Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=5 command.cpu_time_ms=32 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1512 command.oublock=0 command.real_time_ms=65 command.spawn_token_fork_ms=4 command.system_time_ms=29 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-06-08T19:19:43.256" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:43.256" grpc.time_ms=50.369 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1917vm-test-run-nixbot-gitlab> gitlab # [  306.667951] gitaly[1371]: time="2026-06-08T13:19:43.365Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:13.363" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:43.363" grpc.time_ms=1.22 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1918vm-test-run-nixbot-gitlab> gitlab # [  306.679825] gitaly[1371]: time="2026-06-08T13:19:43.369Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP76ES4SPH74YCP482DTA1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:43.369" grpc.time_ms=0.717 pid=1371 span.kind=server system=grpc1919vm-test-run-nixbot-gitlab> gitlab # [  306.688985] gitaly[1371]: time="2026-06-08T13:19:43.379Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-06-08T13:19:53.187" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:43.368" grpc.time_ms=11.502 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1920vm-test-run-nixbot-gitlab> gitlab # [  306.701120] gitaly[1371]: time="2026-06-08T13:19:43.406Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP76ES4SPH74YCP482DTA1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4157 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:43.405" grpc.time_ms=0.427 pid=1371 span.kind=server system=grpc1921vm-test-run-nixbot-gitlab> gitlab # [  306.709887] gitaly[1371]: time="2026-06-08T13:19:43.414Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP76ES4SPH74YCP482DTA1 diskcache=03f2d35d-18b7-421d-a3e4-c996edf42a6b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-08T13:19:53.058" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:43.309" pid=1371 ref=refs/keep-around/f0b6d6d46b23f23b011cbcd0741feac8d387b1a6 remote_ip="2001:db8:1::1" revision=f0b6d6d46b23f23b011cbcd0741feac8d387b1a6 span.kind=server system=grpc username=root1922vm-test-run-nixbot-gitlab> gitlab # [  306.720608] gitaly[1371]: time="2026-06-08T13:19:43.414Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=88 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5232 command.oublock=8 command.real_time_ms=99 command.spawn_token_fork_ms=1 command.system_time_ms=30 command.user_time_ms=58 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP76ES4SPH74YCP482DTA1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-08T13:19:53.058" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:43.309" grpc.time_ms=104.847 pid=1371 ref=refs/keep-around/f0b6d6d46b23f23b011cbcd0741feac8d387b1a6 remote_ip="2001:db8:1::1" revision=f0b6d6d46b23f23b011cbcd0741feac8d387b1a6 span.kind=server system=grpc username=root1923vm-test-run-nixbot-gitlab> gitlab # [  306.734413] gitaly[1371]: time="2026-06-08T13:19:43.418Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP76ES4SPH74YCP482DTA1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:13.317" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:43.418" grpc.time_ms=0.392 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1924vm-test-run-nixbot-gitlab> gitlab # [  306.746350] gitaly[1371]: time="2026-06-08T13:19:43.469Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=5 catfile.flush_count=1 catfile.flush_ms=5 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-08T13:20:13.462" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:43.462" grpc.time_ms=6.281 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1925vm-test-run-nixbot-gitlab> gitlab # [  306.758284] gitaly[1371]: time="2026-06-08T13:19:43.482Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=209 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-06-08T13:20:13.473" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:43.474" grpc.time_ms=7.403 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1926vm-test-run-nixbot-gitlab> gitlab # [  306.773389] gitaly[1371]: time="2026-06-08T13:19:43.541Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-08T13:19:53.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:43.528" grpc.time_ms=12.963 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1927vm-test-run-nixbot-gitlab> gitlab # [  306.932225] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:43 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f0b6d6d46b23f23b011cbcd0741feac8d387b1a6 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 6501928vm-test-run-nixbot-gitlab> gitlab # [  306.938975] nixbot[3793]: {"ts": "2026-06-08T13:19:43.718Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f0b6d6d46b23f23b011cbcd0741feac8d387b1a6 \"HTTP/1.1 201 Created\""}1929vm-test-run-nixbot-gitlab> gitlab # [  306.946959] nixbot[3793]: {"ts": "2026-06-08T13:19:43.730Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-f0b6d6d46b23-77c02d05", "argv0": "bwrap"}1930vm-test-run-nixbot-gitlab> gitlab # [  307.160908] systemd[1]: Started Nix Daemon.1931vm-test-run-nixbot-gitlab> gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=81313f96c272bc1a0bb41e3b39d9dc4949b6745d'1932vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=81313f96c272bc1a0bb41e3b39d9dc4949b6745d', in 0.08 seconds)1933vm-test-run-nixbot-gitlab> []1934vm-test-run-nixbot-gitlab> gitlab # [  307.270161] nixbot[3793]: INFO:     127.0.0.1:41432 - "GET /api/repos/gitlab/root/test-flake/builds?commit=81313f96c272bc1a0bb41e3b39d9dc4949b6745d HTTP/1.1" 200 OK1935vm-test-run-nixbot-gitlab> gitlab # [  307.279609] nix-daemon[4087]: accepted connection from pid 4085, user nixbot1936vm-test-run-nixbot-gitlab> gitlab # [  307.283638] nix-daemon[4087]: accepted connection from pid 4086, user nixbot1937vm-test-run-nixbot-gitlab> gitlab # [  307.453920] gitaly[1371]: time="2026-06-08T13:19:44.237Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=16 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-06-08T13:20:14.208" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:44.209" grpc.time_ms=28.096 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1938vm-test-run-nixbot-gitlab> gitlab # [  307.483918] gitaly[1371]: time="2026-06-08T13:19:44.267Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=0 command.user_time_ms=12 component=gitaly.StreamServerInterceptor correlation_id=01KTKP75FE5Z8X8K0PT1SZYN7C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-06-08T13:20:14.242" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:44.242" grpc.time_ms=24.845 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1939vm-test-run-nixbot-gitlab> gitlab # [  307.519826] sidekiq-cluster[2428]: {"severity":"WARN","time":"2026-06-08T13:19:44.287Z","class":"CreatePipelineWorker","correlation_id":"01KTKP75FE5Z8X8K0PT1SZYN7C","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"f0b6d6d46b23f23b011cbcd0741feac8d387b1a6","after":"81313f96c272bc1a0bb41e3b39d9dc4949b6745d","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"81313f96c272bc1a0bb41e3b39d9dc4949b6745d","ref":"refs/heads/master"},"retry":0}1940vm-test-run-nixbot-gitlab> gitlab # [  307.530010] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:44.301Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"4af3f178f0567fec23f84d49","created_at":"2026-06-08T13:19:43.026Z","trace_propagation_headers":{"sentry-trace":"473c2f856fd34a1a84abe2f485566005-d09eef57b3a54d51","baggage":"sentry-trace_id=473c2f856fd34a1a84abe2f485566005,sentry-release=Unknown"},"correlation_id":"01KTKP75FE5Z8X8K0PT1SZYN7C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ca370b6542356a108b8bd632d962629df271cff841dcc2c6c7328dd1ac9de087","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:43.028Z","job_size_bytes":467,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-4af3f178f0567fec23f84d49: done: 0.968056 sec","job_status":"done","queue_duration_s":0.304416,"scheduling_latency_s":0.304445,"gitaly_calls":7,"gitaly_duration_s":0.112946,"redis_calls":33,"redis_duration_s":0.005782,"redis_read_bytes":185,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000726,"redis_cache_read_bytes":44,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001319,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002382,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001355,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":30,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":26,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.820488,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.968056,"completed_at":"2026-06-08T13:19:44.301Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.045437,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1941vm-test-run-nixbot-gitlab> gitlab # [  307.583233] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:44.305Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"dfb8360e-099e-4480-a77a-c285bc0a2927\"}"],"class":"WebHookWorker","jid":"546d708359a852f635a53abd","created_at":"2026-06-08T13:19:43.164Z","trace_propagation_headers":{"sentry-trace":"473c2f856fd34a1a84abe2f485566005-d09eef57b3a54d51","baggage":"sentry-trace_id=473c2f856fd34a1a84abe2f485566005,sentry-release=Unknown"},"correlation_id":"01KTKP75FE5Z8X8K0PT1SZYN7C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9e9fea9d2e43d8204182d7aaa35c69b5d45bec288820b093fd06c485df1c9870","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:43.171Z","job_size_bytes":1749,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-546d708359a852f635a53abd: start","job_status":"start","queue_duration_s":1.133826,"scheduling_latency_s":1.133878}1942vm-test-run-nixbot-gitlab> gitlab # [  307.660760] nixbot[3793]: INFO:     127.0.0.1:41440 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1943vm-test-run-nixbot-gitlab> gitlab # [  307.678415] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:44.462Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"dfb8360e-099e-4480-a77a-c285bc0a2927\"}"],"class":"WebHookWorker","jid":"546d708359a852f635a53abd","created_at":"2026-06-08T13:19:43.164Z","trace_propagation_headers":{"sentry-trace":"473c2f856fd34a1a84abe2f485566005-d09eef57b3a54d51","baggage":"sentry-trace_id=473c2f856fd34a1a84abe2f485566005,sentry-release=Unknown"},"correlation_id":"01KTKP75FE5Z8X8K0PT1SZYN7C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9e9fea9d2e43d8204182d7aaa35c69b5d45bec288820b093fd06c485df1c9870","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:43.171Z","job_size_bytes":1749,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-546d708359a852f635a53abd: done: 0.156803 sec","job_status":"done","queue_duration_s":1.133826,"scheduling_latency_s":1.133878,"redis_calls":19,"redis_duration_s":0.005093,"redis_read_bytes":31,"redis_write_bytes":5280,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001288,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000332,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3642,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001977,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001496,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.010277359999975033,"cpu_s":0.12765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025502,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","duration_s":0.156803,"completed_at":"2026-06-08T13:19:44.461Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004003,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1944vm-test-run-nixbot-gitlab> gitlab # [  307.771203] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:44.463Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"e49d1499de4206f434ac9c73","created_at":"2026-06-08T13:19:43.424Z","trace_propagation_headers":{"sentry-trace":"bcbcfd50844c4890a935716f3f870754-38b83d72a9aa48ee","baggage":"sentry-trace_id=bcbcfd50844c4890a935716f3f870754,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP76ES4SPH74YCP482DTA1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:43.433Z","job_size_bytes":65,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-e49d1499de4206f434ac9c73: start","job_status":"start","queue_duration_s":1.030409,"scheduling_latency_s":1.030429}1945vm-test-run-nixbot-gitlab> gitlab # [  307.789547] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:44.545Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"e49d1499de4206f434ac9c73","created_at":"2026-06-08T13:19:43.424Z","trace_propagation_headers":{"sentry-trace":"bcbcfd50844c4890a935716f3f870754-38b83d72a9aa48ee","baggage":"sentry-trace_id=bcbcfd50844c4890a935716f3f870754,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP76ES4SPH74YCP482DTA1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:43.433Z","job_size_bytes":65,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-e49d1499de4206f434ac9c73: done: 0.081289 sec","job_status":"done","queue_duration_s":1.030409,"scheduling_latency_s":1.030429,"redis_calls":18,"redis_duration_s":0.004087,"redis_read_bytes":271,"redis_write_bytes":2103,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002337,"redis_feature_flag_read_bytes":264,"redis_feature_flag_write_bytes":1285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001418,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000332,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025524,"duration_s":0.081289,"completed_at":"2026-06-08T13:19:44.545Z","load_balancing_strategy":"primary","db_duration_s":0.03074,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1946vm-test-run-nixbot-gitlab> gitlab # [  307.833030] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:44.546Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"0626d7a122f89d9d97dc90da","created_at":"2026-06-08T13:19:43.434Z","trace_propagation_headers":{"sentry-trace":"bcbcfd50844c4890a935716f3f870754-38b83d72a9aa48ee","baggage":"sentry-trace_id=bcbcfd50844c4890a935716f3f870754,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP76ES4SPH74YCP482DTA1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:43.441Z","job_size_bytes":65,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-0626d7a122f89d9d97dc90da: start","job_status":"start","queue_duration_s":1.105001,"scheduling_latency_s":1.105018}1947vm-test-run-nixbot-gitlab> gitlab # [  307.849406] gitaly[1371]: time="2026-06-08T13:19:44.606Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KTKP77VHV6FX7RSKJBW4PD5X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:44.588" grpc.time_ms=17.664 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc1948vm-test-run-nixbot-gitlab> gitlab # [  307.862283] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:44 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 1101949vm-test-run-nixbot-gitlab> gitlab # [  307.864596] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:44.644Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"0626d7a122f89d9d97dc90da","created_at":"2026-06-08T13:19:43.434Z","trace_propagation_headers":{"sentry-trace":"bcbcfd50844c4890a935716f3f870754-38b83d72a9aa48ee","baggage":"sentry-trace_id=bcbcfd50844c4890a935716f3f870754,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP76ES4SPH74YCP482DTA1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:43.441Z","job_size_bytes":65,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-0626d7a122f89d9d97dc90da: done: 0.097893 sec","job_status":"done","queue_duration_s":1.105001,"scheduling_latency_s":1.105018,"redis_calls":21,"redis_duration_s":0.003277,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.001512,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000797,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000291,"duration_s":0.097893,"completed_at":"2026-06-08T13:19:44.644Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.03388,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1950vm-test-run-nixbot-gitlab> gitlab # [  307.907309] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:44.646Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"67707835066b8e411f4da92c","created_at":"2026-06-08T13:19:43.664Z","trace_propagation_headers":{"sentry-trace":"bcbcfd50844c4890a935716f3f870754-38b83d72a9aa48ee","baggage":"sentry-trace_id=bcbcfd50844c4890a935716f3f870754,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP76ES4SPH74YCP482DTA1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:43.677Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-67707835066b8e411f4da92c: start","job_status":"start","queue_duration_s":0.968383,"scheduling_latency_s":0.968402}1951vm-test-run-nixbot-gitlab> gitlab # [  307.922553] gitaly[1371]: time="2026-06-08T13:19:44.704Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP77Z11664A5F7ABSN64ZN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:44.693" pid=1371 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc1952vm-test-run-nixbot-gitlab> gitlab # [  307.932330] gitlab-workhorse[1297]: time="2026-06-08T13:19:44Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671953vm-test-run-nixbot-gitlab> gitlab # [  307.934066] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:44 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 961954vm-test-run-nixbot-gitlab> gitlab # [  307.935807] gitaly[1371]: time="2026-06-08T13:19:44.705Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=587 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP77Z11664A5F7ABSN64ZN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:44.693" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc1955vm-test-run-nixbot-gitlab> gitlab # [  307.948698] gitaly[1371]: time="2026-06-08T13:19:44.705Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=587 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP77Z11664A5F7ABSN64ZN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:44.693" grpc.time_ms=11.533 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc1956vm-test-run-nixbot-gitlab> gitlab # [  307.962039] nixbot[3793]: {"ts": "2026-06-08T13:19:44.743Z", "level": "info", "logger": "nixbot.canceller", "msg": "cancelling build", "build_id": 1, "reason": "superseded"}1957vm-test-run-nixbot-gitlab> gitlab # [  307.969760] nix-daemon[4095]: unexpected Nix daemon error: error: interrupted by the user1958vm-test-run-nixbot-gitlab> gitlab # [  307.975786] gitaly[1371]: time="2026-06-08T13:19:44.758Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTKP76ES4SPH74YCP482DTA1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-08T13:20:14.757" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:44.757" grpc.time_ms=1.031 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1959vm-test-run-nixbot-gitlab> gitlab # [  308.020309] gitaly[1371]: time="2026-06-08T13:19:44.804Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP76ES4SPH74YCP482DTA1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:14.802" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:44.803" grpc.time_ms=0.922 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1960vm-test-run-nixbot-gitlab> gitlab # [  308.046957] gitaly[1371]: time="2026-06-08T13:19:44.826Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP783APE2RMCBRERTPFFA7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:14.425" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:44.825" grpc.time_ms=0.581 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1961vm-test-run-nixbot-gitlab> gitlab # [  308.066855] gitaly[1371]: time="2026-06-08T13:19:44.838Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP76ES4SPH74YCP482DTA1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:14.837" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:44.838" grpc.time_ms=0.712 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1962vm-test-run-nixbot-gitlab> gitlab # [  308.082758] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:44.854Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"67707835066b8e411f4da92c","created_at":"2026-06-08T13:19:43.664Z","trace_propagation_headers":{"sentry-trace":"bcbcfd50844c4890a935716f3f870754-38b83d72a9aa48ee","baggage":"sentry-trace_id=bcbcfd50844c4890a935716f3f870754,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP76ES4SPH74YCP482DTA1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:43.677Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-67707835066b8e411f4da92c: done: 0.208028 sec","job_status":"done","queue_duration_s":0.968383,"scheduling_latency_s":0.968402,"gitaly_calls":3,"gitaly_duration_s":0.009825,"redis_calls":48,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.020905,"redis_read_bytes":208,"redis_write_bytes":6803,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.004645,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":16,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.001604,"redis_cache_read_bytes":32,"redis_cache_write_bytes":1470,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.00601,"redis_feature_flag_read_bytes":134,"redis_feature_flag_write_bytes":992,"redis_queues_calls":2,"redis_queues_duration_s":0.000282,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.001391,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":840,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000757,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000253,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001318,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":34,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":34,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":22,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.147889,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.1732957,"duration_s":0.208028,"completed_at":"2026-06-08T13:19:44.854Z","load_balancing_strategy":"primary","db_duration_s":0.042719,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1963vm-test-run-nixbot-gitlab> gitlab # [  308.141951] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:44.855Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","546d708359a852f635a53abd"],"class":"WebHooks::LogExecutionWorker","jid":"f9251b470389b2f22ccea853","created_at":"2026-06-08T13:19:44.448Z","trace_propagation_headers":{"sentry-trace":"473c2f856fd34a1a84abe2f485566005-f77c6602f5854a91","baggage":"sentry-trace_id=473c2f856fd34a1a84abe2f485566005,sentry-release=Unknown"},"correlation_id":"01KTKP75FE5Z8X8K0PT1SZYN7C","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6cbc26726d5c29152f7244ad3a79440beab39981412824822cc95a4173815492","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:44.453Z","job_size_bytes":2507,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-f9251b470389b2f22ccea853: start","job_status":"start","queue_duration_s":0.402174,"scheduling_latency_s":0.402199}1964vm-test-run-nixbot-gitlab> gitlab # [  308.157995] gitaly[1371]: time="2026-06-08T13:19:44.872Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=594 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01KTKP783APE2RMCBRERTPFFA7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-06-08T13:20:14.461" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:44.861" grpc.time_ms=10.567 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1965vm-test-run-nixbot-gitlab> gitlab # [  308.171194] gitaly[1371]: time="2026-06-08T13:19:44.890Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTKP783APE2RMCBRERTPFFA7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-08T13:19:54.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:44.883" grpc.time_ms=7.56 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1966vm-test-run-nixbot-gitlab> gitlab # [  308.184085] gitaly[1371]: time="2026-06-08T13:19:44.943Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7879BA6X0KQA23GKPQ72 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:14.839" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:44.941" grpc.time_ms=0.521 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1967vm-test-run-nixbot-gitlab> gitlab # [  308.195762] gitaly[1371]: time="2026-06-08T13:19:44.965Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP783APE2RMCBRERTPFFA7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-06-08T13:19:54.055" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:44.965" grpc.time_ms=0.244 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1968vm-test-run-nixbot-gitlab> gitlab # [  308.206039] gitaly[1371]: time="2026-06-08T13:19:44.980Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP783APE2RMCBRERTPFFA7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-06-08T13:19:54.060" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:44.970" grpc.time_ms=9.795 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1969vm-test-run-nixbot-gitlab> gitlab # [  308.219183] gitaly[1371]: time="2026-06-08T13:19:44.995Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01KTKP7879BA6X0KQA23GKPQ72 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-08T13:19:54.125" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:44.985" grpc.time_ms=9.391 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1970vm-test-run-nixbot-gitlab> gitlab # [  308.234151] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:45.017Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","546d708359a852f635a53abd"],"class":"WebHooks::LogExecutionWorker","jid":"f9251b470389b2f22ccea853","created_at":"2026-06-08T13:19:44.448Z","trace_propagation_headers":{"sentry-trace":"473c2f856fd34a1a84abe2f485566005-f77c6602f5854a91","baggage":"sentry-trace_id=473c2f856fd34a1a84abe2f485566005,sentry-release=Unknown"},"correlation_id":"01KTKP75FE5Z8X8K0PT1SZYN7C","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6cbc26726d5c29152f7244ad3a79440beab39981412824822cc95a4173815492","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:44.453Z","job_size_bytes":2507,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-f9251b470389b2f22ccea853: done: 0.16195 sec","job_status":"done","queue_duration_s":0.402174,"scheduling_latency_s":0.402199,"redis_calls":10,"redis_duration_s":0.001789,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000338,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001083,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000368,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.039,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.039,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.141159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029318,"duration_s":0.16195,"completed_at":"2026-06-08T13:19:45.017Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012349,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1971vm-test-run-nixbot-gitlab> gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=81313f96c272bc1a0bb41e3b39d9dc4949b6745d'1972vm-test-run-nixbot-gitlab> gitlab # [  308.276894] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:45.019Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"137b099bfcba7740ce2dc831","created_at":"2026-06-08T13:19:44.729Z","trace_propagation_headers":{"sentry-trace":"bcbcfd50844c4890a935716f3f870754-453fa8ed55a145bd","baggage":"sentry-trace_id=bcbcfd50844c4890a935716f3f870754,sentry-release=Unknown"},"correlation_id":"01KTKP76ES4SPH74YCP482DTA1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:44.737Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-137b099bfcba7740ce2dc831: start","job_status":"start","queue_duration_s":0.28131,"scheduling_latency_s":0.281331}1973vm-test-run-nixbot-gitlab> gitlab # [  308.291094] nixbot[3793]: {"ts": "2026-06-08T13:19:45.054Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f0b6d6d46b23f23b011cbcd0741feac8d387b1a6 \"HTTP/1.1 201 Created\""}1974vm-test-run-nixbot-gitlab> gitlab # [  308.293596] gitaly[1371]: time="2026-06-08T13:19:45.021Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP783APE2RMCBRERTPFFA7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:45.021" grpc.time_ms=0.364 pid=1371 span.kind=server system=grpc1975vm-test-run-nixbot-gitlab> gitlab # [  308.302899] gitaly[1371]: time="2026-06-08T13:19:45.046Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP783APE2RMCBRERTPFFA7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4157 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:45.046" grpc.time_ms=0.4 pid=1371 span.kind=server system=grpc1976vm-test-run-nixbot-gitlab> gitlab # [  308.314957] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:45 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f0b6d6d46b23f23b011cbcd0741feac8d387b1a6 HTTP/1.1" 201 651 "" "python-httpx/0.28.1" 1791977vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=81313f96c272bc1a0bb41e3b39d9dc4949b6745d', in 0.07 seconds)1978vm-test-run-nixbot-gitlab> [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '81313f96c272bc1a0bb41e3b39d9dc4949b6745d', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-06-08T13:19:44.736365Z', 'started_at': None, 'finished_at': None}]1979vm-test-run-nixbot-gitlab> (finished: subtest: push delivers the webhook, in 3.41 seconds)1980vm-test-run-nixbot-gitlab> subtest: eval and build post commit statuses1981vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/81313f96c272bc1a0bb41e3b39d9dc4949b6745d/statuses1982vm-test-run-nixbot-gitlab> gitlab # [  308.317529] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:45.062Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"137b099bfcba7740ce2dc831","created_at":"2026-06-08T13:19:44.729Z","trace_propagation_headers":{"sentry-trace":"bcbcfd50844c4890a935716f3f870754-453fa8ed55a145bd","baggage":"sentry-trace_id=bcbcfd50844c4890a935716f3f870754,sentry-release=Unknown"},"correlation_id":"01KTKP76ES4SPH74YCP482DTA1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:44.737Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-137b099bfcba7740ce2dc831: done: 0.043377 sec","job_status":"done","queue_duration_s":0.28131,"scheduling_latency_s":0.281331,"redis_calls":10,"redis_duration_s":0.001542,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00034,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000299,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024234,"duration_s":0.043377,"completed_at":"2026-06-08T13:19:45.062Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005461,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1983vm-test-run-nixbot-gitlab> gitlab # [  308.362776] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:45.064Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"b42da4439b2f03c441812547","created_at":"2026-06-08T13:19:45.031Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-abe3363bfe9c420e","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.035Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b42da4439b2f03c441812547: start","job_status":"start","queue_duration_s":0.028551,"scheduling_latency_s":0.028574}1984vm-test-run-nixbot-gitlab> gitlab # [  308.378811] gitaly[1371]: time="2026-06-08T13:19:45.056Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP783APE2RMCBRERTPFFA7 diskcache=cd8af57f-4a68-4437-ab50-7e6d4c46ad52 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-08T13:19:54.072" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:44.982" pid=1371 ref=refs/keep-around/81313f96c272bc1a0bb41e3b39d9dc4949b6745d remote_ip="2001:db8:1::1" revision=81313f96c272bc1a0bb41e3b39d9dc4949b6745d span.kind=server system=grpc username=root1985vm-test-run-nixbot-gitlab> gitlab # [  308.389587] nixbot[3793]: INFO:     127.0.0.1:41442 - "GET /api/repos/gitlab/root/test-flake/builds?commit=81313f96c272bc1a0bb41e3b39d9dc4949b6745d HTTP/1.1" 200 OK1986vm-test-run-nixbot-gitlab> gitlab # [  308.391352] gitaly[1371]: time="2026-06-08T13:19:45.056Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=47 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4751 command.oublock=8 command.real_time_ms=66 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=33 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP783APE2RMCBRERTPFFA7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-08T13:19:54.072" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-08T13:19:44.982" grpc.time_ms=73.503 pid=1371 ref=refs/keep-around/81313f96c272bc1a0bb41e3b39d9dc4949b6745d remote_ip="2001:db8:1::1" revision=81313f96c272bc1a0bb41e3b39d9dc4949b6745d span.kind=server system=grpc username=root1987vm-test-run-nixbot-gitlab> gitlab # [  308.405905] gitaly[1371]: time="2026-06-08T13:19:45.064Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP783APE2RMCBRERTPFFA7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:15.063" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:45.063" grpc.time_ms=0.679 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1988vm-test-run-nixbot-gitlab> gitlab # [  308.418024] gitaly[1371]: time="2026-06-08T13:19:45.128Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP78D7X0EBWEQF47MFJ0ME grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:15.025" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:45.127" grpc.time_ms=0.611 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1989vm-test-run-nixbot-gitlab> gitlab # [  308.431405] gitaly[1371]: time="2026-06-08T13:19:45.186Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTKP78D7X0EBWEQF47MFJ0ME grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-08T13:19:55.127" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:45.177" grpc.time_ms=8.581 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1990vm-test-run-nixbot-gitlab> gitlab # [  308.444223] gitaly[1371]: time="2026-06-08T13:19:45.211Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP7879BA6X0KQA23GKPQ72 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3899 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:45.211" grpc.time_ms=0.336 pid=1371 span.kind=server system=grpc1991vm-test-run-nixbot-gitlab> gitlab # [  308.460615] gitaly[1371]: time="2026-06-08T13:19:45.244Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP7879BA6X0KQA23GKPQ72 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:45.243" grpc.time_ms=1.201 pid=1371 span.kind=server system=grpc1992vm-test-run-nixbot-gitlab> gitlab # [  308.493931] gitaly[1371]: time="2026-06-08T13:19:45.278Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP7879BA6X0KQA23GKPQ72 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3899 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:45.277" grpc.time_ms=0.405 pid=1371 span.kind=server system=grpc1993vm-test-run-nixbot-gitlab> gitlab # [  308.508346] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:45 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f0b6d6d46b23f23b011cbcd0741feac8d387b1a6 HTTP/1.1" 201 665 "" "python-httpx/0.28.1" 2201994vm-test-run-nixbot-gitlab> gitlab # [  308.510805] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:45 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/81313f96c272bc1a0bb41e3b39d9dc4949b6745d HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 5441995vm-test-run-nixbot-gitlab> gitlab # [  308.513669] nixbot[3793]: {"ts": "2026-06-08T13:19:45.285Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f0b6d6d46b23f23b011cbcd0741feac8d387b1a6 \"HTTP/1.1 201 Created\""}1996vm-test-run-nixbot-gitlab> gitlab # [  308.516247] nixbot[3793]: {"ts": "2026-06-08T13:19:45.292Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/81313f96c272bc1a0bb41e3b39d9dc4949b6745d \"HTTP/1.1 201 Created\""}1997vm-test-run-nixbot-gitlab> gitlab # [  308.518773] nixbot[3793]: {"ts": "2026-06-08T13:19:45.297Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-81313f96c272-0a9f4bbc", "argv0": "bwrap"}1998vm-test-run-nixbot-gitlab> gitlab # [  308.521139] gitaly[1371]: time="2026-06-08T13:19:45.293Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP78GJZE3QRBDEFT5GGCS3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:15.192" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:45.293" grpc.time_ms=0.476 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1999vm-test-run-nixbot-gitlab> gitlab # [  308.533015] gitaly[1371]: time="2026-06-08T13:19:45.297Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7879BA6X0KQA23GKPQ72 diskcache=17bf3cea-04a3-4a6b-a75d-7a1fe18a86b0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-08T13:20:15.176" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:45.177" pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2000vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/81313f96c272bc1a0bb41e3b39d9dc4949b6745d/statuses, in 0.20 seconds)2001vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '81313f96c272bc1a0bb41e3b39d9dc4949b6745d', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-06-08T13:19:45.251Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2002vm-test-run-nixbot-gitlab> gitlab # [  308.541938] gitaly[1371]: time="2026-06-08T13:19:45.297Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=72 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7161 command.oublock=0 command.real_time_ms=109 command.spawn_token_fork_ms=0 command.system_time_ms=61 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7879BA6X0KQA23GKPQ72 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-08T13:20:15.176" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:45.177" grpc.time_ms=120.227 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2003vm-test-run-nixbot-gitlab> gitlab # [  308.553921] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/81313f96c272bc1a0bb41e3b39d9dc4949b6745d/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1532004vm-test-run-nixbot-gitlab> gitlab # [  308.605085] gitaly[1371]: time="2026-06-08T13:19:45.389Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTKP7879BA6X0KQA23GKPQ72 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-08T13:20:15.388" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:45.388" grpc.time_ms=0.717 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2005vm-test-run-nixbot-gitlab> gitlab # [  308.639366] gitaly[1371]: time="2026-06-08T13:19:45.423Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7879BA6X0KQA23GKPQ72 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:15.422" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:45.422" grpc.time_ms=0.652 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2006vm-test-run-nixbot-gitlab> gitlab # [  308.662985] nix-daemon[4087]: accepted connection from pid 4206, user nixbot2007vm-test-run-nixbot-gitlab> gitlab # [  308.674476] nix-daemon[4087]: accepted connection from pid 4205, user nixbot2008vm-test-run-nixbot-gitlab> gitlab # [  308.685969] gitaly[1371]: time="2026-06-08T13:19:45.470Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7879BA6X0KQA23GKPQ72 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:15.468" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:45.469" grpc.time_ms=0.688 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2009vm-test-run-nixbot-gitlab> gitlab # [  308.705656] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:45.478Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"8118a2abbff068544b424332","created_at":"2026-06-08T13:19:45.476Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-2df2532303b748e6","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"b42da4439b2f03c441812547","job_size_bytes":3,"pid":2428,"job_status":"deduplicated","message":"PipelineProcessWorker JID-8118a2abbff068544b424332: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2010vm-test-run-nixbot-gitlab> gitlab # [  308.724947] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:45.479Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"b42da4439b2f03c441812547","created_at":"2026-06-08T13:19:45.031Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-abe3363bfe9c420e","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.035Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2428,"job_status":"rescheduled","message":"PipelineProcessWorker JID-b42da4439b2f03c441812547: rescheduled"}2011vm-test-run-nixbot-gitlab> gitlab # [  308.741031] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:45.487Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"b42da4439b2f03c441812547","created_at":"2026-06-08T13:19:45.031Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-abe3363bfe9c420e","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.035Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b42da4439b2f03c441812547: done: 0.423421 sec","job_status":"done","queue_duration_s":0.028551,"scheduling_latency_s":0.028574,"gitaly_calls":4,"gitaly_duration_s":0.132216,"redis_calls":104,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.03566,"redis_read_bytes":267,"redis_write_bytes":24004,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000826,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":17,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.002097,"redis_cache_read_bytes":33,"redis_cache_write_bytes":1526,"redis_feature_flag_calls":22,"redis_feature_flag_duration_s":0.012347,"redis_feature_flag_read_bytes":22,"redis_feature_flag_write_bytes":3871,"redis_queues_calls":22,"redis_queues_duration_s":0.006905,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12383,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.008111,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000201,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000462,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003885,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":850,"db_count":47,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.051,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.018,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.023,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.028,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.210522,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.39084016,"duration_s":0.423421,"completed_at":"2026-06-08T13:19:45.487Z","load_balancing_strategy":"primary","db_duration_s":0.055414,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2012vm-test-run-nixbot-gitlab> gitlab # [  308.791215] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:45.489Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"4bfd73f3fd39f7f847c4b75a","created_at":"2026-06-08T13:19:45.075Z","trace_propagation_headers":{"sentry-trace":"50a85ffb304849e7a062bc341985928f-9418dd706bdd4afe","baggage":"sentry-trace_id=50a85ffb304849e7a062bc341985928f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP783APE2RMCBRERTPFFA7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.082Z","job_size_bytes":65,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-4bfd73f3fd39f7f847c4b75a: start","job_status":"start","queue_duration_s":0.406758,"scheduling_latency_s":0.406778}2013vm-test-run-nixbot-gitlab> gitlab # [  308.806965] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:45.518Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"4bfd73f3fd39f7f847c4b75a","created_at":"2026-06-08T13:19:45.075Z","trace_propagation_headers":{"sentry-trace":"50a85ffb304849e7a062bc341985928f-9418dd706bdd4afe","baggage":"sentry-trace_id=50a85ffb304849e7a062bc341985928f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP783APE2RMCBRERTPFFA7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.082Z","job_size_bytes":65,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-4bfd73f3fd39f7f847c4b75a: done: 0.029562 sec","job_status":"done","queue_duration_s":0.406758,"scheduling_latency_s":0.406778,"redis_calls":7,"redis_duration_s":0.002061,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001486,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000575,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029562,"completed_at":"2026-06-08T13:19:45.518Z","load_balancing_strategy":"primary","db_duration_s":0.003298,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2014vm-test-run-nixbot-gitlab> gitlab # [  308.847212] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:45.520Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"55e5e0648cc204cadad064ff","created_at":"2026-06-08T13:19:45.084Z","trace_propagation_headers":{"sentry-trace":"50a85ffb304849e7a062bc341985928f-9418dd706bdd4afe","baggage":"sentry-trace_id=50a85ffb304849e7a062bc341985928f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP783APE2RMCBRERTPFFA7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.090Z","job_size_bytes":65,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-55e5e0648cc204cadad064ff: start","job_status":"start","queue_duration_s":0.429967,"scheduling_latency_s":0.429985}2015vm-test-run-nixbot-gitlab> gitlab # [  308.865128] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:45.610Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"55e5e0648cc204cadad064ff","created_at":"2026-06-08T13:19:45.084Z","trace_propagation_headers":{"sentry-trace":"50a85ffb304849e7a062bc341985928f-9418dd706bdd4afe","baggage":"sentry-trace_id=50a85ffb304849e7a062bc341985928f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP783APE2RMCBRERTPFFA7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.090Z","job_size_bytes":65,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-55e5e0648cc204cadad064ff: done: 0.089574 sec","job_status":"done","queue_duration_s":0.429967,"scheduling_latency_s":0.429985,"redis_calls":10,"redis_duration_s":0.003634,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002046,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001588,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.069038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.089574,"completed_at":"2026-06-08T13:19:45.610Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015444,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2016vm-test-run-nixbot-gitlab> gitlab # [  308.906037] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:45.612Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"dc9b42dd99af9337ae25c330","created_at":"2026-06-08T13:19:45.156Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-2df2532303b748e6","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.162Z","job_size_bytes":23,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-dc9b42dd99af9337ae25c330: start","job_status":"start","queue_duration_s":0.449551,"scheduling_latency_s":0.449579}2017vm-test-run-nixbot-gitlab> gitlab # [  309.024757] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:45.808Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"dc9b42dd99af9337ae25c330","created_at":"2026-06-08T13:19:45.156Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-2df2532303b748e6","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.162Z","job_size_bytes":23,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-dc9b42dd99af9337ae25c330: done: 0.195793 sec","job_status":"done","queue_duration_s":0.449551,"scheduling_latency_s":0.449579,"redis_calls":15,"redis_duration_s":0.004616,"redis_read_bytes":13,"redis_write_bytes":3011,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000606,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_calls":2,"redis_queues_duration_s":0.000441,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1626,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002188,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":742,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000698,"redis_rate_limiting_write_bytes":148,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000683,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":13,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":13,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.161516,"worker_id":"sidekiq_0","rate_limiting_gates":["permanent_email_failure","temporary_email_failure"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00049818,"duration_s":0.195793,"completed_at":"2026-06-08T13:19:45.807Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026327,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2018vm-test-run-nixbot-gitlab> gitlab # [  309.126354] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:45.810Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"d5eddd18aab0687f3c98b1ba","created_at":"2026-06-08T13:19:45.793Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-6608cc4b4cb74cd2","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineNotificationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:1d7d7f84747a407cc5db8997c2cbcbfd6c00c9e7cbee6c84a2274dd3df4727fa","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.796Z","job_size_bytes":464,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-d5eddd18aab0687f3c98b1ba: start","job_status":"start","queue_duration_s":0.013636,"scheduling_latency_s":0.013664}2019vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/81313f96c272bc1a0bb41e3b39d9dc4949b6745d/statuses2020vm-test-run-nixbot-gitlab> gitlab # [  309.156038] sidekiq-cluster[2428]: {"severity":"WARN","time":"2026-06-08T13:19:45.872Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"d5eddd18aab0687f3c98b1ba","created_at":"2026-06-08T13:19:45.793Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-6608cc4b4cb74cd2","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineNotificationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:1d7d7f84747a407cc5db8997c2cbcbfd6c00c9e7cbee6c84a2274dd3df4727fa","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.796Z","job_size_bytes":464,"pid":2428,"sidekiq_tid":"m4fc","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-d5eddd18aab0687f3c98b1ba: fail: 0.061259 sec","job_status":"fail","queue_duration_s":0.013636,"scheduling_latency_s":0.013664,"redis_calls":7,"redis_duration_s":0.0023309999999999997,"redis_read_bytes":5,"redis_write_bytes":786,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001712,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000619,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038516,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.061259,"completed_at":"2026-06-08T13:19:45.871Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/anil03slywxmk4rnhn17xdngk0v51799-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/anil03slywxmk4rnhn17xdngk0v51799-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/anil03slywxmk4rnhn17xdngk0v51799-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/pipelines.rb:33:in `pipeline_mail'","app/mailers/emails/pipelines.rb:10:in `pipeline_failed_email'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/w9mp1gyfs2qdv12r0ji70idzndmxwz2s-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/qr8jwlszzf80b9yy5410msfvxfhdlv3q-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/p8ylyr0sj9sxcknqcpja13nypqixk2dp-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/dmv1shq667w4j882d6hfknpqjgmsjk3d-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/dmv1shq667w4j882d6hfknpqjgmsjk3d-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/dndr7b4a17339dsm67vzb6nv4p2kp82q-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/qr8jwlszzf80b9yy5410msfvxfhdlv3q-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/zx6ndpscxs64hnidz69ab430ccms6rak-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.012043,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2021vm-test-run-nixbot-gitlab> gitlab # [  309.592764] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:45.877Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"c52e6af8b9f9c5e4657d346e","created_at":"2026-06-08T13:19:45.260Z","trace_propagation_headers":{"sentry-trace":"50a85ffb304849e7a062bc341985928f-9418dd706bdd4afe","baggage":"sentry-trace_id=50a85ffb304849e7a062bc341985928f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP783APE2RMCBRERTPFFA7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.266Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c52e6af8b9f9c5e4657d346e: start","job_status":"start","queue_duration_s":0.610853,"scheduling_latency_s":0.610901}2022vm-test-run-nixbot-gitlab> gitlab # [  309.607508] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:46.158Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"c52e6af8b9f9c5e4657d346e","created_at":"2026-06-08T13:19:45.260Z","trace_propagation_headers":{"sentry-trace":"50a85ffb304849e7a062bc341985928f-9418dd706bdd4afe","baggage":"sentry-trace_id=50a85ffb304849e7a062bc341985928f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP783APE2RMCBRERTPFFA7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.266Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c52e6af8b9f9c5e4657d346e: done: 0.281393 sec","job_status":"done","queue_duration_s":0.610853,"scheduling_latency_s":0.610901,"gitaly_calls":3,"gitaly_duration_s":0.013617,"redis_calls":44,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.011826,"redis_read_bytes":99,"redis_write_bytes":6013,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002017,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.002879,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_queues_calls":2,"redis_queues_duration_s":0.000436,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001953,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000463,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000739,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001322,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":31,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":31,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.051,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":19,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.019,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.217423,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.23407652,"duration_s":0.281393,"completed_at":"2026-06-08T13:19:46.158Z","load_balancing_strategy":"primary","db_duration_s":0.054031,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2023vm-test-run-nixbot-gitlab> gitlab # [  309.655829] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:46.160Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"34f16e40a0396184637abfdc","created_at":"2026-06-08T13:19:45.304Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-2df2532303b748e6","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.311Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-34f16e40a0396184637abfdc: start","job_status":"start","queue_duration_s":0.849302,"scheduling_latency_s":0.849328}2024vm-test-run-nixbot-gitlab> gitlab # [  309.672957] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:46.204Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"34f16e40a0396184637abfdc","created_at":"2026-06-08T13:19:45.304Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-2df2532303b748e6","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.311Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-34f16e40a0396184637abfdc: done: 0.044273 sec","job_status":"done","queue_duration_s":0.849302,"scheduling_latency_s":0.849328,"redis_calls":10,"redis_duration_s":0.003048,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000404,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002095,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000549,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00056894,"duration_s":0.044273,"completed_at":"2026-06-08T13:19:46.204Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0066,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2025vm-test-run-nixbot-gitlab> gitlab # [  309.715259] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:46.207Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"74e942890878467ae2fc855a","created_at":"2026-06-08T13:19:45.328Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-2df2532303b748e6","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.334Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-74e942890878467ae2fc855a: start","job_status":"start","queue_duration_s":0.872216,"scheduling_latency_s":0.872241}2026vm-test-run-nixbot-gitlab> gitlab # [  309.730120] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:46.264Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"74e942890878467ae2fc855a","created_at":"2026-06-08T13:19:45.328Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-2df2532303b748e6","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.334Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-74e942890878467ae2fc855a: done: 0.057826 sec","job_status":"done","queue_duration_s":0.872216,"scheduling_latency_s":0.872241,"redis_calls":10,"redis_duration_s":0.003058,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000587,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001855,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000616,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00059312,"duration_s":0.057826,"completed_at":"2026-06-08T13:19:46.264Z","load_balancing_strategy":"primary","db_duration_s":0.01392,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2027vm-test-run-nixbot-gitlab> gitlab # [  309.771264] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:46.266Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"67b1054e77aa205dc4d4601d","created_at":"2026-06-08T13:19:45.348Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-2df2532303b748e6","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.352Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-67b1054e77aa205dc4d4601d: start","job_status":"start","queue_duration_s":0.913884,"scheduling_latency_s":0.913909}2028vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/81313f96c272bc1a0bb41e3b39d9dc4949b6745d/statuses, in 0.26 seconds)2029vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '81313f96c272bc1a0bb41e3b39d9dc4949b6745d', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-06-08T13:19:45.251Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2030vm-test-run-nixbot-gitlab> gitlab # [  309.786109] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:46.309Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"67b1054e77aa205dc4d4601d","created_at":"2026-06-08T13:19:45.348Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-2df2532303b748e6","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.352Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-67b1054e77aa205dc4d4601d: done: 0.043229 sec","job_status":"done","queue_duration_s":0.913884,"scheduling_latency_s":0.913909,"redis_calls":13,"redis_duration_s":0.0032459999999999998,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000489,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001549,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000651,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000557,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037386,"duration_s":0.043229,"completed_at":"2026-06-08T13:19:46.309Z","load_balancing_strategy":"primary","db_duration_s":0.007107,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2031vm-test-run-nixbot-gitlab> gitlab # [  309.827150] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:46.311Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"28d2c12efdb976b6409a1b21","created_at":"2026-06-08T13:19:45.353Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-2df2532303b748e6","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.359Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-28d2c12efdb976b6409a1b21: start","job_status":"start","queue_duration_s":0.952171,"scheduling_latency_s":0.952192}2032vm-test-run-nixbot-gitlab> gitlab # [  309.842991] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:46.351Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"28d2c12efdb976b6409a1b21","created_at":"2026-06-08T13:19:45.353Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-2df2532303b748e6","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.359Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-28d2c12efdb976b6409a1b21: done: 0.040006 sec","job_status":"done","queue_duration_s":0.952171,"scheduling_latency_s":0.952192,"redis_calls":10,"redis_duration_s":0.003175,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000508,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002118,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000549,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021822,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00086806,"duration_s":0.040006,"completed_at":"2026-06-08T13:19:46.351Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008766,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2033vm-test-run-nixbot-gitlab> gitlab # [  309.886334] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:46.357Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"ed40a30ef570bf1e14b00d1a","created_at":"2026-06-08T13:19:45.364Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-2df2532303b748e6","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.369Z","job_size_bytes":19,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-ed40a30ef570bf1e14b00d1a: start","job_status":"start","queue_duration_s":0.987854,"scheduling_latency_s":0.987878}2034vm-test-run-nixbot-gitlab> gitlab # [  309.902018] gitaly[1371]: time="2026-06-08T13:19:46.026Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTKP783APE2RMCBRERTPFFA7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-08T13:20:16.024" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:46.024" grpc.time_ms=1.408 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2035vm-test-run-nixbot-gitlab> gitlab # [  309.914167] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:46 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/81313f96c272bc1a0bb41e3b39d9dc4949b6745d/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1692036vm-test-run-nixbot-gitlab> gitlab # [  309.916700] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:46.434Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"ed40a30ef570bf1e14b00d1a","created_at":"2026-06-08T13:19:45.364Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-2df2532303b748e6","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.369Z","job_size_bytes":19,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-ed40a30ef570bf1e14b00d1a: done: 0.077309 sec","job_status":"done","queue_duration_s":0.987854,"scheduling_latency_s":0.987878,"redis_calls":11,"redis_duration_s":0.0074730000000000005,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000624,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003916,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002933,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00076364,"duration_s":0.077309,"completed_at":"2026-06-08T13:19:46.434Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01056,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2037vm-test-run-nixbot-gitlab> gitlab # [  309.958292] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:46.437Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"failed\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"c796b8f135a30067f5e0c0a4","created_at":"2026-06-08T13:19:45.372Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-2df2532303b748e6","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2e8f76273ed3dffe93170e4a8828cd9c1cde36f18ce9deaf751670cff2f2dad","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.377Z","job_size_bytes":65,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-c796b8f135a30067f5e0c0a4: start","job_status":"start","queue_duration_s":1.060171,"scheduling_latency_s":1.060205}2038vm-test-run-nixbot-gitlab> gitlab # [  309.974575] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:46.499Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"failed\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"c796b8f135a30067f5e0c0a4","created_at":"2026-06-08T13:19:45.372Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-2df2532303b748e6","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2e8f76273ed3dffe93170e4a8828cd9c1cde36f18ce9deaf751670cff2f2dad","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.377Z","job_size_bytes":65,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-c796b8f135a30067f5e0c0a4: done: 0.062312 sec","job_status":"done","queue_duration_s":1.060171,"scheduling_latency_s":1.060205,"redis_calls":10,"redis_duration_s":0.005964,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000493,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004614,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000857,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00211184,"duration_s":0.062312,"completed_at":"2026-06-08T13:19:46.499Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009751,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2039vm-test-run-nixbot-gitlab> gitlab # [  310.017146] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:46.503Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"5b7a53aa12a33f7fd68c0fa8","created_at":"2026-06-08T13:19:45.378Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-2df2532303b748e6","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.380Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-5b7a53aa12a33f7fd68c0fa8: start","job_status":"start","queue_duration_s":1.122898,"scheduling_latency_s":1.122935}2040vm-test-run-nixbot-gitlab> gitlab # [  310.032288] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:46.571Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"5b7a53aa12a33f7fd68c0fa8","created_at":"2026-06-08T13:19:45.378Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-2df2532303b748e6","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.380Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-5b7a53aa12a33f7fd68c0fa8: done: 0.068004 sec","job_status":"done","queue_duration_s":1.122898,"scheduling_latency_s":1.122935,"redis_calls":7,"redis_duration_s":0.002869,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002056,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000813,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.068004,"completed_at":"2026-06-08T13:19:46.571Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008804,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2041vm-test-run-nixbot-gitlab> gitlab # [  310.072110] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:46.574Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"d6a56f6e5b114fb8aa0e20cb","created_at":"2026-06-08T13:19:45.424Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-2df2532303b748e6","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.435Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-d6a56f6e5b114fb8aa0e20cb: start","job_status":"start","queue_duration_s":1.139359,"scheduling_latency_s":1.139394}2042vm-test-run-nixbot-gitlab> gitlab # [  310.088758] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:46.631Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"d6a56f6e5b114fb8aa0e20cb","created_at":"2026-06-08T13:19:45.424Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-2df2532303b748e6","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.435Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-d6a56f6e5b114fb8aa0e20cb: done: 0.057122 sec","job_status":"done","queue_duration_s":1.139359,"scheduling_latency_s":1.139394,"redis_calls":10,"redis_duration_s":0.003174,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000549,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00191,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000715,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031178,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00055286,"duration_s":0.057122,"completed_at":"2026-06-08T13:19:46.631Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014904,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2043vm-test-run-nixbot-gitlab> gitlab # [  310.129833] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:46.633Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"c0f8c3173dad0f2e8366fbee","created_at":"2026-06-08T13:19:45.435Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-2df2532303b748e6","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.439Z","job_size_bytes":6,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-c0f8c3173dad0f2e8366fbee: start","job_status":"start","queue_duration_s":1.193738,"scheduling_latency_s":1.193768}2044vm-test-run-nixbot-gitlab> gitlab # [  310.144734] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:46.669Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"c0f8c3173dad0f2e8366fbee","created_at":"2026-06-08T13:19:45.435Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-2df2532303b748e6","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.439Z","job_size_bytes":6,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-c0f8c3173dad0f2e8366fbee: done: 0.035788 sec","job_status":"done","queue_duration_s":1.193738,"scheduling_latency_s":1.193768,"redis_calls":10,"redis_duration_s":0.003116,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0006,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001848,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000668,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00060878,"duration_s":0.035788,"completed_at":"2026-06-08T13:19:46.669Z","load_balancing_strategy":"primary","db_duration_s":0.004056,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2045vm-test-run-nixbot-gitlab> gitlab # [  310.185281] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:46.671Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"8a0757bfc991ee6633e68ed0","created_at":"2026-06-08T13:19:45.480Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-2df2532303b748e6","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.481Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8a0757bfc991ee6633e68ed0: start","job_status":"start","queue_duration_s":1.189572,"scheduling_latency_s":1.189596}2046vm-test-run-nixbot-gitlab> gitlab # [  310.199863] gitaly[1371]: time="2026-06-08T13:19:46.092Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP783APE2RMCBRERTPFFA7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:16.090" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:46.091" grpc.time_ms=1.381 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2047vm-test-run-nixbot-gitlab> gitlab # [  310.211818] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:46.795Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"8a0757bfc991ee6633e68ed0","created_at":"2026-06-08T13:19:45.480Z","trace_propagation_headers":{"sentry-trace":"877a2bf003714017b71f8ad28ef2f7e1-2df2532303b748e6","baggage":"sentry-trace_id=877a2bf003714017b71f8ad28ef2f7e1,sentry-release=Unknown"},"correlation_id":"01KTKP7879BA6X0KQA23GKPQ72","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:45.481Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8a0757bfc991ee6633e68ed0: done: 0.124484 sec","job_status":"done","queue_duration_s":1.189572,"scheduling_latency_s":1.189596,"gitaly_calls":2,"gitaly_duration_s":0.010139,"redis_calls":19,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.004145,"redis_read_bytes":42,"redis_write_bytes":1891,"redis_cache_calls":8,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000814,"redis_cache_read_bytes":16,"redis_cache_write_bytes":735,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001671,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000315,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001345,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":20,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":20,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":9,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.08381,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.09080562,"duration_s":0.124484,"completed_at":"2026-06-08T13:19:46.795Z","load_balancing_strategy":"primary","db_duration_s":0.030261,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2048vm-test-run-nixbot-gitlab> gitlab # [  310.255024] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:46.797Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"542f0a9440f1b4cd4ae142f0","created_at":"2026-06-08T13:19:46.000Z","trace_propagation_headers":{"sentry-trace":"50a85ffb304849e7a062bc341985928f-37f46a7f20d9466b","baggage":"sentry-trace_id=50a85ffb304849e7a062bc341985928f,sentry-release=Unknown"},"correlation_id":"01KTKP783APE2RMCBRERTPFFA7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:46.004Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-542f0a9440f1b4cd4ae142f0: start","job_status":"start","queue_duration_s":0.793218,"scheduling_latency_s":0.79324}2049vm-test-run-nixbot-gitlab> gitlab # [  310.270201] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:46.834Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"542f0a9440f1b4cd4ae142f0","created_at":"2026-06-08T13:19:46.000Z","trace_propagation_headers":{"sentry-trace":"50a85ffb304849e7a062bc341985928f-37f46a7f20d9466b","baggage":"sentry-trace_id=50a85ffb304849e7a062bc341985928f,sentry-release=Unknown"},"correlation_id":"01KTKP783APE2RMCBRERTPFFA7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:46.004Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-542f0a9440f1b4cd4ae142f0: done: 0.037159 sec","job_status":"done","queue_duration_s":0.793218,"scheduling_latency_s":0.79324,"redis_calls":7,"redis_duration_s":0.001987,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001423,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000564,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025733,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037159,"completed_at":"2026-06-08T13:19:46.834Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006058,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2050vm-test-run-nixbot-gitlab> gitlab # [  310.312182] gitaly[1371]: time="2026-06-08T13:19:46.144Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP783APE2RMCBRERTPFFA7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:16.142" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:46.143" grpc.time_ms=1.09 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2051vm-test-run-nixbot-gitlab> gitlab # [  310.323764] redis[1271]: 10 changes in 300 seconds. Saving...2052vm-test-run-nixbot-gitlab> gitlab # [  310.324738] gitaly[1371]: time="2026-06-08T13:19:46.512Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP79Q1JQ8J0FR7CCR9EWBX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:16.109" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:46.510" grpc.time_ms=1.197 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2053vm-test-run-nixbot-gitlab> gitlab # [  310.336604] redis[1271]: Background saving started by pid 42222054vm-test-run-nixbot-gitlab> gitlab # [  310.337470] gitaly[1371]: time="2026-06-08T13:19:46.730Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTKP7879BA6X0KQA23GKPQ72 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-08T13:20:16.727" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:46.728" grpc.time_ms=1.667 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2055vm-test-run-nixbot-gitlab> gitlab # [  310.349488] redis[4222]: BGSAVE done, 582 keys saved, 0 keys skipped, 138358 bytes written.2056vm-test-run-nixbot-gitlab> gitlab # [  310.350651] gitaly[1371]: time="2026-06-08T13:19:46.780Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7879BA6X0KQA23GKPQ72 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:16.777" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:46.778" grpc.time_ms=1.336 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2057vm-test-run-nixbot-gitlab> gitlab # [  310.362482] redis[4222]: DB saved on disk2058vm-test-run-nixbot-gitlab> gitlab # [  310.363156] redis[4222]: Fork CoW for RDB: current 1 MB, peak 1 MB, average 0 MB2059vm-test-run-nixbot-gitlab> gitlab # [  310.372433] redis[1271]: Background saving terminated with success2060vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/81313f96c272bc1a0bb41e3b39d9dc4949b6745d/statuses2061vm-test-run-nixbot-gitlab> gitlab # [  310.979752] gitaly[1371]: time="2026-06-08T13:19:47.762Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7AYQH6Y8VP0A3K98VHDZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:17.360" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:47.761" grpc.time_ms=1.234 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2062vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/81313f96c272bc1a0bb41e3b39d9dc4949b6745d/statuses, in 0.22 seconds)2063vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '81313f96c272bc1a0bb41e3b39d9dc4949b6745d', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-06-08T13:19:45.251Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2064vm-test-run-nixbot-gitlab> gitlab # [  311.031738] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/81313f96c272bc1a0bb41e3b39d9dc4949b6745d/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1422065vm-test-run-nixbot-gitlab> gitlab # [  311.822299] postgres[1340]: [1340] LOG:  checkpoint starting: time2066vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/81313f96c272bc1a0bb41e3b39d9dc4949b6745d/statuses2067vm-test-run-nixbot-gitlab> gitlab # [  312.179418] gitaly[1371]: time="2026-06-08T13:19:48.962Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7C464JHY9WX70CBACC99 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:18.559" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:48.960" grpc.time_ms=1.276 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2068vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/81313f96c272bc1a0bb41e3b39d9dc4949b6745d/statuses, in 0.19 seconds)2069vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '81313f96c272bc1a0bb41e3b39d9dc4949b6745d', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-06-08T13:19:45.251Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2070vm-test-run-nixbot-gitlab> gitlab # [  312.224910] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/81313f96c272bc1a0bb41e3b39d9dc4949b6745d/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1362071vm-test-run-nixbot-gitlab> gitlab # [  312.659652] gitaly[1371]: time="2026-06-08T13:19:49.443Z" level=info msg="burden monitor stats" pid=1371 top_10_by_cpu="[]" top_10_by_memory="[]"2072vm-test-run-nixbot-gitlab> gitlab # [  312.949808] gitaly[1371]: time="2026-06-08T13:19:49.733Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7CVTR0XPY9RVESRPR2XM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:19.331" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:49.731" grpc.time_ms=1.423 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2073vm-test-run-nixbot-gitlab> gitlab # [  313.028545] gitaly[1371]: time="2026-06-08T13:19:49.812Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01KTKP7CVTR0XPY9RVESRPR2XM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-08T13:19:59.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:49.794" grpc.time_ms=17.404 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2074vm-test-run-nixbot-gitlab> gitlab # [  313.093172] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:49.875Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"14dd2f61e42630aa153dfa5b","created_at":"2026-06-08T13:19:49.866Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-b773ecb9e9374164","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:49.872Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-14dd2f61e42630aa153dfa5b: start","job_status":"start","queue_duration_s":0.00286,"scheduling_latency_s":0.002924}2075vm-test-run-nixbot-gitlab> gitlab # [  313.135737] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/81313f96c272bc1a0bb41e3b39d9dc4949b6745d HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 2662076vm-test-run-nixbot-gitlab> gitlab # [  313.141780] nixbot[3793]: {"ts": "2026-06-08T13:19:49.895Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/81313f96c272bc1a0bb41e3b39d9dc4949b6745d \"HTTP/1.1 201 Created\""}2077vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/81313f96c272bc1a0bb41e3b39d9dc4949b6745d/statuses2078vm-test-run-nixbot-gitlab> gitlab # [  313.244108] gitaly[1371]: time="2026-06-08T13:19:50.026Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7D4CXRZ5PNJJ416KFH1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:20.024" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:50.025" grpc.time_ms=1.401 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2079vm-test-run-nixbot-gitlab> gitlab # [  313.305615] gitaly[1371]: time="2026-06-08T13:19:50.089Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP7CVTR0XPY9RVESRPR2XM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3899 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:50.088" grpc.time_ms=0.695 pid=1371 span.kind=server system=grpc2080vm-test-run-nixbot-gitlab> gitlab # [  313.350437] gitaly[1371]: time="2026-06-08T13:19:50.134Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=4 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTKP7D4CXRZ5PNJJ416KFH1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-08T13:20:00.069" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:50.119" grpc.time_ms=14.388 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2081vm-test-run-nixbot-gitlab> gitlab # [  313.367103] gitaly[1371]: time="2026-06-08T13:19:50.141Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7D9HRP0PKH7A0RWNCXPW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:20.138" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:50.139" grpc.time_ms=1.278 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2082vm-test-run-nixbot-gitlab> gitlab # [  313.381949] gitaly[1371]: time="2026-06-08T13:19:50.152Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP7CVTR0XPY9RVESRPR2XM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:50.151" grpc.time_ms=0.573 pid=1371 span.kind=server system=grpc2083vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/81313f96c272bc1a0bb41e3b39d9dc4949b6745d/statuses, in 0.17 seconds)2084vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '81313f96c272bc1a0bb41e3b39d9dc4949b6745d', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-06-08T13:19:45.251Z', 'started_at': None, 'finished_at': '2026-06-08T13:19:49.850Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2085vm-test-run-nixbot-gitlab> gitlab # [  313.392598] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/81313f96c272bc1a0bb41e3b39d9dc4949b6745d/statuses HTTP/1.1" 200 671 "" "curl/8.20.0" 1102086vm-test-run-nixbot-gitlab> gitlab # [  313.417447] gitaly[1371]: time="2026-06-08T13:19:50.201Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP7CVTR0XPY9RVESRPR2XM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3899 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:50.200" grpc.time_ms=0.731 pid=1371 span.kind=server system=grpc2087vm-test-run-nixbot-gitlab> gitlab # [  313.434129] gitaly[1371]: time="2026-06-08T13:19:50.210Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7CVTR0XPY9RVESRPR2XM diskcache=8ac9c772-972a-4239-9a38-4d63fa3ad667 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-08T13:20:20.024" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:50.025" pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2088vm-test-run-nixbot-gitlab> gitlab # [  313.448096] gitaly[1371]: time="2026-06-08T13:19:50.210Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=149 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7091 command.oublock=0 command.real_time_ms=176 command.spawn_token_fork_ms=1 command.system_time_ms=56 command.user_time_ms=93 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7CVTR0XPY9RVESRPR2XM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-08T13:20:20.024" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:50.025" grpc.time_ms=185.212 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2089vm-test-run-nixbot-gitlab> gitlab # [  313.464990] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/81313f96c272bc1a0bb41e3b39d9dc4949b6745d HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3322090vm-test-run-nixbot-gitlab> gitlab # [  313.468265] nixbot[3793]: {"ts": "2026-06-08T13:19:50.235Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/81313f96c272bc1a0bb41e3b39d9dc4949b6745d \"HTTP/1.1 201 Created\""}2091vm-test-run-nixbot-gitlab> gitlab # [  313.483549] gitaly[1371]: time="2026-06-08T13:19:50.267Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTKP7CVTR0XPY9RVESRPR2XM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-08T13:20:20.265" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:50.266" grpc.time_ms=1.018 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2092vm-test-run-nixbot-gitlab> gitlab # [  313.524422] gitaly[1371]: time="2026-06-08T13:19:50.308Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7CVTR0XPY9RVESRPR2XM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:20.306" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:50.307" grpc.time_ms=0.932 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2093vm-test-run-nixbot-gitlab> gitlab # [  313.557609] gitaly[1371]: time="2026-06-08T13:19:50.318Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7DFCZ89JKFQQ3GNKQ9CH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:20.316" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:50.317" grpc.time_ms=0.637 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2094vm-test-run-nixbot-gitlab> gitlab # [  313.587652] gitaly[1371]: time="2026-06-08T13:19:50.370Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7CVTR0XPY9RVESRPR2XM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-08T13:20:20.369" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-08T13:19:50.369" grpc.time_ms=0.744 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2095vm-test-run-nixbot-gitlab> gitlab # [  313.608172] gitaly[1371]: time="2026-06-08T13:19:50.383Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KTKP7DFCZ89JKFQQ3GNKQ9CH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-08T13:20:00.121" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:50.371" grpc.time_ms=11.705 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2096vm-test-run-nixbot-gitlab> gitlab # [  313.625301] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.385Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0057b252acd63228d3550755","created_at":"2026-06-08T13:19:50.381Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"14dd2f61e42630aa153dfa5b","job_size_bytes":3,"pid":2428,"job_status":"deduplicated","message":"PipelineProcessWorker JID-0057b252acd63228d3550755: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2097vm-test-run-nixbot-gitlab> gitlab # [  313.642540] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.387Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"14dd2f61e42630aa153dfa5b","created_at":"2026-06-08T13:19:49.866Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-b773ecb9e9374164","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:49.872Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2428,"job_status":"rescheduled","message":"PipelineProcessWorker JID-14dd2f61e42630aa153dfa5b: rescheduled"}2098vm-test-run-nixbot-gitlab> gitlab # [  313.658295] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.396Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"14dd2f61e42630aa153dfa5b","created_at":"2026-06-08T13:19:49.866Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-b773ecb9e9374164","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:49.872Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-14dd2f61e42630aa153dfa5b: done: 0.521744 sec","job_status":"done","queue_duration_s":0.00286,"scheduling_latency_s":0.002924,"gitaly_calls":4,"gitaly_duration_s":0.202384,"redis_calls":93,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.025649,"redis_read_bytes":262,"redis_write_bytes":23383,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001917,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":21,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.002943,"redis_cache_read_bytes":39,"redis_cache_write_bytes":1840,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001032,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":712,"redis_queues_calls":25,"redis_queues_duration_s":0.005299,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14464,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.008689,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000495,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000866,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002491,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":38,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":38,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.062,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":23,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.014,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.019,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.028,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.244034,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.45797156,"duration_s":0.521744,"completed_at":"2026-06-08T13:19:50.396Z","load_balancing_strategy":"primary","db_duration_s":0.066664,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2099vm-test-run-nixbot-gitlab> gitlab # [  313.712204] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.400Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"64f2459a237f5d476628c8e1","created_at":"2026-06-08T13:19:50.008Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.012Z","job_size_bytes":23,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-64f2459a237f5d476628c8e1: start","job_status":"start","queue_duration_s":0.387505,"scheduling_latency_s":0.387528}2100vm-test-run-nixbot-gitlab> gitlab # [  313.727404] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.459Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"64f2459a237f5d476628c8e1","created_at":"2026-06-08T13:19:50.008Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.012Z","job_size_bytes":23,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-64f2459a237f5d476628c8e1: done: 0.059165 sec","job_status":"done","queue_duration_s":0.387505,"scheduling_latency_s":0.387528,"redis_calls":7,"redis_duration_s":0.010339,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009326,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032402,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.059165,"completed_at":"2026-06-08T13:19:50.459Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009658,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2101vm-test-run-nixbot-gitlab> gitlab # [  313.767977] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.461Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"4c08a3ae1f2a7b00eea57b54","created_at":"2026-06-08T13:19:50.218Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.222Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-4c08a3ae1f2a7b00eea57b54: start","job_status":"start","queue_duration_s":0.238564,"scheduling_latency_s":0.238591}2102vm-test-run-nixbot-gitlab> gitlab # [  313.785243] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.488Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"4c08a3ae1f2a7b00eea57b54","created_at":"2026-06-08T13:19:50.218Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.222Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-4c08a3ae1f2a7b00eea57b54: done: 0.027155 sec","job_status":"done","queue_duration_s":0.238564,"scheduling_latency_s":0.238591,"redis_calls":7,"redis_duration_s":0.0026699999999999996,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002188,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000482,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027155,"completed_at":"2026-06-08T13:19:50.488Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002972,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2103vm-test-run-nixbot-gitlab> gitlab # [  313.825821] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.489Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"1d41f311cfa999d1ef9c6871","created_at":"2026-06-08T13:19:50.231Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.233Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-1d41f311cfa999d1ef9c6871: start","job_status":"start","queue_duration_s":0.256273,"scheduling_latency_s":0.256291}2104vm-test-run-nixbot-gitlab> gitlab # [  313.841026] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/81313f96c272bc1a0bb41e3b39d9dc4949b6745d HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2002105vm-test-run-nixbot-gitlab> gitlab # [  313.843521] nixbot[3793]: {"ts": "2026-06-08T13:19:50.456Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/81313f96c272bc1a0bb41e3b39d9dc4949b6745d \"HTTP/1.1 201 Created\""}2106vm-test-run-nixbot-gitlab> gitlab # [  313.846274] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.520Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"1d41f311cfa999d1ef9c6871","created_at":"2026-06-08T13:19:50.231Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.233Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-1d41f311cfa999d1ef9c6871: done: 0.030588 sec","job_status":"done","queue_duration_s":0.256273,"scheduling_latency_s":0.256291,"redis_calls":7,"redis_duration_s":0.001616,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001157,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000459,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030588,"completed_at":"2026-06-08T13:19:50.520Z","load_balancing_strategy":"primary","db_duration_s":0.006388,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2107vm-test-run-nixbot-gitlab> gitlab # [  313.885785] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.522Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"131b6acd98e51246772b341a","created_at":"2026-06-08T13:19:50.243Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.245Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-131b6acd98e51246772b341a: start","job_status":"start","queue_duration_s":0.276661,"scheduling_latency_s":0.276679}2108vm-test-run-nixbot-gitlab> gitlab # [  313.906986] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.690Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"131b6acd98e51246772b341a","created_at":"2026-06-08T13:19:50.243Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.245Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-131b6acd98e51246772b341a: done: 0.16868 sec","job_status":"done","queue_duration_s":0.276661,"scheduling_latency_s":0.276679,"redis_calls":10,"redis_duration_s":0.003657,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001669,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001322,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000666,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.15712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.16868,"completed_at":"2026-06-08T13:19:50.690Z","load_balancing_strategy":"primary","db_duration_s":0.004383,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2109vm-test-run-nixbot-gitlab> gitlab # [  313.947730] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.693Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9cc35f36a9d12d740c2a9ade","created_at":"2026-06-08T13:19:50.245Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.247Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9cc35f36a9d12d740c2a9ade: start","job_status":"start","queue_duration_s":0.446153,"scheduling_latency_s":0.446178}2110vm-test-run-nixbot-gitlab> gitlab # [  313.963344] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.721Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9cc35f36a9d12d740c2a9ade","created_at":"2026-06-08T13:19:50.245Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.247Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9cc35f36a9d12d740c2a9ade: done: 0.027661 sec","job_status":"done","queue_duration_s":0.446153,"scheduling_latency_s":0.446178,"redis_calls":7,"redis_duration_s":0.0025,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002037,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000463,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016079,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027661,"completed_at":"2026-06-08T13:19:50.721Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004528,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2111vm-test-run-nixbot-gitlab> gitlab # [  314.005300] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.723Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"9ecc60e69e6776b3c0b223e5","created_at":"2026-06-08T13:19:50.248Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.251Z","job_size_bytes":19,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-9ecc60e69e6776b3c0b223e5: start","job_status":"start","queue_duration_s":0.471533,"scheduling_latency_s":0.47155}2112vm-test-run-nixbot-gitlab> gitlab # [  314.020504] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.750Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"9ecc60e69e6776b3c0b223e5","created_at":"2026-06-08T13:19:50.248Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.251Z","job_size_bytes":19,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-9ecc60e69e6776b3c0b223e5: done: 0.026668 sec","job_status":"done","queue_duration_s":0.471533,"scheduling_latency_s":0.47155,"redis_calls":8,"redis_duration_s":0.001433,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001072,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000361,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026668,"completed_at":"2026-06-08T13:19:50.749Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00523,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2113vm-test-run-nixbot-gitlab> gitlab # [  314.060379] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.751Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"4b12842a3872c48435883d05","created_at":"2026-06-08T13:19:50.253Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.255Z","job_size_bytes":66,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-4b12842a3872c48435883d05: start","job_status":"start","queue_duration_s":0.496479,"scheduling_latency_s":0.496497}2114vm-test-run-nixbot-gitlab> gitlab # [  314.076347] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.771Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"4b12842a3872c48435883d05","created_at":"2026-06-08T13:19:50.253Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.255Z","job_size_bytes":66,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-4b12842a3872c48435883d05: done: 0.019353 sec","job_status":"done","queue_duration_s":0.496479,"scheduling_latency_s":0.496497,"redis_calls":7,"redis_duration_s":0.001055,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000775,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00028,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019353,"completed_at":"2026-06-08T13:19:50.771Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001412,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2115vm-test-run-nixbot-gitlab> gitlab # [  314.117386] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.772Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"ef24923b016c5e2ace06b66f","created_at":"2026-06-08T13:19:50.256Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.258Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-ef24923b016c5e2ace06b66f: start","job_status":"start","queue_duration_s":0.513737,"scheduling_latency_s":0.513754}2116vm-test-run-nixbot-gitlab> gitlab # [  314.132639] nix-daemon[4087]: accepted connection from pid 4279, user nixbot2117vm-test-run-nixbot-gitlab> gitlab # [  314.133557] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.808Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"ef24923b016c5e2ace06b66f","created_at":"2026-06-08T13:19:50.256Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.258Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-ef24923b016c5e2ace06b66f: done: 0.036451 sec","job_status":"done","queue_duration_s":0.513737,"scheduling_latency_s":0.513754,"redis_calls":7,"redis_duration_s":0.001009,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000735,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036451,"completed_at":"2026-06-08T13:19:50.808Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009247,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2118vm-test-run-nixbot-gitlab> gitlab # [  314.174608] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.809Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"9e5241ec1a6abea67ef15d1d","created_at":"2026-06-08T13:19:50.319Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.322Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-9e5241ec1a6abea67ef15d1d: start","job_status":"start","queue_duration_s":0.487532,"scheduling_latency_s":0.487548}2119vm-test-run-nixbot-gitlab> gitlab # [  314.189981] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.833Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"9e5241ec1a6abea67ef15d1d","created_at":"2026-06-08T13:19:50.319Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.322Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-9e5241ec1a6abea67ef15d1d: done: 0.023404 sec","job_status":"done","queue_duration_s":0.487532,"scheduling_latency_s":0.487548,"redis_calls":7,"redis_duration_s":0.0015240000000000002,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00059,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023404,"completed_at":"2026-06-08T13:19:50.833Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003624,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2120vm-test-run-nixbot-gitlab> gitlab # [  314.230330] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.835Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"616a5970c18c00a85186188a","created_at":"2026-06-08T13:19:50.322Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.325Z","job_size_bytes":6,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-616a5970c18c00a85186188a: start","job_status":"start","queue_duration_s":0.509844,"scheduling_latency_s":0.509862}2121vm-test-run-nixbot-gitlab> gitlab # [  314.245130] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.891Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"616a5970c18c00a85186188a","created_at":"2026-06-08T13:19:50.322Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.325Z","job_size_bytes":6,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-616a5970c18c00a85186188a: done: 0.056272 sec","job_status":"done","queue_duration_s":0.509844,"scheduling_latency_s":0.509862,"redis_calls":7,"redis_duration_s":0.030323000000000003,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.021878,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.008445,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.056272,"completed_at":"2026-06-08T13:19:50.891Z","load_balancing_strategy":"primary","db_duration_s":0.005405,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2122vm-test-run-nixbot-gitlab> gitlab # [  314.284645] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.893Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"a3f103055da8e69394dab422","created_at":"2026-06-08T13:19:50.326Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.332Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a3f103055da8e69394dab422: start","job_status":"start","queue_duration_s":0.561273,"scheduling_latency_s":0.561302}2123vm-test-run-nixbot-gitlab> gitlab # [  314.298830] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.940Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"a3f103055da8e69394dab422","created_at":"2026-06-08T13:19:50.326Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.332Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a3f103055da8e69394dab422: done: 0.047578 sec","job_status":"done","queue_duration_s":0.561273,"scheduling_latency_s":0.561302,"redis_calls":10,"redis_duration_s":0.0018579999999999998,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000385,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001058,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000415,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003136,"duration_s":0.047578,"completed_at":"2026-06-08T13:19:50.940Z","load_balancing_strategy":"primary","db_duration_s":0.009579,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2124vm-test-run-nixbot-gitlab> gitlab # [  314.339958] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:50.942Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"0eae83e463e5f36233bfbd8a","created_at":"2026-06-08T13:19:50.387Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.389Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0eae83e463e5f36233bfbd8a: start","job_status":"start","queue_duration_s":0.552704,"scheduling_latency_s":0.552727}2125vm-test-run-nixbot-gitlab> gitlab # [  314.355119] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:50 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 962126vm-test-run-nixbot-gitlab> gitlab # [  314.357163] gitlab-workhorse[1297]: time="2026-06-08T13:19:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672127vm-test-run-nixbot-gitlab> gitlab # [  314.358862] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 762128vm-test-run-nixbot-gitlab> gitlab # [  314.360972] gitaly[1371]: time="2026-06-08T13:19:50.961Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTKP7E2G1ZCPRN53JQF4GYKG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:50.949" grpc.time_ms=11.459 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc2129vm-test-run-nixbot-gitlab> gitlab # [  314.373233] gitaly[1371]: time="2026-06-08T13:19:51.039Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7E5J2K7MYHZ1Y4TJBG0J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:51.027" pid=1371 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc2130vm-test-run-nixbot-gitlab> gitlab # [  314.383893] gitaly[1371]: time="2026-06-08T13:19:51.039Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7E5J2K7MYHZ1Y4TJBG0J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:51.027" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc2131vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/81313f96c272bc1a0bb41e3b39d9dc4949b6745d/statuses2132vm-test-run-nixbot-gitlab> gitlab # [  314.396902] gitaly[1371]: time="2026-06-08T13:19:51.039Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7E5J2K7MYHZ1Y4TJBG0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-08T13:19:51.027" grpc.time_ms=11.769 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc2133vm-test-run-nixbot-gitlab> gitlab # [  314.409466] gitaly[1371]: time="2026-06-08T13:19:51.062Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP7CVTR0XPY9RVESRPR2XM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3899 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:51.062" grpc.time_ms=0.416 pid=1371 span.kind=server system=grpc2134vm-test-run-nixbot-gitlab> gitlab # [  314.417743] gitaly[1371]: time="2026-06-08T13:19:51.083Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP7CVTR0XPY9RVESRPR2XM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:51.082" grpc.time_ms=0.437 pid=1371 span.kind=server system=grpc2135vm-test-run-nixbot-gitlab> gitlab # [  314.426087] gitaly[1371]: time="2026-06-08T13:19:51.103Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTKP7CVTR0XPY9RVESRPR2XM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3899 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-08T13:19:51.102" grpc.time_ms=0.329 pid=1371 span.kind=server system=grpc2136vm-test-run-nixbot-gitlab> gitlab # [  314.434714] gitaly[1371]: time="2026-06-08T13:19:51.107Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7CVTR0XPY9RVESRPR2XM forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-08T13:20:21.029" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:51.030" operations="[repack_refs]" pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2137vm-test-run-nixbot-gitlab> gitlab # [  314.444210] gitaly[1371]: time="2026-06-08T13:19:51.109Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7CVTR0XPY9RVESRPR2XM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-08T13:20:21.029" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:51.030" pid=1371 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-06-08 13:19:34.30720654 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2138vm-test-run-nixbot-gitlab> gitlab # [  314.455499] gitaly[1371]: time="2026-06-08T13:19:51.113Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7CVTR0XPY9RVESRPR2XM diskcache=e1053b2e-a3c3-4468-8100-6fa54bf38333 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-08T13:20:21.029" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:51.030" pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2139vm-test-run-nixbot-gitlab> gitlab # [  314.464872] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:51.224Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"0eae83e463e5f36233bfbd8a","created_at":"2026-06-08T13:19:50.387Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.389Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2428,"job_status":"rescheduled","message":"PipelineProcessWorker JID-0eae83e463e5f36233bfbd8a: rescheduled"}2140vm-test-run-nixbot-gitlab> gitlab # [  314.478746] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:51.233Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"0eae83e463e5f36233bfbd8a","created_at":"2026-06-08T13:19:50.387Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-36125d66b01448fd","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:50.389Z","job_size_bytes":3,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0eae83e463e5f36233bfbd8a: done: 0.291173 sec","job_status":"done","queue_duration_s":0.552704,"scheduling_latency_s":0.552727,"gitaly_calls":3,"gitaly_duration_s":0.093413,"redis_calls":68,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.014401,"redis_read_bytes":149,"redis_write_bytes":18171,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000391,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001162,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":22,"redis_queues_duration_s":0.002608,"redis_queues_read_bytes":24,"redis_queues_write_bytes":12313,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.006755,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000179,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001231,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001684,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":26,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":26,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.016,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.016,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.021,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.150707,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.250908,"duration_s":0.291173,"completed_at":"2026-06-08T13:19:51.233Z","load_balancing_strategy":"primary","db_duration_s":0.042503,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2141vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/81313f96c272bc1a0bb41e3b39d9dc4949b6745d/statuses, in 0.15 seconds)2142vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '81313f96c272bc1a0bb41e3b39d9dc4949b6745d', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-06-08T13:19:45.251Z', 'started_at': None, 'finished_at': '2026-06-08T13:19:49.850Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': '81313f96c272bc1a0bb41e3b39d9dc4949b6745d', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-06-08T13:19:50.190Z', 'started_at': None, 'finished_at': '2026-06-08T13:19:50.415Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2143vm-test-run-nixbot-gitlab> gitlab # [  314.526819] sidekiq-cluster[2428]: {"severity":"INFO","time":"2026-06-08T13:19:51.235Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"3975c4f280ba6a81c064acb6","created_at":"2026-06-08T13:19:51.019Z","trace_propagation_headers":{"sentry-trace":"ee3a80332fe44d768dbe41ba875a82c0-89c6c408ac144b2c","baggage":"sentry-trace_id=ee3a80332fe44d768dbe41ba875a82c0,sentry-release=Unknown"},"correlation_id":"01KTKP7CVTR0XPY9RVESRPR2XM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-06-08T13:19:51.021Z","job_size_bytes":23,"pid":2428,"sidekiq_tid":"ma7s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-3975c4f280ba6a81c064acb6: start","job_status":"start","queue_duration_s":0.213338,"scheduling_latency_s":0.21336}2144vm-test-run-nixbot-gitlab> (finished: subtest: eval and build post commit statuses, in 6.19 seconds)2145vm-test-run-nixbot-gitlab> (finished: run the VM test script, in 378.09 seconds)2146vm-test-run-nixbot-gitlab> gitlab # [  314.542180] gitaly[1371]: time="2026-06-08T13:19:51.114Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=76 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7208 command.oublock=0 command.real_time_ms=79 command.spawn_token_fork_ms=2 command.system_time_ms=40 command.user_time_ms=36 component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7CVTR0XPY9RVESRPR2XM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-08T13:20:21.029" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:51.030" grpc.time_ms=83.956 pid=1371 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2147vm-test-run-nixbot-gitlab> gitlab # [  314.554689] gitlab-workhorse[1297]: gitlab 2001:db8:1::1 - - [2026/06/08:13:19:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/81313f96c272bc1a0bb41e3b39d9dc4949b6745d/statuses HTTP/1.1" 200 1328 "" "curl/8.20.0" 822148vm-test-run-nixbot-gitlab> gitlab # [  314.557211] nix-daemon[4087]: accepted connection from pid 4337, user nixbot2149vm-test-run-nixbot-gitlab> gitlab # [  314.558092] gitaly[1371]: time="2026-06-08T13:19:51.130Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7CVTR0XPY9RVESRPR2XM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-08T13:20:21.029" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-06-08T13:19:51.030" pid=1371 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2150vm-test-run-nixbot-gitlab> gitlab # [  314.574691] gitaly[1371]: time="2026-06-08T13:19:51.130Z" level=info msg="optimized repository" clean_stale_data_time=21.1736ms clean_work_trees_time="99.98µs" commit_graph_time=400ns correlation_id=01KTKP7CVTR0XPY9RVESRPR2XM gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="1.46µs" pid=1371 prune_time=300ns relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="1.3µs" storage_name=default system=housekeeping total_time=21.29644ms2151vm-test-run-nixbot-gitlab> test script finished in 378.12s2152vm-test-run-nixbot-gitlab> cleanup2153vm-test-run-nixbot-gitlab> kill QemuMachine (pid 13)2154vm-test-run-nixbot-gitlab> gitlab # [  314.582358] gitaly[1371]: time="2026-06-08T13:19:51.130Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01KTKP7CVTR0XPY9RVESqemu-system-aarch64: terminating on signal 15 from pid 6 (/nix/store/lqn6mbgzzdrqq2qkwddcmxj9z6amdd86-python3-3.13.13/bin/python3.13)2155vm-test-run-nixbot-gitlab> (finished: cleanup, in 1.13 seconds)21562157post-build step Upload coverage to codecov: ok2158Skipping codecov: project=Mic92/nixbot attr=aarch64-linux.nixbot-gitlab