startup fail- Control socket connect

[bodsch]

Description

Fresh install of colima for local testing.

$ colima start
INFO[0000] starting colima                              
INFO[0000] runtime: docker                              
INFO[0000] creating and starting ...                     context=vm
> "[hostagent] failed to exit SSH master" error="failed to execute `ssh -O exit -p 39849 127.0.0.1`, out=\"Control socket connect(/home/bodsch/.config/colima/_lima/colima/ssh.sock): No such file or directory\\r\\n\": exit status 255"
> [hostagent] Shutting down QEMU with ACPI
> [hostagent] Failed to remove SSH binding for port 39849
> "[hostagent] failed to open the QMP socket \"/home/bodsch/.config/colima/_lima/colima/qmp.sock\", forcibly killing QEMU" error="dial unix /home/bodsch/.config/colima/_lima/colima/qmp.sock: connect: connection refused"
> [hostagent] QEMU has already exited
> exiting, status={Running:false Degraded:false Exiting:true Errors:[] SSHLocalPort:0} (hint: see "/home/bodsch/.config/colima/_lima/colima/ha.stderr.log")
FATA[0000] error starting vm: error at 'creating and starting': exit status 1

Version

• colima version v0.7.5 - git commit: 1588c06
• limactl version 0.23.2
• qemu-img version 9.1.0

Operating System

• macOS Intel <= 13 (Ventura)
• macOS Intel >= 14 (Sonoma)
• Apple Silicon <= 13 (Ventura)
• Apple Silicon >= 14 (Sonoma)
• Linux

Output of colima status

colima status
FATA[0000] colima is not running

Reproduction Steps

1. install both packes direct from github and extract to /usr/local
2. colima start
3. fail

Expected behaviour

No response

Additional context

ha.stdout.log

{"time":"2024-10-16T14:14:31.682147467+02:00","status":{"sshLocalPort":39849}}
{"time":"2024-10-16T14:14:31.853121283+02:00","status":{"exiting":true}}

ha.stderr.log

{"level":"debug","msg":"Creating iso file /home/bodsch/.config/colima/_lima/colima/cidata.iso","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"Using /tmp/diskfs_iso1085749784 as workspace","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"OpenSSH version 9.9.1 detected","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"AES accelerator seems available, prioritizing aes128-gcm@openssh.com and aes256-gcm@openssh.com","time":"2024-10-16T14:14:31+02:00"}
{"level":"info","msg":"hostagent socket created at /home/bodsch/.config/colima/_lima/colima/ha.sock","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"QEMU version 9.1.0 detected","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"firmware candidates = [/home/bodsch/.local/share/qemu/edk2-x86_64-code.fd /usr/share/qemu/edk2-x86_64-code.fd /usr/share/OVMF/OVMF_CODE.fd /usr/share/OVMF/OVMF_CODE_4M.fd /usr/share/edk2/ovmf/OVMF_CODE.fd /usr/share/qemu/ovmf-x86_64-code.bin /usr/share/edk2-ovmf/x64/OVMF_CODE.fd]","time":"2024-10-16T14:14:31+02:00"}
{"level":"info","msg":"Using system firmware (\"/usr/share/edk2-ovmf/x64/OVMF_CODE.fd\")","time":"2024-10-16T14:14:31+02:00"}
{"level":"info","msg":"Starting QEMU (hint: to watch the boot progress, see \"/home/bodsch/.config/colima/_lima/colima/serial*.log\")","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"qCmd.Args: [/usr/bin/qemu-system-x86_64 -m 2048 -cpu host -machine q35,accel=kvm -smp 2,sockets=1,cores=2,threads=1 -drive if=pflash,format=raw,readonly=on,file=/usr/share/edk2-ovmf/x64/OVMF_CODE.fd -boot order=c,splash-time=0,menu=on -drive file=/home/bodsch/.config/colima/_lima/colima/diffdisk,if=virtio,discard=on -drive id=cdrom0,if=none,format=raw,readonly=on,file=/home/bodsch/.config/colima/_lima/colima/cidata.iso -device virtio-scsi-pci,id=scsi0 -device scsi-cd,bus=scsi0.0,drive=cdrom0 -netdev socket,id=net0,fd=3 -device virtio-net-pci,netdev=net0,mac=52:55:55:a6:3f:36 -device virtio-rng-pci -display none -device virtio-vga -device virtio-keyboard-pci -device virtio-mouse-pci -device qemu-xhci,id=usb-bus -parallel none -chardev socket,id=char-serial,path=/home/bodsch/.config/colima/_lima/colima/serial.sock,server=on,wait=off,logfile=/home/bodsch/.config/colima/_lima/colima/serial.log -serial chardev:char-serial -chardev socket,id=char-serial-virtio,path=/home/bodsch/.config/colima/_lima/colima/serialv.sock,server=on,wait=off,logfile=/home/bodsch/.config/colima/_lima/colima/serialv.log -device virtio-serial-pci,id=virtio-serial0,max_ports=1 -device virtconsole,chardev=char-serial-virtio,id=console0 -chardev socket,id=char-qmp,path=/home/bodsch/.config/colima/_lima/colima/qmp.sock,server=on,wait=off -qmp chardev:char-qmp -chardev socket,path=/home/bodsch/.config/colima/_lima/colima/ga.sock,server=on,wait=off,id=qga0 -device virtio-serial -device virtserialport,chardev=qga0,name=io.lima-vm.guest_agent.0 -name lima-colima -pidfile /home/bodsch/.config/colima/_lima/colima/qemu.pid]","time":"2024-10-16T14:14:31+02:00"}
{"level":"info","msg":"Waiting for the essential requirement 1 of 4: \"ssh\"","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"executing script \"ssh\"","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"executing ssh for script \"ssh\": /usr/bin/ssh [ssh -F /dev/null -o IdentityFile=\"/home/bodsch/.config/colima/_lima/_config/user\" -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o NoHostAuthenticationForLocalhost=yes -o GSSAPIAuthentication=no -o PreferredAuthentications=publickey -o Compression=no -o BatchMode=yes -o IdentitiesOnly=yes -o Ciphers=\"^aes128-gcm@openssh.com,aes256-gcm@openssh.com\" -o User=bodsch -o ControlMaster=auto -o ControlPath=\"/home/bodsch/.config/colima/_lima/colima/ssh.sock\" -o ControlPersist=yes -p 39849 127.0.0.1 -- /bin/bash]","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"stdout=\"\", stderr=\"ssh: connect to host 127.0.0.1 port 39849: Connection refused\\r\\n\", err=failed to execute script \"ssh\": stdout=\"\", stderr=\"ssh: connect to host 127.0.0.1 port 39849: Connection refused\\r\\n\": exit status 255","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"qemu[stderr]: qemu-system-x86_64: -device virtio-vga: 'virtio-vga' is not a valid device model name","time":"2024-10-16T14:14:31+02:00"}
{"level":"info","msg":"Driver stopped due to error: \"exit status 1\"","time":"2024-10-16T14:14:31+02:00"}
{"level":"info","msg":"Shutting down the host agent","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"shutting down the SSH master","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"executing ssh for exiting the master: /usr/bin/ssh [ssh -F /dev/null -o IdentityFile=\"/home/bodsch/.config/colima/_lima/_config/user\" -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o NoHostAuthenticationForLocalhost=yes -o GSSAPIAuthentication=no -o PreferredAuthentications=publickey -o Compression=no -o BatchMode=yes -o IdentitiesOnly=yes -o Ciphers=\"^aes128-gcm@openssh.com,aes256-gcm@openssh.com\" -o User=bodsch -o ControlMaster=auto -o ControlPath=\"/home/bodsch/.config/colima/_lima/colima/ssh.sock\" -o ControlPersist=yes -O exit -p 39849 127.0.0.1]","time":"2024-10-16T14:14:31+02:00"}
{"error":"failed to execute `ssh -O exit -p 39849 127.0.0.1`, out=\"Control socket connect(/home/bodsch/.config/colima/_lima/colima/ssh.sock): No such file or directory\\r\\n\": exit status 255","level":"warning","msg":"failed to exit SSH master","time":"2024-10-16T14:14:31+02:00"}
{"level":"info","msg":"Shutting down QEMU with ACPI","time":"2024-10-16T14:14:31+02:00"}
{"level":"warning","msg":"Failed to remove SSH binding for port 39849","time":"2024-10-16T14:14:31+02:00"}
{"error":"dial unix /home/bodsch/.config/colima/_lima/colima/qmp.sock: connect: connection refused","level":"warning","msg":"failed to open the QMP socket \"/home/bodsch/.config/colima/_lima/colima/qmp.sock\", forcibly killing QEMU","time":"2024-10-16T14:14:31+02:00"}
{"level":"info","msg":"QEMU has already exited","time":"2024-10-16T14:14:31+02:00"}

[michielsarne2]

Same on mac here

[jeremiah]

This is a known bug. The solution that worked for me when I encountered the same problem on my M1 is listed here: #381 towards the end.

TLDR;

1. Remove the folder ~/.colima/_lima/_networks
2. Restart colima

[bodsch]

No, that doesn't work for me. :(

$ rm -rfv ~/.colima/_lima/_networks
$ colima start
INFO[0000] starting colima                              
INFO[0000] runtime: docker                              
INFO[0000] creating and starting ...                     context=vm
INFO[0000] downloading disk image ...                    context=vm
> "[hostagent] failed to exit SSH master" error="failed to execute `ssh -O exit -p 40597 127.0.0.1`, out=\"Control socket connect(/home/bodsch/.config/colima/_lima/colima/ssh.sock): No such file or directory\\r\\n\": exit status 255"
> [hostagent] Shutting down QEMU with ACPI
> [hostagent] Failed to remove SSH binding for port 40597
> "[hostagent] failed to open the QMP socket \"/home/bodsch/.config/colima/_lima/colima/qmp.sock\", forcibly killing QEMU" error="dial unix /home/bodsch/.config/colima/_lima/colima/qmp.sock: connect: connection refused"
> [hostagent] QEMU has already exited
> exiting, status={Running:false Degraded:false Exiting:true Errors:[] SSHLocalPort:0} (hint: see "/home/bodsch/.config/colima/_lima/colima/ha.stderr.log")
FATA[0037] error starting vm: error at 'creating and starting': exit status 1

$ cat /home/bodsch/.config/colima/_lima/colima/ha.stderr.log
{"level":"debug","msg":"executing [ssh-keygen -t ed25519 -q -N  -C lima -f /home/bodsch/.config/colima/_lima/_config/user]","time":"2024-10-23T08:02:19+02:00"}
{"level":"debug","msg":"Creating iso file /home/bodsch/.config/colima/_lima/colima/cidata.iso","time":"2024-10-23T08:02:19+02:00"}
{"level":"debug","msg":"Using /tmp/diskfs_iso4268600307 as workspace","time":"2024-10-23T08:02:19+02:00"}
{"level":"debug","msg":"OpenSSH version 9.9.1 detected","time":"2024-10-23T08:02:19+02:00"}
{"level":"debug","msg":"AES accelerator seems available, prioritizing aes128-gcm@openssh.com and aes256-gcm@openssh.com","time":"2024-10-23T08:02:19+02:00"}
{"level":"info","msg":"hostagent socket created at /home/bodsch/.config/colima/_lima/colima/ha.sock","time":"2024-10-23T08:02:19+02:00"}
{"level":"debug","msg":"QEMU version 9.1.1 detected","time":"2024-10-23T08:02:19+02:00"}
{"level":"debug","msg":"firmware candidates = [/home/bodsch/.local/share/qemu/edk2-x86_64-code.fd /usr/share/qemu/edk2-x86_64-code.fd /usr/share/OVMF/OVMF_CODE.fd /usr/share/OVMF/OVMF_CODE_4M.fd /usr/share/edk2/ovmf/OVMF_CODE.fd /usr/share/qemu/ovmf-x86_64-code.bin /usr/share/edk2-ovmf/x64/OVMF_CODE.fd]","time":"2024-10-23T08:02:19+02:00"}
{"level":"info","msg":"Using system firmware (\"/usr/share/edk2-ovmf/x64/OVMF_CODE.fd\")","time":"2024-10-23T08:02:19+02:00"}
{"level":"info","msg":"Starting QEMU (hint: to watch the boot progress, see \"/home/bodsch/.config/colima/_lima/colima/serial*.log\")","time":"2024-10-23T08:02:19+02:00"}
{"level":"debug","msg":"qCmd.Args: [/usr/bin/qemu-system-x86_64 -m 2048 -cpu host -machine q35,accel=kvm -smp 2,sockets=1,cores=2,threads=1 -drive if=pflash,format=raw,readonly=on,file=/usr/share/edk2-ovmf/x64/OVMF_CODE.fd -boot order=c,splash-time=0,menu=on -drive file=/home/bodsch/.config/colima/_lima/colima/diffdisk,if=virtio,discard=on -drive id=cdrom0,if=none,format=raw,readonly=on,file=/home/bodsch/.config/colima/_lima/colima/cidata.iso -device virtio-scsi-pci,id=scsi0 -device scsi-cd,bus=scsi0.0,drive=cdrom0 -netdev socket,id=net0,fd=3 -device virtio-net-pci,netdev=net0,mac=52:55:55:a6:3f:36 -device virtio-rng-pci -display none -device virtio-vga -device virtio-keyboard-pci -device virtio-mouse-pci -device qemu-xhci,id=usb-bus -parallel none -chardev socket,id=char-serial,path=/home/bodsch/.config/colima/_lima/colima/serial.sock,server=on,wait=off,logfile=/home/bodsch/.config/colima/_lima/colima/serial.log -serial chardev:char-serial -chardev socket,id=char-serial-virtio,path=/home/bodsch/.config/colima/_lima/colima/serialv.sock,server=on,wait=off,logfile=/home/bodsch/.config/colima/_lima/colima/serialv.log -device virtio-serial-pci,id=virtio-serial0,max_ports=1 -device virtconsole,chardev=char-serial-virtio,id=console0 -chardev socket,id=char-qmp,path=/home/bodsch/.config/colima/_lima/colima/qmp.sock,server=on,wait=off -qmp chardev:char-qmp -chardev socket,path=/home/bodsch/.config/colima/_lima/colima/ga.sock,server=on,wait=off,id=qga0 -device virtio-serial -device virtserialport,chardev=qga0,name=io.lima-vm.guest_agent.0 -name lima-colima -pidfile /home/bodsch/.config/colima/_lima/colima/qemu.pid]","time":"2024-10-23T08:02:19+02:00"}
{"level":"info","msg":"Waiting for the essential requirement 1 of 4: \"ssh\"","time":"2024-10-23T08:02:19+02:00"}
{"level":"debug","msg":"executing script \"ssh\"","time":"2024-10-23T08:02:19+02:00"}
{"level":"debug","msg":"executing ssh for script \"ssh\": /usr/bin/ssh [ssh -F /dev/null -o IdentityFile=\"/home/bodsch/.config/colima/_lima/_config/user\" -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o NoHostAuthenticationForLocalhost=yes -o GSSAPIAuthentication=no -o PreferredAuthentications=publickey -o Compression=no -o BatchMode=yes -o IdentitiesOnly=yes -o Ciphers=\"^aes128-gcm@openssh.com,aes256-gcm@openssh.com\" -o User=bodsch -o ControlMaster=auto -o ControlPath=\"/home/bodsch/.config/colima/_lima/colima/ssh.sock\" -o ControlPersist=yes -p 40597 127.0.0.1 -- /bin/bash]","time":"2024-10-23T08:02:19+02:00"}
{"level":"debug","msg":"stdout=\"\", stderr=\"ssh: connect to host 127.0.0.1 port 40597: Connection refused\\r\\n\", err=failed to execute script \"ssh\": stdout=\"\", stderr=\"ssh: connect to host 127.0.0.1 port 40597: Connection refused\\r\\n\": exit status 255","time":"2024-10-23T08:02:19+02:00"}
{"level":"debug","msg":"qemu[stderr]: qemu-system-x86_64: -device virtio-vga: 'virtio-vga' is not a valid device model name","time":"2024-10-23T08:02:19+02:00"}
{"level":"info","msg":"Driver stopped due to error: \"exit status 1\"","time":"2024-10-23T08:02:20+02:00"}
{"level":"info","msg":"Shutting down the host agent","time":"2024-10-23T08:02:20+02:00"}
{"level":"debug","msg":"shutting down the SSH master","time":"2024-10-23T08:02:20+02:00"}
{"level":"debug","msg":"executing ssh for exiting the master: /usr/bin/ssh [ssh -F /dev/null -o IdentityFile=\"/home/bodsch/.config/colima/_lima/_config/user\" -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o NoHostAuthenticationForLocalhost=yes -o GSSAPIAuthentication=no -o PreferredAuthentications=publickey -o Compression=no -o BatchMode=yes -o IdentitiesOnly=yes -o Ciphers=\"^aes128-gcm@openssh.com,aes256-gcm@openssh.com\" -o User=bodsch -o ControlMaster=auto -o ControlPath=\"/home/bodsch/.config/colima/_lima/colima/ssh.sock\" -o ControlPersist=yes -O exit -p 40597 127.0.0.1]","time":"2024-10-23T08:02:20+02:00"}
{"error":"failed to execute `ssh -O exit -p 40597 127.0.0.1`, out=\"Control socket connect(/home/bodsch/.config/colima/_lima/colima/ssh.sock): No such file or directory\\r\\n\": exit status 255","level":"warning","msg":"failed to exit SSH master","time":"2024-10-23T08:02:20+02:00"}
{"level":"info","msg":"Shutting down QEMU with ACPI","time":"2024-10-23T08:02:20+02:00"}
{"level":"warning","msg":"Failed to remove SSH binding for port 40597","time":"2024-10-23T08:02:20+02:00"}
{"error":"dial unix /home/bodsch/.config/colima/_lima/colima/qmp.sock: connect: connection refused","level":"warning","msg":"failed to open the QMP socket \"/home/bodsch/.config/colima/_lima/colima/qmp.sock\", forcibly killing QEMU","time":"2024-10-23T08:02:20+02:00"}
{"level":"info","msg":"QEMU has already exited","time":"2024-10-23T08:02:20+02:00"}

[jeremiah]

I think the main issue is here;
"error":"failed to execute ssh -O exit -p 40597 127.0.0.1, out=\"Control socket connect(/home/bodsch/.config/colima/_lima/colima/ssh.sock): No such file or directory\\r\\n\": exit status 255","level":"warning","msg":"failed to exit SSH master","time":"2024-10-23T08:02:20+02:00"}

I will rerun the same commands on my machine and try to see if I can replicate your issue.

[bodsch]

Perhaps some important information about my system:

• OS: ArchLinux (daily updated)
• QEMU: 9.1.1
• libvirt: 10.8.0

libvirtd Service are running (maybe a problem?)

[abiosoft]

Oh, just realising you are running Linux.

I would need to be able to reproduce this. I only have access to Linux aarch64, so the experience may vary.

[zackees]

Hitting this on a github runner for mac arm. It looks like QEMU is crashing. I saw somewhere else that I have to downgrade to 9.0.2, as there is a bug in 9.1.0, if memory serves correct. I'm going to try that next.

Output log

Run bash install
  
==> Downloading https://ghcr.io/v2/homebrew/core/uv/manifests/0.4.25
==> Fetching uv
==> Downloading https://ghcr.io/v2/homebrew/core/uv/blobs/sha256:2d7e252c755fb313c4d7cdc7cd25ae5270062[14](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:14)0195ad26e0ca326de04a4ab47
==> Pouring uv--0.4.25.arm64_sonoma.bottle.tar.gz
==> Caveats
Bash completion has been installed to:
  /opt/homebrew/etc/bash_completion.d
==> Summary
🍺  /opt/homebrew/Cellar/uv/0.4.25: 17 files, 25.9MB
Using CPython 3.11.9 interpreter at: /Library/Frameworks/Python.framework/Versions/3.11/bin/python
Creating virtual environment with seed packages at: .venv
 + pip==24.3.1
 + setuptools==75.3.0
 + wheel==0.44.0
Activate with: source .venv/bin/activate
Installed 20 packages in 9ms
Obtaining file:///Users/runner/work/fastled-wasm/fastled-wasm
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Checking if build backend supports build_editable: started
  Checking if build backend supports build_editable: finished with status 'done'
  Getting requirements to build editable: started
  Getting requirements to build editable: finished with status 'done'
  Preparing editable metadata (pyproject.toml): started
  Preparing editable metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: docker in ./.venv/lib/python3.11/site-packages (from fastled_wasm==1.0.6) (6.1.3)
Requirement already satisfied: keyring in ./.venv/lib/python3.11/site-packages (from fastled_wasm==1.0.6) (24.1.1)
Requirement already satisfied: watchdog in ./.venv/lib/python3.11/site-packages (from fastled_wasm==1.0.6) (3.0.0)
Requirement already satisfied: livereload in ./.venv/lib/python3.11/site-packages (from fastled_wasm==1.0.6) (2.7.0)
Requirement already satisfied: download in ./.venv/lib/python3.11/site-packages (from fastled_wasm==1.0.6) (0.3.5)
Requirement already satisfied: packaging>=[14](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:15).0 in ./.venv/lib/python3.11/site-packages (from docker->fastled_wasm==1.0.6) (24.0)
Requirement already satisfied: requests>=2.26.0 in ./.venv/lib/python3.11/site-packages (from docker->fastled_wasm==1.0.6) (2.31.0)
Requirement already satisfied: urllib3>=1.26.0 in ./.venv/lib/python3.11/site-packages (from docker->fastled_wasm==1.0.6) (2.0.7)
Requirement already satisfied: websocket-client>=0.32.0 in ./.venv/lib/python3.11/site-packages (from docker->fastled_wasm==1.0.6) (1.6.1)
Requirement already satisfied: tqdm in ./.venv/lib/python3.11/site-packages (from download->fastled_wasm==1.0.6) (4.66.6)
Requirement already satisfied: six in ./.venv/lib/python3.11/site-packages (from download->fastled_wasm==1.0.6) (1.16.0)
Requirement already satisfied: jaraco.classes in ./.venv/lib/python3.11/site-packages (from keyring->fastled_wasm==1.0.6) (3.2.3)
Requirement already satisfied: importlib-metadata>=4.11.4 in ./.venv/lib/python3.11/site-packages (from keyring->fastled_wasm==1.0.6) (6.7.0)
Requirement already satisfied: tornado in ./.venv/lib/python3.11/site-packages (from livereload->fastled_wasm==1.0.6) (6.2)
Requirement already satisfied: zipp>=0.5 in ./.venv/lib/python3.11/site-packages (from importlib-metadata>=4.11.4->keyring->fastled_wasm==1.0.6) (3.[15](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:16).0)
Requirement already satisfied: charset-normalizer<4,>=2 in ./.venv/lib/python3.11/site-packages (from requests>=2.26.0->docker->fastled_wasm==1.0.6) (3.4.0)
Requirement already satisfied: idna<4,>=2.5 in ./.venv/lib/python3.11/site-packages (from requests>=2.26.0->docker->fastled_wasm==1.0.6) (3.10)
Requirement already satisfied: certifi>=2017.4.17 in ./.venv/lib/python3.11/site-packages (from requests>=2.26.0->docker->fastled_wasm==1.0.6) (2024.8.30)
Requirement already satisfied: more-itertools in ./.venv/lib/python3.11/site-packages (from jaraco.classes->keyring->fastled_wasm==1.0.6) (9.1.0)
Building wheels for collected packages: fastled_wasm
  Building editable for fastled_wasm (pyproject.toml): started
  Building editable for fastled_wasm (pyproject.toml): finished with status 'done'
  Created wheel for fastled_wasm: filename=fastled_wasm-1.0.6-0.editable-py3-none-any.whl size=3662 sha256=1145de0c22b7f30e3eacd47610b74bea7abf4c1e08ce1bdc1bd76f9b3875374e
  Stored in directory: /private/var/folders/g6/rgtlsw6n123b0gt5483s5_cm0000gn/T/pip-ephem-wheel-cache-w8z7qn2u/wheels/86/6f/e9/b3f17154fd3179462b93214cf32994ec69b7663310e3b5228c
Successfully built fastled_wasm
Installing collected packages: fastled_wasm
  Attempting uninstall: fastled_wasm
    Found existing installation: fastled_wasm 1.0.6
    Uninstalling fastled_wasm-1.0.6:
      Successfully uninstalled fastled_wasm-1.0.6
Successfully installed fastled_wasm-1.0.6
Uninstalled 1 package in 0.57ms
Installed 1 package in 2ms
Collecting black (from -r requirements.testing.txt (line 1))
  Downloading black-24.10.0-cp311-cp311-macosx_11_0_arm64.whl.metadata (79 kB)
Collecting isort (from -r requirements.testing.txt (line 2))
  Downloading isort-5.13.2-py3-none-any.whl.metadata (12 kB)
Collecting mypy (from -r requirements.testing.txt (line 3))
  Downloading mypy-1.13.0-cp311-cp311-macosx_11_0_arm64.whl.metadata (2.1 kB)
Collecting pytest (from -r requirements.testing.txt (line 4))
  Downloading pytest-8.3.3-py3-none-any.whl.metadata (7.5 kB)
Collecting ruff (from -r requirements.testing.txt (line 5))
  Downloading ruff-0.7.1-py3-none-macosx_11_0_arm64.whl.metadata (25 kB)
Collecting pytest-xdist (from -r requirements.testing.txt (line 6))
  Downloading pytest_xdist-3.6.1-py3-none-any.whl.metadata (4.3 kB)
Collecting click>=8.0.0 (from black->-r requirements.testing.txt (line 1))
  Downloading click-8.1.7-py3-none-any.whl.metadata (3.0 kB)
Collecting mypy-extensions>=0.4.3 (from black->-r requirements.testing.txt (line 1))
  Downloading mypy_extensions-1.0.0-py3-none-any.whl.metadata (1.1 kB)
Requirement already satisfied: packaging>=22.0 in ./.venv/lib/python3.11/site-packages (from black->-r requirements.testing.txt (line 1)) (24.0)
Collecting pathspec>=0.9.0 (from black->-r requirements.testing.txt (line 1))
  Downloading pathspec-0.12.1-py3-none-any.whl.metadata (21 kB)
Collecting platformdirs>=2 (from black->-r requirements.testing.txt (line 1))
  Downloading platformdirs-4.3.6-py3-none-any.whl.metadata (11 kB)
Collecting typing-extensions>=4.6.0 (from mypy->-r requirements.testing.txt (line 3))
  Downloading typing_extensions-4.12.2-py3-none-any.whl.metadata (3.0 kB)
Collecting iniconfig (from pytest->-r requirements.testing.txt (line 4))
  Downloading iniconfig-2.0.0-py3-none-any.whl.metadata (2.6 kB)
Collecting pluggy<2,>=1.5 (from pytest->-r requirements.testing.txt (line 4))
  Downloading pluggy-1.5.0-py3-none-any.whl.metadata (4.8 kB)
Collecting execnet>=2.1 (from pytest-xdist->-r requirements.testing.txt (line 6))
  Downloading execnet-2.1.1-py3-none-any.whl.metadata (2.9 kB)
Downloading black-24.10.0-cp311-cp311-macosx_11_0_arm64.whl (1.4 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.4/1.4 MB 41.3 MB/s eta 0:00:00
Downloading isort-5.13.2-py3-none-any.whl (92 kB)
Downloading mypy-1.13.0-cp311-cp311-macosx_11_0_arm64.whl (10.1 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10.1/10.1 MB 87.7 MB/s eta 0:00:00
Downloading pytest-8.3.3-py3-none-any.whl (342 kB)
Downloading ruff-0.7.1-py3-none-macosx_11_0_arm64.whl (9.8 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.8/9.8 MB 124.8 MB/s eta 0:00:00
Downloading pytest_xdist-3.6.1-py3-none-any.whl (46 kB)
Downloading click-8.1.7-py3-none-any.whl (97 kB)
Downloading execnet-2.1.1-py3-none-any.whl (40 kB)
Downloading mypy_extensions-1.0.0-py3-none-any.whl (4.7 kB)
Downloading pathspec-0.12.1-py3-none-any.whl (31 kB)
Downloading platformdirs-4.3.6-py3-none-any.whl (18 kB)
Downloading pluggy-1.5.0-py3-none-any.whl (20 kB)
Downloading typing_extensions-4.12.2-py3-none-any.whl (37 kB)
Downloading iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Installing collected packages: typing-extensions, ruff, pluggy, platformdirs, pathspec, mypy-extensions, isort, iniconfig, execnet, click, pytest, mypy, black, pytest-xdist
Successfully installed black-24.10.0 click-8.1.7 execnet-2.1.1 iniconfig-2.0.0 isort-5.13.2 mypy-1.13.0 mypy-extensions-1.0.0 pathspec-0.12.1 platformdirs-4.3.6 pluggy-1.5.0 pytest-8.3.3 pytest-xdist-3.6.1 ruff-0.7.1 typing-extensions-4.12.2
Warning: Treating docker as a formula. For the cask, use homebrew/cask/docker or specify the `--cask` flag. To silence this message, use the `--formula` flag.
==> Downloading https://ghcr.io/v2/homebrew/core/docker/manifests/27.3.1
==> Fetching dependencies for docker: docker-completion
==> Downloading https://ghcr.io/v2/homebrew/core/docker-completion/manifests/27.3.1
==> Fetching docker-completion
==> Downloading https://ghcr.io/v2/homebrew/core/docker-completion/blobs/sha256:d5e13e8755e02db6eee3448b95d8ce3acef2ca77f5edd5d57e70c8ca29e72982
==> Fetching docker
==> Downloading https://ghcr.io/v2/homebrew/core/docker/blobs/sha256:dcd25100f823e80d665ce0bed51fe50[16](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:17)a4839669cb8bbfbb2e5be0e26dcc545
==> Installing dependencies for docker: docker-completion
==> Installing docker dependency: docker-completion
==> Downloading https://ghcr.io/v2/homebrew/core/docker-completion/manifests/27.3.1
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/1263cdb88b6345d8473b526b63d34f02d95608dceaa69c6c4da074a8e9d3702b--docker-completion-27.3.1.bottle_manifest.json
==> Pouring docker-completion--27.3.1.all.bottle.tar.gz
🍺  /opt/homebrew/Cellar/docker-completion/27.3.1: 10 files, 342.2KB
==> Installing docker
==> Pouring docker--27.3.1.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/docker/27.3.1: 14 files, 25.6MB
==> Downloading https://ghcr.io/v2/homebrew/core/colima/manifests/0.7.5
==> Fetching dependencies for colima: capstone, dtc, libslirp, libssh, ncurses, snappy, vde, qemu and lima
==> Downloading https://ghcr.io/v2/homebrew/core/capstone/manifests/5.0.3
==> Fetching capstone
==> Downloading https://ghcr.io/v2/homebrew/core/capstone/blobs/sha256:2c1c08af469f0307469b70ff6c277d5971495db3a8c7ae38c98bd2c70745acbb
==> Downloading https://ghcr.io/v2/homebrew/core/dtc/manifests/1.7.1
==> Fetching dtc
==> Downloading https://ghcr.io/v2/homebrew/core/dtc/blobs/sha256:eb7120f37159256116e64121d375138261b8c72ffe81ef7291a3857d0360b732
==> Downloading https://ghcr.io/v2/homebrew/core/libslirp/manifests/4.8.0
==> Fetching libslirp
==> Downloading https://ghcr.io/v2/homebrew/core/libslirp/blobs/sha256:6c4d57761e16cc3a1cd0a9c02147d28072e80159d38bdb90216e980d51deb265
==> Downloading https://ghcr.io/v2/homebrew/core/libssh/manifests/0.11.1
==> Fetching libssh
==> Downloading https://ghcr.io/v2/homebrew/core/libssh/blobs/sha256:0a6184ee3bcd7d1ef5deb30a1534d04a90ba4f6070eddd5a05fe75b9acc20ea1
==> Downloading https://ghcr.io/v2/homebrew/core/ncurses/manifests/6.5
==> Fetching ncurses
==> Downloading https://ghcr.io/v2/homebrew/core/ncurses/blobs/sha256:ee5253473badfa0701deac8e9973a7358c761dd287f0d748f753130a7a6d2705
==> Downloading https://ghcr.io/v2/homebrew/core/snappy/manifests/1.2.1
==> Fetching snappy
==> Downloading https://ghcr.io/v2/homebrew/core/snappy/blobs/sha256:2b905dfed7d6c0b44de9c89a79a6aa69824758c2727dcffe95bc6ebef465cf3f
==> Downloading https://ghcr.io/v2/homebrew/core/vde/manifests/2.3.3
==> Fetching vde
==> Downloading https://ghcr.io/v2/homebrew/core/vde/blobs/sha256:3d2231810ad7229ba6a68[17](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:18)8d648ab1f13bdfe50b214cb2d299d644d66e03762
==> Downloading https://ghcr.io/v2/homebrew/core/qemu/manifests/9.1.1
==> Fetching qemu
==> Downloading https://ghcr.io/v2/homebrew/core/qemu/blobs/sha256:0f3764292c3cf30b0f5b2c8636768feade7c733a8b61beea8109fa1ef7df86cd
==> Downloading https://ghcr.io/v2/homebrew/core/lima/manifests/0.23.2
==> Fetching lima
==> Downloading https://ghcr.io/v2/homebrew/core/lima/blobs/sha256:be8e2b92961eca2f862f1a994dbef367e86d36705a705ebfa16d21c7f1366c35
==> Fetching colima
==> Downloading https://ghcr.io/v2/homebrew/core/colima/blobs/sha256:242c7c[18](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:19)09ab130b98d733c0b[19](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:20)46a3d9bd3ba2a8f35d5afea40ab0e6643d9a3
==> Installing dependencies for colima: capstone, dtc, libslirp, libssh, ncurses, snappy, vde, qemu and lima
==> Installing colima dependency: capstone
==> Downloading https://ghcr.io/v2/homebrew/core/capstone/manifests/5.0.3
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/f77d59d4c25d40ffcd60c4[20](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:21)fbcd75fc7821fdaec8c04b54dca354ecb3dd9384--capstone-5.0.3.bottle_manifest.json
==> Pouring capstone--5.0.3.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/capstone/5.0.3: 31 files, 22.4MB
==> Installing colima dependency: dtc
==> Downloading https://ghcr.io/v2/homebrew/core/dtc/manifests/1.7.1
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/9af2d1bdcb1bf2aa3d63869290ab4a3627ffd6cbabca2be328f51ec71bdd0150--dtc-1.7.1.bottle_manifest.json
==> Pouring dtc--1.7.1.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/dtc/1.7.1: 19 files, 626.4KB
==> Installing colima dependency: libslirp
==> Downloading https://ghcr.io/v2/homebrew/core/libslirp/manifests/4.8.0
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/6d0118aaacae7b522b8c6fd6c5a20c3d5ed9e43c01253fb70ef514620a3bfedf--libslirp-4.8.0.bottle_manifest.json
==> Pouring libslirp--4.8.0.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/libslirp/4.8.0: 12 files, 412.5KB
==> Installing colima dependency: libssh
==> Downloading https://ghcr.io/v2/homebrew/core/libssh/manifests/0.11.1
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/3591f41514c0ebe698a36753dce13e71fa33363993429a04af0da249f1eea04c--libssh-0.11.1.bottle_manifest.json
==> Pouring libssh--0.11.1.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/libssh/0.11.1: 25 files, 1.4MB
==> Installing colima dependency: ncurses
==> Downloading https://ghcr.io/v2/homebrew/core/ncurses/manifests/6.5
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/b2f8ce4e08b15832435170efd265346225ee388d5baab3d5c50e3a77c5673b5a--ncurses-6.5.bottle_manifest.json
==> Pouring ncurses--6.5.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/ncurses/6.5: 4,052 files, 9.9MB
==> Installing colima dependency: snappy
==> Downloading https://ghcr.io/v2/homebrew/core/snappy/manifests/1.2.1
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/b2e6bfcdbddf1d451a8dbbb6fc3c44a267b753ac1a889dbb0b9159bf31dacdd5--snappy-1.2.1.bottle_manifest.json
==> Pouring snappy--1.2.1.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/snappy/1.2.1: 19 files, 172.2KB
==> Installing colima dependency: vde
==> Downloading https://ghcr.io/v2/homebrew/core/vde/manifests/2.3.3
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/4e9503141162571c2cd[21](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:22)e89a9e61f524a7403ffe5ffe269f4a39ce5aef9f210--vde-2.3.3.bottle_manifest.json
==> Pouring vde--2.3.3.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/vde/2.3.3: 67 files, 1.3MB
==> Installing colima dependency: qemu
==> Downloading https://ghcr.io/v2/homebrew/core/qemu/manifests/9.1.1
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/1657512e610a3e8252efe616e2da3fe2a86b7d68dd73739430341c31397c857b--qemu-9.1.1.bottle_manifest.json
==> Pouring qemu--9.1.1.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/qemu/9.1.1: 165 files, 644.9MB
==> Installing colima dependency: lima
==> Downloading https://ghcr.io/v2/homebrew/core/lima/manifests/0.23.2
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/157f4cc1e8c9189dbe09385cc33c8e9ceebfdadba9[22](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:23)60aaa5c22c59a922d31c--lima-0.23.2.bottle_manifest.json
==> Pouring lima--0.[23](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:24).2.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/lima/0.23.2: 109 files, 202.5MB
==> Installing colima
==> Pouring colima--0.7.5.arm64_sonoma.bottle.tar.gz
==> Caveats
Bash completion has been installed to:
  /opt/homebrew/etc/bash_completion.d
To start colima now and restart at login:
  brew services start colima
Or, if you don't want/need a background service you can just run:
  /opt/homebrew/opt/colima/bin/colima start -f
==> Summary
🍺  /opt/homebrew/Cellar/colima/0.7.5: 11 files, 5.7MB
==> Caveats
==> colima
Bash completion has been installed to:
  /opt/homebrew/etc/bash_completion.d
To start colima now and restart at login:
  brew services start colima
Or, if you don't want/need a background service you can just run:
  /opt/homebrew/opt/colima/bin/colima start -f
time="20[24](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:25)-10-31T07:53:51Z" level=info msg="starting colima"
time="2024-10-31T07:53:51Z" level=info msg="runtime: docker"
time="2024-10-31T07:53:53Z" level=info msg="creating and starting ..." context=vm
time="2024-10-31T07:53:54Z" level=info msg="downloading disk image ..." context=vm
                                                                           0.0%
                                                                           1.1%
##                                                                         3.3%
####                                                                       5.7%
######                                                                     8.6%
#######                                                                   11.0%
#########                                                                 13.5%
###########                                                               15.9%
#############                                                             18.4%
###############                                                           20.8%
################                                                          23.2%
##################                                                        [25](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:26).7%
####################                                                      28.2%
#####################                                                     30.5%
#######################                                                   32.9%
#########################                                                 35.3%
###########################                                               37.8%
############################                                              40.1%
##############################                                            42.4%
################################                                          44.7%
#################################                                         47.1%
###################################                                       49.4%
#####################################                                     51.8%
#######################################                                   54.2%
########################################                                  56.6%
##########################################                                58.9%
###########################################                               61.1%
#############################################                             63.5%
###############################################                           66.0%
#################################################                         69.2%
###################################################                       71.8%
#####################################################                     74.2%
#######################################################                   76.8%
#########################################################                 79.3%
##########################################################                81.7%
############################################################              84.4%
##############################################################            86.7%
################################################################          89.0%
#################################################################         91.3%
###################################################################       93.7%
#####################################################################     96.1%
######################################################################    98.4%
######################################################################## 100.0%
time="2024-10-31T07:54:02Z" level=info msg="Terminal is not available, proceeding without opening an editor"
time="2024-10-31T07:54:02Z" level=info msg="Starting the instance \"colima\" with VM driver \"qemu\""
time="2024-10-31T07:54:02Z" level=info msg="QEMU binary \"/opt/homebrew/bin/qemu-system-aarch64\" seems properly signed with the \"com.apple.security.hypervisor\" entitlement"
time="2024-10-31T07:54:02Z" level=info msg="Attempting to download the image" arch=aarch64 digest= location=/Users/runner/Library/Caches/colima/caches/fc0bfb9256e1f61294f2c41fc95ff4feb6c0daafccfb3b435e2d972e39bc8432.raw
time="2024-10-31T07:54:02Z" level=info msg="Downloaded the image from \"/Users/runner/Library/Caches/colima/caches/fc0bfb9256e1f61294f2c41fc95ff4feb6c0daafccfb3b435e2d972e39bc8432.raw\""
time="2024-10-31T07:54:03Z" level=info msg="[hostagent] hostagent socket created at /Users/runner/.colima/_lima/colima/ha.sock"
time="2024-10-31T07:54:03Z" level=info msg="[hostagent] Using system firmware (\"/opt/homebrew/share/qemu/edk2-aarch64-code.fd\")"
time="2024-10-31T07:54:03Z" level=info msg="[hostagent] Starting QEMU (hint: to watch the boot progress, see \"/Users/runner/.colima/_lima/colima/serial*.log\")"
time="2024-10-31T07:54:03Z" level=info msg="SSH Local Port: 49[27](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:28)5"
time="2024-10-31T07:54:03Z" level=info msg="[hostagent] Waiting for the essential requirement 1 of 4: \"ssh\""
time="2024-10-31T07:54:03Z" level=info msg="[hostagent] Driver stopped due to error: \"signal: abort trap\""
time="2024-10-[31](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:32)T07:54:03Z" level=info msg="[hostagent] Shutting down the host agent"
time="2024-10-31T07:54:03Z" level=warning msg="[hostagent] failed to exit SSH master" error="failed to execute `ssh -O exit -p 49275 127.0.0.1`, out=\"Control socket connect(/Users/runner/.colima/_lima/colima/ssh.sock): No such file or directory\\r\\n\": exit status 255"
time="2024-10-31T07:54:03Z" level=info msg="[hostagent] Shutting down QEMU with ACPI"
time="2024-10-31T07:54:03Z" level=warning msg="[hostagent] Failed to remove SSH binding for port 49275"
time="2024-10-31T07:54:03Z" level=warning msg="[hostagent] failed to open the QMP socket \"/Users/runner/.colima/_lima/colima/qmp.sock\", forcibly killing QEMU" error="dial unix /Users/runner/.colima/_lima/colima/qmp.sock: connect: connection refused"
time="2024-10-31T07:54:03Z" level=info msg="[hostagent] QEMU has already exited"
time="2024-10-31T07:54:03Z" level=fatal msg="exiting, status={Running:false Degraded:false Exiting:true Errors:[] SSHLocalPort:0} (hint: see \"/Users/runner/.colima/_lima/colima/ha.stderr.log\")"
time="2024-10-31T07:54:03Z" level=fatal msg="error starting vm: error at 'creating and starting': exit status 1"

Here is my github script:

name: Build Compiler for Docker arm64

on: [push]

jobs:
  test:
    runs-on: ${{ matrix.os }}
    strategy:
      matrix:
        python-version: [3.11]
        os: [macos-latest-xlarge]


    steps:
    - uses: actions/checkout@v4
    - name: Set up Python ${{ matrix.python-version }}
      uses: actions/setup-python@v4
      with:
        python-version: ${{ matrix.python-version }}
    - uses: docker-practice/actions-setup-docker@master
      timeout-minutes: 25



    - name: Print platform and cpu arch
      run: |
        echo "platform=$(uname -s)"
        echo "cpu_arch=$(uname -m)"
        echo "cpu_arch=$(uname -m)"

    - name: Install dependencies And run.
      run: |
        bash install
        brew install docker
        brew install colima
        colima nerdctl install
        colima start
        python build_docker_image.py --docker-pass ${{ secrets.DOCKER_PASSWORD }}

[thorfour]

I'm also running into this issue. Did this ever get resolved somehow?

[zachcb]

I'm also running into this issue. Did this ever get resolved somehow?

The fix for me was to install qemu-full rather than qemu-base. I'm on Arch 6.17.8