Skip to content

Messing around with macos tests#1656

Open
jbusecke wants to merge 9 commits intomainfrom
test-on-macos
Open

Messing around with macos tests#1656
jbusecke wants to merge 9 commits intomainfrom
test-on-macos

Conversation

@jbusecke
Copy link
Contributor

@jbusecke jbusecke commented Feb 17, 2026

This is an attempt to expand the full testing (not just unit tests) to macos runners.

Apparently it is very difficult (if not impossible?) to run docker within (already virtualized?) runners (see here).

My initial hope was to catch #1654 here before implementing a fix, but it seems like this is a behavior that was either changed after macos 15 or is somehow unique to my machine.

Either way I thought it could be good to test fully against at least one macos version?

The remaining question is if its worth carrying these tests as they are significantly slower (still working on that).

Positive side effect of this endeavour: With claudes help I was able to reorganize the order and start compiling the tests while the docker setup finishes in parallel, which saves ~2 min on each test:

Before

image image

After

image image

@jbusecke
Copy link
Contributor Author

The first successful macos full test took almost 30 min:
image

@jbusecke
Copy link
Contributor Author

Brought the macos test down to
image

@jbusecke jbusecke requested review from li-em and paraseba February 17, 2026 21:14
@jbusecke
Copy link
Contributor Author

Happy to revert the full macos-15-intel test for the sake of time, but could leave in the reordering of steps to speed up the other CI runs.

@jbusecke jbusecke marked this pull request as ready for review February 17, 2026 21:16
@li-em
Copy link
Contributor

li-em commented Feb 17, 2026

Would it be worth to run full tests only on macos-latest, and just to unit tests in macos-15-intel (like before)?

Sorry, should have reviewed it properly before, you mention it is not possible to run docker on arm 🙈

@jbusecke
Copy link
Contributor Author

Yeah its a real bummer TBH, but maybe that gets solved when all the runners are m4 or whatever...not holding my breath.

@jbusecke
Copy link
Contributor Author

huh wait, why is it breaking now?

@jbusecke
Copy link
Contributor Author

Ok seems like (atleast the ubuntu failure was a flaky one).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants