Add AI skills to drive end-to-end tests

[crazytonyli]

Description

This PR adds two skills:

1. ios-sim-navigation. This skill is basically a reference of WDA, which Claude Code can use to interact with iOS simulators.
2. ai-test-runner. This skill describes a workflow for running end-to-end tests on iOS simulators using the ios-sim-navigation skill.

You can use ios-sim-navigation to verify your code changes. For example, you can add this to your prompt:

After completing the code changes, use the general-purpose agent with the ios-sim-navigation skill to verify the changes on the iPhone 17 Simulator.

You can try the ai-test-runner locally using a prompt like this:

Run the test case at Tests/AgentTests/ui-tests/create-blank-page.md on the iPhone 17 simulator. Here are the test site credentials: [url], [username], [application-password].

I have translated some UI tests into test cases in Tests/AgentTests/ui-tests. If you want, you can ask Claude Code to run the full test suite, which takes 40+ minutes. You can also ask Claude Code to run on two simulators simultaneously, which halves the runtime.

[dangermattic]

	1 Warning
⚠️	This PR is larger than 500 lines of changes. Please consider splitting it into smaller PRs for easier and faster reviews.

Generated by 🚫 Danger

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

[wpmobilebot]

📲 You can test the changes from this Pull Request in Jetpack by scanning the QR code below to install the corresponding build.

	App Name	Jetpack
	Configuration	Release-Alpha
	Build Number	31375
	Version	PR #25354
	Bundle ID	com.jetpack.alpha
	Commit	4ce4ab4
	Installation URL	6pjn4fq5kcv9g

Automatticians: You can use our internal self-serve MC tool to give yourself access to those builds if needed.

[wpmobilebot]

📲 You can test the changes from this Pull Request in WordPress by scanning the QR code below to install the corresponding build.

	App Name	WordPress
	Configuration	Release-Alpha
	Build Number	31375
	Version	PR #25354
	Bundle ID	org.wordpress.alpha
	Commit	4ce4ab4
	Installation URL	68ui02in8rn88

Automatticians: You can use our internal self-serve MC tool to give yourself access to those builds if needed.

[wpmobilebot]

🤖 Build Failure Analysis

This build has failures. Claude has analyzed them - check the build annotations for details.

[kean]

Hey Tony, is the plan to merge the PR or is it only for evaluation purposes? I've tried running it but quickly realized that it requires https://github.com/facebookarchive/WebDriverAgent, which I don't currently have installed. Would you mind sharing the setup steps required to get these skills to work please?

What was your experience running ai-test-runner? Can you share how the output looks like from your test runs?

[crazytonyli]

@kean I think we can merge this PR. I'll ask the apps infra team to see if it's possible to run the tests on CI, which I'll leave them to explore now that a locally runnable pipeline is implemented in this PR.

Have you tried the example prompts in the PR description? Do they work for you? Yes, WebDriveAgent is needed. But the skill should take care of that (cloning, running, etc), you should not need to do anything other than click "yes".

[kean]

Yes, WebDriveAgent is needed. But the skill should take care of that (cloning, running, etc)

I tried ios-sim-navigation yesterday and it tried invoking WDA in multiple ways, so I ended up aborting it mid-process. I'm going to give it another go when I get time, prioritizing other PR reviews for now if you don't mind.

[crazytonyli]

I tried ios-sim-navigation yesterday and it tried invoking WDA in multiple ways

By "invoking WDA", do you mean making curl http://localhost... requests? When I use it, I just skip permission checks. Because CC may invoke the curl command in different ways: multiple commands in one line, commands with an env var, or even a full-on bash script.

[kean]

The PR looks good. I replied to the RFC as well. Nice work 👏