How to launch A/B tests on Shopify with Claude. No theme duplication. No code paste. No developer.
By MoreConversions · From our database of 1,000+ A/B tests
What this is
The simplest accurate playbook for running an A/B test on Shopify when you're a brand operator, not a developer.
You give Claude:
- A hypothesis (one sentence). What you want to test and why.
- Optional: a Figma frame from the Design playbook.
- Read access to your live store (Shopify Storefront MCP, optional).
Claude returns:
- The variant JS/CSS that produces the change.
- A Convert.com A/B experiment configured with that variant via the Convert MCP.
- A QA + launch checklist.
You spend ~20 minutes per test. Zero theme duplication. Zero code paste into Shopify admin (after the one-time tracking script install). Convert serves the variant via its tracking script; your live theme stays untouched.
There is exactly one A/B testing platform on the market with a real MCP server: Convert.com. That's the entire reason this playbook exists. With the Convert MCP, Claude:
- Creates the experiment programmatically
- Injects the variant via Convert's tracking script (no theme changes per test)
- Reads experiment status, traffic, results