Skip to main content

Theme Scientist A/B Testing


13 ratings
AAfterShip Mobile User
Great concept poor execution. I have been trying to get in touch with someone from support for the past couple days. The metrics that are being shown on the AB test are not accurate and due to that we are being shown false metrics on which test is winning.
AAfterShip Mobile User
This app is easily one of our favorites and most used tools. We've used it to test multiple growth ideas and increase our revenue by over $50k a year so far. Developers are responsive, kind and very helpful. They've even introduced me to other products and people that could have been a better option for us. We want to test store-wide features so we create 2 versions of the same theme, and every 24 hours the theme switches. It's obviously more ideal to split visitors live, but Shopify seems to restrict developers from creating this experience. Everyone on our team is always really excited about our tests and results. My 2 requests would be to add slightly more robust insights on the results table and to be able to split audiences live (fingers crossed one day shopify will let it be built!)
AAfterShip Mobile User
Great app! Our team has been using this app for over a year to run A/B tests on products and website features - always testing something. We use a set it and forget it style: create a test, wait a few weeks or so, analyze the results, then start another test. The best for us has been testing product prices. Finding a better product price is golden!
AAfterShip Mobile User
I really like the interface and i am nearly fully happy! BUT i would like to set the swapping times to something uneven, like 1/3/5/7/9 hours in order to really give every option the same time frames during a day. If i put my A/B test to swap every 4 hours for example, A would get 8-12 and 16-20 o clock every single day, which would mix up by swapping them every 3 hours. I would love, that you update this feature in the near future and ill happily give you 5 stars Great job guys! Love the update! Cheers :)
AAfterShip Mobile User
Great app for those looking to make more informed decisions when it comes to theme updates. Also the support team is very responsive.