Shogun ‑ AB Testing
by Shogun Labs, Inc. · launched
View in Shopify App Store ↗Reviews (46)
The UI is very clean, the testing options are robust, and the customer support is phenomenal.
Developer reply ·
Thank you for the awesome feedback! We’re glad you’re enjoying the clean UI and robust testing options. It’s especially great to hear that our Support team has made a positive impression. We really appreciate your support! 😊 Sweetan | Client Services Shogun
Support is really good, responsive and helpful. The tool it's is easy to use and get testing up and running.
Developer reply ·
Thank you so much for the kind words! We’re really glad to hear that you’ve found the tool easy to use and that our Support team has been responsive and helpful. We really appreciate you taking the time to share your experience! 🙌 Sweetan | Client Services Shogun
Very quickly responded and helped in a great way. Also the app improvements show every KPI you need, with a lot of filters to filter on what actually works.
Developer reply ·
Thank you so much for the fantastic feedback! We’re glad to hear our support team was able to help quickly and effectively. It’s also great to know you’re finding the reporting and filtering options useful for identifying what’s actually working. We’re always looking to make Shogun A/B Testing more powerful and easier to use, so we really appreciate your support! Sweetan | Client Services Shogun
This app has been super useful for theme & template testing for us! The support team is very responsive and helpful when troubleshooting issues, a great team to work with!
Developer reply ·
Hi there, thanks for sharing your feedback with us. We're thrilled to hear that Shogun A/B Testing has been valuable for your theme and template testing. It's also wonderful to know our support team has been responsive and helpful whenever you've needed assistance. We truly appreciate your kind words and look forward to continuing to support your optimization efforts. Please let us know if there is anything we can assist you with. Thanks for being a part of the Shogun community! :) Sweetan | Client Services Shogun
Amazing app, good to do A/B test. Very easy to understand the metrics and setup tests
Developer reply ·
Thank you so much for the wonderful feedback! We're delighted to hear you're enjoying the app and finding it easy to set up A/B tests and understand the results. We believe experimentation should be simple and actionable, so it's great to know the metrics and workflow are helping you make data-driven decisions. We truly appreciate your support! Sweetan | Client Services Shogun
We've had a great experience using Shogun's A/B Testing app as part of a major website refresh and optimization initiative for IGK Hair. Rather than relying on assumptions, we were able to test multiple PDP layouts, content hierarchies, and merchandising strategies with real customer traffic to understand what truly resonated with our shoppers. The insights we gained were instrumental in shaping our rebuild and gave us the confidence to make data-driven decisions throughout the redesign process. The platform was easy to implement, the testing experience was seamless, and the reporting made it simple to identify winning experiences. If you're planning a website redesign or looking to optimize your PDPs, we highly recommend Shogun A/B Testing. It's been a valuable part of our CRO toolkit and helped us launch a stronger, more customer-centric shopping experience.
Developer reply ·
Thank you so much for taking the time to share such a thoughtful review! We're thrilled to hear that Shogun A/B Testing played a valuable role in your website refresh and optimization efforts. It's especially rewarding to know the platform helped you validate decisions with real customer data rather than assumptions. Enabling teams to confidently test PDP layouts, content strategies, and merchandising experiences is exactly what we designed the app to do, so it's great to hear the insights helped shape your redesign. We're also glad you found the implementation, testing workflow, and reporting intuitive and seamless. Thank you for making Shogun a part of your CRO toolkit and for recommending us to others. We look forward to supporting your optimization journey as you continue to grow! Sweetan | Client Services Shogun
This app already helped us a lot with optimizing our CRO! The dashboard works easy and intuitive and gives us insights we didn't have before.
Developer reply ·
Thank you so much for the review and the feedback! We're delighted to hear that Shogun is already helping you optimize your conversion rate and uncover valuable insights. It's great to know you're finding the dashboard intuitive and easy to use. That's exactly the experience we aim to deliver. We appreciate your support and look forward to helping you continue discovering new opportunities to grow! Sweetan | Client Services Shogun
WORST APP EVER - MY PRODUCT PHOTOS LAGGED AND DID NOT WORK / THE PRICE EVEN AFTER UN INSTALLING KEPT CHANGING . Subject: Re: Toothy - pricing test issue Hi Sweetan, Thanks for looking into this. Before reinstalling or sharing collaborator access, I want to share what I've found on my end, because I think it points to the actual cause. After uninstalling Shogun, I found that Shogun had written code directly into my theme files rather than only using app embeds/blocks. Specifically: 1. A snippet called `snippets/product-media-gallery.liquid` had Shogun-authored Liquid code reading from metafields under the `app--214825828353` namespace (`product-pricing`, `product-variant-pricing`, `test-media-1` through `test-media-4`). This code used `{% paginate %}` on values that aren't valid paginateable objects, which caused a "Liquid error: Array is not paginateable" on my live product pages. 2. Separately, I found a file called `snippets/shogun-optimizer.liquid`, labeled in its own comments as "Auto-generated by Shogun-AB." This file contains embedded, minified JavaScript that appears to run content-type detection across templates and includes a `cartCreate` GraphQL mutation. This file was still present and apparently still active on my storefront after I had already uninstalled the app. 3. The pricing metafields under `app--214825828353` also still exist on my products, since metafields persist independently of whether the app is installed. This is very likely why the price kept changing even after uninstall — the leftover Liquid/JS was still reading that stored data. Given this, before I reinstall anything or share collaborator access, I'd like to understand: - Does reinstalling the app actually remove or replace `shogun-optimizer.liquid` and the leftover metafields, or does it just resume using them? - Is there a clean uninstall process that removes all injected snippets and metafields, rather than leaving them orphaned in the theme? - Can you confirm whether the `cartCreate` mutation in that script ever affects the price actually charged at checkout, separate from what's displayed on the page? I want to be sure no customers were charged incorrectly during the test. I'd rather resolve this by removing the leftover code and metafields directly, since I already have a good picture of what was left behind. If there's a specific reason full collaborator access is necessary beyond what I've described above, let me know and I'm happy to discuss it further. Thanks,
Developer reply ·
---UPDATE - August 7, 2026--- Hi again, Hamad. It has been a while, and we haven't heard back from you here or in the email thread. I wanted to check if the information we provided previously has helped. Hoping to hear back from you. Sweetan | Client Services Shogun ------------------------------------------- ---UPDATE - July 13, 2026--- Hey there, Hamad. I just wanted to check if you received the last update and if that has helped. I am also reaching out via the email thread, and we'd appreciate it if you could reply back to us. Thanks for your patience and understanding. Sweetan | Client Services Shogun ----------------------------------------------- ---UPDATE - July 8, 2026--- Hi Hamad, Thank you again for taking the time to investigate this so thoroughly. We shared your findings with our engineering team, and I wanted to address each of the points you raised. Regarding `snippets/shogun-optimizer.liquid`, you're correct that this file can remain in the theme after the app is uninstalled. Once the app is uninstalled, Shopify immediately invalidates our API tokens, which means we're no longer able to modify the theme or remove files as part of a cleanup process. That said, the optimizer includes a safeguard where, if it hasn't received a refreshed configuration for approximately 24 hours, it automatically stands down. This is intended to prevent visitors from continuing to receive experiments after the app has been uninstalled. With respect to `snippets/product-media-gallery.liquid`, this is an existing theme snippet that's responsible for rendering your product image gallery. During an AI Theme Modification, this is one of the files that is commonly updated so that Shogun can swap in the appropriate media for products participating in a test. The behavior you described- reading the media metafields and displaying the corresponding images for the active variation is expected. You also asked whether a syntax error could have been introduced. While our AI-generated modifications go through validation, no automated process is perfect, and it's possible for an issue to slip through in certain scenarios. This is why we recommend reviewing the modified theme and verifying that key pages are functioning as expected before publishing it. We'd be happy to review your theme with you or help rerun the theme modification if necessary to check this better. Regarding the product metafields, our expectation is generally that Shopify manages app-owned data on uninstall. However, we've seen reports from other developers that, in some cases, app-owned metafields can remain after an app is removed due to Shopify platform behavior. To answer your remaining questions: * Reinstalling the app **does not** automatically restart or resume paused tests. It performs the necessary setup, but any previously paused optimization remains paused unless you explicitly start it again. * The `cartCreate` mutation does **not** modify the price charged at checkout. It simply passes the selected variant to the cart. It has no effect on the final checkout pricing. * The cart transform function is managed by Shopify and is automatically removed when the app is uninstalled, so it is no longer active after uninstall. It is possible you were seeing the cached version on your end. We really appreciate the effort you've put into documenting what you found. Collaborator access would still be valuable because it would allow our engineering team to inspect the current state of your theme and configuration directly, verify whether there are any lingering issues specific to your store, and determine whether there's anything we can improve on our side. If you're open to it, we'd be happy to continue the investigation together. Thanks again for your detailed report, and I look forward to hearing from you. Sweetan Shogun Support ------------------------------------------- Hi Hamad, we're sorry to hear about your experience. I see you reinstalled our app on July 2, ran the test for a few hours, stopped the test, and then uninstalled the app. We weren't able to locate any support conversations under the email address associated with the account. If you contacted us using a different email address, please let us know; we'd be happy to look into that correspondence. That should help us to analyze this better for you. Regarding the pricing, when a pricing test is started, paused, or stopped, Shogun updates the related data to ensure pricing remains consistent across your storefront. That said, we'd like to investigate your specific experience thoroughly to understand what happened. I've reached out to you via email to gather a few additional details, and I'll also be sending a Shopify Collaborator access request so our technical team can investigate. We'd really appreciate your reply so we can get to the bottom of this and work toward a resolution. Thanks. Sweetan | Client Services Shogun
Developer reply ·
Hey there, thank you so much for taking the time to leave us a review. Please let us know if there is anything we can help you with. Sweetan | Client Services Shogun
it f*cked up a live theme. Now I have to figure out what to do in the middle of the day while traffic enter the broken theme.
Developer reply ·
Hey there, Kevin. We are sorry to hear about the issues that have led to this experience and review of our app. We want to understand the issue better so that we can analyze and help you better. When we checked the internal logs, we noticed that our AB testing app was installed and the Pro plan's trial was selected. You then upgraded the free trial to our Unlimited plan in order to run the Price test. You ran the theme modification, which is required to run a price test. It looks like the theme modification was completed correctly. We then notice that you left a review, and then deleted the test that you were working on. Could you please help us to understand what issue you were noticing on the live theme? I also don't see any support outreach, as our team is more than happy to help. Our product team has reached out to you via email, and I am reaching out in a separate email thread to gather some additional information and gain some clarity so we can help. We would greatly appreciate it if you could reply to us. Thanks for your support and understanding Sweetan | Client Services Shogun
Developer reply ·
Hey there, Manjit. I apologize for any inconvenience that has led you to leave this review. I wanted to check if there was an issue that you were facing with our AB app. I see our app was uninstalled back in April, April 30, and I also could not find any support conversations under your email address, which would help to understand any issues. This review was left today, a month after the app was uninstalled, and we wonder what went wrong. I was checking the logs and I could not see any AB tests that were set. Could you please help us with the issue that you are/were facing? I am reaching out via email to understand this further so that we can assist you. We will look forward to hearing back from you. Sweetan | Client Services Shogun
AMAZING
Developer reply ·
Hi there, thank you so much for leaving us a review. Sweetan | Client Services Shogun
Shogun A/B testing is really poor and full of bugs. My store theme got unpublished without notice. It publish duplicated theme that created month ago. Now my entire store is messed up. This kind of sneaky conduct has caused me order losses. I paid $119 for the service, but the product detail testing function fails to work. I cannot even edit and adjust product descriptions normally.
Developer reply ·
----UPDATE Aug 7, 2026---- Hi again, Shenghai. I hope you are doing well. It has been a while, and we did not hear back from you here or in the email thread. I just wanted to check and reach out again to see if we can still help you. Thanks for your understanding and support. Sweetan | Client Services Shogun ------------------------------------------ Hey there, Shenghai. Thanks for sharing your feedback. We apologize for the inconvenience you faced that has led to this feedback. I was looking at the use case and your account, and I want to let you know that when you start/run a product details test, we set up a duplicate theme that has all the required adjustments for you to make the changes to the variant. We then publish this modified theme. You can treat the modified theme as the new main theme moving forward, and modify that in case you wish to modify anything in the theme. However, if you want, once the test ends, you can republish the old theme again. Also, about the product details, I wanted to check if you had made changes to the description on the original. When you change the product description, you may want to re-run theme modifications if you have already run it on a previous version. This ensures the theme is set correctly and you can make changes to the variant B of your test. I see you had run a few product details tests previously, and they were all for the same product. Having said that, we would love to analyze the issue for you and help you better. I have reached out to you via the same chat thread and we would appreciate if you could reply back to us We appreciate your support. Sweetan | Client Services Shogun
Doesnt allocate traffic evenly, sending 3/4 bos to A, leading to unusable test results. Support team published a theme without our approval
Developer reply ·
Hi Tim, Thank you for taking the time to share your feedback. I’m really sorry to hear how frustrating this experience has been. I’d like to clarify one important point: we do not publish a theme without your approval. Can you please confirm which theme you would refer to, or would you be referring to the activity log? Regarding the traffic split you experienced, we completely understand how this impacted your confidence in the test results. As mentioned previously in the email thread by my colleague, James, we have identified cases where bot traffic can skew experiment distribution by behaving like normal visitors. This is something our team is actively working on improving, so test data remains reliable. We truly appreciate you raising both of these concerns and giving us the chance to investigate and also process a refund for both your invoices. We'll look forward to hearing back from you on the same email thread so that we can look at the other concerns for you. Thanks for your support. Sweetan | Client Services Shogun
I started an AB test. It deleted all of my product images and made some of my apps broken.
Developer reply ·
Hi there, We're very sorry for the experience you had here. We understand the impact issues like this can have on your store and appreciate you bringing it to our attention. As requested, we’ve reached out directly and are awaiting your reply so we can investigate this properly with you. We’re committed to understanding exactly what happened, why the safeguards in place didn’t behave as expected, and helping get everything fully resolved. We take issues like this very seriously and are looking forward to working with you to get this fixed. James Shogun Support
Great A/B testing and very simple to use. I had a question and Sweetan helped me out and went in depth. Thank you
Developer reply ·
Hi there, Thanks for taking the time and leaving us a review. I am so glad that I was able to help and answer the question. We are here to help and if you bump into any issues, please don't hesitate to reach out. Thanks for your support. Sweetan | Client Services Shogun
I am very impressed with this plugin. A/B testing used to be so complex and expensive. This makes it so easy, you dont even need a developer. Well done guys.
Developer reply ·
Thank you so much for the amazing feedback! We’re thrilled to hear the app has made A/B testing easier and more accessible for your team. Making powerful optimization tools simple to use without needing a developer is exactly what we aim for. We really appreciate your support and are excited to keep helping you test, learn, and grow! Sweetan | Client Services Shogun
really good, super easy to use
Developer reply ·
Thank you for the great feedback! We’re so glad to hear you’re finding the app easy to use. That’s exactly the experience we aim to create. We really appreciate your support! Sweetan | Client Services Shogun
Great app and great customer support team.
Developer reply ·
Thanks for leaving us a review and sharing your feedback. We are glad to hear that you are enjoying the app and having a great experience with our support team. Please let us know if there is anything else we can assist you with. Sweetan | Client Services Shogun
Developer reply ·
We’re so grateful for the review! If there’s ever anything we can do to make your experience even better, we’re always here to help. Sweetan | Client Services Shogun
Great app! Helped us pull another 12% on our best-selling product. New Pricing testing function is really cool too. Great support team.
Developer reply ·
Wow! That’s amazing to hear! 🚀 A 12% lift on your best-selling product is a huge win. We’re so glad the new Pricing Testing feature is delivering value for you, and it’s great to hear our support team has been there when you needed them. Thanks so much for sharing your results. We’re excited to keep helping you grow! Sweetan | Client Services Shogun
Developer reply ·
Hey there, thanks for leaving us a review. We hope you are having a great experience with the app. Let us know if there is anything we can help you with. Sweetan | Client Services Shogun
Developer reply ·
Thank you so much for your review. Please let us know if there is anything we can help you with. Sweetan | Client Services Shogun
Developer reply ·
Hi there, thanks for taking the time and sharing your feedback with us. Please let us know if there is anything we can help you with. Sweetan | Client Services Shogun
great help!
Developer reply ·
Thank you for your kind words. We’re always here if you need anything else. Sweetan | Client Services Shogun
Developer reply ·
Hey there, we appreciate the feedback. Please let us know if there is anything we can help you with. Sweetan | Client Services Shogun
Developer reply ·
Thank you so much for taking the time and sharing our feedback with us. Please let us know if there is anything we can help you with. Sweetan | Client Services Shogun
Developer reply ·
Thank you so much for leaving us a review! ⭐ We really appreciate your support. Sweetan | Client Services Shogun
Developer reply ·
Thank you so much for leaving us a review! We really appreciate your support. Let us know if there is anything we can help you with in the future. 😊 Sweetan | Client Services Shogun
As a first-time user of A/B testing apps on Shopify, I found Shogun an easy-to-use, intuitive tool for improving my pages. I had some questions, which the customer service team answered right away. Overall, a great experience!
Developer reply ·
Thank you for sharing your first experience with A/B testing on Shopify! 🎉 We’re so glad you found Shogun intuitive and that our support team could assist you quickly. Thrilled to hear it’s been a great experience for you! Sweetan | Client Services Shogun
Great app for testing landing pages and product offers, super handy for quick A/B tests on Shopify, and the results are easy to understand!
Developer reply ·
Thanks a lot for the awesome feedback! 🙌 We’re so glad the app is making your A/B testing easier and helping you optimize landing pages and offers. Here’s to more winning experiments! Please let us know if there is anything that we can help you with. 😊 Sweetan | Client Services Shogun
We had some issues at first, but the app runs smoothly now. Their customer service is excellent, and it’s clear there’s a strong, dedicated team behind this product.
Developer reply ·
Hi there, Jesse. Thank you for sharing your experience! We’re glad everything is running smoothly now and that our support team could assist you. Your kind words about our team mean a lot. We’re dedicated to making sure you have the best experience possible! 😊 Please let us know if you bump into any other issues and we'll be here to assist you. Sweetan | Client Services Shogun
This is by far the easiest app the navigate, but the customer support was next level helpful!! helped me problem solve a very complicated issue i was stressing over in a matter of 20 mins.
Developer reply ·
Hi there, Sarah! Thank you so much for your kind words! 😊 It was great to communicate with you. We’re thrilled to hear you found the app easy to use and that our support team could quickly help resolve your issue 🚀✨ Please let us know if there is anything else we can assist you with. Sweetan | Client Services Shogun
Amazing app - feels like a native Shopify app, and is super easy to use and has everything you would want. 10/5
Developer reply ·
Thank you so much for the amazing feedback! We're thrilled to hear that the app feels like a native part of Shopify and gives you everything you need. Your "10/5" rating truly made our day! 🙌 If you ever have questions or suggestions, we're always here to help. 😊 Sweetan | Client Services Shogun
We've been using this tool for a few weeks, and so far it's working great. The support from the Shogun team has been amazing. It's easy to configure and set up tests, and the pricing is excellent.
Developer reply ·
Thank you so much for leaving us a review. We are super glad to hear that your experience with the app has been amazing and that you are finding the tests to be easy to configure. We also appreciate your feedback on the pricing. I will be happy to share the kind words with our entire team. Please let us know if there is anything we can help you with. 😊 Sweetan | Client Services Shogun
Highly recommend this app for ab testing page templates across home, products, pages, collections for shopify.
Developer reply ·
Hey there, thank you so much for the honest recommendation. We are glad to hear that you are using the A/B test app across your store and pages to make the most out of it. Thanks. Please let us know if there is anything we can help you with. 😊 Sweetan | Client Services Shogun
We've been using this A/B testing app on our Shopify store, and it's been an absolute game-changer. The setup is incredibly straightforward — no coding required, and the interface is clean and intuitive. We were able to launch our first test in minutes. What really stands out is how fast we started seeing results. Within just a few days, we had actionable insights that helped us improve our conversion rate. The app gives clear data on what version performs better, so there's no guesswork. It's also very affordable compared to other tools out there. it's the perfect solution to test headlines, product images, pricing, and more — without breaking the bank. Highly recommended for anyone looking to optimize product pages quickly and easily. Simple, powerful, and effective.
Developer reply ·
Hi there, thank you so much for leaving us a review and sharing your feedback with us. We are super glad to hear that you are finding our new A/B testing app useful and that the setup has been straightforward. While working on the app, our team strived to ensure the app and the interface were easy to use and the settings were right in front. 😊 I will be happy to share the kind words and this helpful feedback with the entire Shogun team so that we can continue to work on the app and improve your experience. Thanks for the honest recommendation, it means a lot. Let us know if there is anything we can help you with. ❤️ Sweetan | Client Services Shogun
As the CEO of a mobile app company, I recognize the crucial role A/B testing plays in enhancing user experiences, driving revenue, and refining our products and services. For me, the A/B testing feature from Shogun has been a reliable and straightforward tool for this purpose. The app is remarkably intuitive and easy to set up! One aspect that stands out to me is their excellent customer support. The team is responsive and always willing to help, which is invaluable during the testing process. They are also open to hearing feature suggestions, showing their dedication to improvement and user feedback.
Developer reply ·
Hey there, Vanessa. Thanks for stopping by and sharing your feedback in the form of this amazing review. ❤️ We are super glad to hear that our A/B testing app has been a reliable and straightforward tool when it comes to driving revenue and enhancing user experiences. Your kind words and feedback helps us to continuously improve the app further so that we can enhance your experience as well. Thanks for testing the app and we are happy to hear that it has been easy to set up. Our support team is always here to assist you and yes, we value your suggestions. Please don't hesitate to share them with us. Let us know if you bump into any issues and we will be happy to assist you. Appreciate your love and support. 😊 Sweetan | Client Services Shogun